Designing baseline surveys for impact analysis and evaluation of progress
FTF Monitoring and Evaluation:
The FTF Big Picture
• At the G-8 Summit in July 2009, the President pledged to
provide at least $3.5 billion over the next three years
(FY 2010 to FY 2012) to attack the root causes of global
hunger through accelerated agricultural development
and improved nutrition.
• The overall goal of the President’s Feed the Future
(FTF) initiative is to accelerate progress towards
achieving the first Millennium Development Goal (MDG
1) of halving by 2015 the proportion of people living
in extreme poverty and suffering from hunger.
• The USG commitment leveraged more than $18 billion
in support from other donors.
FTF on the Forefront of Implementing
• USAID FORWARD, changing the way the Agency does
business—with new partnerships, local capacity building, an
emphasis on innovation and a relentless focus on results as
a way to achieve high-impact development.
• USAID’s new evaluation policy that links systematic
monitoring of performance and evaluation of impact in all
program design, budgeting and strategy work.
Monitoring versus Evaluation
Performance monitoring of
changes in performance
indicators reveals whether
desired results are
occurring and whether
implementation is on track.
In general, the results
measured are the direct and
near-term consequences of
the systematic collection of
information about the
outcomes of Development
Objectives, projects, or
activities in order to make
effectiveness, and/or inform
decisions about current and
The Balancing Act
FTF Monitoring and Evaluation Approach
M & E System Components
FTF Strategy &
- FTF MYS
- PMP or M&E Plan
- Indicators (Collection & Targets, CBA)
- Portfolio Reviews
- Reporting (FACTS Info/FTFMS)
- PMP or M&E Plan
- Hypotheses and Questions
- Performance Eval
- Impact Eval
- Learning Agenda
- M&E Plan
- Dissemination Methods
The M&E System
and set targets
Data for Monitoring
findings in strategy
28 project level
8 WoG, required
13 IR level,
FTF Performance Monitoring
Total of 57 FTF indicators
21 required if applicable (1)
13 – Intermediate Result
8 - whole of government
27 recommended standard
M&E Contractor will collect
data for 13 of the high-level
and IR-level indicators
All other indicators collected
by Implementing Partners or
from secondary sources
•Accountability (Show results): Measure and provide
findings related to project effectiveness, relevance, and
•Learning: Systematically generate knowledge about
project performance, outcomes, and impact to inform
project and strategy design and implementation.
Impact and Performance Evaluations address different questions:
Performance Evaluation - No Inherent Causality
– Is the program being implemented as designed?
– Could the operations be more efficient?
– Are the benefits getting to those intended?
Impact Evaluation - Causality
– What difference did the intervention make?
– Were the desired results achieved?
– Was it the intervention that caused these results?
Performance vs. Impact Evaluation
USAID Evaluation Standards…
Relevant to Future Decisions
Based on Best Methods
Reinforcement of Local Capacity
Commitment to Transparency
Integrated into Design
…are FTF Evaluation Standards
Local Capacity-Building Investments for Data
Collection and Use
• All countries require valid and reliable statistics to measures a
country’s status and welfare.
• The agriculture sector is at the center of critical global issues: food
security, feed-stocks for biofuels, climate change.
• In many FTF focus countries, responsible entities to collect and use
data to build effective policy responses to complex development
problems and to monitor progress toward economic and social
objectives is limited.
USG will be a strong advocate for investment in strengthening
national statistical systems/capacity in four ways.
Global Strategies to Improve Statistics
1. Support the GLOBAL STRATEGY to improve agriculture
statistics launched by United Nations Statistical Commission
based on common concerns, with following goals:
– Help countries develop and implement a strategic vision for
agriculture and rural statistics.
– Build on existing institution and groups - national & international
statistical agencies and data users.
– Promote a set of core data across countries, coordination across
national statistical system, and sustainability through statistical
Promotion at Donor Platforms
2. USG is using multiple donor platforms to promote
strengthening national statistical systems/capacity
including CAADP, AFSI, G8/G20.
– Data collection and use to inform policy, budget allocations, and
program design for both agriculture and nutrition sectors;
– Sex- and age-disaggregated data collection in agriculture and
nutrition to better monitor and analyze gender dynamics, adjust
programming where necessary to improve positive impact across
– Promote common tools for data collection against performance
indicators, such as household surveys (e.g. LSMS) or population
sampling (e.g. LQAS) among local groups or host government
Coordinating Support to Improve Ag.
Statistics at the National Level
3. Coordinating Support to Improve Ag. Statistics at the
•Accurate measures of national food security and economic growth status and
•Relevant and timely agricultural and nutrition statistics are needed to analyze
implications for government policy related to trade, social safety nets, stockpiles;
•Timely and accurate information is also required for efficient functioning of
•LINK TO FTF - Strong national data systems are required to access progress
toward the higher level agriculture and health objectives in FTF.
Local Providers of M&E Services
4. Engage local firms and institutions to carry out FTF M&E services
and to formulate impact evaluation priorities
• FTF’s M&E strategy urges missions to contract with and
provide grants to more and varied local partners.
• Build metrics into M&E contractor deliverables to maximize
opportunities to sub-contract with local firms or direct
contract with local institutions to capitalize on local
knowledge and capabilities and build local capacity.
Way Forward and Best Practices
Next steps to consider:
1.USAID explore what is current situation in country with agricultural
2.If not adequate, initiate an outside detailed agricultural statistics capacity
Typically a two week visit by two senior statisticians with
experience in operational statistical programs
Recommendations on organizational, procedure, methodology, and
capacity building issues would be provided
3.Depending on assessment recommendations, consider a statistical
capacity improvement project
Kristin Penn, Feed the Future/USAID