Your SlideShare is downloading. ×
Measuring impact:Understanding pathways to rural transformation                  A side event of the IFAD Governing Counci...
Measuring impact: Understanding pathways to rural transformationThe Importanceof Measuring the Impact of  The Importance o...
The Importance of Measuring the Impact of               Development Interventions                        Why Evaluate Impa...
The Importance of Measuring the Impact of         Development Interventions           What Is To Be Evaluated?• Interventi...
The Importance of Measuring the Impact of              Development Interventions             The Need to Measure Impact Pr...
The Importance of Measuring the Impact of             Development Interventions          Key Features of Good Impact Evalu...
The Importance of Measuring the Impact of              Development Interventions              Types of Impact Evaluation D...
The Importance of Measuring the Impact of        Development InterventionsTypes of Evaluation for Different Policy Questions
The Importance of Measuring the Impact of       Development Interventions              Thank you             Philip Davies...
The Importance of Measuring the Impact of       Development Interventions              Thank you             Philip Davies...
Upcoming SlideShare
Loading in...5
×

Philip Davies: The importance of measuring the impact of development projects. The perspectives of 3ie.

11,746

Published on

Presentation by Phillip Davies, Head of 3ie London, delivered at side event at IFAD Governing Council, 12 February 2013.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
11,746
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Philip Davies: The importance of measuring the impact of development projects. The perspectives of 3ie."

  1. 1. Measuring impact:Understanding pathways to rural transformation A side event of the IFAD Governing Council 2013
  2. 2. Measuring impact: Understanding pathways to rural transformationThe Importanceof Measuring the Impact of The Importance of Measuring the Impact of Development Interventions Development Interventions Philip Davies PhD Head of London Office of 3ie [International Initiative for Impact Evaluation]
  3. 3. The Importance of Measuring the Impact of Development Interventions Why Evaluate Impact ?• Effectiveness - ensure that interventions have a positive impact• Attribution – ensure that the outcomes are the results of (are caused by) the intervention• Efficiency – use scarce public resources to maximum effect (VfM)• Implementation – ensure that interventions are/can be implemented successfully and effectively.• Service Orientation – ensure we meet citizens’ needs/expectations• Adaptation – allow policy makers to know when a change of policy/different intervention is required• Accountability - transparency of what is done and why• Democracy - enhance the democratic process
  4. 4. The Importance of Measuring the Impact of Development Interventions What Is To Be Evaluated?• Intervention effectiveness - what works?• Implementation effectiveness – how/why it works?• Diversity of effectiveness across different groups – what works for whom and when?• Experiential effectiveness - users’ views• Resource effectiveness - at what cost/benefit?
  5. 5. The Importance of Measuring the Impact of Development Interventions The Need to Measure Impact ProperlyIt is difficult to gauge whetheragricultural interventions improvethe nutritional status of children.Many studies were conducted onsmall samples. Several animalhusbandry and home gardeningstudies found no change in thenutritional status of the children Source: Massett, E. et al, 2011, A Systematic Review of Agricultural Interventions That Aim to Improve Theinvolved. More importantly, the Nutritional Status of Children, London, EPPI-Centre.studies reviewed were statisticallyunable to identify impact if anyexisted.
  6. 6. The Importance of Measuring the Impact of Development Interventions Key Features of Good Impact Evaluation• Ask a clear and answerable question• Have a clear and explicit theory of change• Have an appropriate comparison/counterfactual• Have adequate sample sizes, and sufficient statistical power• Have meaningful outcomes, and data on those outcomes• Choose the most appropriate evaluation design• Ensure that the evaluation in undertaken properly• Check for internal and external validity• Check for adequacy of reporting and analysis
  7. 7. The Importance of Measuring the Impact of Development Interventions Types of Impact Evaluation Design• Randomised Controlled Experiments [Allocate the intervention to groups on a random basis]• Matched Comparison Designs [Carefully matched those who get the intervention with those who do not]• Regression Discontinuity Designs [Allocate the intervention on a clearly define basis – check for differences post-intervention]• Difference-in-Difference Designs [Accept initial differences between intervention and control group – check on the size of the difference post-intervention]
  8. 8. The Importance of Measuring the Impact of Development InterventionsTypes of Evaluation for Different Policy Questions
  9. 9. The Importance of Measuring the Impact of Development Interventions Thank you Philip Davies Email: pdavies@3ieimpact.org +44 (0)207 958 8350 Visit www.3ieimpact.org
  10. 10. The Importance of Measuring the Impact of Development Interventions Thank you Philip Davies Email: pdavies@3ieimpact.org +44 (0)207 958 8350 Visit www.3ieimpact.org

×