The Importance of Metrics in Sustainable Scale-up


Published on

Presented by Beatriz Plaza at the April 2014 Global Health & Innovation Conference.

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

The Importance of Metrics in Sustainable Scale-up

  1. 1. The Importance of Metrics in Sustainable Scale-up Beatriz Plaza, MEASURE Evaluation GHIC 2014 Global Health & Innovion Conference Yale University, New Haven, CT April 12-13
  3. 3. “If you can’t measure it, you can’t manage it” Peter Drucker “If an intervention can’t demonstrate real impact, it shouldn’t be scaled up. We don’t invest in organizations that don’t measure impact: they’re flying blind and we would be too.” Mulago Foundation “If you can’t measure it, you can’t grow it.” Nancy Mahon, SSIR
  4. 4. …in 2012 global health financing totaled 28.1 billion dollars Institute for Health Metrics & Evaluation …in 2012 private sector contributions through foundations, NGO’s and corporate giving accounted for nearly 15% of global health financing Institute for Health Metrics & Evaluation
  5. 5. Einsteins dictum: Einsteins dictum: “Not everything that counts can be counted, and not everything that can be counted counts”
  6. 6. Key Questions:  Are we investing where it matters?  Are we using strategies and selecting programs that can deliver through sustainable and scalable programs?  Are we impacting the field beyond just financial investment and creating real social return?
  7. 7. The Challenge? Rigorous yet Realistic Measurement!
  8. 8. How do we design for real impact?
  9. 9. “Impact is a change in the state of the work brought about by an intervention. It’s the final result of behaviors (outcomes) that are generated by activities (outputs).” -Mulago Foundation
  10. 10. Recommendations for building evaluation into your programs or organizations:  Define your mission Choose the right indicators
  11. 11. Make the case that it was the programs efforts that caused the change!
  12. 12. Impact Evaluation Impact evaluation uses research methods and statistical analyses that measure change in population based outcomes (usually health status) that can be attributed to a program intervention while adequately ruling out other potential factors. The data come from special studies and require strong study designs.
  13. 13. Gold Standard Randomized Control Trials
  14. 14. Outcome Evaluation Outcome evaluation measures whether or not a program or intervention has resulted in the desired changes or has attained the desired results.
  15. 15. Cost-effective studies  Cost per impact: We want a number. We want to know how much it costs.
  16. 16. Pearls  Everyone needs to be measuring impact (especially when thinking of scaling up)  Eveyone benefits from a brighter look at impact: donors, funders, social sector and most importantly the beneficiaries!  When we measure impact we can address the issues of accountability, transparency, culture & ethics
  17. 17. THANK YOU
  18. 18. MEASURE Evaluation is funded by the U.S. Agency for International Development (USAID) and implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill in partnership with Futures Group, ICF International, John Snow, Inc., Management Sciences for Health, and Tulane University. Views expressed in this presentation do not necessarily reflect the views of USAID or the U.S. government. MEASURE Evaluation is the USAID Global Health Bureau's primary vehicle for supporting improvements in monitoring and evaluation in population, health and nutrition worldwide.
  19. 19.