SlideShare a Scribd company logo

How Do We Evaluate That? Evaluation in the Uncontrolled World

•
•
MEASURE Evaluation
MEASURE Evaluation

Presented at the Global Health Mini-University

1 of 22
How do we evaluate that? Evaluation in the uncontrolled world Siân Curtis, PhD Project Director, MEASURE Evaluation Carolina Population Center University of North Carolina at Chapel Hill Global Health Mini University October 8, 2010, Washington, DC
Learning Objectives ,[object Object],[object Object],[object Object],[object Object]
Overview ,[object Object],[object Object],[object Object],[object Object]
Growing Emphasis on Evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Scientific Debate ,[object Object],[object Object],[object Object],[object Object],[object Object]
Ideal Impact Assessment
 
Methodological Constraints to Rigorous Impact Evaluation ,[object Object],[object Object],[object Object],[object Object],Source: Victora et al. 2010.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practical Constraints to Rigorous Impact Evaluation
Some Proposed Approaches
Adequacy, Plausibility and Probability ,[object Object],[object Object],[object Object],[object Object]
National Evaluation Platforms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Source: Bryce, 2010. Step Wise Approaches to Evaluation
UNAIDS Prevention Evaluation Guidelines ,[object Object],[object Object],[object Object],[object Object],[object Object]
M&E Staircase: HIV/AIDS Source: Adapted from Rugg et al. 2004
RBM MERG: Evaluating Malaria Programs in Sub-Saharan Africa ,[object Object],[object Object],[object Object],[object Object]
Selected FP Indicators, Nigeria COMPASS Evaluation
Common Themes ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation and GIS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Some Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Getting beyond 42 ,[object Object]
MEASURE Evaluation is funded by the U.S. Agency for International Development through Cooperative Agreement GHA-A-00-08-00003-00 and is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill, in partnership with Futures Group, ICF Macro, John Snow, Inc., Management Sciences for Health, and Tulane University. The views expressed in this presentation do not necessarily reflect the views of USAID or the United States government. Visit us online at http://www.cpc.unc.edu/measure.

Recommended

Lessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsLessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsMEASURE Evaluation
 
Evaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeEvaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeMEASURE Evaluation
 
Impact evaluation an overview
Impact evaluation an overviewImpact evaluation an overview
Impact evaluation an overviewPreston Healthcare Consulting
 
Evaluating Mental Health First Aid
Evaluating Mental Health First AidEvaluating Mental Health First Aid
Evaluating Mental Health First Aidaprilshowalter
 
What is impact evaluation?
What is impact evaluation?What is impact evaluation?
What is impact evaluation?David Evans
 
Evavluation of large scale health programs
Evavluation of large scale health programsEvavluation of large scale health programs
Evavluation of large scale health programsUniversity of Khartoum
 
How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...IFAD International Fund for Agricultural Development
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMEASURE Evaluation
 

Recommended

Lessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsLessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsMEASURE Evaluation
 
Evaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeEvaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeMEASURE Evaluation
 
Impact evaluation an overview
Impact evaluation an overviewImpact evaluation an overview
Impact evaluation an overviewPreston Healthcare Consulting
 
Evaluating Mental Health First Aid
Evaluating Mental Health First AidEvaluating Mental Health First Aid
Evaluating Mental Health First Aidaprilshowalter
 
What is impact evaluation?
What is impact evaluation?What is impact evaluation?
What is impact evaluation?David Evans
 
Evavluation of large scale health programs
Evavluation of large scale health programsEvavluation of large scale health programs
Evavluation of large scale health programsUniversity of Khartoum
 
How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...IFAD International Fund for Agricultural Development
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMEASURE Evaluation
 
Gilligan quantitative impact eval methods
Gilligan quantitative impact eval methodsGilligan quantitative impact eval methods
Gilligan quantitative impact eval methodsgenderassets
 
The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - LIDC
 
Measuring Impact Qualitatively
Measuring Impact QualitativelyMeasuring Impact Qualitatively
Measuring Impact QualitativelyMEASURE Evaluation
 
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening InterventionBeyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening InterventionMEASURE Evaluation
 
Impact Evaluation Overview
Impact Evaluation OverviewImpact Evaluation Overview
Impact Evaluation OverviewPhilip Jakob
 
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program ScienceThe Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program Scienceamusten
 
(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...Dr. Chiachen Cheng
 
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...MEASURE Evaluation
 
What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managers What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managersMEASURE Evaluation
 
Philosophical foundations of education
Philosophical foundations of educationPhilosophical foundations of education
Philosophical foundations of educationUmme Rubab
 
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems TransformationSTOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems Transformationamusten
 
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...MEASURE Evaluation
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...International Food Policy Research Institute- South Asia Office
 
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...MEASURE Evaluation
 
Spf overview(1)
Spf overview(1)Spf overview(1)
Spf overview(1)progroup
 
Community-based Evaluation Methods and Practice
Community-based Evaluation Methods and PracticeCommunity-based Evaluation Methods and Practice
Community-based Evaluation Methods and Practiceamusten
 
An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13CORE Group
 
Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12CORE Group
 
Title of Session_Speaker Last Name
Title of Session_Speaker Last NameTitle of Session_Speaker Last Name
Title of Session_Speaker Last NameCORE Group
 
Interactive evaluation
Interactive evaluationInteractive evaluation
Interactive evaluationCarlo Magno
 
M&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets EM&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets EMEASURE Evaluation
 
Institutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in NigeriaInstitutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in NigeriaMEASURE Evaluation
 

More Related Content

What's hot

Gilligan quantitative impact eval methods
Gilligan quantitative impact eval methodsGilligan quantitative impact eval methods
Gilligan quantitative impact eval methodsgenderassets
 
The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - LIDC
 
Measuring Impact Qualitatively
Measuring Impact QualitativelyMeasuring Impact Qualitatively
Measuring Impact QualitativelyMEASURE Evaluation
 
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening InterventionBeyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening InterventionMEASURE Evaluation
 
Impact Evaluation Overview
Impact Evaluation OverviewImpact Evaluation Overview
Impact Evaluation OverviewPhilip Jakob
 
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program ScienceThe Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program Scienceamusten
 
(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...Dr. Chiachen Cheng
 
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...MEASURE Evaluation
 
What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managers What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managersMEASURE Evaluation
 
Philosophical foundations of education
Philosophical foundations of educationPhilosophical foundations of education
Philosophical foundations of educationUmme Rubab
 
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems TransformationSTOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems Transformationamusten
 
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...MEASURE Evaluation
 
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...MEASURE Evaluation
 
Spf overview(1)
Spf overview(1)Spf overview(1)
Spf overview(1)progroup
 
Community-based Evaluation Methods and Practice
Community-based Evaluation Methods and PracticeCommunity-based Evaluation Methods and Practice
Community-based Evaluation Methods and Practiceamusten
 
An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13CORE Group
 
Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12CORE Group
 
Title of Session_Speaker Last Name
Title of Session_Speaker Last NameTitle of Session_Speaker Last Name
Title of Session_Speaker Last NameCORE Group
 
Interactive evaluation
Interactive evaluationInteractive evaluation
Interactive evaluationCarlo Magno
 

What's hot (20)

Gilligan quantitative impact eval methods
Gilligan quantitative impact eval methodsGilligan quantitative impact eval methods
Gilligan quantitative impact eval methods
 
The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges -
 
Measuring Impact Qualitatively
Measuring Impact QualitativelyMeasuring Impact Qualitatively
Measuring Impact Qualitatively
 
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening InterventionBeyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
 
Impact Evaluation Overview
Impact Evaluation OverviewImpact Evaluation Overview
Impact Evaluation Overview
 
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program ScienceThe Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
 
(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...(2014) Standards Implementation and Systems Change: Results of a Survey of On...
(2014) Standards Implementation and Systems Change: Results of a Survey of On...
 
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
 
What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managers What Makes a Good Performance Management Plan? A new tool for managers
What Makes a Good Performance Management Plan? A new tool for managers
 
Philosophical foundations of education
Philosophical foundations of educationPhilosophical foundations of education
Philosophical foundations of education
 
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems TransformationSTOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
 
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
 
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
 
Spf overview(1)
Spf overview(1)Spf overview(1)
Spf overview(1)
 
Community-based Evaluation Methods and Practice
Community-based Evaluation Methods and PracticeCommunity-based Evaluation Methods and Practice
Community-based Evaluation Methods and Practice
 
An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13An Introduction to Implementation Research_Emily Peca_4.22.13
An Introduction to Implementation Research_Emily Peca_4.22.13
 
Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12Bringing operations research to life_nyangara2_5.2.12
Bringing operations research to life_nyangara2_5.2.12
 
Title of Session_Speaker Last Name
Title of Session_Speaker Last NameTitle of Session_Speaker Last Name
Title of Session_Speaker Last Name
 
Interactive evaluation
Interactive evaluationInteractive evaluation
Interactive evaluation
 

Viewers also liked

M&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets EM&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets EMEASURE Evaluation
 
Institutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in NigeriaInstitutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in NigeriaMEASURE Evaluation
 
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEM
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEMINTEGRATING CSI INTO OVC PROGRAM M&E SYSTEM
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEMMEASURE Evaluation
 
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...MEASURE Evaluation
 
Data Demand and Use Training Materials
Data Demand and Use Training MaterialsData Demand and Use Training Materials
Data Demand and Use Training MaterialsMEASURE Evaluation
 
MEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and ToolsMEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and ToolsMEASURE Evaluation
 
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...MEASURE Evaluation
 
Monitoring and Evaluating Male Engagement in Family Planning Programs
Monitoring and Evaluating Male Engagement in Family Planning ProgramsMonitoring and Evaluating Male Engagement in Family Planning Programs
Monitoring and Evaluating Male Engagement in Family Planning ProgramsMEASURE Evaluation
 
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...MEASURE Evaluation
 
Data utilization presentation conference 2010
Data utilization presentation conference 2010Data utilization presentation conference 2010
Data utilization presentation conference 2010MEASURE Evaluation
 

Viewers also liked (10)

M&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets EM&E Systems for Evaluation: Where M meets E
M&E Systems for Evaluation: Where M meets E
 
Institutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in NigeriaInstitutionalization of M&E Capacity Strengthening in Nigeria
Institutionalization of M&E Capacity Strengthening in Nigeria
 
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEM
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEMINTEGRATING CSI INTO OVC PROGRAM M&E SYSTEM
INTEGRATING CSI INTO OVC PROGRAM M&E SYSTEM
 
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...
Using Maps in Decision Making to Strengthen Programs for Orphans and Vulnerab...
 
Data Demand and Use Training Materials
Data Demand and Use Training MaterialsData Demand and Use Training Materials
Data Demand and Use Training Materials
 
MEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and ToolsMEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and Tools
 
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
 
Monitoring and Evaluating Male Engagement in Family Planning Programs
Monitoring and Evaluating Male Engagement in Family Planning ProgramsMonitoring and Evaluating Male Engagement in Family Planning Programs
Monitoring and Evaluating Male Engagement in Family Planning Programs
 
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
 
Data utilization presentation conference 2010
Data utilization presentation conference 2010Data utilization presentation conference 2010
Data utilization presentation conference 2010
 

Similar to How Do We Evaluate That? Evaluation in the Uncontrolled World

Program Evaluations to avoid aids/HIV for children
Program Evaluations to avoid aids/HIV for childrenProgram Evaluations to avoid aids/HIV for children
Program Evaluations to avoid aids/HIV for childrenBenjamingabanelabong
 
Technical Consultation on Innovative Approaches to Evaluation within Global H...
Technical Consultation on Innovative Approaches to Evaluation within Global H...Technical Consultation on Innovative Approaches to Evaluation within Global H...
Technical Consultation on Innovative Approaches to Evaluation within Global H...MEASURE Evaluation
 
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventKey Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventMEASURE Evaluation
 
Evaluation of health programs
Evaluation of health programsEvaluation of health programs
Evaluation of health programsnium
 
June 20 2010 bsi christie
June 20 2010 bsi christieJune 20 2010 bsi christie
June 20 2010 bsi christieharrindl
 
Evaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxEvaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxelbanglis
 
Evaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxEvaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxturveycharlyn
 
Program evaluation
Program evaluationProgram evaluation
Program evaluationYen Bunsoy
 
Program Evaluation: Forms and Approaches by Helen A. Casimiro
Program Evaluation: Forms and Approaches by Helen A. CasimiroProgram Evaluation: Forms and Approaches by Helen A. Casimiro
Program Evaluation: Forms and Approaches by Helen A. CasimiroHelen Casimiro
 
COMMUNITY EVALUATION 2023.pptx
COMMUNITY EVALUATION 2023.pptxCOMMUNITY EVALUATION 2023.pptx
COMMUNITY EVALUATION 2023.pptxgggadiel
 
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11CORE Group
 
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...Evolution of Family Planning Impact Evaluation: New contexts and methodologic...
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...MEASURE Evaluation
 
Assessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptAssessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptShahidMahmood503398
 
Workshop: Monitoring, evaluation and impact assessment
Workshop: Monitoring, evaluation and impact assessmentWorkshop: Monitoring, evaluation and impact assessment
Workshop: Monitoring, evaluation and impact assessmentWorldFish
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes successcontentli
 

Similar to How Do We Evaluate That? Evaluation in the Uncontrolled World (20)

Program Evaluations to avoid aids/HIV for children
Program Evaluations to avoid aids/HIV for childrenProgram Evaluations to avoid aids/HIV for children
Program Evaluations to avoid aids/HIV for children
 
Technical Consultation on Innovative Approaches to Evaluation within Global H...
Technical Consultation on Innovative Approaches to Evaluation within Global H...Technical Consultation on Innovative Approaches to Evaluation within Global H...
Technical Consultation on Innovative Approaches to Evaluation within Global H...
 
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventKey Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
 
Evaluation of health programs
Evaluation of health programsEvaluation of health programs
Evaluation of health programs
 
June 20 2010 bsi christie
June 20 2010 bsi christieJune 20 2010 bsi christie
June 20 2010 bsi christie
 
Labor Markets Core Course 2013: Monitoring and evaluation
Labor Markets Core Course 2013: Monitoring and evaluation Labor Markets Core Course 2013: Monitoring and evaluation
Labor Markets Core Course 2013: Monitoring and evaluation
 
Evaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxEvaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docx
 
Evaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docxEvaluation Research and Policy AnalysisChapter 11.docx
Evaluation Research and Policy AnalysisChapter 11.docx
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
Program Evaluation: Forms and Approaches by Helen A. Casimiro
Program Evaluation: Forms and Approaches by Helen A. CasimiroProgram Evaluation: Forms and Approaches by Helen A. Casimiro
Program Evaluation: Forms and Approaches by Helen A. Casimiro
 
COMMUNITY EVALUATION 2023.pptx
COMMUNITY EVALUATION 2023.pptxCOMMUNITY EVALUATION 2023.pptx
COMMUNITY EVALUATION 2023.pptx
 
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11
Considerations For Incorporating Health Equity in Project Design_Luna_5.12.11
 
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...Evolution of Family Planning Impact Evaluation: New contexts and methodologic...
Evolution of Family Planning Impact Evaluation: New contexts and methodologic...
 
CCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
CCIH-2017-Monitoring-and-Evaluation-Preconference-OutlineCCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
CCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
 
Benefits of M&E.PDF
Benefits of M&E.PDFBenefits of M&E.PDF
Benefits of M&E.PDF
 
ME_Katende (2).ppt
ME_Katende (2).pptME_Katende (2).ppt
ME_Katende (2).ppt
 
Assessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptAssessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.ppt
 
Workshop: Monitoring, evaluation and impact assessment
Workshop: Monitoring, evaluation and impact assessmentWorkshop: Monitoring, evaluation and impact assessment
Workshop: Monitoring, evaluation and impact assessment
 
Program Evaluation 1
Program Evaluation 1Program Evaluation 1
Program Evaluation 1
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
 

More from MEASURE Evaluation

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...MEASURE Evaluation
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsMEASURE Evaluation
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceMEASURE Evaluation
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundMEASURE Evaluation
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...MEASURE Evaluation
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisMEASURE Evaluation
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...MEASURE Evaluation
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenMEASURE Evaluation
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodMEASURE Evaluation
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationMEASURE Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleMEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...MEASURE Evaluation
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaMEASURE Evaluation
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationMEASURE Evaluation
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...MEASURE Evaluation
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...MEASURE Evaluation
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...MEASURE Evaluation
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationMEASURE Evaluation
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...MEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsMEASURE Evaluation
 

More from MEASURE Evaluation (20)

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic Evaluations
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidance
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and Background
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network Analysis
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young Women
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment Scale
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in Evaluation
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluation
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
 

How Do We Evaluate That? Evaluation in the Uncontrolled World

  • 1. How do we evaluate that? Evaluation in the uncontrolled world Siân Curtis, PhD Project Director, MEASURE Evaluation Carolina Population Center University of North Carolina at Chapel Hill Global Health Mini University October 8, 2010, Washington, DC
  • 2.
  • 3.
  • 4.
  • 5.
  • 7.  
  • 8.
  • 9.
  • 11.
  • 12.
  • 13. Source: Bryce, 2010. Step Wise Approaches to Evaluation
  • 14.
  • 15. M&E Staircase: HIV/AIDS Source: Adapted from Rugg et al. 2004
  • 16.
  • 17. Selected FP Indicators, Nigeria COMPASS Evaluation
  • 18.
  • 19.
  • 20.
  • 21.
  • 22. MEASURE Evaluation is funded by the U.S. Agency for International Development through Cooperative Agreement GHA-A-00-08-00003-00 and is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill, in partnership with Futures Group, ICF Macro, John Snow, Inc., Management Sciences for Health, and Tulane University. The views expressed in this presentation do not necessarily reflect the views of USAID or the United States government. Visit us online at http://www.cpc.unc.edu/measure.

Editor's Notes

  1. .