SlideShare a Scribd company logo
Evaluating the
impact of OVC
programs:
standardizing
our methods
Jenifer Chapman, PhD
Senior OVC Advisor
MEASURE Evaluation
Overview
 Background
 Purpose of the OVC Survey Tools
 Process of development
 Guiding principles
 Structure and content
 When to use the Tools
 When not to use the Tools
 Using the data
Tools in a Toolbox
 There is no single data collection tool that can
meet all OVC program targeting, case
management and M&E requirements.
 This set of survey tools responds to distinct
information needs related to program planning
and evaluation, and fills a tools gap.
The problem
 High investment in OVC programs BUT impact
is unclear & questions regarding “what works”
in improving household well-being
 Part of the challenge: lack of standardized
measures and tools for child and household
outcomes (well-being)
4
A proposed solution
Standardized questionnaires for use in a survey of
children ages 0-17 years and their adult caregivers
The purpose
 Standardize population-level child and caregiver well-
being data beyond what is available from routine
surveys
 Produce actionable data to inform programs and
enable mid-course corrections
 Enable comparative assessments of child and
caregiver well-being and household economic status
across a diverse set of interventions and regions
Who are these tools for?
 Local and international research institutions and
other implementing organizations with evaluation
agenda
Our Process
 Two step, participatory process:
 Build consensus around core impact indicators for
PEPFAR-funded OVC programs
 Develop OVC program evaluation (survey) tools
Distilling the core indicators
Step 1: Extensive literature search
Step 2: Gaps (HES, PSS) filled through targeted
research
 Result: >600 child/HH wellbeing
questions/indicators
Step 3: Analysis against 8 criteria
 Result: shorter list of questions for discussion
9
Inclusion criteria
1. Measures impact/outcomes
2. Amenable to change from program interventions
3. Relevant across a wide range of interventions
4. Contributes to a holistic vision of child wellbeing
5. Verifiable through another source
6. Easy to implement
7. Relevant across different regions / countries
8. Relevant or easily adapted across age and sex
10
Finalizing the core indicators
 External working group: solicited review from 49
stakeholders
 Received feedback from > 25 individuals/groups
 Finalized core set of 12 child and 3 household
measures
11
From indicators to tools:
Guiding principles
 Questionnaires measure program outcomes
 Program outcome data should be collected by
trained data collectors
 A documented protocol is required
 Protocol with tools needs to undergo ethical approval
both in the country of data collection and in the US
 Tools require pilot testing in new settings before use
Developing the tools
 Tools drafted with
strong stakeholder input
 Draft tools piloted in
Zambia (and Nigeria)
 Cognitive interviews to
test key concepts (e.g.
social support)
 Household pre-test of
full tools, procedures
Structure and content
1. Caregiver questionnaire (including questions on
household)
2. Child questionnaire (ages 0-9 years),
administered to caregiver
3. Child questionnaire (ages 10-17), administered
to child with parental consent & child assent
Evaluating Impact of OVC Programs: Standardizing our methods
Evaluating Impact of OVC Programs: Standardizing our methods
Sections Core questions Optional modules
Section 1: Household
schedule
• Household schedule* (10)
• Changes in household
composition (4)
Section 2: Background
Information on Caregiver
and Household
• Demographic information* (7)
• Work* (3)
• Access to money (3)
• Shelter (1)
• Household Economic Status
(forthcoming)
• Progress out of Poverty
Index or similar (country
specific)
Section 3: Food Security • Household food security (6) • Dietary Diversity (1)
Section 4: Caregiver Well-
being and Attitudes
• General health (2)
• Caregiver support (4)
• Parental self-efficacy (1)
• Perceptions and experience
of child discipline, violent
discipline (forthcoming)
• Gender roles and
decisionmaking power* (9)
Section 5: HIV/AIDS Testing,
Knowledge, Attitudes
• Basic HIV/AIDS knowledge* (7)
• HIV testing* (3)
• Attitudes to condom educ (1)
• HIV/AIDS attitudes* (4)
Section 6: Access to HIV
Prevention, Care & Support
• Household access to services
(1)
*DHS, bold=core indicator
Caregiver questionnaire
Sections Core questions Optional modules
Section 1: Child Health and
Welfare
• Confirm demographics (5)
• General health & disability (4)
• Birth certificate (2)
• Vaccinations (11)
• Fever (<5 years)* (1)
• Diarrhea (<5 years)* (1)
• Experience of neglect (2)
• Slept under mosquito net* (1)
• HIV testing experience* (2)
• Fever: extended* (4)
• Diarrhea: extended* (3)
• Health for children
living with HIV/AIDS
(forthcoming)
Section 2: Education and
Work
• School attendance*,
progression/repeats, drop-outs,
missed school days (5+ years) (9)
• Work for wages (2)
• Early childhood stimulation (2)
Section 3: Food
Consumption
• Food consumption (2+ years) (8) • Dietary diversity (1)
Section 4: Access to HIV
Prevention, Care & Support
• Child access to services (1)
Section 5: Anthropometric
Measures (of Children)
• Weight*, Height*, MUAC
Child questionnaire (ages 0-9)
*DHS, bold=core indicator
Child questionnaire (ages 10-17)
Sections Core questions Optional modules
Section 1: Background
Information on Child
• Confirm demographics* (5)
• Identity of caregiver (1)
Section 2: Diary • Daily log (6)
Section 3: Education • School attendance*,
progression/repeats, drop-
outs (9)
Section 4: Chores & Work • Chores (3)
• Work (7)
Section 5: Food & Alcohol
Consumption
• Food consumption (8)
• Alcohol consumption (3)
• Dietary diversity (1)
Section 6: Health, Support &
Protection
• Birth certificate (2)
• General health & disability (3)
• General support (4)
• Health for children living with
HIV/AIDS (forthcoming)
• Perceptions/experience of
violence (forthcoming)
Section 7: HIV Testing,
Knowledge, and Attitudes
• Basic HIV/AIDS knowledge* (7)
• HIV testing * (3)
• Child development knowledge (6)
• HIV/AIDS attitudes and beliefs (4)
Section 8: Sexual Experience • Sexual behavior (13-17 yrs) (5)
Section 9: Access to HIV
Prevention, Care & Support
• Child access to services (1)
Section 10: Anthropometric
Measures: Weight and Height
• Weight, Height, MUAC
When are these the right tools?
Tools are useful if your question is:
1.Is my program having, or did my program have an impact on the
children and households it reached?
2.What are the characteristics of children and their caregivers in
my country, state/province or district/area, in terms of education,
health, protection, and psychosocial support?
3.Where do the children most in need of program support live?
4.Approximately how many children need services or support?
5.What are the needs of my program’s registered beneficiaries, in
terms of education, health, protection, and psychosocial support?
These are not the right tools for you if…
You want to know:
Which children in selected communities to target
How a particular child/household is faring
Which households, children or caregivers are worst off
What services to provide or refer for a particular child /
household
The number of children/households that are receiving
program support, and the types of support received
Whether staff are carrying out their responsibilities
Whether interventions are being implemented as planned
And, why a special OVC survey?
 DHS and MICS take a general population sample
 difficult to discern the program’s contribution
 DHS and MICS include some, but not all of the OVC
core indicators
Using the Data
 Representative sample of program beneficiaries
 Data collected at one point in time
 Data collected at two points in time
 Representative sample of the general population
Beneficiary sample: 1 point in time
 Often called: Baseline, Midline or Endline
 If baseline or midline: Use data for program
planning or design, or mid-course corrections
 Example: high food insecurity found at baseline
 Result: Change in workplan, PMP agreed between
partner and USG, emphasizing food security
 If endline: Use data to inform follow-on activities
Beneficiary sample: 2 (or more)
points in time
 Commonly referred to as an “evaluation”
 Baseline data should be used immediately
 Evaluation results inform future programming, policy
 But, change in wellbeing from time 1 to time 2, does
not mean program is 100% responsible
 Much stronger result if:
 Comparison group is added (counterfactual)
 Panel study / cohort
General population sample
 Commonly called a Situation Analysis
 Use data for needs-based resource allocation at
national or sub-national level (not individual or
community level)
 Example:
 Nigeria OVC Situation Analysis
Triangulate
 Analyze data alongside DHS and MICS data
 Check for differences and similarities
 Determine whether differences or similarities
make sense, or point to a data quality issue
Implementation so far
 Zambia: Impact evaluation of savings and
internal lending communities on OVC wellbeing
 Baseline data available early Fall
 Nigeria: Baseline survey of OVC umbrella grant
mechanism beneficiaries in 10 states (planning
phase)
You said a toolkit?
 Tools & Manual
 Data analysis guide
 Template protocol with
consent/assent forms
 Data collector training
materials
 And then what?
 Revising as we learn
 Supporting countries to
implement
Where can I find out more?
Go to our website:
http://www.cpc.unc.edu/measure/our-work/ovc
Keep in touch on Child Status Net:
http://childstatus.net/
Email:
Jenifer Chapman: jchapman@futuresgroup.com
and Janet Shriberg: jshriberg@usaid.gov
The research presented here has been supported by the
President’s Emergency Plan for AIDS Relief (PEPFAR)
through the United States Agency for International
Development (USAID) under the terms of MEASURE
Evaluation cooperative agreement GHA-A-00-08-00003-
00. Views expressed are not necessarily those of
PEPFAR, USAID or the United States government.
MEASURE Evaluation is implemented by the Carolina
Population Center at the University of North Carolina at
Chapel Hill in partnership with Futures Group, ICF
International, John Snow, Inc., Management Sciences for
Health, and Tulane University.
Questions?

More Related Content

What's hot

Monitoring and Evaluation of Gender and HIV
Monitoring and Evaluation of Gender and HIVMonitoring and Evaluation of Gender and HIV
Monitoring and Evaluation of Gender and HIV
MEASURE Evaluation
 
A Role for Mathematical Models in Program Science
A Role for Mathematical Models in Program ScienceA Role for Mathematical Models in Program Science
A Role for Mathematical Models in Program Science
amusten
 
Piloting WILLOW in Ontario
Piloting WILLOW in OntarioPiloting WILLOW in Ontario
Piloting WILLOW in Ontario
amusten
 
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
MEASURE Evaluation
 
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program ScienceThe Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
amusten
 
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
MEASURE Evaluation
 
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
MEASURE Evaluation
 
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems TransformationSTOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
amusten
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluation
MEASURE Evaluation
 
How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...
IFAD International Fund for Agricultural Development
 
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level: A Strategic Review of ME...Monitoring and Evaluation at the Community Level: A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
MEASURE Evaluation
 
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
MEASURE Evaluation
 
RHIS Curriculum: Standardizing Core Competencies and Training Materials
RHIS Curriculum: Standardizing Core Competencies and Training MaterialsRHIS Curriculum: Standardizing Core Competencies and Training Materials
RHIS Curriculum: Standardizing Core Competencies and Training Materials
MEASURE Evaluation
 
Qualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to ForethoughtQualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to Forethought
MEASURE Evaluation
 
Using SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDIUsing SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDI
UNICEF Office of Research - Innocenti
 
What is impact evaluation?
What is impact evaluation?What is impact evaluation?
What is impact evaluation?
David Evans
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunities
UNICEF Office of Research - Innocenti
 
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
MEASURE Evaluation
 
Custom Country Tool: Global Application
Custom Country Tool: Global ApplicationCustom Country Tool: Global Application
Custom Country Tool: Global Application
MEASURE Evaluation
 
Integrating Gender in the M&E of Health Programs: A Toolkit
Integrating Gender in the M&E of Health Programs: A ToolkitIntegrating Gender in the M&E of Health Programs: A Toolkit
Integrating Gender in the M&E of Health Programs: A Toolkit
MEASURE Evaluation
 

What's hot (20)

Monitoring and Evaluation of Gender and HIV
Monitoring and Evaluation of Gender and HIVMonitoring and Evaluation of Gender and HIV
Monitoring and Evaluation of Gender and HIV
 
A Role for Mathematical Models in Program Science
A Role for Mathematical Models in Program ScienceA Role for Mathematical Models in Program Science
A Role for Mathematical Models in Program Science
 
Piloting WILLOW in Ontario
Piloting WILLOW in OntarioPiloting WILLOW in Ontario
Piloting WILLOW in Ontario
 
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
 
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program ScienceThe Role of Economic Evaluation and Cost-Effectiveness in Program Science
The Role of Economic Evaluation and Cost-Effectiveness in Program Science
 
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
HIV Risk and Service Use: Results of a Survey of Men in Port-au-Prince and St...
 
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
 
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems TransformationSTOP HIV/AIDS Pilot: Program Science and Systems Transformation
STOP HIV/AIDS Pilot: Program Science and Systems Transformation
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluation
 
How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...How we can use impact evaluation to assure effective use of resources for dev...
How we can use impact evaluation to assure effective use of resources for dev...
 
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Monitoring and Evaluation at the Community Level: A Strategic Review of ME...Monitoring and Evaluation at the Community Level: A Strategic Review of ME...
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
 
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
Collecting the PEPFAR OVC MER Essential Survey Indicators: Frequently Asked Q...
 
RHIS Curriculum: Standardizing Core Competencies and Training Materials
RHIS Curriculum: Standardizing Core Competencies and Training MaterialsRHIS Curriculum: Standardizing Core Competencies and Training Materials
RHIS Curriculum: Standardizing Core Competencies and Training Materials
 
Qualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to ForethoughtQualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to Forethought
 
Using SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDIUsing SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDI
 
What is impact evaluation?
What is impact evaluation?What is impact evaluation?
What is impact evaluation?
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunities
 
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
Addressing Complexity in the Impact Evaluation of the Cross-Border Health Int...
 
Custom Country Tool: Global Application
Custom Country Tool: Global ApplicationCustom Country Tool: Global Application
Custom Country Tool: Global Application
 
Integrating Gender in the M&E of Health Programs: A Toolkit
Integrating Gender in the M&E of Health Programs: A ToolkitIntegrating Gender in the M&E of Health Programs: A Toolkit
Integrating Gender in the M&E of Health Programs: A Toolkit
 

Viewers also liked

A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
MEASURE Evaluation
 
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
MEASURE Evaluation
 
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
MEASURE Evaluation
 
The Prevalence, Experience and Management of Pain
The Prevalence, Experience and Management of PainThe Prevalence, Experience and Management of Pain
The Prevalence, Experience and Management of Pain
MEASURE Evaluation
 
Including AIDS-affected young people in OVC research: Challenges and opportu...
Including AIDS-affected young people in OVC research:  Challenges and opportu...Including AIDS-affected young people in OVC research:  Challenges and opportu...
Including AIDS-affected young people in OVC research: Challenges and opportu...
MEASURE Evaluation
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and Interventions
MEASURE Evaluation
 
Using the PLACE Method to Inform Decision Making
Using the PLACE Method to Inform Decision MakingUsing the PLACE Method to Inform Decision Making
Using the PLACE Method to Inform Decision Making
MEASURE Evaluation
 
Measuring Success in Repositioning Family Planning
Measuring Success in Repositioning Family PlanningMeasuring Success in Repositioning Family Planning
Measuring Success in Repositioning Family Planning
MEASURE Evaluation
 
Community Trace and Verify in Tanzania
Community Trace and Verify in TanzaniaCommunity Trace and Verify in Tanzania
Community Trace and Verify in Tanzania
MEASURE Evaluation
 
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
MEASURE Evaluation
 
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
MEASURE Evaluation
 
Integration as a Health Systems Strengthening Intervention: Case Studies from...
Integration as a Health Systems Strengthening Intervention: Case Studies from...Integration as a Health Systems Strengthening Intervention: Case Studies from...
Integration as a Health Systems Strengthening Intervention: Case Studies from...
MEASURE Evaluation
 
Enhancing FP/RH Decision Making through GIS Data Linking
Enhancing FP/RH Decision Making through GIS Data LinkingEnhancing FP/RH Decision Making through GIS Data Linking
Enhancing FP/RH Decision Making through GIS Data Linking
MEASURE Evaluation
 
RHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
RHINO Forum Kickoff: iHRIS Open Source HR Information SolutionsRHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
RHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
Routine Health Information Network
 
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
MEASURE Evaluation
 
Assessment of Constraints to Data Use
Assessment of Constraints to Data UseAssessment of Constraints to Data Use
Assessment of Constraints to Data Use
MEASURE Evaluation
 
Monitoring Referrals to Strengthen Service Integration
Monitoring Referrals to Strengthen Service IntegrationMonitoring Referrals to Strengthen Service Integration
Monitoring Referrals to Strengthen Service Integration
MEASURE Evaluation
 
Data Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV ProgramsData Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV Programs
MEASURE Evaluation
 
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
MEASURE Evaluation
 
Geospatial Analysis: Innovation in GIS for Better Decision Making
Geospatial Analysis: Innovation in GIS for Better Decision MakingGeospatial Analysis: Innovation in GIS for Better Decision Making
Geospatial Analysis: Innovation in GIS for Better Decision Making
MEASURE Evaluation
 

Viewers also liked (20)

A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
A Toolkit for Evaluating the Impact of HIV/AIDS Programming on Children in Af...
 
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?
 
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
Interoperability & Crowdsourcing: Can these improve the management of ANC pro...
 
The Prevalence, Experience and Management of Pain
The Prevalence, Experience and Management of PainThe Prevalence, Experience and Management of Pain
The Prevalence, Experience and Management of Pain
 
Including AIDS-affected young people in OVC research: Challenges and opportu...
Including AIDS-affected young people in OVC research:  Challenges and opportu...Including AIDS-affected young people in OVC research:  Challenges and opportu...
Including AIDS-affected young people in OVC research: Challenges and opportu...
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and Interventions
 
Using the PLACE Method to Inform Decision Making
Using the PLACE Method to Inform Decision MakingUsing the PLACE Method to Inform Decision Making
Using the PLACE Method to Inform Decision Making
 
Measuring Success in Repositioning Family Planning
Measuring Success in Repositioning Family PlanningMeasuring Success in Repositioning Family Planning
Measuring Success in Repositioning Family Planning
 
Community Trace and Verify in Tanzania
Community Trace and Verify in TanzaniaCommunity Trace and Verify in Tanzania
Community Trace and Verify in Tanzania
 
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
Assessing HIV Service: Use and Information Systems for Key Populations in Nam...
 
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
Measuring Ethnic and Sexual Identities: Lessons from Two Studies in Central A...
 
Integration as a Health Systems Strengthening Intervention: Case Studies from...
Integration as a Health Systems Strengthening Intervention: Case Studies from...Integration as a Health Systems Strengthening Intervention: Case Studies from...
Integration as a Health Systems Strengthening Intervention: Case Studies from...
 
Enhancing FP/RH Decision Making through GIS Data Linking
Enhancing FP/RH Decision Making through GIS Data LinkingEnhancing FP/RH Decision Making through GIS Data Linking
Enhancing FP/RH Decision Making through GIS Data Linking
 
RHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
RHINO Forum Kickoff: iHRIS Open Source HR Information SolutionsRHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
RHINO Forum Kickoff: iHRIS Open Source HR Information Solutions
 
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...
 
Assessment of Constraints to Data Use
Assessment of Constraints to Data UseAssessment of Constraints to Data Use
Assessment of Constraints to Data Use
 
Monitoring Referrals to Strengthen Service Integration
Monitoring Referrals to Strengthen Service IntegrationMonitoring Referrals to Strengthen Service Integration
Monitoring Referrals to Strengthen Service Integration
 
Data Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV ProgramsData Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV Programs
 
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
 
Geospatial Analysis: Innovation in GIS for Better Decision Making
Geospatial Analysis: Innovation in GIS for Better Decision MakingGeospatial Analysis: Innovation in GIS for Better Decision Making
Geospatial Analysis: Innovation in GIS for Better Decision Making
 

Similar to Evaluating Impact of OVC Programs: Standardizing our methods

Evaluating Impact of OVC Programs
Evaluating Impact of OVC ProgramsEvaluating Impact of OVC Programs
Evaluating Impact of OVC Programs
MEASURE Evaluation
 
Evaluating impact of OVC programs: standardizing our methods
Evaluating impact of OVC programs: standardizing our methodsEvaluating impact of OVC programs: standardizing our methods
Evaluating impact of OVC programs: standardizing our methods
MEASURE Evaluation
 
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
MEASURE Evaluation
 
Implementing NutriSTEP Ontario - June 09 Webinar
Implementing NutriSTEP Ontario - June 09 WebinarImplementing NutriSTEP Ontario - June 09 Webinar
Implementing NutriSTEP Ontario - June 09 Webinar
Nutrition Resource Centre
 
Epe talk for Supervisors
Epe talk for SupervisorsEpe talk for Supervisors
Epe talk for Supervisors
Brandon Williams
 
A review of the evidence: School-based Interventions to Address Obesity Preve...
A review of the evidence: School-based Interventions to Address Obesity Preve...A review of the evidence: School-based Interventions to Address Obesity Preve...
A review of the evidence: School-based Interventions to Address Obesity Preve...
Health Evidence™
 
Child Well Being Assessment
Child Well Being Assessment Child Well Being Assessment
Child Well Being Assessment
MEASURE Evaluation
 
Evaluating and Developing the Early Education Pilot for Two Year Olds
Evaluating and Developing the Early Education Pilot for Two Year OldsEvaluating and Developing the Early Education Pilot for Two Year Olds
Evaluating and Developing the Early Education Pilot for Two Year Olds
Mike Blamires
 
Support for healthy breastfeeding mothers with healthy term babies: What's th...
Support for healthy breastfeeding mothers with healthy term babies: What's th...Support for healthy breastfeeding mothers with healthy term babies: What's th...
Support for healthy breastfeeding mothers with healthy term babies: What's th...
Health Evidence™
 
Updates from Maternal Infant and Early Childhood Home Visiting
Updates from Maternal Infant and Early Childhood Home VisitingUpdates from Maternal Infant and Early Childhood Home Visiting
Updates from Maternal Infant and Early Childhood Home Visiting
Children’s Trust of South Carolina
 
Interventions for preventing elder abuse: What's the evidence?
Interventions for preventing elder abuse: What's the evidence?Interventions for preventing elder abuse: What's the evidence?
Interventions for preventing elder abuse: What's the evidence?
Health Evidence™
 
Case management versus M&E in the context of OVC programs: What have we learned?
Case management versus M&E in the context of OVC programs: What have we learned?Case management versus M&E in the context of OVC programs: What have we learned?
Case management versus M&E in the context of OVC programs: What have we learned?
MEASURE Evaluation
 
Introduction to the Quality Improvement Center on Early Childhood
Introduction to the Quality Improvement Center on Early ChildhoodIntroduction to the Quality Improvement Center on Early Childhood
Introduction to the Quality Improvement Center on Early Childhood
k.stepleton
 
Southwest Georgia Communities Adapting Evidence-Based Programs
Southwest Georgia Communities Adapting Evidence-Based ProgramsSouthwest Georgia Communities Adapting Evidence-Based Programs
Southwest Georgia Communities Adapting Evidence-Based Programs
GPHA
 
Advances in Outcome Monitoring
Advances in Outcome MonitoringAdvances in Outcome Monitoring
Advances in Outcome Monitoring
MEASURE Evaluation
 
The Essential Package_Nicole Richardson_4.25.13
The Essential Package_Nicole Richardson_4.25.13The Essential Package_Nicole Richardson_4.25.13
The Essential Package_Nicole Richardson_4.25.13
CORE Group
 
Introduction to the Child Status Index
Introduction to the Child Status IndexIntroduction to the Child Status Index
Introduction to the Child Status Index
MEASURE Evaluation
 
Intersectoral Action & the Social Determinants of Health: What's the Evidence?
Intersectoral Action & the Social Determinants of Health: What's the Evidence?Intersectoral Action & the Social Determinants of Health: What's the Evidence?
Intersectoral Action & the Social Determinants of Health: What's the Evidence?
Health Evidence™
 
Research into parenting programmes: evidence-based policy or what?
Research into parenting programmes: evidence-based policy or what?Research into parenting programmes: evidence-based policy or what?
Research into parenting programmes: evidence-based policy or what?
Mike Blamires
 
Pathway to Practice: Incorporating Evidence into Military Family Services
Pathway to Practice: Incorporating Evidence into Military Family ServicesPathway to Practice: Incorporating Evidence into Military Family Services
Pathway to Practice: Incorporating Evidence into Military Family Services
MFLNFamilyDevelopmnt
 

Similar to Evaluating Impact of OVC Programs: Standardizing our methods (20)

Evaluating Impact of OVC Programs
Evaluating Impact of OVC ProgramsEvaluating Impact of OVC Programs
Evaluating Impact of OVC Programs
 
Evaluating impact of OVC programs: standardizing our methods
Evaluating impact of OVC programs: standardizing our methodsEvaluating impact of OVC programs: standardizing our methods
Evaluating impact of OVC programs: standardizing our methods
 
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
Targeted Evaluation of Five Programs Supporting Orphans and Vulnerable Childr...
 
Implementing NutriSTEP Ontario - June 09 Webinar
Implementing NutriSTEP Ontario - June 09 WebinarImplementing NutriSTEP Ontario - June 09 Webinar
Implementing NutriSTEP Ontario - June 09 Webinar
 
Epe talk for Supervisors
Epe talk for SupervisorsEpe talk for Supervisors
Epe talk for Supervisors
 
A review of the evidence: School-based Interventions to Address Obesity Preve...
A review of the evidence: School-based Interventions to Address Obesity Preve...A review of the evidence: School-based Interventions to Address Obesity Preve...
A review of the evidence: School-based Interventions to Address Obesity Preve...
 
Child Well Being Assessment
Child Well Being Assessment Child Well Being Assessment
Child Well Being Assessment
 
Evaluating and Developing the Early Education Pilot for Two Year Olds
Evaluating and Developing the Early Education Pilot for Two Year OldsEvaluating and Developing the Early Education Pilot for Two Year Olds
Evaluating and Developing the Early Education Pilot for Two Year Olds
 
Support for healthy breastfeeding mothers with healthy term babies: What's th...
Support for healthy breastfeeding mothers with healthy term babies: What's th...Support for healthy breastfeeding mothers with healthy term babies: What's th...
Support for healthy breastfeeding mothers with healthy term babies: What's th...
 
Updates from Maternal Infant and Early Childhood Home Visiting
Updates from Maternal Infant and Early Childhood Home VisitingUpdates from Maternal Infant and Early Childhood Home Visiting
Updates from Maternal Infant and Early Childhood Home Visiting
 
Interventions for preventing elder abuse: What's the evidence?
Interventions for preventing elder abuse: What's the evidence?Interventions for preventing elder abuse: What's the evidence?
Interventions for preventing elder abuse: What's the evidence?
 
Case management versus M&E in the context of OVC programs: What have we learned?
Case management versus M&E in the context of OVC programs: What have we learned?Case management versus M&E in the context of OVC programs: What have we learned?
Case management versus M&E in the context of OVC programs: What have we learned?
 
Introduction to the Quality Improvement Center on Early Childhood
Introduction to the Quality Improvement Center on Early ChildhoodIntroduction to the Quality Improvement Center on Early Childhood
Introduction to the Quality Improvement Center on Early Childhood
 
Southwest Georgia Communities Adapting Evidence-Based Programs
Southwest Georgia Communities Adapting Evidence-Based ProgramsSouthwest Georgia Communities Adapting Evidence-Based Programs
Southwest Georgia Communities Adapting Evidence-Based Programs
 
Advances in Outcome Monitoring
Advances in Outcome MonitoringAdvances in Outcome Monitoring
Advances in Outcome Monitoring
 
The Essential Package_Nicole Richardson_4.25.13
The Essential Package_Nicole Richardson_4.25.13The Essential Package_Nicole Richardson_4.25.13
The Essential Package_Nicole Richardson_4.25.13
 
Introduction to the Child Status Index
Introduction to the Child Status IndexIntroduction to the Child Status Index
Introduction to the Child Status Index
 
Intersectoral Action & the Social Determinants of Health: What's the Evidence?
Intersectoral Action & the Social Determinants of Health: What's the Evidence?Intersectoral Action & the Social Determinants of Health: What's the Evidence?
Intersectoral Action & the Social Determinants of Health: What's the Evidence?
 
Research into parenting programmes: evidence-based policy or what?
Research into parenting programmes: evidence-based policy or what?Research into parenting programmes: evidence-based policy or what?
Research into parenting programmes: evidence-based policy or what?
 
Pathway to Practice: Incorporating Evidence into Military Family Services
Pathway to Practice: Incorporating Evidence into Military Family ServicesPathway to Practice: Incorporating Evidence into Military Family Services
Pathway to Practice: Incorporating Evidence into Military Family Services
 

More from MEASURE Evaluation

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...
MEASURE Evaluation
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic Evaluations
MEASURE Evaluation
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidance
MEASURE Evaluation
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and Background
MEASURE Evaluation
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...
MEASURE Evaluation
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network Analysis
MEASURE Evaluation
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
MEASURE Evaluation
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young Women
MEASURE Evaluation
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
MEASURE Evaluation
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) Evaluation
MEASURE Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment Scale
MEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
MEASURE Evaluation
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
MEASURE Evaluation
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
MEASURE Evaluation
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
MEASURE Evaluation
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
MEASURE Evaluation
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
MEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
MEASURE Evaluation
 
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
MEASURE Evaluation
 
Sexual Orientation and Gender Identity Measures for Global Survey Research
Sexual Orientation and Gender Identity Measures for Global Survey ResearchSexual Orientation and Gender Identity Measures for Global Survey Research
Sexual Orientation and Gender Identity Measures for Global Survey Research
MEASURE Evaluation
 

More from MEASURE Evaluation (20)

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic Evaluations
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidance
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and Background
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network Analysis
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young Women
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment Scale
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
 
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
 
Sexual Orientation and Gender Identity Measures for Global Survey Research
Sexual Orientation and Gender Identity Measures for Global Survey ResearchSexual Orientation and Gender Identity Measures for Global Survey Research
Sexual Orientation and Gender Identity Measures for Global Survey Research
 

Recently uploaded

Regenerative Medicine in Chronic Pain Management
Regenerative Medicine in Chronic Pain ManagementRegenerative Medicine in Chronic Pain Management
Regenerative Medicine in Chronic Pain Management
Reza Aminnejad
 
rheumatoid arthritis conditions dr aseem
rheumatoid arthritis conditions dr aseemrheumatoid arthritis conditions dr aseem
rheumatoid arthritis conditions dr aseem
Dr. Aseem Goyal
 
Tevar & evar ppt by Dr. Amrit kumar CTVS
Tevar & evar ppt by Dr. Amrit kumar CTVSTevar & evar ppt by Dr. Amrit kumar CTVS
Tevar & evar ppt by Dr. Amrit kumar CTVS
Amrit Maheswari
 
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATIONACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
krutikanitinbhandari
 
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
allamsreeha2285
 
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptxEXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
AbhashSingh12
 
Intl J Gynecology Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
Intl J Gynecology   Obste - 2024 - Nwagha - Multidisciplinary approach to obs...Intl J Gynecology   Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
Intl J Gynecology Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
Aloy Okechukwu Ugwu
 
Lymphoma Made Easy , New Teaching Lectures
Lymphoma Made Easy , New Teaching LecturesLymphoma Made Easy , New Teaching Lectures
Lymphoma Made Easy , New Teaching Lectures
MiadAlsulami
 
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
satpalsheravatmumbai
 
Statistical modeling in pharmaceutical research and development
Statistical modeling in pharmaceutical research and developmentStatistical modeling in pharmaceutical research and development
Statistical modeling in pharmaceutical research and development
njoecreations99
 
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdfHeart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
MedicoseAcademics
 
Definition of Radiotherapy Treatment Planning.pptx
Definition of Radiotherapy Treatment Planning.pptxDefinition of Radiotherapy Treatment Planning.pptx
Definition of Radiotherapy Treatment Planning.pptx
Dr. Dheeraj Kumar
 
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
sukaniyasunnu
 
Drugs used in Treatment of Hyperlipidemia
Drugs used in Treatment of HyperlipidemiaDrugs used in Treatment of Hyperlipidemia
Drugs used in Treatment of Hyperlipidemia
Dr. Nikhilkumar Sakle
 
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsxDr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
Dr.Tarik Enaairi
 
UNIT 2 Principles and Concept of Mental Health Nursing
UNIT 2 Principles and Concept of Mental Health NursingUNIT 2 Principles and Concept of Mental Health Nursing
UNIT 2 Principles and Concept of Mental Health Nursing
Prof. (Dr.) Rahul Sharma
 
Ativisha by Saket in Dravyguna BAMS NCISM
Ativisha by Saket in Dravyguna BAMS NCISMAtivisha by Saket in Dravyguna BAMS NCISM
Ativisha by Saket in Dravyguna BAMS NCISM
SaketkumarSrivastava
 
The Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
The Revolutionary Nature of Needleless Double Transfer Spikes in HealthcareThe Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
The Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
Nanchang Kindly Meditech
 
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHYSTAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
DRPREETHIJAMESP
 
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
Internal medicine department, faculty of Medicine Beni-Suef University Egypt
 

Recently uploaded (20)

Regenerative Medicine in Chronic Pain Management
Regenerative Medicine in Chronic Pain ManagementRegenerative Medicine in Chronic Pain Management
Regenerative Medicine in Chronic Pain Management
 
rheumatoid arthritis conditions dr aseem
rheumatoid arthritis conditions dr aseemrheumatoid arthritis conditions dr aseem
rheumatoid arthritis conditions dr aseem
 
Tevar & evar ppt by Dr. Amrit kumar CTVS
Tevar & evar ppt by Dr. Amrit kumar CTVSTevar & evar ppt by Dr. Amrit kumar CTVS
Tevar & evar ppt by Dr. Amrit kumar CTVS
 
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATIONACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
ACID - BASE BALANCE BY KRUTIKA BHANDARI - PRESENTATION
 
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
MYASTHENIA GRAVIS: etiology, pathophysiology, clinical manifestations, diagno...
 
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptxEXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
EXTRACTION,_PHYTOCHEMICAL_SCREENING_&_FORMULATION_OF_BOERRHAVIA.pptx
 
Intl J Gynecology Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
Intl J Gynecology   Obste - 2024 - Nwagha - Multidisciplinary approach to obs...Intl J Gynecology   Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
Intl J Gynecology Obste - 2024 - Nwagha - Multidisciplinary approach to obs...
 
Lymphoma Made Easy , New Teaching Lectures
Lymphoma Made Easy , New Teaching LecturesLymphoma Made Easy , New Teaching Lectures
Lymphoma Made Easy , New Teaching Lectures
 
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
VIP Surat Girls Call Surat 0X0000000X Doorstep High-Profile Girl Service Call...
 
Statistical modeling in pharmaceutical research and development
Statistical modeling in pharmaceutical research and developmentStatistical modeling in pharmaceutical research and development
Statistical modeling in pharmaceutical research and development
 
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdfHeart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
Heart Valves and Heart Sounds -Congenital & valvular heart disease.pdf
 
Definition of Radiotherapy Treatment Planning.pptx
Definition of Radiotherapy Treatment Planning.pptxDefinition of Radiotherapy Treatment Planning.pptx
Definition of Radiotherapy Treatment Planning.pptx
 
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
VIP Hyderabad Girls Call Service Hyderabad 0X0000000X Independent Service Ava...
 
Drugs used in Treatment of Hyperlipidemia
Drugs used in Treatment of HyperlipidemiaDrugs used in Treatment of Hyperlipidemia
Drugs used in Treatment of Hyperlipidemia
 
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsxDr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
Dr.Tarik Enaairi - Dermatology - Mastocytosis.ppsx
 
UNIT 2 Principles and Concept of Mental Health Nursing
UNIT 2 Principles and Concept of Mental Health NursingUNIT 2 Principles and Concept of Mental Health Nursing
UNIT 2 Principles and Concept of Mental Health Nursing
 
Ativisha by Saket in Dravyguna BAMS NCISM
Ativisha by Saket in Dravyguna BAMS NCISMAtivisha by Saket in Dravyguna BAMS NCISM
Ativisha by Saket in Dravyguna BAMS NCISM
 
The Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
The Revolutionary Nature of Needleless Double Transfer Spikes in HealthcareThe Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
The Revolutionary Nature of Needleless Double Transfer Spikes in Healthcare
 
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHYSTAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
STAPHYSAGRIA.BHMS.MATERIA MEDICA.HOMOEOPATHY
 
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
Subcutaneous nodules in rheumatic diseases Ahmed Yehia Assistant Professor of...
 

Evaluating Impact of OVC Programs: Standardizing our methods

  • 1. Evaluating the impact of OVC programs: standardizing our methods Jenifer Chapman, PhD Senior OVC Advisor MEASURE Evaluation
  • 2. Overview  Background  Purpose of the OVC Survey Tools  Process of development  Guiding principles  Structure and content  When to use the Tools  When not to use the Tools  Using the data
  • 3. Tools in a Toolbox  There is no single data collection tool that can meet all OVC program targeting, case management and M&E requirements.  This set of survey tools responds to distinct information needs related to program planning and evaluation, and fills a tools gap.
  • 4. The problem  High investment in OVC programs BUT impact is unclear & questions regarding “what works” in improving household well-being  Part of the challenge: lack of standardized measures and tools for child and household outcomes (well-being) 4
  • 5. A proposed solution Standardized questionnaires for use in a survey of children ages 0-17 years and their adult caregivers
  • 6. The purpose  Standardize population-level child and caregiver well- being data beyond what is available from routine surveys  Produce actionable data to inform programs and enable mid-course corrections  Enable comparative assessments of child and caregiver well-being and household economic status across a diverse set of interventions and regions
  • 7. Who are these tools for?  Local and international research institutions and other implementing organizations with evaluation agenda
  • 8. Our Process  Two step, participatory process:  Build consensus around core impact indicators for PEPFAR-funded OVC programs  Develop OVC program evaluation (survey) tools
  • 9. Distilling the core indicators Step 1: Extensive literature search Step 2: Gaps (HES, PSS) filled through targeted research  Result: >600 child/HH wellbeing questions/indicators Step 3: Analysis against 8 criteria  Result: shorter list of questions for discussion 9
  • 10. Inclusion criteria 1. Measures impact/outcomes 2. Amenable to change from program interventions 3. Relevant across a wide range of interventions 4. Contributes to a holistic vision of child wellbeing 5. Verifiable through another source 6. Easy to implement 7. Relevant across different regions / countries 8. Relevant or easily adapted across age and sex 10
  • 11. Finalizing the core indicators  External working group: solicited review from 49 stakeholders  Received feedback from > 25 individuals/groups  Finalized core set of 12 child and 3 household measures 11
  • 12. From indicators to tools: Guiding principles  Questionnaires measure program outcomes  Program outcome data should be collected by trained data collectors  A documented protocol is required  Protocol with tools needs to undergo ethical approval both in the country of data collection and in the US  Tools require pilot testing in new settings before use
  • 13. Developing the tools  Tools drafted with strong stakeholder input  Draft tools piloted in Zambia (and Nigeria)  Cognitive interviews to test key concepts (e.g. social support)  Household pre-test of full tools, procedures
  • 14. Structure and content 1. Caregiver questionnaire (including questions on household) 2. Child questionnaire (ages 0-9 years), administered to caregiver 3. Child questionnaire (ages 10-17), administered to child with parental consent & child assent
  • 17. Sections Core questions Optional modules Section 1: Household schedule • Household schedule* (10) • Changes in household composition (4) Section 2: Background Information on Caregiver and Household • Demographic information* (7) • Work* (3) • Access to money (3) • Shelter (1) • Household Economic Status (forthcoming) • Progress out of Poverty Index or similar (country specific) Section 3: Food Security • Household food security (6) • Dietary Diversity (1) Section 4: Caregiver Well- being and Attitudes • General health (2) • Caregiver support (4) • Parental self-efficacy (1) • Perceptions and experience of child discipline, violent discipline (forthcoming) • Gender roles and decisionmaking power* (9) Section 5: HIV/AIDS Testing, Knowledge, Attitudes • Basic HIV/AIDS knowledge* (7) • HIV testing* (3) • Attitudes to condom educ (1) • HIV/AIDS attitudes* (4) Section 6: Access to HIV Prevention, Care & Support • Household access to services (1) *DHS, bold=core indicator Caregiver questionnaire
  • 18. Sections Core questions Optional modules Section 1: Child Health and Welfare • Confirm demographics (5) • General health & disability (4) • Birth certificate (2) • Vaccinations (11) • Fever (<5 years)* (1) • Diarrhea (<5 years)* (1) • Experience of neglect (2) • Slept under mosquito net* (1) • HIV testing experience* (2) • Fever: extended* (4) • Diarrhea: extended* (3) • Health for children living with HIV/AIDS (forthcoming) Section 2: Education and Work • School attendance*, progression/repeats, drop-outs, missed school days (5+ years) (9) • Work for wages (2) • Early childhood stimulation (2) Section 3: Food Consumption • Food consumption (2+ years) (8) • Dietary diversity (1) Section 4: Access to HIV Prevention, Care & Support • Child access to services (1) Section 5: Anthropometric Measures (of Children) • Weight*, Height*, MUAC Child questionnaire (ages 0-9) *DHS, bold=core indicator
  • 19. Child questionnaire (ages 10-17) Sections Core questions Optional modules Section 1: Background Information on Child • Confirm demographics* (5) • Identity of caregiver (1) Section 2: Diary • Daily log (6) Section 3: Education • School attendance*, progression/repeats, drop- outs (9) Section 4: Chores & Work • Chores (3) • Work (7) Section 5: Food & Alcohol Consumption • Food consumption (8) • Alcohol consumption (3) • Dietary diversity (1) Section 6: Health, Support & Protection • Birth certificate (2) • General health & disability (3) • General support (4) • Health for children living with HIV/AIDS (forthcoming) • Perceptions/experience of violence (forthcoming) Section 7: HIV Testing, Knowledge, and Attitudes • Basic HIV/AIDS knowledge* (7) • HIV testing * (3) • Child development knowledge (6) • HIV/AIDS attitudes and beliefs (4) Section 8: Sexual Experience • Sexual behavior (13-17 yrs) (5) Section 9: Access to HIV Prevention, Care & Support • Child access to services (1) Section 10: Anthropometric Measures: Weight and Height • Weight, Height, MUAC
  • 20. When are these the right tools? Tools are useful if your question is: 1.Is my program having, or did my program have an impact on the children and households it reached? 2.What are the characteristics of children and their caregivers in my country, state/province or district/area, in terms of education, health, protection, and psychosocial support? 3.Where do the children most in need of program support live? 4.Approximately how many children need services or support? 5.What are the needs of my program’s registered beneficiaries, in terms of education, health, protection, and psychosocial support?
  • 21. These are not the right tools for you if… You want to know: Which children in selected communities to target How a particular child/household is faring Which households, children or caregivers are worst off What services to provide or refer for a particular child / household The number of children/households that are receiving program support, and the types of support received Whether staff are carrying out their responsibilities Whether interventions are being implemented as planned
  • 22. And, why a special OVC survey?  DHS and MICS take a general population sample  difficult to discern the program’s contribution  DHS and MICS include some, but not all of the OVC core indicators
  • 23. Using the Data  Representative sample of program beneficiaries  Data collected at one point in time  Data collected at two points in time  Representative sample of the general population
  • 24. Beneficiary sample: 1 point in time  Often called: Baseline, Midline or Endline  If baseline or midline: Use data for program planning or design, or mid-course corrections  Example: high food insecurity found at baseline  Result: Change in workplan, PMP agreed between partner and USG, emphasizing food security  If endline: Use data to inform follow-on activities
  • 25. Beneficiary sample: 2 (or more) points in time  Commonly referred to as an “evaluation”  Baseline data should be used immediately  Evaluation results inform future programming, policy  But, change in wellbeing from time 1 to time 2, does not mean program is 100% responsible  Much stronger result if:  Comparison group is added (counterfactual)  Panel study / cohort
  • 26. General population sample  Commonly called a Situation Analysis  Use data for needs-based resource allocation at national or sub-national level (not individual or community level)  Example:  Nigeria OVC Situation Analysis
  • 27. Triangulate  Analyze data alongside DHS and MICS data  Check for differences and similarities  Determine whether differences or similarities make sense, or point to a data quality issue
  • 28. Implementation so far  Zambia: Impact evaluation of savings and internal lending communities on OVC wellbeing  Baseline data available early Fall  Nigeria: Baseline survey of OVC umbrella grant mechanism beneficiaries in 10 states (planning phase)
  • 29. You said a toolkit?  Tools & Manual  Data analysis guide  Template protocol with consent/assent forms  Data collector training materials  And then what?  Revising as we learn  Supporting countries to implement
  • 30. Where can I find out more? Go to our website: http://www.cpc.unc.edu/measure/our-work/ovc Keep in touch on Child Status Net: http://childstatus.net/ Email: Jenifer Chapman: jchapman@futuresgroup.com and Janet Shriberg: jshriberg@usaid.gov
  • 31. The research presented here has been supported by the President’s Emergency Plan for AIDS Relief (PEPFAR) through the United States Agency for International Development (USAID) under the terms of MEASURE Evaluation cooperative agreement GHA-A-00-08-00003- 00. Views expressed are not necessarily those of PEPFAR, USAID or the United States government. MEASURE Evaluation is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill in partnership with Futures Group, ICF International, John Snow, Inc., Management Sciences for Health, and Tulane University.