1. OVC TRACK Applying the Child Status Index to Measure OVC Program Effectiveness Rogers Mutie World Concern Development Organization Core Group Spring Meeting—M&E Working Group May 11, 2011

2. World Concern & the AHA Consortium WC was the lead agency for the AERDO (now known as ACCORD) HIV&AIDS Alliance(AHA) in Kenya, Zambia & Haiti The AHA consortium Track 1 implementing agencies: WC (lead), WR, CRWRC, WH, NCM, OB, TSA, FH, MAP, MAI/Lifewind) AHA consortium implemented PEPFAR funded OVC Track 1 project from 2004 to 2010 www.worldconcern.org 2

3. M&E Tools used The Child Inventory Form/database-child’s baseline survey information The Essential Services Tracking Form-records services delivered by date & type. Summarized every 6 months The Quarterly Planning/Reporting Tool(QPR)-for process & output monitoring. Tracking activity targets reached under each strategic objective All the above tools & the periodic reports generated tracked numbers reached, but could hardly tell us whether the intervention were making any difference in child wellbeing. www.worldconcern.org 3

4. The Child Status Index Was developed by MEASURE Evaluation It’s purpose-to asses individual children’s needs & monitor progress in 6 areas of child well being (Food & Nutrition, Shelter & Care, Protection, Healthcare, Psychosocial support & Education) Each area has two indices and a rating(1-4) based on a predetermined criteria (1-Very Bad, 2=Bad, 3=Fair, 4=Good) Scoring done after interviewing at least 3 informers e.g. the caregiver, the child & teacher in the case of education for example Each child visited periodically (e.g. Every 6 months& data collected ) www.worldconcern.org 4

5. CSI Implementation We piloted in Kenya and Zambia with 200 OVCs per agency(total 1,800 children) Trainings conducted in both countries project staff(especially field based staff, volunteers, local church pastors who would act as data collectors in their community Training included role playing & site visits www.worldconcern.org 5

6. CSI implementation 1st visit (approx. 1,800) first visited and first round of data collected between late 2008 & early 2009. 2nd visit (to the same children)-done late 2009-early 2010 & using the same tool & data collectors (in most cases), 2nd round data collected Both data sets aggregated to make an overall comparison & determine whether or not there were changes that took place within the year of implementation www.worldconcern.org 6

7. Some strengths of the CSI tool Helps OVC project implementers to improve on qualitative aspects of reporting (impact, quality…) Can help implementers to focus their services to what is actually needed & address emerging negative trends It’s fairly cheap to implement & easy to understand with simple training The CSI domains are consistent with the essential services – this maximizes on existing knowledge/understanding www.worldconcern.org 7

8. Some weaknesses with the tool Each ranking has many “conditions” and in our opinion it can be a challenge to data collectors with limited education Sometimes caregivers want to provide information that expresses what they think is the “right answer”. Sometimes they may down play impact for fear of losing services Scoring depends on subjective judgement of the data collector. If different people collect data on each visit, scoring may change considerably making comparison difficult www.worldconcern.org 8

9. Some of the Findings- Kenya/Zambia OVC Nutrition & Growth status- Kenya www.worldconcern.org 9

10. Some of the Findings-Kenya/Zambia OVC Physical Health (wellness)-Kenya www.worldconcern.org 10

11. Some of the Findings-Kenya/Zambia OVC Emotional Health Status-Kenya www.worldconcern.org 11

12. Some of the Findings-Kenya/Zambia OVC Food Security Status - Zambia www.worldconcern.org 12

13. Some of the Findings-Kenya/Zambia OVC Performance in School- Zambia www.worldconcern.org 13

14. Some of the Findings-Kenya/Zambia OVC Shelter Status- Zambia www.worldconcern.org 14

15. Therefore with CSI, We were able to, Evaluate the possible impact of the project on child well being at a lower cost Plan better resource allocation on areas of need Respond to emerging issues (over time, project would be able to arrest emerging negative trends early) END www.worldconcern.org 15