1. M&E for Social Service Systems
Webinar
October 17th 2012
By Kelley McCreery Bunkers & Mari Hickmann

2. Developing M&E for
Social Service Systems
 Phase I: literature reviews, stakeholder inputs,
information gathering
 Phase II: suggest a core set of indicators (based
on‘best-practices,’ ‘promising practices’ or
informed recommendations)
 Phase III: final M&E framework and handbook

3. Evolution of Social Service Systems
 Provision of material goods to system investments
 2010 Social Welfare Workforce Conference in
Capetown
 2011 and 2012 Child Protection System
Conferences (Nairobi & Dakar & India)
 Growing interface between child protection and
social protection systems

5. TWO EXAMPLES OF HOW A
FUNCTIONAL SYSTEM MIGHT
WORK

6. Example #1

7. Example #2

8. System Break Downs
Using the illustrations from previous slides, this is what
might occur when the system is not functioning well:
Example 1

9. System Break Downs
Example 2

10. How do we know the strength of
the system?
“the strength of a system depends on its ability to carry
out its functions…which in turn is influenced by the
capacity and interactions of actors across system
levels”
- PEPFAR OVC Guidance

11. M&E of Key System Components
1. Leadership & governance
2. Well-performing workforce
3. Adequate financing
4. Information management / accountability
5. Coordination & networking
6. Service models and service delivery

12. 1. Leadership & Governance
 Clear mandates, visions and strategies
 Organizational structures, roles & responsibilities
 National policy / policy implementation
Examples of possible indicators:
 National Strategy for Addressing Child Vulnerability is
developed and approved
 Is there a national Social/Child Protection policy?
Sources: Maestral, 2010; Save the Children,2008

13. 2. Well-Performing Workforce
 Human resource data and staffing plans
 Capacity building / training opportunities
 Occupational standards and codes of conduct
Examples of possible indicators:
 National human resource assessment been completed
 Clear titles, competencies and functions are defined for
the different cadres of the workforce
 # of social service workers / 10,000 population
Sources: Maestral, 2010; WHO, 2010

14. 3. Adequate Financing
 Costs and benefits of services
 National budget allocation
 Financial management systems
Examples of possible indicators:
 % of total national and local government spending
allocated to social services for children
 Recognized cost/service (e.g., alternative care)
Sources: Maestral, 2010; Save the Children,2008

15. 4. Information Management /
Accountability
 Data management systems
 Clear mandates to collect specific data
 Usage of data to inform policy and programming
Examples of possible indicators:
 Clear monitoring and evaluation functions of key staff
involved in child protection at the national level
 Data utilized to develop in X laws, policies, strategies
Sources: Save the Children, 2008; Maestral, 2010; US DHHS, 2006

16. 5. Coordination & Networking
 Stakeholder mapping
 Coordination mechanisms
 Collaborative agreements with different actors
Examples of possible indicators include:
 Terms of Reference for National Technical Working
Group is developed and approved
 # of actors engaged in system disaggregated by type of
function/service offered/location, etc.
Sources: US DHHS, 2006; Maestral, 2010

17. 6. Service Models / Delivery
Mechanisms
 Service delivery strategy
 Clear case management practices
 Promotion, prevention and response services
Examples of possible indicators could include:
 Quality Service Standards exist
 Case review system is in place at all levels
 Data on # of children outside of parental care
Sources: US DHHS, 2006; BCN & UNICEF, 2009

18. The purpose of this M&E
framework is to…
 Guide countries in designing/implementing social
service system strengthening efforts
 Provide a framework to monitor system improvements
 Deliver strong evidence to support national strategies
and advocacy
 Provide a foundation for global monitoring of social
service system strengthening efforts

19. But it is not…
 Meant to be used by service providers to
evaluate the impact a targeted intervention(s)
 Meant to provide qualitative indicators (which are
recommended to complement quantitative)

20. What we know (or think we know)
M&E of Child/Social Protection Systems is nascent
 But there is helpful documentation, info and tools to support
Semi-relevant examples from the U.S. child welfare system
and systems development from Eastern Europe
 But these are not perfect, and not necessarily applicable to
all countries we’re working in
Applicable & relevant lessons from health system
strengthening
 But health ≠ equal child social services

21. What we would like from you
 Overall reactions and feedback
 Are there examples of social welfare system
assessments (outside the U.S.)?
 Are there examples of Ministries/Governments that
monitor or evaluate (parts of) their social service
system?
 Do any of the programs that you work in or with use
indicators that monitor any of the 6 system
components?

22. How you can contribute
1. Raise you hand to speak
2. Type comments / questions into the chat box
3. Join the discussion online at:
http://childstatus.net/social-service-systems/
4. Email us:
• Mari Hickmann: mhickmann@futuresgroup.com
• Kelley McCreery Bunkers:
kelleybunkers@gmail.com

23. THANK YOU!
MEASURE Evaluation is a MEASURE project funded by the U.S.
Agency for International Development and implemented by the
Carolina Population Center at the University of North Carolina at
Chapel Hill in partnership with Futures Group International, ICF Macro,
John Snow, Inc., Management Sciences for Health, and Tulane
University. Views expressed in this presentation do not necessarily
reflect the views of USAID or the U.S. Government. MEASURE
Evaluation is the USAID Global Health Bureau's primary vehicle for
supporting improvements in monitoring and evaluation in population,
health and nutrition worldwide.
Visit us online at http://www.cpc.unc.edu/measure.