1. The signification process applied during an Outcome
Harvesting Evaluation of a Global Network dedicated
to improving the life of vulnerable children
Goele Scheers
EES-2016 Conference Maastricht
Using the signification process of SenseMaker
to enrich Outcome Mapping and Outcome Harvesting
30 Sept 2016
14:15h-15:45h
Room 2.7
2. Family for Every Child is a global alliance of national civil society
organisations working together to mobilise knowledge, skills
and resources to build a world where every child grows up in a
permanent, safe and caring family, and to provide quality
alternative care where needed
3. Outcome Harvesting for Family for Every Child
•OH Evaluation: outcomes
2012-2016
•Integrate OH into the M&E
system of the network
4. 6 OH steps applied to Family for Every Child
2. Review
documentation and
draft outcomes
1. Design the
Harvest
4. Analyse and
interpret
3. Engage network
members, board
and staff
6. Support use of
findings and make
strategic decisions
5. Substantiation
5. Outcomes were
gathered during focus
groups with
secretariat staff, board
and members
95 outcomes
Harvesting the outcomes
7. Example of an external outcome from Family
Outcome description:
In June 2015, The Ministry of Women and Child Development of India invited Butterflies (Family’s
Indian member) to lead the Foster Care Committee in developing guidelines, training modules and
monitoring tools on foster care and included their contribution in the Foster Care guidelines that
were launched in October 2015.
Significance:
This was a key moment in the development of state policy and guidance in India, when not only
international NGOs and experts, but also national NGOs, including Butterflies were asked to
contribute. Previously, there had been piecemeal and patchy development of foster care in India, led
by internationally supported NGOs, but not strongly or consistently coordinated by the government.
Contribution:
The exposure of Butterflies to foster care through its membership of Family enabled it to respond to
a request it received from its government, and thereby make a significant contribution to the
government’s development of policy and guidance for foster care providers. Butterflies was able to
respond within tight deadlines because of the help of network members finding and sharing with
them the policy and practice examples from various countries.
16. CONTRIBUTION OF THE NETWORK
Change has happened
without influence of the network
Change only happened because
of the interventions of the network
Internal outcomes 68%
External outcomes
14 outcomes
10 outcomes
Analysis: Dyad filtered
25. CONTRIBUTION OF THE NETWORK
Change has happened
without influence of the network
Change only happened because
of the interventions of the network
Internal outcomes 68%
External outcomes
14 outcomes
10 outcomes
Analysis: Dyad filtered
28. Reflections on Sensemaker for OH - Strenghts
COLLECTIVE SIGNIFICATION
• Stimulates discussion and joint reflection during harvesting
• Common understanding about program, outcomes and the role of the
implementer
• Triads are easy to understand, useful, possibility to make nuances
ANALYSIS
• More depth, new layers of meaning/connections
• Easy visualization of patterns
• Change agents can relate to the analysis
29. SUPPORTING USE OF FINDINGS
• Feedback of the results of the OH evaluation
• Further collective sensemaking on the outcomes
• Generate actionable insights
Reflections on Sensemaker for OH - Strenghts
30. • Three corners need to be well-defined
• Triads have to be connected to the use and the evaluation questions
• Need to have a substantial amount of outcomes
Reflections on Sensemaker for OH - Challenges