Monitoring and evaluation of social change projects

1. Comparing indicators for M&E
prepared by Sheeva Dubey, for classroom
discussion, 2014

2. Rockefeller foundation, 2001
Indicators
Key measurement questions
Expanded public and privatedialogue and debate
Eg: Approach to HIV/AIDS in Uganda
•Familydiscussion
•Discussion among friends
•Discussion in community gatherings
•Coverage and discussion in news media
•Problem solving dialogue
•Focus and discussion in entertainment media
•Debate and dialogue in the political process
Increased accuracy of the informationthat people share in the dialogue / debate
Eg: on tobacco use and strategies of tobacco companies
•5 pieces of data over which there is general consensus
•4different perspectives on the issue
Supported the people centrally affected by an issue[s] voicing their perspective in the debate and dialogue
•How were the most disadvantaged groups in relation to the issue of concernsupported to give voice to their perspective
•What happened
prepared by Sheeva Dubey, for classroom discussion, 2014

3. Rockefeller foundation, 2001, contd.
Indicator
Key measurement questions
Increased leadership role by people disadvantaged by the issues of concern
Eg: Role of HIV/AIDS infected people
•Who makes the major decisions concerning the priorities and activitiesof the communication intervention
•How are the people centrally affected by those issues engaged in the decision making process
•What are some specific examples where the involvement of that group has influenced strategic or fine tuning decisions
Resonates with the major issues of interest to people’s everyday interests
Eg: civil rights movement in USA –buses and education
•Which were the issues that providedthe focus
•To what extent were people energized by these issues
•What actions followed
Linked peopleand groups with similar interests who might otherwise not be in contact
Eg: child survival and development revolution of 1980s, bringing disparate partners together
•Whichgroups are involved
•What are their interests
•Have they been linked together
•How does that linking take place
•Is there an alliance
•How does the alliance work
prepared by Sheeva Dubey, for classroom discussion, 2014

4. Tom Jacobson, 2005
1
Did you clearly comprehendeverything the organizer / facilitators were tryingto say in their program materials and processes?
2
Did you feel free to challenge organizer / facilitators’ grasp of relevantlocal facts?
3
Did you feel free to challenge the cultural appropriateness of organizer/ facilitators’ behavior and the way they conducted meetings?
4
Did you feel free to challengeorganizer / facilitators’ sincerity, i.e. whether the project was oriented toward solving local problems or just pursuing a donor organization’s goals?
5
Did you feel you were allowed / empowered to speak as oftenas you wished?
6
Did you feel that the organizers/ facilitators allowed you to raise any proposal or criticism you wished to raise, i.e. was everything “on the table?”
7
Did you feel that every proposition or criticismraised was dealt with fully and to your satisfaction? prepared by Sheeva Dubey, for classroom
discussion, 2014

5. Comprehensive Evaluation FrameworkCommunication For Social Change Consortium, 2005
Type ofevaluation
Broad purpose
Main questionsanswered
Baseline analysis/
Formative evaluation research
Determines concept and design
•Where are wenow?
•Is an intervention needed?
•Who needs the intervention?
•How should the intervention be carried out?
Monitoring /
Process evaluation
Monitorsinputs and outputs; assesses service quality
•How are we doing?
•To whatextent are planned activities actually realized?
•How well are the services provided?
Outcome/ Impact /
Effectiveness evaluation
Assessesoutcome and impact
•Howdid we do?
•What outcomes are observed?
•What do the outcomes mean?
•Is the program making a difference?
Future plans /
Cost-effectiveness analysis
Value-for-resources committed including sustainability issues
•What are our next steps and needed resources?
•Should programpriorities change or expand?
•To what extent should resources be reallocated?
prepared by Sheeva Dubey, for classroom discussion, 2014

6. Contd. Some indicators
•Participation
•Trust
•Leadership
•Structure and control
•Diversity and dynamism
•Democracy
•Sustainability factors
•And many others…
prepared by Sheeva Dubey, for classroom
discussion, 2014

7. PMERL, CARE International, 2012
•Are CBA achievements matching expectations?
•Are the CBA achievements the right ones?
•Is the CBA being done in the right way?
•Is the CBA reaching the right scale?
prepared by Sheeva Dubey, for classroom
discussion, 2014

8. Integrated model of CFSC (The Rockefeller Foundation, 2002)
1.Leadership
2.Degree and equity of participation
3.Information equity
4.Collective self-efficacy
5.Sense of ownership
6.Social cohesion
7.Social norms
(at individual level and social level)
prepared by Sheeva Dubey, for classroom
discussion, 2014

9. Discussion
•What are the key indicators?
•How well-defined or abstract M&E is?
prepared by Sheeva Dubey, for classroom
discussion, 2014