Monitoring and evaluation of social change projects

1. Participatory Monitoring & Evaluation
Will Parks with Denise Gray-Felder, Jim Hunt and AilishByrne
COMMUNICATION FOR SOCIAL CHANGE CONSORTIUM
prepared by Sheeva Dubey, for classroom discussion, 2014

2. Outcomes of CFSC leading to societal impact
Individual Change
•Skills
•Ideation: knowledge, attitudes, perceived risk, subjective norms, self-image, emotion, self- efficacy, social influence, personal advocacy
•Intention to engage in new behavior
•Behavior
Social Change
•Leadership
•Degree and equity of participation
•Information equity
•Collective self-efficacy
•Sense of ownership
•Social cohesion
•Social norms
prepared by Sheeva Dubey, for classroom discussion, 2014

3. Comprehensive Evaluation Framework
Type ofevaluation
Broad purpose
Main questionsanswered
Baseline analysis/
Formative evaluation research
Determines concept and design
•Where are wenow?
•Is an intervention needed?
•Who needs the intervention?
•How should the intervention be carried out?
Monitoring /
Process evaluation
Monitorsinputs and outputs; assesses service quality
•How are we doing?
•To whatextent are planned activities actually realized?
•How well are the services provided?
Outcome/ Impact /
Effectiveness evaluation
Assessesoutcome and impact
•Howdid we do?
•What outcomes are observed?
•What do the outcomes mean?
•Is the program making a difference?
Future plans /
Cost-effectiveness analysis
Value-for-resources committed including sustainability issues
•What are our next steps and needed resources?
•Should programpriorities change or expand?
•To what extent should resources be reallocated?
prepared by Sheeva Dubey, for classroom discussion, 2014

4. Some indicators
•Participation
•Trust
•Leadership
•Structure and control
•Diversity and dynamism
•Democracy
•Sustainability factors
•And many others…
prepared by Sheeva Dubey, for classroom discussion, 2014

5. Advocacy M&E
•USAID conceptual framework
-Transformational (moving from citizen empowerment)
-Developmental (to civil society strengthening)
-Instrumental (and concluding with policy influence)
•RosDavid’s 4 indicators:
1.Policy change
2.Civil society
3.Enlarging democratic space
4.Supporting people-centered policy making
prepared by Sheeva Dubey, for classroom discussion, 2014

6. PM&E techniques
•PRA/ PLA related:
•Visualized Analysis –Modeling, Mapping, problem ranking / sorting, Preference ranking, Problem tree or casual diagram, Seasonal calendars, Vignettes, Narrated observation walks / transect walks, Daily / weekly activity profiles, Historical profiles and trend analyses, Internal / external organization charts, Pocket charts, Force-field analysis / Story with a gap, Task analysis, Journals and diaries
•Interviewing and sampling methods –In-depth individual interview, Key informant interview, Group interview, Observation, Analysis of secondary data, Well-being and wealth-ranking
•Audio-visual techniques
•For anthropological research –participant observation, oral testimonies
prepared by Sheeva Dubey, for classroom discussion, 2014