Successfully reported this slideshow.
The Most Significant ChangeProLearn Project in IndiaInka PíbilováCzech Evaluation Society Conference in Prague, 28 May 2013
A „tsunami relief“ project 2004 first tsunami relief in Andra Pradesh India funded byindividual donors of ADRA Czech Repu...
Evaluation Objectives• Show evidence of the project impact on access toeducation, increased education quality and child-fr...
Evaluation Methodology - Factors1. Logical matrix did not correspond to reality2. Audit of the construction done, client i...
TermsofReference–Objectives,scope,stakeholders,questions,budget,schedule,outputs,use.Desk studyInterviewsThe MostSignifica...
http://www.mande.co.uk/docs/MSCGuide.pdf
http://www.mande.co.uk/docs/MSCGuide.pdf
http://www.mande.co.uk/docs/MSCGuide.pdf
How was the technique appliedMSC Training ofcommunityvolunteersCollection ofthe MSCstories byvolunteersSelection of theMSC...
How we selected the „MSC story“
What were the findings• Renovated or constructed school buildings and games forchildren were appreciated, but...
What were the findingsThe Most Significant Change was the encreasedempowerment of children in established Child Clubs, who...
Communication of findings• Fiel mission closed after evaluation finished - keycommunication had to be done at the end of t...
Lessons Learnt• The method can be used for evaluating impacts of projectsrelated to behavioral changes as an additional da...
LinksDetailed information on the method, including studies, evaluationreports etc. :• http://mande.co.uk/special-issues/mo...
Any questions?Inka Píbilováinka@evaluace.com
Upcoming SlideShare
Loading in …5
×

The most significant change as a part of a project evaluation in india

1,167 views

Published on

Presentation from the conference of the Czech Evaluation Society on 28 May 2013.

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

The most significant change as a part of a project evaluation in india

  1. 1. The Most Significant ChangeProLearn Project in IndiaInka PíbilováCzech Evaluation Society Conference in Prague, 28 May 2013
  2. 2. A „tsunami relief“ project 2004 first tsunami relief in Andra Pradesh India funded byindividual donors of ADRA Czech Republic 2007 needs assessment with Education Office among 20schools 2008 – 2009 infrastructure development in 8 schools toincrease and retain the number of children– Classrooms construction– Teacher training– Learning aids– Community sensitisation– Children participation
  3. 3. Evaluation Objectives• Show evidence of the project impact on access toeducation, increased education quality and child-friendlylearning environment, thus achieving learning outcomesand higher literacy.• Show evidence of attitudinal changes of community,school staff, children and government representatives ineducation.• Assess sustainability of the “Pro Learn” project afterADRA withdrew support.• Draw lessons learnt and recommendations forimprovements in future projects with respect toplanning, implementation, monitoring and evaluation.
  4. 4. Evaluation Methodology - Factors1. Logical matrix did not correspond to reality2. Audit of the construction done, client interested inimpacts and sustainability.3. Donor did not have experience with evaluationsand did not have a specific method in mind.4. Lack of funding to conduct the evaluation.5. Lack of baseline data.6. Field mission restricted to 3 weeks
  5. 5. TermsofReference–Objectives,scope,stakeholders,questions,budget,schedule,outputs,use.Desk studyInterviewsThe MostSignificantChangeCommunityconversationsObservationsPreliminaryfindings&conclusionsFinaldebriefingof project teamandcommunityvolunteersCommunication with the Project PartnersDraft evaluationreportFinalevaluationreportInceptionphase1 monthFieldresearch1 monthsReportingphase2 monthsInitialbriefingandinceptionEvaluatorSelectionEvaluation Methodology
  6. 6. http://www.mande.co.uk/docs/MSCGuide.pdf
  7. 7. http://www.mande.co.uk/docs/MSCGuide.pdf
  8. 8. http://www.mande.co.uk/docs/MSCGuide.pdf
  9. 9. How was the technique appliedMSC Training ofcommunityvolunteersCollection ofthe MSCstories byvolunteersSelection of theMSC withcommunityvolunteers andproject teamMSC drawings bychildren
  10. 10. How we selected the „MSC story“
  11. 11. What were the findings• Renovated or constructed school buildings and games forchildren were appreciated, but...
  12. 12. What were the findingsThe Most Significant Change was the encreasedempowerment of children in established Child Clubs, whowere able to secure access to potable water or cleantoilets from the local authorities within 3-6 months.What were the findings
  13. 13. Communication of findings• Fiel mission closed after evaluation finished - keycommunication had to be done at the end of the evaluation.• The local community was to a big extent illiterate - communityvolunteers were expected to debrief the respectivecommunities.• Headquarters in India unavailable for debriefing – done bySkype, donor organisation debriefed back in Europe.• Donor organisation decided to delay the communication andfinally did not published the evaluation report.• Though a short debriefing was held with District EducationOffice, despite the original plan findings were not officiallycommunicated to school management, teachers and students.• Stories had already been used in local media.
  14. 14. Lessons Learnt• The method can be used for evaluating impacts of projectsrelated to behavioral changes as an additional data collectionmethod, even in case of lack of resources.• Secure and train reliable volunteers / interviewers.• The atmosphere of trust and openess is key (interpreting)• Verify the stories in the field.• Ensure availability of key stakeholders in the selection of theMost Significant Change story.• The stories help in communicating successes of the project,therefore communication incl. budget needs to be carefullyplanned (to be a part of the evaluation mission or a subsequentproject atcivity)
  15. 15. LinksDetailed information on the method, including studies, evaluationreports etc. :• http://mande.co.uk/special-issues/most-significant-change-msc/• http://groups.yahoo.com/group/MostSignificantChangesGuide:• http://www.mande.co.uk/docs/MSCGuide.pdfTrainings currently available in Europe:• www.socialimpactconsulting.com.au• www.traceydelaney.net/
  16. 16. Any questions?Inka Píbilováinka@evaluace.com

×