SlideShare a Scribd company logo
1 of 16
Download to read offline
The Most Significant Change
ProLearn Project in India
Inka Píbilová
Czech Evaluation Society Conference in Prague, 28 May 2013
A „tsunami relief“ project
 2004 first tsunami relief in Andra Pradesh India funded by
individual donors of ADRA Czech Republic
 2007 needs assessment with Education Office among 20
schools
 2008 – 2009 infrastructure development in 8 schools to
increase and retain the number of children
– Classrooms construction
– Teacher training
– Learning aids
– Community sensitisation
– Children participation
Evaluation Objectives
• Show evidence of the project impact on access to
education, increased education quality and child-friendly
learning environment, thus achieving learning outcomes
and higher literacy.
• Show evidence of attitudinal changes of community,
school staff, children and government representatives in
education.
• Assess sustainability of the “Pro Learn” project after
ADRA withdrew support.
• Draw lessons learnt and recommendations for
improvements in future projects with respect to
planning, implementation, monitoring and evaluation.
Evaluation Methodology - Factors
1. Logical matrix did not correspond to reality
2. Audit of the construction done, client interested in
impacts and sustainability.
3. Donor did not have experience with evaluations
and did not have a specific method in mind.
4. Lack of funding to conduct the evaluation.
5. Lack of baseline data.
6. Field mission restricted to 3 weeks
TermsofReference–Objectives,
scope,stakeholders,questions,
budget,schedule,outputs,use.
Desk study
Interviews
The Most
Significant
Change
Community
conversations
Observations
Preliminaryfindings&conclusions
Final
debriefing
of project team
and
community
volunteers
Communication with the Project Partners
Draft evaluation
report
Finalevaluationreport
Inception
phase
1 month
Field
research
1 months
Reporting
phase
2 months
Initialbriefingandinception
Evaluator
Selection
Evaluation Methodology
http://www.mande.co.uk/docs/MSCGuide.pdf
http://www.mande.co.uk/docs/MSCGuide.pdf
http://www.mande.co.uk/docs/MSCGuide.pdf
How was the technique applied
MSC Training of
community
volunteers
Collection of
the MSC
stories by
volunteers
Selection of the
MSC with
community
volunteers and
project team
MSC drawings by
children
How we selected the „MSC story“
What were the findings
• Renovated or constructed school buildings and games for
children were appreciated, but...
What were the findings
The Most Significant Change was the encreased
empowerment of children in established Child Clubs, who
were able to secure access to potable water or clean
toilets from the local authorities within 3-6 months.
What were the findings
Communication of findings
• Fiel mission closed after evaluation finished - key
communication had to be done at the end of the evaluation.
• The local community was to a big extent illiterate - community
volunteers were expected to debrief the respective
communities.
• Headquarters in India unavailable for debriefing – done by
Skype, donor organisation debriefed back in Europe.
• Donor organisation decided to delay the communication and
finally did not published the evaluation report.
• Though a short debriefing was held with District Education
Office, despite the original plan findings were not officially
communicated to school management, teachers and students.
• Stories had already been used in local media.
Lessons Learnt
• The method can be used for evaluating impacts of projects
related to behavioral changes as an additional data collection
method, even in case of lack of resources.
• Secure and train reliable volunteers / interviewers.
• The atmosphere of trust and openess is key (interpreting)
• Verify the stories in the field.
• Ensure availability of key stakeholders in the selection of the
Most Significant Change story.
• The stories help in communicating successes of the project,
therefore communication incl. budget needs to be carefully
planned (to be a part of the evaluation mission or a subsequent
project atcivity)
Links
Detailed information on the method, including studies, evaluation
reports etc. :
• http://mande.co.uk/special-issues/most-significant-change-
msc/
• http://groups.yahoo.com/group/MostSignificantChanges
Guide:
• http://www.mande.co.uk/docs/MSCGuide.pdf
Trainings currently available in Europe:
• www.socialimpactconsulting.com.au
• www.traceydelaney.net/
Any questions?
Inka Píbilová
inka@evaluace.com

More Related Content

What's hot

Hudsonville Evaulation Logic Design
Hudsonville Evaulation Logic DesignHudsonville Evaulation Logic Design
Hudsonville Evaulation Logic DesignRobert Leneway
 
Beyond the blend: practical approaches to designing fully online learning
Beyond the blend: practical approaches to designing fully online learningBeyond the blend: practical approaches to designing fully online learning
Beyond the blend: practical approaches to designing fully online learningJisc
 
Panel Debate: An Uncertain Future - TEF, Retention, and Student Success
Panel Debate: An Uncertain Future - TEF, Retention, and Student SuccessPanel Debate: An Uncertain Future - TEF, Retention, and Student Success
Panel Debate: An Uncertain Future - TEF, Retention, and Student SuccessHobsons
 
California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...Una Daly
 
Leading through change - how has COVID-19 reshaped approaches to engaging lea...
Leading through change - how has COVID-19 reshaped approaches to engaging lea...Leading through change - how has COVID-19 reshaped approaches to engaging lea...
Leading through change - how has COVID-19 reshaped approaches to engaging lea...Jisc
 
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...Blackboard APAC
 
Nguyen Anh Thinh - Building Partnerships for Peer Health
Nguyen Anh Thinh - Building Partnerships for Peer HealthNguyen Anh Thinh - Building Partnerships for Peer Health
Nguyen Anh Thinh - Building Partnerships for Peer HealthDevelopment Futures
 
La Trobe's success developing the student experience - Professor Jessica Vand...
La Trobe's success developing the student experience - Professor Jessica Vand...La Trobe's success developing the student experience - Professor Jessica Vand...
La Trobe's success developing the student experience - Professor Jessica Vand...Studiosity.com
 
Redesigning the curriculum in COVID-19 times
Redesigning the curriculum in COVID-19 timesRedesigning the curriculum in COVID-19 times
Redesigning the curriculum in COVID-19 timesJisc
 
A whole of institution approach to improving student experience using usage d...
A whole of institution approach to improving student experience using usage d...A whole of institution approach to improving student experience using usage d...
A whole of institution approach to improving student experience using usage d...Blackboard APAC
 
Capturing the student voice
Capturing the student voiceCapturing the student voice
Capturing the student voiceSEDA
 
ePortfolios: Reflecting Quality Learning
ePortfolios: Reflecting Quality LearningePortfolios: Reflecting Quality Learning
ePortfolios: Reflecting Quality LearningErin Sawyer
 
Smarthinking poster_Library_final
Smarthinking poster_Library_finalSmarthinking poster_Library_final
Smarthinking poster_Library_finalElizabeth McCarthy
 
Using research to inform the assessment feedback process
Using research to inform the assessment feedback processUsing research to inform the assessment feedback process
Using research to inform the assessment feedback processSimon Haslett
 
Distance Learning Presentation js
Distance Learning Presentation jsDistance Learning Presentation js
Distance Learning Presentation jsjjsopko
 
Continuing adventures of library learning analytics
Continuing adventures of library learning analyticsContinuing adventures of library learning analytics
Continuing adventures of library learning analyticsSelena Killick
 

What's hot (19)

Hudsonville Evaulation Logic Design
Hudsonville Evaulation Logic DesignHudsonville Evaulation Logic Design
Hudsonville Evaulation Logic Design
 
Beyond the blend: practical approaches to designing fully online learning
Beyond the blend: practical approaches to designing fully online learningBeyond the blend: practical approaches to designing fully online learning
Beyond the blend: practical approaches to designing fully online learning
 
Panel Debate: An Uncertain Future - TEF, Retention, and Student Success
Panel Debate: An Uncertain Future - TEF, Retention, and Student SuccessPanel Debate: An Uncertain Future - TEF, Retention, and Student Success
Panel Debate: An Uncertain Future - TEF, Retention, and Student Success
 
Campus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task ForceCampus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task Force
 
California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...
 
Leading through change - how has COVID-19 reshaped approaches to engaging lea...
Leading through change - how has COVID-19 reshaped approaches to engaging lea...Leading through change - how has COVID-19 reshaped approaches to engaging lea...
Leading through change - how has COVID-19 reshaped approaches to engaging lea...
 
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...
Implementing learning outcome and assessment in Blackboard Learn - Wade Weich...
 
Nguyen Anh Thinh - Building Partnerships for Peer Health
Nguyen Anh Thinh - Building Partnerships for Peer HealthNguyen Anh Thinh - Building Partnerships for Peer Health
Nguyen Anh Thinh - Building Partnerships for Peer Health
 
La Trobe's success developing the student experience - Professor Jessica Vand...
La Trobe's success developing the student experience - Professor Jessica Vand...La Trobe's success developing the student experience - Professor Jessica Vand...
La Trobe's success developing the student experience - Professor Jessica Vand...
 
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and RelevancePerformance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
 
Redesigning the curriculum in COVID-19 times
Redesigning the curriculum in COVID-19 timesRedesigning the curriculum in COVID-19 times
Redesigning the curriculum in COVID-19 times
 
A whole of institution approach to improving student experience using usage d...
A whole of institution approach to improving student experience using usage d...A whole of institution approach to improving student experience using usage d...
A whole of institution approach to improving student experience using usage d...
 
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salterHE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
 
Capturing the student voice
Capturing the student voiceCapturing the student voice
Capturing the student voice
 
ePortfolios: Reflecting Quality Learning
ePortfolios: Reflecting Quality LearningePortfolios: Reflecting Quality Learning
ePortfolios: Reflecting Quality Learning
 
Smarthinking poster_Library_final
Smarthinking poster_Library_finalSmarthinking poster_Library_final
Smarthinking poster_Library_final
 
Using research to inform the assessment feedback process
Using research to inform the assessment feedback processUsing research to inform the assessment feedback process
Using research to inform the assessment feedback process
 
Distance Learning Presentation js
Distance Learning Presentation jsDistance Learning Presentation js
Distance Learning Presentation js
 
Continuing adventures of library learning analytics
Continuing adventures of library learning analyticsContinuing adventures of library learning analytics
Continuing adventures of library learning analytics
 

Similar to The most significant change as a part of a project evaluation in india

Making Quality Education Accessible in Pakistan: A Social Accountability Appr...
Making Quality Education Accessible in Pakistan: A Social Accountability Appr...Making Quality Education Accessible in Pakistan: A Social Accountability Appr...
Making Quality Education Accessible in Pakistan: A Social Accountability Appr...Muhammad Sohaib
 
The Academies Show Birmingham 2014 - Session on Pupil Premium
The Academies Show Birmingham 2014 - Session on Pupil PremiumThe Academies Show Birmingham 2014 - Session on Pupil Premium
The Academies Show Birmingham 2014 - Session on Pupil Premiumacademiesshow
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Beck Pitt
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...OER Hub
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationMEASURE Evaluation
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaFereshte Goshtasbpour
 
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 finalFETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 finalJulie Evans
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaBeck Pitt
 
Cohort 2 Schools Orientation to Next Steps NH
Cohort 2 Schools Orientation to Next Steps NHCohort 2 Schools Orientation to Next Steps NH
Cohort 2 Schools Orientation to Next Steps NHzwonkin
 
Virtual Learning Policy Consideration (iNacol)
Virtual Learning Policy Consideration (iNacol)Virtual Learning Policy Consideration (iNacol)
Virtual Learning Policy Consideration (iNacol)Blacketor Consultants, LLC
 
Fairfax County Attendance Task Force Update Number 2
Fairfax County Attendance Task Force Update Number 2Fairfax County Attendance Task Force Update Number 2
Fairfax County Attendance Task Force Update Number 2Fairfax County
 
Teacher certification policy and teacher education institutions in Indonesia
Teacher certification policy and teacher education institutions in IndonesiaTeacher certification policy and teacher education institutions in Indonesia
Teacher certification policy and teacher education institutions in IndonesiaIwan Syahril
 
Roseveare Making Reform Happen in Education
Roseveare Making Reform Happen in EducationRoseveare Making Reform Happen in Education
Roseveare Making Reform Happen in EducationDeborah Roseveare
 

Similar to The most significant change as a part of a project evaluation in india (20)

Parivartan
ParivartanParivartan
Parivartan
 
System Insights from 'WellAhead':
System Insights from 'WellAhead': System Insights from 'WellAhead':
System Insights from 'WellAhead':
 
Making Quality Education Accessible in Pakistan: A Social Accountability Appr...
Making Quality Education Accessible in Pakistan: A Social Accountability Appr...Making Quality Education Accessible in Pakistan: A Social Accountability Appr...
Making Quality Education Accessible in Pakistan: A Social Accountability Appr...
 
84305X_FY2022.pptx
84305X_FY2022.pptx84305X_FY2022.pptx
84305X_FY2022.pptx
 
The Academies Show Birmingham 2014 - Session on Pupil Premium
The Academies Show Birmingham 2014 - Session on Pupil PremiumThe Academies Show Birmingham 2014 - Session on Pupil Premium
The Academies Show Birmingham 2014 - Session on Pupil Premium
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
Samadhaan
SamadhaanSamadhaan
Samadhaan
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in Evaluation
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in Kenya
 
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 finalFETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
 
Fall Research Collaborative meeting
Fall Research Collaborative meetingFall Research Collaborative meeting
Fall Research Collaborative meeting
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in Kenya
 
Cohort 2 Schools Orientation to Next Steps NH
Cohort 2 Schools Orientation to Next Steps NHCohort 2 Schools Orientation to Next Steps NH
Cohort 2 Schools Orientation to Next Steps NH
 
Virtual Learning Policy Consideration (iNacol)
Virtual Learning Policy Consideration (iNacol)Virtual Learning Policy Consideration (iNacol)
Virtual Learning Policy Consideration (iNacol)
 
Kartvya
KartvyaKartvya
Kartvya
 
Fairfax County Attendance Task Force Update Number 2
Fairfax County Attendance Task Force Update Number 2Fairfax County Attendance Task Force Update Number 2
Fairfax County Attendance Task Force Update Number 2
 
Teacher certification policy and teacher education institutions in Indonesia
Teacher certification policy and teacher education institutions in IndonesiaTeacher certification policy and teacher education institutions in Indonesia
Teacher certification policy and teacher education institutions in Indonesia
 
costatine
costatinecostatine
costatine
 
Roseveare Making Reform Happen in Education
Roseveare Making Reform Happen in EducationRoseveare Making Reform Happen in Education
Roseveare Making Reform Happen in Education
 

More from Inka Pibilova

Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...
Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...
Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...Inka Pibilova
 
Evaluace českého onkologickéo projektu v Srbsku 2015
Evaluace českého onkologickéo projektu v Srbsku 2015 Evaluace českého onkologickéo projektu v Srbsku 2015
Evaluace českého onkologickéo projektu v Srbsku 2015 Inka Pibilova
 
Participativní plánování, monitoring a evaluace
Participativní plánování, monitoring a evaluaceParticipativní plánování, monitoring a evaluace
Participativní plánování, monitoring a evaluaceInka Pibilova
 
Monitoring zamereny na vysledky a evaluace
Monitoring zamereny na vysledky a evaluace Monitoring zamereny na vysledky a evaluace
Monitoring zamereny na vysledky a evaluace Inka Pibilova
 
How European Civil Society Organisations Strive for their Development Effecti...
How European Civil Society Organisations Strive for their Development Effecti...How European Civil Society Organisations Strive for their Development Effecti...
How European Civil Society Organisations Strive for their Development Effecti...Inka Pibilova
 
How European CSOs strive for their development effectiveness
How European CSOs strive for their development effectivenessHow European CSOs strive for their development effectiveness
How European CSOs strive for their development effectivenessInka Pibilova
 
Prevence přenosu HIV z matek na děti v Keni
Prevence přenosu HIV z matek na děti v KeniPrevence přenosu HIV z matek na děti v Keni
Prevence přenosu HIV z matek na děti v KeniInka Pibilova
 
Introduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogIntroduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogInka Pibilova
 
Monitoring and evaluation of human rights projects
Monitoring and evaluation of human rights projectsMonitoring and evaluation of human rights projects
Monitoring and evaluation of human rights projectsInka Pibilova
 
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...Inka Pibilova
 
How to plan EC-funded projects
How to plan EC-funded projectsHow to plan EC-funded projects
How to plan EC-funded projectsInka Pibilova
 
Pribehy nejvetsich zmen v ramci evaluace projektu v indii
Pribehy nejvetsich zmen v ramci evaluace projektu v indiiPribehy nejvetsich zmen v ramci evaluace projektu v indii
Pribehy nejvetsich zmen v ramci evaluace projektu v indiiInka Pibilova
 
Gender Analysis of Child Trafficking Prevention and Rehabilitation in Ethiopia
Gender Analysis of Child Trafficking Prevention and Rehabilitation in EthiopiaGender Analysis of Child Trafficking Prevention and Rehabilitation in Ethiopia
Gender Analysis of Child Trafficking Prevention and Rehabilitation in EthiopiaInka Pibilova
 
Mutual Peer Reviews between Organisations
Mutual Peer Reviews between Organisations Mutual Peer Reviews between Organisations
Mutual Peer Reviews between Organisations Inka Pibilova
 
Lessons learnt from evaluations of Development Education / Awareness Raising ...
Lessons learnt from evaluations of Development Education / Awareness Raising ...Lessons learnt from evaluations of Development Education / Awareness Raising ...
Lessons learnt from evaluations of Development Education / Awareness Raising ...Inka Pibilova
 
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...Inka Pibilova
 
Poučení z evaluací vzdělávacích projektů
Poučení z evaluací vzdělávacích projektůPoučení z evaluací vzdělávacích projektů
Poučení z evaluací vzdělávacích projektůInka Pibilova
 
FoRS Code on Effectiveness, Peer Reviews and Development Coffee
FoRS Code on Effectiveness, Peer Reviews and Development CoffeeFoRS Code on Effectiveness, Peer Reviews and Development Coffee
FoRS Code on Effectiveness, Peer Reviews and Development CoffeeInka Pibilova
 
Evaluace projektu prevence a léčby HIV v Keni
Evaluace projektu prevence a léčby HIV v KeniEvaluace projektu prevence a léčby HIV v Keni
Evaluace projektu prevence a léčby HIV v KeniInka Pibilova
 
Evaluation and capacity building tools for Czech CSOs
Evaluation and capacity building tools for Czech CSOsEvaluation and capacity building tools for Czech CSOs
Evaluation and capacity building tools for Czech CSOsInka Pibilova
 

More from Inka Pibilova (20)

Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...
Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...
Impacts of Czech cancer-fighting projects in Georgia and Serbia: lessons for ...
 
Evaluace českého onkologickéo projektu v Srbsku 2015
Evaluace českého onkologickéo projektu v Srbsku 2015 Evaluace českého onkologickéo projektu v Srbsku 2015
Evaluace českého onkologickéo projektu v Srbsku 2015
 
Participativní plánování, monitoring a evaluace
Participativní plánování, monitoring a evaluaceParticipativní plánování, monitoring a evaluace
Participativní plánování, monitoring a evaluace
 
Monitoring zamereny na vysledky a evaluace
Monitoring zamereny na vysledky a evaluace Monitoring zamereny na vysledky a evaluace
Monitoring zamereny na vysledky a evaluace
 
How European Civil Society Organisations Strive for their Development Effecti...
How European Civil Society Organisations Strive for their Development Effecti...How European Civil Society Organisations Strive for their Development Effecti...
How European Civil Society Organisations Strive for their Development Effecti...
 
How European CSOs strive for their development effectiveness
How European CSOs strive for their development effectivenessHow European CSOs strive for their development effectiveness
How European CSOs strive for their development effectiveness
 
Prevence přenosu HIV z matek na děti v Keni
Prevence přenosu HIV z matek na děti v KeniPrevence přenosu HIV z matek na děti v Keni
Prevence přenosu HIV z matek na děti v Keni
 
Introduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogIntroduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / Trialog
 
Monitoring and evaluation of human rights projects
Monitoring and evaluation of human rights projectsMonitoring and evaluation of human rights projects
Monitoring and evaluation of human rights projects
 
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...
Using Istanbul CSO Development Effectiveness Principles to evaluate a health ...
 
How to plan EC-funded projects
How to plan EC-funded projectsHow to plan EC-funded projects
How to plan EC-funded projects
 
Pribehy nejvetsich zmen v ramci evaluace projektu v indii
Pribehy nejvetsich zmen v ramci evaluace projektu v indiiPribehy nejvetsich zmen v ramci evaluace projektu v indii
Pribehy nejvetsich zmen v ramci evaluace projektu v indii
 
Gender Analysis of Child Trafficking Prevention and Rehabilitation in Ethiopia
Gender Analysis of Child Trafficking Prevention and Rehabilitation in EthiopiaGender Analysis of Child Trafficking Prevention and Rehabilitation in Ethiopia
Gender Analysis of Child Trafficking Prevention and Rehabilitation in Ethiopia
 
Mutual Peer Reviews between Organisations
Mutual Peer Reviews between Organisations Mutual Peer Reviews between Organisations
Mutual Peer Reviews between Organisations
 
Lessons learnt from evaluations of Development Education / Awareness Raising ...
Lessons learnt from evaluations of Development Education / Awareness Raising ...Lessons learnt from evaluations of Development Education / Awareness Raising ...
Lessons learnt from evaluations of Development Education / Awareness Raising ...
 
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...
Evaluační výzkum v zahraniční rozvojové spolupráci - příležitosti pro student...
 
Poučení z evaluací vzdělávacích projektů
Poučení z evaluací vzdělávacích projektůPoučení z evaluací vzdělávacích projektů
Poučení z evaluací vzdělávacích projektů
 
FoRS Code on Effectiveness, Peer Reviews and Development Coffee
FoRS Code on Effectiveness, Peer Reviews and Development CoffeeFoRS Code on Effectiveness, Peer Reviews and Development Coffee
FoRS Code on Effectiveness, Peer Reviews and Development Coffee
 
Evaluace projektu prevence a léčby HIV v Keni
Evaluace projektu prevence a léčby HIV v KeniEvaluace projektu prevence a léčby HIV v Keni
Evaluace projektu prevence a léčby HIV v Keni
 
Evaluation and capacity building tools for Czech CSOs
Evaluation and capacity building tools for Czech CSOsEvaluation and capacity building tools for Czech CSOs
Evaluation and capacity building tools for Czech CSOs
 

Recently uploaded

MEP Plans in Construction of Building and Industrial Projects 2024
MEP Plans in Construction of Building and Industrial Projects 2024MEP Plans in Construction of Building and Industrial Projects 2024
MEP Plans in Construction of Building and Industrial Projects 2024Chandresh Chudasama
 
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdf
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdfGUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdf
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdfDanny Diep To
 
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...Hector Del Castillo, CPM, CPMM
 
Customizable Contents Restoration Training
Customizable Contents Restoration TrainingCustomizable Contents Restoration Training
Customizable Contents Restoration TrainingCalvinarnold843
 
Simplify Your Funding: Quick and Easy Business Loans
Simplify Your Funding: Quick and Easy Business LoansSimplify Your Funding: Quick and Easy Business Loans
Simplify Your Funding: Quick and Easy Business LoansNugget Global
 
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...ssuserf63bd7
 
1911 Gold Corporate Presentation Apr 2024.pdf
1911 Gold Corporate Presentation Apr 2024.pdf1911 Gold Corporate Presentation Apr 2024.pdf
1911 Gold Corporate Presentation Apr 2024.pdfShaun Heinrichs
 
Unveiling the Soundscape Music for Psychedelic Experiences
Unveiling the Soundscape Music for Psychedelic ExperiencesUnveiling the Soundscape Music for Psychedelic Experiences
Unveiling the Soundscape Music for Psychedelic ExperiencesDoe Paoro
 
Data Analytics Strategy Toolkit and Templates
Data Analytics Strategy Toolkit and TemplatesData Analytics Strategy Toolkit and Templates
Data Analytics Strategy Toolkit and TemplatesAurelien Domont, MBA
 
Implementing Exponential Accelerators.pptx
Implementing Exponential Accelerators.pptxImplementing Exponential Accelerators.pptx
Implementing Exponential Accelerators.pptxRich Reba
 
Rakhi sets symbolizing the bond of love.pptx
Rakhi sets symbolizing the bond of love.pptxRakhi sets symbolizing the bond of love.pptx
Rakhi sets symbolizing the bond of love.pptxRakhi Bazaar
 
Psychic Reading | Spiritual Guidance – Astro Ganesh Ji
Psychic Reading | Spiritual Guidance – Astro Ganesh JiPsychic Reading | Spiritual Guidance – Astro Ganesh Ji
Psychic Reading | Spiritual Guidance – Astro Ganesh Jiastral oracle
 
71368-80-4.pdf Fast delivery good quality
71368-80-4.pdf Fast delivery  good quality71368-80-4.pdf Fast delivery  good quality
71368-80-4.pdf Fast delivery good qualitycathy664059
 
Introducing the Analogic framework for business planning applications
Introducing the Analogic framework for business planning applicationsIntroducing the Analogic framework for business planning applications
Introducing the Analogic framework for business planning applicationsKnowledgeSeed
 
Darshan Hiranandani (Son of Niranjan Hiranandani).pdf
Darshan Hiranandani (Son of Niranjan Hiranandani).pdfDarshan Hiranandani (Son of Niranjan Hiranandani).pdf
Darshan Hiranandani (Son of Niranjan Hiranandani).pdfShashank Mehta
 
How to Conduct a Service Gap Analysis for Your Business
How to Conduct a Service Gap Analysis for Your BusinessHow to Conduct a Service Gap Analysis for Your Business
How to Conduct a Service Gap Analysis for Your BusinessHelp Desk Migration
 
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...Aggregage
 
Neha Jhalani Hiranandani: A Guide to Her Life and Career
Neha Jhalani Hiranandani: A Guide to Her Life and CareerNeha Jhalani Hiranandani: A Guide to Her Life and Career
Neha Jhalani Hiranandani: A Guide to Her Life and Careerr98588472
 

Recently uploaded (20)

MEP Plans in Construction of Building and Industrial Projects 2024
MEP Plans in Construction of Building and Industrial Projects 2024MEP Plans in Construction of Building and Industrial Projects 2024
MEP Plans in Construction of Building and Industrial Projects 2024
 
WAM Corporate Presentation April 12 2024.pdf
WAM Corporate Presentation April 12 2024.pdfWAM Corporate Presentation April 12 2024.pdf
WAM Corporate Presentation April 12 2024.pdf
 
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdf
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdfGUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdf
GUIDELINES ON USEFUL FORMS IN FREIGHT FORWARDING (F) Danny Diep Toh MBA.pdf
 
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...
How Generative AI Is Transforming Your Business | Byond Growth Insights | Apr...
 
Customizable Contents Restoration Training
Customizable Contents Restoration TrainingCustomizable Contents Restoration Training
Customizable Contents Restoration Training
 
Simplify Your Funding: Quick and Easy Business Loans
Simplify Your Funding: Quick and Easy Business LoansSimplify Your Funding: Quick and Easy Business Loans
Simplify Your Funding: Quick and Easy Business Loans
 
Authentically Social - presented by Corey Perlman
Authentically Social - presented by Corey PerlmanAuthentically Social - presented by Corey Perlman
Authentically Social - presented by Corey Perlman
 
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
 
1911 Gold Corporate Presentation Apr 2024.pdf
1911 Gold Corporate Presentation Apr 2024.pdf1911 Gold Corporate Presentation Apr 2024.pdf
1911 Gold Corporate Presentation Apr 2024.pdf
 
Unveiling the Soundscape Music for Psychedelic Experiences
Unveiling the Soundscape Music for Psychedelic ExperiencesUnveiling the Soundscape Music for Psychedelic Experiences
Unveiling the Soundscape Music for Psychedelic Experiences
 
Data Analytics Strategy Toolkit and Templates
Data Analytics Strategy Toolkit and TemplatesData Analytics Strategy Toolkit and Templates
Data Analytics Strategy Toolkit and Templates
 
Implementing Exponential Accelerators.pptx
Implementing Exponential Accelerators.pptxImplementing Exponential Accelerators.pptx
Implementing Exponential Accelerators.pptx
 
Rakhi sets symbolizing the bond of love.pptx
Rakhi sets symbolizing the bond of love.pptxRakhi sets symbolizing the bond of love.pptx
Rakhi sets symbolizing the bond of love.pptx
 
Psychic Reading | Spiritual Guidance – Astro Ganesh Ji
Psychic Reading | Spiritual Guidance – Astro Ganesh JiPsychic Reading | Spiritual Guidance – Astro Ganesh Ji
Psychic Reading | Spiritual Guidance – Astro Ganesh Ji
 
71368-80-4.pdf Fast delivery good quality
71368-80-4.pdf Fast delivery  good quality71368-80-4.pdf Fast delivery  good quality
71368-80-4.pdf Fast delivery good quality
 
Introducing the Analogic framework for business planning applications
Introducing the Analogic framework for business planning applicationsIntroducing the Analogic framework for business planning applications
Introducing the Analogic framework for business planning applications
 
Darshan Hiranandani (Son of Niranjan Hiranandani).pdf
Darshan Hiranandani (Son of Niranjan Hiranandani).pdfDarshan Hiranandani (Son of Niranjan Hiranandani).pdf
Darshan Hiranandani (Son of Niranjan Hiranandani).pdf
 
How to Conduct a Service Gap Analysis for Your Business
How to Conduct a Service Gap Analysis for Your BusinessHow to Conduct a Service Gap Analysis for Your Business
How to Conduct a Service Gap Analysis for Your Business
 
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...
Strategic Project Finance Essentials: A Project Manager’s Guide to Financial ...
 
Neha Jhalani Hiranandani: A Guide to Her Life and Career
Neha Jhalani Hiranandani: A Guide to Her Life and CareerNeha Jhalani Hiranandani: A Guide to Her Life and Career
Neha Jhalani Hiranandani: A Guide to Her Life and Career
 

The most significant change as a part of a project evaluation in india

  • 1. The Most Significant Change ProLearn Project in India Inka Píbilová Czech Evaluation Society Conference in Prague, 28 May 2013
  • 2. A „tsunami relief“ project  2004 first tsunami relief in Andra Pradesh India funded by individual donors of ADRA Czech Republic  2007 needs assessment with Education Office among 20 schools  2008 – 2009 infrastructure development in 8 schools to increase and retain the number of children – Classrooms construction – Teacher training – Learning aids – Community sensitisation – Children participation
  • 3. Evaluation Objectives • Show evidence of the project impact on access to education, increased education quality and child-friendly learning environment, thus achieving learning outcomes and higher literacy. • Show evidence of attitudinal changes of community, school staff, children and government representatives in education. • Assess sustainability of the “Pro Learn” project after ADRA withdrew support. • Draw lessons learnt and recommendations for improvements in future projects with respect to planning, implementation, monitoring and evaluation.
  • 4. Evaluation Methodology - Factors 1. Logical matrix did not correspond to reality 2. Audit of the construction done, client interested in impacts and sustainability. 3. Donor did not have experience with evaluations and did not have a specific method in mind. 4. Lack of funding to conduct the evaluation. 5. Lack of baseline data. 6. Field mission restricted to 3 weeks
  • 5. TermsofReference–Objectives, scope,stakeholders,questions, budget,schedule,outputs,use. Desk study Interviews The Most Significant Change Community conversations Observations Preliminaryfindings&conclusions Final debriefing of project team and community volunteers Communication with the Project Partners Draft evaluation report Finalevaluationreport Inception phase 1 month Field research 1 months Reporting phase 2 months Initialbriefingandinception Evaluator Selection Evaluation Methodology
  • 9. How was the technique applied MSC Training of community volunteers Collection of the MSC stories by volunteers Selection of the MSC with community volunteers and project team MSC drawings by children
  • 10. How we selected the „MSC story“
  • 11. What were the findings • Renovated or constructed school buildings and games for children were appreciated, but...
  • 12. What were the findings The Most Significant Change was the encreased empowerment of children in established Child Clubs, who were able to secure access to potable water or clean toilets from the local authorities within 3-6 months. What were the findings
  • 13. Communication of findings • Fiel mission closed after evaluation finished - key communication had to be done at the end of the evaluation. • The local community was to a big extent illiterate - community volunteers were expected to debrief the respective communities. • Headquarters in India unavailable for debriefing – done by Skype, donor organisation debriefed back in Europe. • Donor organisation decided to delay the communication and finally did not published the evaluation report. • Though a short debriefing was held with District Education Office, despite the original plan findings were not officially communicated to school management, teachers and students. • Stories had already been used in local media.
  • 14. Lessons Learnt • The method can be used for evaluating impacts of projects related to behavioral changes as an additional data collection method, even in case of lack of resources. • Secure and train reliable volunteers / interviewers. • The atmosphere of trust and openess is key (interpreting) • Verify the stories in the field. • Ensure availability of key stakeholders in the selection of the Most Significant Change story. • The stories help in communicating successes of the project, therefore communication incl. budget needs to be carefully planned (to be a part of the evaluation mission or a subsequent project atcivity)
  • 15. Links Detailed information on the method, including studies, evaluation reports etc. : • http://mande.co.uk/special-issues/most-significant-change- msc/ • http://groups.yahoo.com/group/MostSignificantChanges Guide: • http://www.mande.co.uk/docs/MSCGuide.pdf Trainings currently available in Europe: • www.socialimpactconsulting.com.au • www.traceydelaney.net/