RIVERSEE regional meeting M&E Steve Powell & Esad Bratović impact regional integration social exclusion monitoring & evaluation
Aims for today
Get idea of impact, in particular on RI and SI
How? What do we do best?
Model? Which are the steps on the road?
How much? How big is this impact?
Ideas for achievably improving M&E until end of program
evaluate e valu ate quality significance
Steps for today
Most Significant Changes process
Definition of SI and RI according to work plans
Reflection on definitions and changes
What is the value we add and how do we add it?
Agreement on finishing report
? Ideas for M&E for the future?
? Ideas for marketing and communication?
What is M&E? “ M&E” Kinds of program Individual programs; kinds of program Individual programs What level Donor, sending organisation, science? Donor, Sending organisation Sending organisation Who for Demonstrate VS is effective; differential knowledge Occasionally? When effectiveness is not yet proven? Program, academics/ externals? Research Is money well spent; lessons learned - (before program?) - After program - (follow-up?) Program or externals Evaluation Improving quality, pre-empting problems During program Program Management Monitoring Why When Who does it
Where are you right now?
What you do
What you’d like to do
What you wouldn’t like to do
Expertise on M&E
Who are we
Qualitative and quantitative
Studies for AVSO and SEEYN
What we have been doing
Overview of what is known about impact of VS & e valuation research in detail
Research on volunteering in a representative sample in BiH
Analysis of attitudes to youth voluntary service in BiH for UNV
Research on importance of motivation/placement fit
Developing tools to measure voluntarism impact
Evaluating voluntarism programs
Developing M&E systems for voluntary organisations
the most significant changes which happened to you (or of which you directly know about)
stories of changes due to any activities which were
It’s about getting a picture of best practice.
No-one is trying to say that everything is as good as in the best stories.
The MSC process : which changes exactly?
changes within volunteers, changes in individuals, communities, organisations, anything else!
changes in people's behaviour, or a significant improvement in a town, anything!
about half to one page of text.
reject “stories” which are lists of achievements like in standard reports.
“ me!” or: “our volunteer!” or: "male teacher, about 30 years old“ or “school in xyz”
How – what lead to what?
What was the change
Why the change is significant
The MSC selection process volunteers Vol 1 Vol 2 Vol 3 IPOs Vol 1 Vol 2 Vol 3 others Vol 1 Vol 2 Vol 3 Main group
The MSC process : Select ing the best ones
Select the best 2 stories, that is, the stories of the changes you consider most significant.
Add one paragraph to each story
saying WHY you consider it most significant.
HOW TYPICAL the story is.
What significant changes? How?
How does RI / SI happen in our work?
Friendships 7, cooperation on regional 5, walls of ignorance, getting comms closer, xborder networking 7
Long-term cooperation, broader
Preventing risk of incoherent approaches??
Getting communities closer – 3 – takes time
EU integration – 3 – nigdje veze
Education x3 in village school, experience, equal opportunites x5 – access to services
Youth – edu, employment,
Breaking down ignorance
Groups excluded / at risk of …
… sexual minorities, blind …
groups on margins x2 except students
Access to education? Which? Formal/informal
Job and income
Analysis of work plans in same 3 groups
How do the MS changes relate to SI and RI
Regional integration Positive volunteer experience Volunteer placements capacity building of organisations breaking down prejudice Change agents - volunteers Activities O utcomes O verall G oals Social inclusion solidarity