M&E workshop for riversee


Published on

Published in: Economy & Finance, Technology
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • M&E workshop for riversee

    1. 1. RIVERSEE regional meeting M&E Steve Powell & Esad Bratović impact regional integration social exclusion monitoring & evaluation
    2. 2. Aims for today <ul><li>Get idea of impact, in particular on RI and SI </li></ul><ul><ul><li>How? What do we do best? </li></ul></ul><ul><ul><li>Model? Which are the steps on the road? </li></ul></ul><ul><ul><li>How much? How big is this impact? </li></ul></ul><ul><li>Ideas for achievably improving M&E until end of program </li></ul>
    3. 3. evaluate e valu ate quality significance
    4. 4. Steps for today <ul><li>Introduction </li></ul><ul><li>Most Significant Changes process </li></ul><ul><li>Definition of SI and RI according to work plans </li></ul><ul><li>Reflection on definitions and changes </li></ul><ul><li>What is the value we add and how do we add it? </li></ul><ul><li>Agreement on finishing report </li></ul><ul><li>? Ideas for M&E for the future? </li></ul><ul><li>? Ideas for marketing and communication? </li></ul>
    5. 5. What is M&E? “ M&E” Kinds of program Individual programs; kinds of program Individual programs What level Donor, sending organisation, science? Donor, Sending organisation Sending organisation Who for Demonstrate VS is effective; differential knowledge Occasionally? When effectiveness is not yet proven? Program, academics/ externals? Research Is money well spent; lessons learned - (before program?) - After program - (follow-up?) Program or externals Evaluation Improving quality, pre-empting problems During program Program Management Monitoring Why When Who does it
    6. 6. Where are you right now? <ul><li>What you do </li></ul><ul><li>What you’d like to do </li></ul><ul><li>What you wouldn’t like to do </li></ul><ul><li>Expertise on M&E </li></ul><ul><li>Something else </li></ul>
    7. 7. Who are we <ul><ul><li>Research </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul><ul><ul><li>Training </li></ul></ul><ul><li>Qualitative and quantitative </li></ul><ul><li>Studies for AVSO and SEEYN </li></ul>
    8. 8. What we have been doing <ul><ul><li>Overview of what is known about impact of VS & e valuation research in detail </li></ul></ul><ul><ul><li>Research on volunteering in a representative sample in BiH </li></ul></ul><ul><ul><li>Analysis of attitudes to youth voluntary service in BiH for UNV </li></ul></ul><ul><ul><li>Research on importance of motivation/placement fit </li></ul></ul><ul><ul><li>Developing tools to measure voluntarism impact </li></ul></ul><ul><ul><li>Evaluating voluntarism programs </li></ul></ul><ul><ul><li>Developing M&E systems for voluntary organisations </li></ul></ul><ul><li>steve@promente.org / eso@promente.org </li></ul>
    9. 9. Inductive methods: Most Significant Change (MSC) <ul><li>Adapted from The Most Significant Change&quot; (MSC) Technique; A Guide to Its Use&quot; © Rick Davies and Jess Dart </li></ul>
    10. 10. MSC Methodology guideline <ul><li>What is Most Significant Change? </li></ul><ul><ul><li>New! </li></ul></ul><ul><ul><li>participatory </li></ul></ul><ul><ul><li>based on stories rather than indicators. </li></ul></ul><ul><ul><li>about important or significant changes </li></ul></ul><ul><ul><li>rich </li></ul></ul><ul><ul><li>about impact </li></ul></ul><ul><ul><li>about values </li></ul></ul><ul><ul><li>informal, easy? </li></ul></ul><ul><ul><li>complements, doesn’t replace other methods of M&E </li></ul></ul>
    11. 11. Why is MSC better than other M&E methods? <ul><li>identifies unexpected changes </li></ul><ul><li>goes beyond planned outcomes to impact </li></ul><ul><li>identify values in an organisation </li></ul><ul><li>participatory </li></ul><ul><li>stimulates discussion about values and why </li></ul><ul><li>quite culture-neutral </li></ul><ul><li>rich picture of what is happening </li></ul>
    12. 12. The MSC process : which changes ? <ul><li>the most significant changes which happened to you (or of which you directly know about) </li></ul><ul><li>stories of changes due to any activities which were </li></ul><ul><ul><li>Remarkable </li></ul></ul><ul><ul><li>Inspiring </li></ul></ul><ul><ul><li>Valuable </li></ul></ul><ul><ul><li>Good </li></ul></ul>
    13. 13. Misconception <ul><li>It’s about getting a picture of best practice. </li></ul><ul><li>No-one is trying to say that everything is as good as in the best stories. </li></ul>☻
    14. 14. The MSC process : which changes exactly? <ul><li>changes within volunteers, changes in individuals, communities, organisations, anything else! </li></ul><ul><li>changes in people's behaviour, or a significant improvement in a town, anything! </li></ul><ul><li>about half to one page of text. </li></ul><ul><li>reject “stories” which are lists of achievements like in standard reports. </li></ul><ul><li>explain </li></ul><ul><ul><li>Who benefited </li></ul></ul><ul><ul><ul><li>“ me!” or: “our volunteer!” or: &quot;male teacher, about 30 years old“ or “school in xyz” </li></ul></ul></ul><ul><ul><li>When </li></ul></ul><ul><ul><li>How – what lead to what? </li></ul></ul><ul><ul><li>What was the change </li></ul></ul><ul><ul><li>Why the change is significant </li></ul></ul>
    15. 15. The MSC selection process volunteers Vol 1 Vol 2 Vol 3 IPOs Vol 1 Vol 2 Vol 3 others Vol 1 Vol 2 Vol 3 Main group
    16. 16. The MSC process : Select ing the best ones <ul><li>Select the best 2 stories, that is, the stories of the changes you consider most significant. </li></ul><ul><li>Add one paragraph to each story </li></ul><ul><ul><li>saying WHY you consider it most significant. </li></ul></ul><ul><ul><li>HOW TYPICAL the story is. </li></ul></ul>
    17. 17. What significant changes? How?
    18. 18. How does RI / SI happen in our work? <ul><li>Yes </li></ul><ul><ul><li>Friendships 7, cooperation on regional 5, walls of ignorance, getting comms closer, xborder networking 7 </li></ul></ul><ul><li>No </li></ul><ul><ul><li>Long-term cooperation, broader </li></ul></ul><ul><ul><li>Preventing risk of incoherent approaches?? </li></ul></ul><ul><ul><li>Getting communities closer – 3 – takes time </li></ul></ul><ul><ul><li>EU integration – 3 – nigdje veze </li></ul></ul><ul><ul><li>Sustainability 2 </li></ul></ul><ul><li>Yes </li></ul><ul><ul><li>Education x3 in village school, experience, equal opportunites x5 – access to services </li></ul></ul><ul><ul><li>Income </li></ul></ul><ul><ul><li>Youth – edu, employment, </li></ul></ul><ul><ul><li>Breaking down ignorance </li></ul></ul><ul><ul><li>Groups excluded / at risk of … </li></ul></ul><ul><ul><li>… sexual minorities, blind … </li></ul></ul><ul><li>No </li></ul><ul><ul><li>groups on margins x2 except students </li></ul></ul><ul><ul><li>Access to education? Which? Formal/informal </li></ul></ul><ul><ul><li>Policy x3 </li></ul></ul><ul><ul><li>Job and income </li></ul></ul>
    19. 19. Analysis of work plans in same 3 groups
    20. 20. How do the MS changes relate to SI and RI
    21. 21. Regional integration Positive volunteer experience Volunteer placements capacity building of organisations breaking down prejudice Change agents - volunteers Activities O utcomes O verall G oals Social inclusion solidarity