Utilization focused evaluation: an introduction (Part 1 - ROER4D) SarahG_SS
Introductory slides on Utilization Focused Evaluation (UFE) that I presented to the ROER4D team (http://roer4d.org/) on 22 September 2014 as part of the project's evaluation process.
Module 7: Monitoring and Evaluation Dima course contentMichael Kenny
This 16 slide presentation Monitoring and Evaluation is Module 7 of a nine (9) module online course for adult education policy makers and practitioners to complement an innovative toolkit to guide adult education policy and practice.
Participation in adult education varies significantly across states and regions of Europe! Why? Evidence and literature suggests a wide disparity in policy making, programming and implementation skills in the adult education sector across Europe. It is imperative that policy makers and programme managers address this disparity to foster life-long learning for a smart-sustainable Europe (see EU2020 https://ec.europa.eu/info/business-economy-euro/economic-and-fiscal-policy-coordination/eu-economic-governance-monitoring-prevention-correction/european-semester/framework/europe-2020-strategy_en) and to achieve a European target of 15% of the adult population engaged in learning.
In response to this challenge, the ERASMUS+ DIMA project (See https://dima-project.eu/index.php/en/, 2015 to 2017) developed a practical 9 module online course to complement an innovative toolkit to guide adult education policy and practice. The DIMA toolkit (See https://dima-project.eu/index.php/en/toolkit) introduces tools for developing, implementing, and monitoring adult education policies, strategies, and practices.
Author: Michael Kenny and DIMA Project partners (https://dima-project.eu/index.php/en/partners)
Utilization focused evaluation: an introduction (Part 1 - ROER4D) SarahG_SS
Introductory slides on Utilization Focused Evaluation (UFE) that I presented to the ROER4D team (http://roer4d.org/) on 22 September 2014 as part of the project's evaluation process.
Module 7: Monitoring and Evaluation Dima course contentMichael Kenny
This 16 slide presentation Monitoring and Evaluation is Module 7 of a nine (9) module online course for adult education policy makers and practitioners to complement an innovative toolkit to guide adult education policy and practice.
Participation in adult education varies significantly across states and regions of Europe! Why? Evidence and literature suggests a wide disparity in policy making, programming and implementation skills in the adult education sector across Europe. It is imperative that policy makers and programme managers address this disparity to foster life-long learning for a smart-sustainable Europe (see EU2020 https://ec.europa.eu/info/business-economy-euro/economic-and-fiscal-policy-coordination/eu-economic-governance-monitoring-prevention-correction/european-semester/framework/europe-2020-strategy_en) and to achieve a European target of 15% of the adult population engaged in learning.
In response to this challenge, the ERASMUS+ DIMA project (See https://dima-project.eu/index.php/en/, 2015 to 2017) developed a practical 9 module online course to complement an innovative toolkit to guide adult education policy and practice. The DIMA toolkit (See https://dima-project.eu/index.php/en/toolkit) introduces tools for developing, implementing, and monitoring adult education policies, strategies, and practices.
Author: Michael Kenny and DIMA Project partners (https://dima-project.eu/index.php/en/partners)
A series of modules on project cycle, planning and the logical framework, aimed at team leaders of international NGOs in developing countries.
Part 7 of 11.
There are two handouts to go with this module, Population Indicators, and a Logframe with blanks. http://www.slideshare.net/Makewa/population-indicators-handout and http://www.slideshare.net/Makewa/exercise-watsan-logframe-with-blanks
Presentation by Michael Richards. The presentation shows the necessary steps in conducting a social and biodiversity impact assessment (SBIA) for REDD projects.
A series of modules on project cycle, planning and the logical framework, aimed at team leaders of international NGOs in developing countries.
Part 7 of 11.
There are two handouts to go with this module, Population Indicators, and a Logframe with blanks. http://www.slideshare.net/Makewa/population-indicators-handout and http://www.slideshare.net/Makewa/exercise-watsan-logframe-with-blanks
Presentation by Michael Richards. The presentation shows the necessary steps in conducting a social and biodiversity impact assessment (SBIA) for REDD projects.
Presentation by Florence Bernard and Slayde Hawkins.
PES may be prohibited by Constitution or law. This presentation discusses how policy may affect the implementation of PES and REDD projects.
Workshop slides from the Climate Change and Midwest Agriculture: Impacts, Challenges, & Opportunities workshop held by the USDA Midwest Climate Hub on March 1-2, 2016.
Presentation by Beria Leimona, Rachman Pasha, Tony Setiawan, Suyanto, and Bruno Verbist. This is a case study of a RUPES Project at Sumberjaya Watershed, Lampung Province, Indonesia.
Presented by Michael Richards and Sara Namirembe. This presentation provides examples of places where payments for environmental services (PES) have been implemented.
Presentation by Trevor Sandwith, The Nature Conservancy (TNC) at Forest Day 3, 13 December 2009, Copenhagen. Learning event "Landscape approaches to Adaptation and Mitigation"
A method for planning and assessing the social effects and internal performance of projects, programs, and organizations.“A project should see itself as a part of an interconnected web of actors, factors and relationships” (Sarah Earl, 2008 IDRC)
Presentation by Simon Batchelor (IDS) on Theory of Change and Outcome mapping methodologies for intermediary work, given at a virtual workshop on M&E for I-K-Mediary Network members, March 30 2010.
A series of modules on project cycle, planning and the logical framework, aimed at team leaders of international NGOs in developing countries. (Part 3 of 11)
There are two handouts to go with this presentation,
- the Project Planning slides as a handout: http://www.slideshare.net/Makewa/3-proj-plan-handouts
- Project Management Terms: http://www.slideshare.net/Makewa/project-management-terms,
& the Project Planning Presenter Notes: http://www.slideshare.net/Makewa/3-proj-plan-notes
Presentation by the Jane Goodall Institute. The goal of this project is to reduce deforestation and forest degradation within the Budongo-Bugoma corridor (BBC) by at least half by building awareness, capacity and governance mechanisms for private forest owners and community groups to access carbon payments and benefit from REDD based global approaches to climate change mitigation.
Presentation by Tuyeni Mwampamba. The presentation discusses data collection, analysis and reporting in Social and Biodiversity Impact Assessment (SBIA) for REDD projects.
2. Broad definition - OM focuses on immediate changes the project wishes to initiate or establish… Changes to influence realization of desired impacts - Outcomes = transformation in behaviour, relationships, activities, actions of people, groups, and organizations that program targets - OM thus = a way or an approach to project planning, monitoring and evaluation that maps, supports the development of and captures desired outcomes (changes) as they unfold
3.
4. Why the OM approach? - From research to adoption, outcomes and impacts … team … How far should a research team stretch and work to achieve objectives?
5. Why the OM approach? - No one delivers outcomes alone. In all R & D efforts many other players and events play key roles… Researchers testing and adoption Adaptation and wider scaling problem identification, exploring solutions Working partnerships
6. What is unique? - OM requires engagement with partners in relationships that support behavioural transformation leading to outcomes indicating progress towards impact OM does not focus on ATTRIBUTION and IMPACT!!!
8. Other approaches Other multi-stakeholder P, M & E Processes: - Results-based Management - Learning Systems Methodology - Soft Systems Methodology - Participatory Learning and Action - Participatory Rural Appraisal - Rapid Appraisal of Agricultural Knowledge Systems Karin Verstralen, September 2005 - Logical Framework Analysis
9. Other approaches Log frame analysis Narrative Summary Verifiable Indicators Means of Verification Important Assumptions Defines project structure, distinguishing between Activities, Inputs, Outputs, Purpose and Goal Emphasis on value of indicators of achievement. Subject to measurement, or qualitative judgement, or both How and from what sources of information each indicator (VI) will be quantified or assessed. Consider practicality and cost Important assumptions on which the success of the project depends . Risks considered
10. Other approaches Log frame analysis Longer term changes in people or organisations (using the immediate project outputs), or changes in others they have subsequently interacted with LFA Goals and Outcomes Large-scale ultimate development changes (economic, political, social or environmental) which the program hopes to contribute. Described in form of (ideal) behaviour of actors in the system OM Vision
11. Other approaches Log frame analysis Changes in people, organisations who have used those project outputs (goods or services) . Project hopes to influence these (and learn about how it can have influence) LFA Purpose level changes (outcomes) Outcome Challenge: The ultimate, most ideal change as result of project actvities. Progress Markers: Gradual, transformational change, starting from what current situation. OM Challenges and Progress markers
12.
13. Other approaches Log frame analysis Some misgivings about LFA Long, complex, unreadable sentences Result of compromises between different parties negotiating the contents of the LFA. Sometimes the result of people not knowing that the whole story does not need to be told in one sentence Narrative statements without people in them, e.g "Rice productivity increased" Unreadable, ... Somehow People left out. Lots of abstract and disembodied processes.
14. Other approaches Log frame analysis Some misgivings about LFA Insistence on only ONE Purpose level statement ONE Purpose and One Goal pushes a very linear model of reality . It does not even allow for any parallel but convergent events