"Assessing Outcomes in CGIAR: Practical Approaches and Methods" training by Burt Perrin for CGIAR Evaluation Community of Practice (ECOP), 2nd annual workshop 2014
Guidance Note on CGIAR Research Programs (CRPS) Commissioned Evaluations . Presentation by Sirkka Immonen to Evaluation Community of Practice participants, 2nd annual ECOP workshop, 2014
Independent evaluation of CGIAR Research Program on Policies, Institutions and Markets (PIM): Brief summary of findings, conclusions and recommendations
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
David Fleming held a seminar on monitoring and evaluation in conflict-affected environments at the Post-war Reconstruction and Development Unit (PRDU), University of York.
Participatory Monitoring and Evaluation background, concepts and principles, goals of PM&E, the PM&E process, stakeholder analysis, PM&E framework, plan, worksheet, a case study using PM&E
"Assessing Outcomes in CGIAR: Practical Approaches and Methods" training by Burt Perrin for CGIAR Evaluation Community of Practice (ECOP), 2nd annual workshop 2014
Guidance Note on CGIAR Research Programs (CRPS) Commissioned Evaluations . Presentation by Sirkka Immonen to Evaluation Community of Practice participants, 2nd annual ECOP workshop, 2014
Independent evaluation of CGIAR Research Program on Policies, Institutions and Markets (PIM): Brief summary of findings, conclusions and recommendations
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
David Fleming held a seminar on monitoring and evaluation in conflict-affected environments at the Post-war Reconstruction and Development Unit (PRDU), University of York.
Participatory Monitoring and Evaluation background, concepts and principles, goals of PM&E, the PM&E process, stakeholder analysis, PM&E framework, plan, worksheet, a case study using PM&E
Using case-based methods to assess scalability and sustainability: Lessons fr...Barb Knittel
Overview of the SC4CCM project and end-line evaluation questions focused on scalability and sustainability. Methodological approaches including case selection strategies, mixed method approaches, within-case and cross-case analysis processes. (Sangeeta Mookherji, GWU)
Monitoring is the continuous collection of data and information on specified indicators to assess the implementation of a development intervention in relation to activity schedules and expenditure of allocated funds, and progress and achievements in relation to its intended outcome.
Evaluation is the periodic assessment of the design implementation, outcome, and impact of a development intervention. It should assess the relevance and achievement of the intended outcome, and implementation performance in terms of effectiveness and efficiency, and the nature, distribution, and sustainability of impact.
Training on Monitoring & Evaluation (M&E) of Adaptation and the NAP processNAP Events
Presented by: Timo Leiter & Julia Olivier
3c. Developing (sub)national adaptation M&E systems
Participants will be taken through a short training course on the basic steps of developing a national adaptation M&E system with specific reference to the process to formulate and implement NAPs. The training will be based on the guidebook “Developing national adaptation M&E systems” developed by GIZ in collaboration with the LEG and the Adaptation Committee.
Understanding change through training for gender equality maram barqawi-fullMaram Barqawi
Understanding Change through Training for Gender Equality Webinar was conducted in May 2017, aiming at measuring and understanding the expected change in Gender Equality due to training on different levels
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...SarahG_SS
Presentation at the OE Global Conference held in Banff, Canada in April 2015. This presentation introduces the development of the evaluation strategy, using Utilization Focused Evaluation (UFE), for the ROER4D Project (http://roer4d.org/).
You can access the abstract here: http://conference.oeconsortium.org/2015/presentation/developing-an-evaluation-strategy-to-gain-insights-into-a-multi-national-project-roer4d/
The role of Monitoring and Evaluation in Improving Public Policies – Challeng...UNDP Policy Centre
IPC-IG's Research Coordinator, Fábio Veras Soares, presentation at the "International Conference on the
Institutionalization of Public Policies Evaluation", held in Rabat, on 5 October.
PEG M&E tool: a tool for monitoring and reviewing Progress, Effectiveness & G...Tariq A. Deen
The session will provide details on: the tool developed by the LEG for monitoring and evaluating progress, effectiveness and gaps (PEG M&E tool) and its application in the process to formulate and implement NAPs; and the best practices for developing monitoring and evaluation (M&E) systems for adaptation at the national level. It will also look at the experiences of countries in developing and applying M&E systems at their national levels.
Presentation on Incorporating DRR issues into the WASH program of the Governm...Shakeb Nabi
This is a study conducted by NARRI (National Alliance for Risk Reduction and Response Initiatives to assess the current WASH program of the Government of Bangladesh and how Disaster Risk Reduction can be incorporated into the same.
The project is being funded by European Commission Humanitarian Aid and Civil Protection. For further information please contact Shakeb Nabi (nabi.shakeb@gmail.com). Please also visit our website www.narri-bd.org
we also post lots of interesting stuffs on DRR on our facebook (NARRI Bangladesh). We encourage you to become member of the same
This Data for Impact webinar took place October 29, 2020. Learn more at https://www.data4impactproject.org/resources/webinars/use-of-routine-data-for-economic-evaluations/
University of Aberdeen and the International Maize and Wheat Improvement Center (CIMMYT) have been collaborating to use the CGIAR Research Program on Climate Change, Agriculture and Food Security (CCAFS) Mitigation Options Tool (CCAFS-MOT) to estimate greenhouse gas emissions from Indian farming and identifies cost-effective mitigation options. Sylvia Vetter has presented a poster with preliminary results of this project at EGU – European Geosciences Union General Assembly in Vienna in April 2016.
Authors: Sylvia Vetter, Diana Feliciano, Jon Hillier, Clare Stirling, Tek Bahdur, Pete Smith.
Presentation by Sophia Huyer, CCAFS Gender and Social Inclusion leader, at the webinar on climate change and agricultural development.
Watch the webinar recording: https://www.youtube.com/watch?v=aBGaXlBLmog
Using case-based methods to assess scalability and sustainability: Lessons fr...Barb Knittel
Overview of the SC4CCM project and end-line evaluation questions focused on scalability and sustainability. Methodological approaches including case selection strategies, mixed method approaches, within-case and cross-case analysis processes. (Sangeeta Mookherji, GWU)
Monitoring is the continuous collection of data and information on specified indicators to assess the implementation of a development intervention in relation to activity schedules and expenditure of allocated funds, and progress and achievements in relation to its intended outcome.
Evaluation is the periodic assessment of the design implementation, outcome, and impact of a development intervention. It should assess the relevance and achievement of the intended outcome, and implementation performance in terms of effectiveness and efficiency, and the nature, distribution, and sustainability of impact.
Training on Monitoring & Evaluation (M&E) of Adaptation and the NAP processNAP Events
Presented by: Timo Leiter & Julia Olivier
3c. Developing (sub)national adaptation M&E systems
Participants will be taken through a short training course on the basic steps of developing a national adaptation M&E system with specific reference to the process to formulate and implement NAPs. The training will be based on the guidebook “Developing national adaptation M&E systems” developed by GIZ in collaboration with the LEG and the Adaptation Committee.
Understanding change through training for gender equality maram barqawi-fullMaram Barqawi
Understanding Change through Training for Gender Equality Webinar was conducted in May 2017, aiming at measuring and understanding the expected change in Gender Equality due to training on different levels
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...SarahG_SS
Presentation at the OE Global Conference held in Banff, Canada in April 2015. This presentation introduces the development of the evaluation strategy, using Utilization Focused Evaluation (UFE), for the ROER4D Project (http://roer4d.org/).
You can access the abstract here: http://conference.oeconsortium.org/2015/presentation/developing-an-evaluation-strategy-to-gain-insights-into-a-multi-national-project-roer4d/
The role of Monitoring and Evaluation in Improving Public Policies – Challeng...UNDP Policy Centre
IPC-IG's Research Coordinator, Fábio Veras Soares, presentation at the "International Conference on the
Institutionalization of Public Policies Evaluation", held in Rabat, on 5 October.
PEG M&E tool: a tool for monitoring and reviewing Progress, Effectiveness & G...Tariq A. Deen
The session will provide details on: the tool developed by the LEG for monitoring and evaluating progress, effectiveness and gaps (PEG M&E tool) and its application in the process to formulate and implement NAPs; and the best practices for developing monitoring and evaluation (M&E) systems for adaptation at the national level. It will also look at the experiences of countries in developing and applying M&E systems at their national levels.
Presentation on Incorporating DRR issues into the WASH program of the Governm...Shakeb Nabi
This is a study conducted by NARRI (National Alliance for Risk Reduction and Response Initiatives to assess the current WASH program of the Government of Bangladesh and how Disaster Risk Reduction can be incorporated into the same.
The project is being funded by European Commission Humanitarian Aid and Civil Protection. For further information please contact Shakeb Nabi (nabi.shakeb@gmail.com). Please also visit our website www.narri-bd.org
we also post lots of interesting stuffs on DRR on our facebook (NARRI Bangladesh). We encourage you to become member of the same
This Data for Impact webinar took place October 29, 2020. Learn more at https://www.data4impactproject.org/resources/webinars/use-of-routine-data-for-economic-evaluations/
University of Aberdeen and the International Maize and Wheat Improvement Center (CIMMYT) have been collaborating to use the CGIAR Research Program on Climate Change, Agriculture and Food Security (CCAFS) Mitigation Options Tool (CCAFS-MOT) to estimate greenhouse gas emissions from Indian farming and identifies cost-effective mitigation options. Sylvia Vetter has presented a poster with preliminary results of this project at EGU – European Geosciences Union General Assembly in Vienna in April 2016.
Authors: Sylvia Vetter, Diana Feliciano, Jon Hillier, Clare Stirling, Tek Bahdur, Pete Smith.
Presentation by Sophia Huyer, CCAFS Gender and Social Inclusion leader, at the webinar on climate change and agricultural development.
Watch the webinar recording: https://www.youtube.com/watch?v=aBGaXlBLmog
What role can the private sector play in climate smart smallholder agriculture in Africa? Presentation from Agriculture and Rural Development Day (ARDD) 2011
Presentación de Ana María Loboguerrero, Directora de CCAFS América Latina y Leida Mercado, Líder del Proyecto MAP-Noruega, en el marco del Lanzamiento de la Iniciativa CCAFS-CATIE en el Trifinio. Más información: http://bit.ly/1PjzGt7
Presentation by Pramod Aggarwal at the 3rd Global Science Conference on Climate-Smart Agriculture in Montpellier.
Read more: http://ccafs.cgiar.org/3rd-global-science-conference-%E2%80%9Cclimate-smart-agriculture-2015%E2%80%9D#.VRurLUesXX4
Analytical Tools To Assist Climate-Smart Agriculture Policy MakingCGIAR
Presented by Mark W. Rosegrant at GFIA 2015, Abu Dhabi, UAE.
Environment and Production Technology Division, IFPRI
Mark highlighted that CSA forces us to shifts the emphasis from policies that aim at a single targets to policies that have multiple objectives. He went on to underline that CSA changes the planning time horizon - policies and analyses necessarily span long time periods of 20-30 years. And that therefore CSA requires the use of integrated modeling frameworks that work at multiple geographical scales. And that given its complexity, importantly, CSA requires an even closer collaboration between policy makers and research community.
International Food Policy Research Institute (IFPRI) organized a three days Training Workshop on ‘Monitoring and Evaluation Methods’ on 10-12 March 2014 in New Delhi, India. The workshop is part of an IFAD grant to IFPRI to partner in the Monitoring and Evaluation component of the ongoing projects in the region. The three day workshop is intended to be a collaborative affair between project directors, M & E leaders and M & E experts. As part of the workshop, detailed interaction will take place on the evaluation routines involving sampling, questionnaire development, data collection and management techniques and production of an evaluation report. The workshop is designed to better understand the M & E needs of various projects that are at different stages of implementation. Both the generic issues involved in M & E programs as well as project specific needs will be addressed in the workshop. The objective of the workshop is to come up with a work plan for M & E domains in the IFAD projects and determine the possibilities of collaboration between IFPRI and project leaders.
A presentation by Nalini Takeshwar as part of the Cohort Research for Programme and Policy panel discussion at the International Symposium on Cohort and Longitudinal Studies in Developing Contexts, UNICEF Office of Research - Innocenti, Florence, Italy 13-15 October 2014
Provides insights into the result based planning process including result based matrix preparation that help to manage scarce resources to realize a better result.
Presentation by Charles Thrift, IISD, on "Measuring Progress" at the National Adaptation Plan (NAP) Global Network's Targeted Topics Forum in Lilongwe, Malawi, in February 2017.
Using case-based methods to assess scalability and sustainability: Lessons fr...JSI
Overview of the SC4CCM project and end-line evaluation questions focused on scalability and sustainability. Methodological approaches including case selection strategies, mixed method approaches, within-case and cross-case analysis processes. (Sangeeta Mookherji, GWU)
Planning the Evaluation
Impact models
Types of inference and choice of design
Defining the indicators and obtaining the data
Carrying out the evaluation
Disseminating evaluation findings
Working in large-scale evaluations
Organizational Capacity-Building Series - Session 6: Program EvaluationINGENAES
This session describes different kinds of program evaluations, and key evaluation considerations. These presentations are are part of a workshop series that was implemented in Nepal and 2016 as part of the INGENAES initiative.
The Accelerating Impact of CGIAR Climate Research for Africa (AICCRA) project works to deliver a climate-smart African future driven by science and innovation in agriculture.
AICCRA does this by enhancing access to climate information services and climate-smart agricultural technology to millions of smallholder farmers in Africa.
With better access to climate technology and advisory services—linked to information about effective response measures—farmers can better anticipate climate-related events and take preventative action that help communities better safeguard their livelihoods and the environment.
AICCRA is supported by a grant from the International Development Association (IDA) of the World Bank, which is used to enhance research and capacity-building activities by the CGIAR centers and initiatives as well as their partners in Africa.
About IDA: IDA helps the world’s poorest countries by providing grants and low to zero-interest loans for projects and programmes that boost economic growth, reduce poverty, and improve poor people’s lives.
IDA is one of the largest sources of assistance for the world’s 76 poorest countries, 39 of which are in Africa.
Annual IDA commitments have averaged about $21 billion over circa 2017-2020, with approximately 61 percent going to Africa.
This presentation was given on 27 October 2021 by Mengpin Ge, Global Climate Program Associate at WRI, during the webinar "Achieving NDC Ambition in Agriculture" organized by CCAFS, FAO and WRI.
Find the recording and more information here: https://bit.ly/AchievingNDCs
This presentation was given on 27 October 2021 by Sabrina Rose, Policy Consultant at CCAFS, during the webinar "Achieving NDC Ambition in Agriculture" organized by CCAFS, FAO and WRI.
Find the recording and more information here: https://bit.ly/AchievingNDCs
This presentation was given on 27 October 2021 by Krystal Crumpler, Climate Change and Agricultural Specialist at FAO, during the webinar "Achieving NDC Ambition in Agriculture" organized by CCAFS, FAO and WRI.
Find the recording and more information here: https://bit.ly/AchievingNDCs
This presentation was meant to be included in the 2021 CLIFF-GRADS Welcome Webinar and presented by Ciniro Costa Jr. (CCAFS).
The webinar recording can be found here: https://youtu.be/UoX6aoC4fhQ
The multilevel CSA monitoring set of standard core uptake and outcome indicators + expanded indicators linked to a rapid and reliable ICT based data collection instrument to systematically
assess and monitor:
- CSA Adoption/ Access to CIS
- CSA effects on food security and livelihoods household level)
- CSA effects on farm performance
Presented by Harsh Rajpal, Code Partners Pte. Ltd., on 30 June 2021 at the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presented by Ciniro Costa Jr., CCAFS, on 28 June 2021 at the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presented by Marion de Vries, Wageningen Livestock Research at Wageningen University, on 28 June 2021 at the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presented by Issac Emery, Informed Sustainability Consulting, on 29 June 2021 at the second day of the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presented by Hongmin Dong and Sha Wei, Chinese Academy of Agricultural Sciences (CAAS), on 28 June 2021 at the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presented by Lini Wollenberg, CCAFS, on 28 June 2021 at the Asian Development Bank (ADB) Webinar on Sustainable Protein Case Study: Outputs and Synthesis of Results.
Presentation by Han Soethoudt, Jan Broeze, and Heike Axmann of Wageningen University & Resaearch (WUR).
WUR and Olam Rice Nigeria conducted a controlled experiment in Nigeria in which mechanized rice harvesting and threshing were introduced on smallholder farms. The result of the study shows that mechanization considerably reduces losses, has a positive impact on farmers’ income, and the climate.
Learn more: https://www.wur.nl/en/news-wur/show-day/Mechanization-helps-Nigerian-farms-reduce-food-loss-and-increase-income.htm
Presentation on the rapid evidence review findings and key take away messages.
Current evidence for biodiversity and agriculture to achieve and bridging gaps in research and investment to reach multiple global goals.
This presentation was given at an internal workshop in April 2020 and was presented by Le Hoang Anh, Hoang Thi Thien Huong, Le Thi Thanh Huyen, and Nguyen Thi Lien Huong.
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
As Europe's leading economic powerhouse and the fourth-largest hashtag#economy globally, Germany stands at the forefront of innovation and industrial might. Renowned for its precision engineering and high-tech sectors, Germany's economic structure is heavily supported by a robust service industry, accounting for approximately 68% of its GDP. This economic clout and strategic geopolitical stance position Germany as a focal point in the global cyber threat landscape.
In the face of escalating global tensions, particularly those emanating from geopolitical disputes with nations like hashtag#Russia and hashtag#China, hashtag#Germany has witnessed a significant uptick in targeted cyber operations. Our analysis indicates a marked increase in hashtag#cyberattack sophistication aimed at critical infrastructure and key industrial sectors. These attacks range from ransomware campaigns to hashtag#AdvancedPersistentThreats (hashtag#APTs), threatening national security and business integrity.
🔑 Key findings include:
🔍 Increased frequency and complexity of cyber threats.
🔍 Escalation of state-sponsored and criminally motivated cyber operations.
🔍 Active dark web exchanges of malicious tools and tactics.
Our comprehensive report delves into these challenges, using a blend of open-source and proprietary data collection techniques. By monitoring activity on critical networks and analyzing attack patterns, our team provides a detailed overview of the threats facing German entities.
This report aims to equip stakeholders across public and private sectors with the knowledge to enhance their defensive strategies, reduce exposure to cyber risks, and reinforce Germany's resilience against cyber threats.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
Adjusting primitives for graph : SHORT REPORT / NOTES
Evidence On Trial: weighing the value of evidence in academic enquiry, policy and everyday life
1. Evidence On Trial: weighing the value of
evidence in academic enquiry, policy and
everyday life
CCAFS outcomes and targets
Tonya Schuetz, Philip Thornton, Wiebke Foerch
Durham 11 July 2016
3. CGIAR,
a global partnership that unites organizations
engaged in research for a food secure future
Background
FTA MAIZE Fish WHEAT PIM A4NH
RICE Livestock RTB DCLAS CCAFS WLE
5. 4. Climate information services
and climate-informed safety
nets
1. Policies and institutions for
climate-resilient food systems
2. Climate smart
technologies,
practices, and
portfolios
Background - Flagship Programs
6. • Large bodies of work (e.g. US$1.5 million)
• Source of funds: any kind
• Single or Multiple Centers/Partners
• Single or Multiple Regions or Global
• Key feature: fits into an impact pathway
Projects
Background – Regional Programs
7. Theory of Change & Impact Pathways – why?
• Bring in focus on people +
outcomes, i.e. behavioral changes,
+ unanticipated changes +
incentives for change
• Ensure that CCAFS plan of work is
targeted at outcomes, requires ‘use
of outputs’ tasks built into each
activity plan
• Strategically encourage
communication and collaboration,
and improved work plans through
harmonizing IPs
• Revisit trajectory of CCAFS
contributions to change and use
them as foresight/ ex-ante impact
assessment – measure progress
towards change, adapted according
to learning
8. From output-focused supply-driven
(logframe approach) to outcome-
focused demand driven Theories of
Change over a two-year process (starting
from the regions):
• Harmonization achieved through
capacity building (beyond trainings: meetings
and frequent virtual communication) in all
flagships, regions and partners
• Built with partners & projects
• RBM first trialed on one Flagship
• Iterative planning process
for the CRP project portfolio
building
Creating our Theories of Change
• Set global flagships
• Regional priorities
• Calls for concepts
• Regional planning meetings
• Detailed project planning
9. • CCAFS operates across multiple sectors, scales, stakeholders
• Allowing for:
Structured linear thinking
and planning with
assumptions for how desired
changes can happen
Complex systems thinking:
flexibility to react according
to lessons and opportunities
arising during implementation
Research Development
Universities,
research
institutes,
bio-medical
facilities,
genetics etc.
UN,
development
NGOs,
philanthropic
foundations,
governments
Solutions
R4D: How were we supposed to do it?
R4D: What it looks like in practice:
Action
Research
Development
Leadership
Learning
Communications
Partnerships
Trust
Combination of ordered & complex systems
10. MEL theoretical framework
Results-based management
• Accountability for
outcomes: logical chain
• Emphasis on systematic, constructive looped learning from past
experiences and subsequent adaption -adaptive management
• Three thirds principle
engaging with partners to decide what needs to be done and how;
doing the actual research, often in partnership;
sharing results in appropriate formats and strengthening capacity of next users to
utilize the research to achieve outcomes and impact.
11. Examples
• Desk studies (e.g. current World Bank investment on
Climate Smart Agriculture)
• Third-party surveys (deforestation rates in CCAFS
regions)
• Other CGIAR/ CRP surveys (e.g. Climate Smart
Agriculture technologies adopted in CCAFS sites)
• Formal impact assessment and evaluation methods
incl. the ones conducted by independent units
• Project activities (CSA technologies adopted in other
sites, GHG emissions in a landscape, …)
• Other (emails, internal government documents, …)
What kind of “evidence” is needed?
Atproject,flagship,andregionallevel
Changesthroughtime–withbaselines
A lot of methodological development is needed to
make evaluation incl. Impact Assessments to be
adequate for TOC / IP approaches.
12. • Definition of an outcome: ‘use of the research by non-
research partners to develop new, or change, policies and
practices’, i.e. beyond new research designs, dissemination,
training and need to be 1000’ of farmers not involved in the
research
• Evaluation of ‘outcome case studies’
By Whom? 1/3 Internal (2) from Program Management Unit
(eliminated conflict of interest), 1/3 external (1) with experience
in a farmer organization, and 1/3 external (1) with >20 years in
R4D
Criteria for scoring: three criteria with different weights,
(a) quality/clarity of write up - 15%, (b) evidence - 20%,
and (c) significance of outcome - 65%.
Credibility of Outcomes
13. How to strengthen the Outcomes?
• Resubmission of outcomes from previous years shows how
these improve over time due to further scaling.
• Trend over four years (2012-15) of reported outcomes:
• improved quality & relevance for 2015, large jump in no.
• increase in % evaluated as ‘not yet outcomes’
• satisfactory no. of very good outcomes reported for 2015
• it would seem that a lot of valuable time went into
developing Outcome Case Studies which did not yet
meet the outcome criteria.
• seems worthwhile to remind of the criteria.
14. Contribution to some System Level Outcomes, which link with SDGs
CRP defined outcome indicators:
• for the flagship level 2030 and 2022
• Quantitative capturing of outcome target values combined with
• Qualitative narrative descriptions
What is CCAFS being held responsible for?
2 + 3
15equitable national/subnational food system
policies enacted that take into consideration climate
smart practices and strategies, informed using
knowledge, tools and approaches derived from CCAFS
science
1 + 2
10regional/global organisations inform their
equitable institutional investments in climate smart
food systems using CCAFS outputs.
20equitable
national/subnational
jurisdictions will have
increased institutional
investments in climate
smart food systems
2015 2016 2022 2030
Flagship 4: Policies and institutions for climate-resilient food systems
15. Understand ToC
Meaningful performance
expectations for results
(outputs, outcomes)
Measure results, assess
contribution of program to
observed outcomes
Report on performance
achieved against expectations
Practical mechanisms and
tools to ensure balanced
quantitative and qualitative
monitoring
A modular MEL system
CCAFS M&E
System
Modules
Harmoniza-
tion of IPs &
ToCs
Indicators &
Baselines
Reflective
Spaces and
Activities
Reporting
Assessment
& Bonus
allocation
Research
on
Institutional
Transfor-
mation
Process
16. • Planning Work & $$
• System/ donor Reports
• Synthesis at
Flagship level
• Synthesis at
Regional level
• Project Synthesis
• Project evaluation
• Deliverable ranking
• Project annual reporting
• Project annual planning
Program
Mgmt.
Unit
Flagship
Program
Leaders
Regional
Program
Leaders
Project
Leaders
Project SettingProject Setting PlanningPlanning ReportingReporting Synthesis & EvaluationsSynthesis & Evaluations
Process supported by an Online Platform
Iterative processes and built-in
• Looped learning
• System for adaptive management
• Project evaluation (traffic light)
• CRP mapped to outcome targets
• Modular MEL
Project Leaders
Wider system
CRP Managers
CCAFS M&E
System
Modules
Harmoniz
ation of
IPs &
ToCs
Indicators
&
Baselines
Reflective
Spaces
and
Activities
Reporting
Assessm
ent &
Bonus
allocation
Research
on
Institution
al
Transfor-
mation
17. Dynamic program and project,
planning and reporting modules
CoA
Technical features
• Open source
• Interoperable with
or linkage to other
data platforms
• Modular
18. MEL Support Pack
• To support strategy implementation through online platform
for different users
19. Incentives – readiness of a system
• The current CGIAR system’s incentive framework can be
improved to make R4D via a TOC/IP approach work
properly, including its financial system.
• A portfolio approach: in which some projects revolve much
more around science and others around engagement. Rarely will
projects do both. Key is that science and engagement are
happening within a regional or global conceptualized and
coordinated programmatic manner.
• Appropriate performance assessment required:
Evaluation needs to be consistent with different measures
required.
Challenges & Opportunities
20. • Complexity and harmonization – of different levels/scales involved:
System, Program, project, countries
• System level – operationalization of the Strategy and Results
Framework with a System MEL Framework and Monitoring Plan
• Donor demands – outcome delivery promise aspirational vs. R4D
reality
• Balancing act of quantitative and qualitative measuring of outcomes
• Results-based management for R4D - learning from the
development sector – yet there are no off-the-shelf solutions
• Accommodating negative outcomes and asking for those explicitly
• ....
Remaining Challenges
21. The “Evidencers”
(the results agenda)
Vs
“The Complexers”
(complex systems,
emergent
properties, messy)
Oxfam blog, “From Poverty to Power”
22. Key reference documents
• Schuetz, T, Förch, W, Thornton, P, Vasileiou, I. (accepted). Pathway to
Impact: Supporting and evaluating enabling environments for research for
development in Juha I. Uitto, Jyotsna Puri and Rob D. van den Berg, eds.
Evaluating Climate Change for Sustainable Development. Springer:
Dordrecht. Forthcoming in 2016.
• CCAFS Planning and Reporting online Platform, Learning Brief No. 16,
Nov. 2015
• CCAFS Reporting and Evaluation in a results-based management
framework, Learning Brief No.15, reporting cycle, Jul. 2015
• Report to CO on RBM Trial, planning cycle, Dec. 2014
• Lessons and Insights from the CCAFS Results-Based Management Trial,
RBM projects feedback/ experience, survey summary, Dec. 2014
• Lessons in theory of change from a series of regional workshops,
Learning Brief No. 11, Dec. 2014
• CCAFS Theory of Change Facilitation Guide, Dec. 2014
• CCAFS RBM MEL strategy, framework from Jul. 2014