Monitoring and evaluation: setting the stage for improved impact
As demand for impact remains a challenge to many research organizations. Innovative approaches for assessing and utilizing impact information are being
sought. Understanding what successful utilization of feedback from impact looks like, and assessing the processes, are essential for strengthening the ability of research
programs to improve on practice, policies and strategies.
Muthoni. R(CIAT), Buruchara. R(CIAT), Solofohery P.(AMADEA), Kanenga. A(NARS DRC)
Improved Beans for the Developing World
Why we research on monitoring and evaluation? The dynamics for performance measurement Utilization of monitoring and evaluation results
in PABRA
There exists a constant demand for accountability both “upward” to
funding agencies and “downward” to participating stakeholders, Deliberate efforts were made to have monitoring and evaluation information
requiring documented evidence of impact on poverty alleviation. Measuring performance towards impacts in PABRA called for a reviewed by program partners for learning and application to ongoing
combination of two approaches. program objectives. Research assessed effective inclusive methods for
participatory evaluation proven to be particularly effective and efficient in
Monitoring and evaluation enables research programs to facilitating use of evaluation results. Research also involved stakeholders in
Accountability to partners. The linear goals and objectives pathways national institutions in the design and implementation of evaluations, which
improve their performance
characterized by input‐activities‐outputs‐outcomes were designed increased utilization on evaluation results. This is a new research area in
learn from experience
interactively with partners and mainstreamed in the program. Policy PABRA, looking at promoting use of monitoring and evaluation information to
track research and development outcomes
guidelines stating that members use the result‐based framework for advice practice, policies and strategies.
access information for decision making
regional and national planning, for developing annual work plans, and
for input‐output –outcome centered updates were mainstreamed. The
use of ‘indicators’ as a quick means to link evaluation with program
Use of evaluation evidence to advise strategies and policy making justifies
planning became common place in the management. Demand grew for
carrying out impact monitoring and evaluations.
additional resources and training.
The systems approach stemmed from the drive to generate
information and knowledge on which to base improvements. The
approach reviewed the interactions between the network of partners
Monitoring and evaluation in PABRA that interact at different levels. Interactions create opportunities and
dynamics that potentially motivate creation of effects and impacts.
PABRA applied monitoring and Assessments on interaction of partners and resulting effects and
evaluation for its benefits in managing impacts were carried out in the areas of delivery using the PABRA wider
performance measurement , improving impact approach, partnerships for seed systems; capacity building and
accountability, documenting impact, on local and regional bean trade.
using monitoring and evaluation
information to support decision making,
and involving key partners in validating
these processes in Participatory Developing strategy assessment tools
Monitoring and evaluation.
Participatory monitoring and evaluation Assessment tools for monitoring, evaluation and utilization of generated
allowed for active involvement of key information were designed collectively with partners and recommended
partners in the design, elicitation , to national and regional teams to guide monitoring, evaluation and National team of researchers reviewing documented project experiences and best practices
analysis and utilization of monitoring learning. They addressed the diversity of objectives in the PABRA program.
and evaluation information.
National partners were involved in designing
and implementing monitoring and evaluation
Exempt of a monitoring tool to assess a bean breeding related topic
Changes observed plans
Changes were observed at two levels with teams of national Baseline Information required Guiding questions (Sample Data Sources Tools, Methods Frequency for data Distribution of
Requirements for period questions that provide and techniques for collection Roles &
partners and PABRA scientists before project start up information on milestones for Data Collection Responsibilities
period under review) across
National Partners PABRA Scientists stakeholders
•Shared understanding of •Indicators of change guided
Indicator # 1 No. of available, 1.1 Quantitative Germplasm introduction and Researchers ‐ Reports from Seasonal National
the goals and objectives program management No. of micronutrient improved micronutrient Evaluation of the evaluation breeders, National partners Bi annually Breeders, &
•Critical inquiry embedded •Evaluation embedded in rich bean varieties rich bean varieties as at segregating populations What are the agro ecological pathologists Nutritionists,
identified and evaluated project start up. No. of men and women zones source of introduction, Farmers Interviews with key farmers.
in team work planning
by year 1. involved in trainings for the no. of entries in the National Bean informants
•Data used in decision •More effective evaluation Processes to be Participatory evaluations germplasm Program Coordinator
making •Stronger outcomes considered 1.2 Qualitative collected/introduced Participating Field journals for
Stakeholder Role of stakeholders Role of stakeholders in stakeholders staff
•Team owned monitoring •Data used in subsequent
involvement Perceptions of men and Participatory plant breeding ‐
and evaluation decision making Gender differentiation women farmers farmers, traders, seed Questionnaires
•Team valuing evaluation •Lessons learnt from program Levels of participation Gender differentiation in companies
•Improved monitoring and experiences Capacity building decision making
Consultative
evaluation practice •A clear plan for utilizing Workshops
lessons learnt from experience
developed
Supporting sustainability in monitoring and Exempt of a tool for facilitating utilization of information obtained from an evaluation study that National programs adapt tools for monitoring and
assessed the influx of improved bean varieties in the local bean markets evaluation for use beyond the bean‐related outputs
evaluation and outcomes .
Sustainability in monitoring and evaluation for partner institutions was Issues related Notable evaluation findings Suggested partner Suggested partner
ensured by carrying out research on institutionalization of monitoring and Topic to content recommendations options for each
evaluation and providing capacity building and advisory services. These specific to each finding finding
Breeding and Focus on a • Old improved bean varieties still dominate Purification of Purify landraces
were provided on the basis of the following guidelines; clarity on goals and
release of improved Breeding local bean markets. landraces / non‐ Produce
objectives amongst key stakeholders; reliable monitoring system that bean‐based strategy to • Evidence gathered from Malawi indicates released varieties sufficient seed
delivers progress information and analysis; review and improvements technologies improve that 80% of the marketed bean types are old Not adequate seed of and make seed
based on feedback; and effective program support functions. existing improved bean varieties, while new releases new varieties available
varieties contribute 12% to this cause. New varieties not Develop new
• Similar trends observed elsewhere in promoted varieties
Ethiopia. • Some varieties have building on
• Some varieties that dominate are as old as 20 good attributes but attributes of
years other’s are un existing ones
• Is there an issue with the old varieties that favorable
require them to be worked on?
Partners are involved in testing of developed tools for
adaptation to local contexts
Selected References
Njuki,J., & Muthoni,R. 2008. Participatory Monitoring and Evaluation for Institutional Learning and Community Empowerment. Poster presented in CIAT knowledge week . 2008
Ravnborg, H, M. 2000. Strengthening IFAD’s support to develop efficient and effective monitoring systems, A synthesis report. Rome: IFAD
Segone , M. 2008. Bridging the gap; The role of monitoring and evaluation in evidence-based policy making. The Evaluation working papers UNICEF
Preskill,H. 2008.Evaluation’s second act: A spotlight on learning. American Journal of Evaluation, 29(2),
Taylor-Powell,E., & Boyd,H.H. 2008. Evaluation Capacity building in complex organizations. In M.T. Braverman, e al, Program evaluation in a complex organizational system: Lessons
from cooperative extension. New Directions for Evaluation, 120,
Adapted from Ravnborg H.M.
2000
Four monitoring and evaluation guidelines and the basis for
sustainability
For additional information contact r.muthoni@cgiar.org