International Food Policy Research Institute (IFPRI) organized a three days Training Workshop on ‘Monitoring and Evaluation Methods’ on 10-12 March 2014 in New Delhi, India. The workshop is part of an IFAD grant to IFPRI to partner in the Monitoring and Evaluation component of the ongoing projects in the region. The three day workshop is intended to be a collaborative affair between project directors, M & E leaders and M & E experts. As part of the workshop, detailed interaction will take place on the evaluation routines involving sampling, questionnaire development, data collection and management techniques and production of an evaluation report. The workshop is designed to better understand the M & E needs of various projects that are at different stages of implementation. Both the generic issues involved in M & E programs as well as project specific needs will be addressed in the workshop. The objective of the workshop is to come up with a work plan for M & E domains in the IFAD projects and determine the possibilities of collaboration between IFPRI and project leaders.
Developing a web-based monitoring and evaluation system: Crop Goat Project in...ILRI
Presentation by Pamela Pali, Harrison Rware, Carlos Quiros, Titus Karanja, Joseph Gatheru Mugo, Nicholas Ndiwa and Jane Poole at an internal seminar by the Poverty, Gender and Impact Unit and the Research Methods Group of the International Livestock Research Institute (ILRI), Nairobi, Kenya, 4 October 2012.
Annual Results and Impact Evaluation Workshop for RBF - Day Five - Simultaneo...RBFHealth
A presentation from the 2014 Annual Results and Impact Evaluation Workshop for RBF, held in Buenos Aires, Argentina.
Examples from Nigeria, Zambia and Zimbabwe.
Creating gendered monitoring, evaluation and learning indicators for the Live...ILRI
Presented by Michael M. Kidoido, Froukje Kruijssen and Alessandra Galie at the Livestock and Fish Gender Working Group Workshop and Planning Meeting, Addis Ababa, Ethiopia, 14-18 October 2013
Developing a web-based monitoring and evaluation system: Crop Goat Project in...ILRI
Presentation by Pamela Pali, Harrison Rware, Carlos Quiros, Titus Karanja, Joseph Gatheru Mugo, Nicholas Ndiwa and Jane Poole at an internal seminar by the Poverty, Gender and Impact Unit and the Research Methods Group of the International Livestock Research Institute (ILRI), Nairobi, Kenya, 4 October 2012.
Annual Results and Impact Evaluation Workshop for RBF - Day Five - Simultaneo...RBFHealth
A presentation from the 2014 Annual Results and Impact Evaluation Workshop for RBF, held in Buenos Aires, Argentina.
Examples from Nigeria, Zambia and Zimbabwe.
Creating gendered monitoring, evaluation and learning indicators for the Live...ILRI
Presented by Michael M. Kidoido, Froukje Kruijssen and Alessandra Galie at the Livestock and Fish Gender Working Group Workshop and Planning Meeting, Addis Ababa, Ethiopia, 14-18 October 2013
Build Your NGO: Monitoring & Evaluation Allie Hoffman
The presentation attached is designed for grassroots NGOs wanting to learn more about monitoring and evaluation.
The presentation is a mini 'how to', in addition to providing an overview of strategic planning
To learn more or with any direct questions, please visit our website: www.thepariproject.com
Presentation on Incorporating DRR issues into the WASH program of the Governm...Shakeb Nabi
This is a study conducted by NARRI (National Alliance for Risk Reduction and Response Initiatives to assess the current WASH program of the Government of Bangladesh and how Disaster Risk Reduction can be incorporated into the same.
The project is being funded by European Commission Humanitarian Aid and Civil Protection. For further information please contact Shakeb Nabi (nabi.shakeb@gmail.com). Please also visit our website www.narri-bd.org
we also post lots of interesting stuffs on DRR on our facebook (NARRI Bangladesh). We encourage you to become member of the same
A Data Centric Approach to Driving Supply Chain Efficiency in IndonesiaJSI
This poster was presented by Hery Firdaus and Bethany Saad at the International Conference on Family Planning (ICFP) in Kigali, Rwanda in November 2018.
Over the past decade, Indonesia’s contraceptive prevalence rate has remained stagnant, to reinvigorate family planning services in Indonesia The National Population & Family Planning Board (BKKBN) is working to ensure that women can choose from a variety of contraceptive methods as part of a “Right Method, Right Time, My Choice” strategy. One challenge to this strategy is inconsistent access to the full range of contraceptives, especially long acting contraceptives, at service delivery points (SDP).
Having a reliable, responsive supply chain that delivers quality contraceptives to service delivery points when and where they are needed is critical to ensuring the success of this strategy. JSI Research & Training Institute, Inc. (JSI) as part of the My Choice Project has been working with BKKBN to address the supply chain challenges.
Can contraceptive availability be improved by strengthening organizational supply chain capacity, multi-level collaboration, and data visibility and use? To achieve this the intervention package included
1) strengthening organizational capacity by redesigning standard processes and developing training tools such as video tutorials and mobile apps
2) improved multi-level collaboration through quality improvement techniques, mentorship, and on-the-job training and
3) improving data visibility, quality, and use through accurate logistics records and reports, creating an inventory management and monitoring tool that facilitates easy decision making, guides stock distribution to maintain adequate stock levels, and monitors overall performance of the supply chain.
Preliminary end line evaluation results suggest that the intervention package has improved supply chain performance and reduced stock outs, especially in areas where the full package was implemented.
Presentation given at the USAID SQALE Symposium, Bridging the Quality Gap - Strengthening Quality Improvement in Community Health Services, by Prisca Muange on behalf of USAID Assist. http://usaidsqale.reachoutconsortium.org/
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
"A Common M&E Framework for CAADP" presentation by Sam Benin at the NEPAD, IFPRI, AGRA and World Bank Meeting to Align Efforts on Agricultural Policy and Knowledge Systems, Dakar, Senegal, January 6-7, 2009.
Measuring and Evaluating Reproductive Health Initiatives MEASURE Evaluation
This presentation provides an overview of the process of updating the Compendium of Indicators for Evaluating Reproductive Health Programs and what the final product will include.
Presentation by Rahija and Mtui at the 2016 AAPOR session on Monitoring data quality during fieldwork in international CAPI surveys. This was not presented at AAPOR although the speakers were part of the program.
Check out the 2013 GMC Yukon brochure provided by Sam Swope Buick GMC in Louisville, KY. To learn more about our current sales and incentives give us a call at 812-282-8285. http://www.samswopebuickgmcsouth.com/
Build Your NGO: Monitoring & Evaluation Allie Hoffman
The presentation attached is designed for grassroots NGOs wanting to learn more about monitoring and evaluation.
The presentation is a mini 'how to', in addition to providing an overview of strategic planning
To learn more or with any direct questions, please visit our website: www.thepariproject.com
Presentation on Incorporating DRR issues into the WASH program of the Governm...Shakeb Nabi
This is a study conducted by NARRI (National Alliance for Risk Reduction and Response Initiatives to assess the current WASH program of the Government of Bangladesh and how Disaster Risk Reduction can be incorporated into the same.
The project is being funded by European Commission Humanitarian Aid and Civil Protection. For further information please contact Shakeb Nabi (nabi.shakeb@gmail.com). Please also visit our website www.narri-bd.org
we also post lots of interesting stuffs on DRR on our facebook (NARRI Bangladesh). We encourage you to become member of the same
A Data Centric Approach to Driving Supply Chain Efficiency in IndonesiaJSI
This poster was presented by Hery Firdaus and Bethany Saad at the International Conference on Family Planning (ICFP) in Kigali, Rwanda in November 2018.
Over the past decade, Indonesia’s contraceptive prevalence rate has remained stagnant, to reinvigorate family planning services in Indonesia The National Population & Family Planning Board (BKKBN) is working to ensure that women can choose from a variety of contraceptive methods as part of a “Right Method, Right Time, My Choice” strategy. One challenge to this strategy is inconsistent access to the full range of contraceptives, especially long acting contraceptives, at service delivery points (SDP).
Having a reliable, responsive supply chain that delivers quality contraceptives to service delivery points when and where they are needed is critical to ensuring the success of this strategy. JSI Research & Training Institute, Inc. (JSI) as part of the My Choice Project has been working with BKKBN to address the supply chain challenges.
Can contraceptive availability be improved by strengthening organizational supply chain capacity, multi-level collaboration, and data visibility and use? To achieve this the intervention package included
1) strengthening organizational capacity by redesigning standard processes and developing training tools such as video tutorials and mobile apps
2) improved multi-level collaboration through quality improvement techniques, mentorship, and on-the-job training and
3) improving data visibility, quality, and use through accurate logistics records and reports, creating an inventory management and monitoring tool that facilitates easy decision making, guides stock distribution to maintain adequate stock levels, and monitors overall performance of the supply chain.
Preliminary end line evaluation results suggest that the intervention package has improved supply chain performance and reduced stock outs, especially in areas where the full package was implemented.
Presentation given at the USAID SQALE Symposium, Bridging the Quality Gap - Strengthening Quality Improvement in Community Health Services, by Prisca Muange on behalf of USAID Assist. http://usaidsqale.reachoutconsortium.org/
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
Agriculture Public Expenditure Workshop organized by the Strengthening National Comprehensive Agricultural Public Expenditure in Sub-Saharan Africa Program
Dar es Salaam, June 2013
Accra, Ghana, April 13-14, 2011
"A Common M&E Framework for CAADP" presentation by Sam Benin at the NEPAD, IFPRI, AGRA and World Bank Meeting to Align Efforts on Agricultural Policy and Knowledge Systems, Dakar, Senegal, January 6-7, 2009.
Measuring and Evaluating Reproductive Health Initiatives MEASURE Evaluation
This presentation provides an overview of the process of updating the Compendium of Indicators for Evaluating Reproductive Health Programs and what the final product will include.
Presentation by Rahija and Mtui at the 2016 AAPOR session on Monitoring data quality during fieldwork in international CAPI surveys. This was not presented at AAPOR although the speakers were part of the program.
Check out the 2013 GMC Yukon brochure provided by Sam Swope Buick GMC in Louisville, KY. To learn more about our current sales and incentives give us a call at 812-282-8285. http://www.samswopebuickgmcsouth.com/
Digital Product Design for NFC by Florian Resatsch and Daniel MichelisFlorian Resatsch
This presentation - held during the Smart University 2008 in Nice, Sophia-Antipolis - focuses on the design of Near Field Communication applications. The presentation helps practitioners in the field of NFC to design consumer-relevant Near Field Communication (NFC) products. It starts a creative process in the heads of listeners to broaden their mind into different aspects of NFC application development. Furthermore, a show a design strategy for NFC applications is proposed.
High quality information has a significant impact on improving hospital efficiency and patient satisfaction, as well as resolving patient disputes. In this paper, on the basis of the analysis of the research status of information quality and process performance, information quality is considered as an important contributory factor in improving patient throughput. A theoretical framework and main content are presented. Through the establishment of quantitative information, quality indicators such as correctness, timeliness and completeness, and the impact on process performance (registered queue length, waiting time, utilization of hospital facilities), together with the cost of the operating process, is analyzed from the theoretical aspect and then verified by simulation technology. Finally, the significance and feasibility of this study are clarified.
OpenEMIS - Open Source Education Management Information System OpenEMIS
OpenEMIS is a generic and Open Source Education Management Information System (EMIS) designed to collect and report data on education systems. The system was conceived by UNESCO and build by Community Systems Foundation to be easily and quickly customized to meet the specific needs of the educational systems of Member States.
The objective of OpenEMIS is to strengthen evidence-based education strategy and policy formulations in developing countries through the easy setup of an affordable, comprehensive and easy to use Education Management Information System.
This sector-wide tool intends to strengthen statistical information with a basic, agile and cost-effective EMIS which is easily adaptable to the needs of producers and users of education information. The flexibility of OpenEMIS allows for its use in a variety of situations in developing countries (Ministries of Education, Bureau of Statistics, administrative units at the regional, local and school levels).
OpenEMIS provides seamless integration with DevInfo, the database system endorsed by the United Nations for tracking country progress towards the Millennium Development Goals and other national priorities. As such, education data entered in OpenEMIS can be easily disseminated via tables, graphs and maps, which will provide decision-makers with key visualizations to quickly identify disparities and gaps.
International indicators of quality education wera paper draft.
Connections: The Learning Sciences Platform work is focus on:
- Educational Support “in situ”
- Professional Development
- Educational Research
This work is complemented with “in situ” accomplaniment and joint research.
Visit our social networks
- Website: http://thelearningsciences.com
- Facebook: https://www.facebook.com/connectionstlsp/
- Instagram: ConexionesPCA2017
- Slideshare: https://www.slideshare.net/Lascienciasdelaprendizaje
- YouTube: https://www.youtube.com/channel/UCyUDsQmjsiJl8T2w5-EF78g
- Linkedin: https://www.linkedin.com/company-beta/16212567/
Contact us:
E-mail: info@thelearningsciences.com
Mobile: +593 995 615 247
PEG M&E tool: a tool for monitoring and reviewing Progress, Effectiveness & G...Tariq A. Deen
The session will provide details on: the tool developed by the LEG for monitoring and evaluating progress, effectiveness and gaps (PEG M&E tool) and its application in the process to formulate and implement NAPs; and the best practices for developing monitoring and evaluation (M&E) systems for adaptation at the national level. It will also look at the experiences of countries in developing and applying M&E systems at their national levels.
PEG M&E tool: a tool for monitoring and reviewing Progress, Effectiveness & ...NAP Events
Presented by: Thinley Namgyel
8.3 Monitoring and evaluation
The session will provide details on: the tool developed by the LEG for monitoring and evaluating progress, effectiveness and gaps (PEG M&E tool) and its application in the process to formulate and implement NAPs; and the best practices for developing monitoring and evaluation (M&E) systems for adaptation at the national level. It will also look at the experiences of countries in developing and applying M&E systems at their national levels.
Using case-based methods to assess scalability and sustainability: Lessons fr...JSI
Overview of the SC4CCM project and end-line evaluation questions focused on scalability and sustainability. Methodological approaches including case selection strategies, mixed method approaches, within-case and cross-case analysis processes. (Sangeeta Mookherji, GWU)
The International Food Policy Research Institute – South Asia Regional Office (IFPRI-SAR) has extensively worked in Nepal on a wide range of policy issues in collaboration with the Ministry of Agriculture and Livestock Development, Government of Nepal. The key outputs from this engagement have been published in a book, Agricultural Transformation in Nepal: Trends, Prospects and Policy Options. The book addresses some of the key strategic agricultural policy questions on major contemporary developments and emerging challenges in Nepal. The book also covers on issues leading to the changing role of agriculture with economic growth, structural transformation and poverty reduction, improvement in nutritional outcomes, as well as challenges of tackling climate change.
IFPRI South Asia researchers Devesh Roy, Ruchira Boss, Mamata Pradhan and Manmeet Ajmani presented ‘Understanding the landscape of pulse policy in India and implications for trade’ to the Global Pulse Federation. The paper examines Indian policy around production, consumption and trade. The need for pulse trade policy in India to be supportive of Domestic priorities focused on serving interest of both India’s farmers and consumers.
More from International Food Policy Research Institute- South Asia Office (20)
Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.
Opendatabay - Open Data Marketplace.pptxOpendatabay
Opendatabay.com unlocks the power of data for everyone. Open Data Marketplace fosters a collaborative hub for data enthusiasts to explore, share, and contribute to a vast collection of datasets.
First ever open hub for data enthusiasts to collaborate and innovate. A platform to explore, share, and contribute to a vast collection of datasets. Through robust quality control and innovative technologies like blockchain verification, opendatabay ensures the authenticity and reliability of datasets, empowering users to make data-driven decisions with confidence. Leverage cutting-edge AI technologies to enhance the data exploration, analysis, and discovery experience.
From intelligent search and recommendations to automated data productisation and quotation, Opendatabay AI-driven features streamline the data workflow. Finding the data you need shouldn't be a complex. Opendatabay simplifies the data acquisition process with an intuitive interface and robust search tools. Effortlessly explore, discover, and access the data you need, allowing you to focus on extracting valuable insights. Opendatabay breaks new ground with a dedicated, AI-generated, synthetic datasets.
Leverage these privacy-preserving datasets for training and testing AI models without compromising sensitive information. Opendatabay prioritizes transparency by providing detailed metadata, provenance information, and usage guidelines for each dataset, ensuring users have a comprehensive understanding of the data they're working with. By leveraging a powerful combination of distributed ledger technology and rigorous third-party audits Opendatabay ensures the authenticity and reliability of every dataset. Security is at the core of Opendatabay. Marketplace implements stringent security measures, including encryption, access controls, and regular vulnerability assessments, to safeguard your data and protect your privacy.
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
Explore our comprehensive data analysis project presentation on predicting product ad campaign performance. Learn how data-driven insights can optimize your marketing strategies and enhance campaign effectiveness. Perfect for professionals and students looking to understand the power of data analysis in advertising. for more details visit: https://bostoninstituteofanalytics.org/data-science-and-artificial-intelligence/
2. 2
Management Information System (MIS)
• System -provides information at any point in the life of the project –
both past and present, or up-to date information for taking project
initiatives, and for corrective actions.
• Information in the MIS comprise both M&E information, and
information regarding the context of the project area-critical for
effective operation of the project.
3. 3
Basic Components of the MIS (Other elements used to the extent
employed in M&E)
• Basic Statistics
• M&E Information based on Component wise Results Indicators
• Financial Information System
• Information on Production and Price
• Information on Public and Private Service Providers
• Information on Markets
• Information on Training Institutes and Research Stations
• Information on Innovations and Technologies
• Information on Wholesalers, Exporters and Transporters
• Process Documentation, etc…
4. Core philosophy and rationale of M&E
• Shift focus from activities and outputs to higher level results
(outcomes and impact)
5. 5
Broad steps for setting up the M&E system
• M&E stakeholders workshop for review and revision of the Logframe
• Preparation of the M&E Plan
• Train staff on RIMS and Baseline Survey
• Conduct RIMS and Baseline Survey
• Prepare the Results Based AWPB (Annual work plan and Budgeting)
• Prepare and test Input-Output monitoring forms
• Ensure that the M&E system is manually up and running & capable of generating reports
• Establish data base for other information areas for the entire MIS
• Computerize the system and test the system
• Enter data regularly, generate reports and use it for learning and decision-making
6. Key Steps in Setting Up an M&E System and Preparing
the M&E Plan
1. Establish the Purpose and Scope;
2. Identify performance questions, stakeholders’ information
needs, and indicators;
3. Define information collection tools, methodologies,
frequencies, and responsibilities;
4. Planning for data processing and analysis;
5. Planning for quality communication, information sharing,
and reporting arrangements;
6. Planning for critical reflection and learning events;
7. Key Elements of an M&E Plan (1)
• Purpose & Scope
• Project overview and objectives
• Rationale for M&E system design
• How the system will support project management and its
partners
• How the system will meet reporting requirements
• Discussion of extent of participation of stakeholders
• Approach
• Overview of how stakeholders will be involved (project
team members at various level, implementing partners,
beneficiaries, external resources…)
• What information gathering and analyzing methods will be
used
8. Key Elements of an M&E Plan (2)
• Performance questions, indicators, and related
information needs
• Define key questions to be answered to understand
whether the project is performing as planned and moving
towards desired objectives;
• Definition of target outcomes, indicators and related
information/data needs
• Baseline data requirement
• Assessment of stakeholders' information needs
9. Key Elements of an M&E Plan (4)
• Information Dissemination and Utilization
• Reporting (format, frequency, responsibilities)
• Communication strategy
• Events for performance review and critical reflections to inform
decision making
• How will the project follow up on M&E information and corrective
action
• Arrangements to support and provide information to external reviews
and evaluations (supervision missions, mid-term review/evaluation,
interim evaluation, completion assessment)
• M&E Work Plan and timing of Activities
• Monitoring of resources, activities an implementation for effective
operations
• Evaluation of outcomes and impact for guiding the project strategy
10. Key Elements of an M&E Plan (5)
• Establishment of Necessary Conditions and Capacities
• M&E organization
• Human resource needs: staff, incentives, external assistance required
• Capacity building plan for M&E: training, exposure, piloting
• Resource needs: equipment, vehicles, TA….
• M&E detailed budget
• Appendices
• Original and revised log frames
• List of proposed indicators
• Outline formats for data collection
• Outline formats for reporting
• Baseline survey questionnaire
• M&E work plan
11. 11
Monitoring & Evaluation ?
• Monitoring -continuous observation, reflection, and correction of
activities. Done frequently –at short time intervals
• Evaluation a similar exercise, where observations on CHANGE as a
result of project intervention (intended, unintended, positive and
negative) is compared over time (baseline, mid-term and end-of-
project), here lessons and best practices are also drawn to improve
present as well as future project design and management.
12. Monitoring and evaluation: Why?
Support project management with information needed for
decision making (management tool);
Provide information on project progress, results, and impacts;
Timely trend detection can prevent project failures and facilitate
necessary adjustment to project activities and strategy;
Incorporating “lessons learned” will facilitate improving
implementation and enhance chances of achieving desired
impact (learning tool);
Accountability for donor funds.
13. 13
M&E Tools in IFAD Projects
• Logical Framework
• Results and Impact Management System
• Results Based Annual Work Plan and Budget
• Annual Outcome Surveys
• Multidimensional Poverty Assessment Tool (MPAT)
14. RIMS: Aims and Objectives
Motivation/objective: Establish a comprehensive system for measuring and
reporting on the results and impact of IFAD supported country programmes
• Provides framework for systematic reporting by the projects to IFAD and by
IFAD to its governing bodies.
• Includes a menu of indicators used to measure and report on the
performance of IFAD projects – at activity, output and impact level.
• The menu provides a standardized list of indicators that could be applied
across all projects, and therefore can be aggregated.
• Standardized questionnaire- issue of flexibility in design and analysis??
15. Reporting in the context of RIMS
• More attention to impact management
• Core indicators, mandatory for all IFAD projects
• Selection of programme specific indicators from the RIMS universe
• Data on indicators reported to IFAD annually, periodically reviewed with IFAD HQ,
ICO or supervision teams
• Impact surveys required at baseline and completion
16. Variables measured through RIMS impact surveys
The “anchor” indicators:
• Household asset index
• Child malnutrition
• Female/ male literacy
• Access to safe water
• Access to improved sanitation
Others:
• Food insecurity (intensity and spread of hungry
seasons)
17. 17
RIMS Impact Indicators
MDG Indicators
Goal-1: Eradicate extreme poverty and
hunger
•Households with improvement in household
assets ownership index*
•Reduction in the prevalence of child
malnutrition*
Goal 2: Achieve universal primary
education
Number of Children completing
primary/secondary school (male/female)
Goal 3: Promote gender equality and
empower women
•Ratio of literate females to males
•Literacy rate (by gender)
Goal 6: Combat HIV/AIDS, malaria and
other diseases
Reduction in the incidence of infectious disease
(HIV/AIDS, malaria, tuberculosis)
Goal 7: Ensure environmental
sustainability
•People with access to improved sanitation
•People with sustainable access to an improved
source of water (drinking water)
18. From results to impact
1st LEVEL
RESULTS
[OUTPUTS]
2nd LEVEL
RESULTS
[OUTCOMES]
IMPACT
Measures financial and
physical progress
indicators
— outputs
Assesses effectiveness
and sustainability and/or
modified behaviour
— outcomes
Measures combined
effect of 1st and 2nd level
indicators
— goal
RIMS Reporting Impact Surveys
19. Executing RIMS from start-up to project completion
• Identify and agree on a list of indicators, including targets.
• Ensure that selected RIMS indicators are part of the M&E system.
• Monitor the indicators and report to IFAD annually.
• An annual record is to be submitted to IFAD with annual Progress reports
and reviewed by IFAD supervision missions.
• Conduct Baseline assessment at start-up and impact assessment at mid-
term and completion.
• RIMS Annual Outcome Surveys
20. Launching and implementing RIMS
• Project Logframe -reviewed to reflect RIMS indicators.
• IFAD and PMU to agree on a number of indicators for the 1st and
2nd level (along with appraisal targets and AWPB estimates)
• An annual record to be submitted to IFAD with annual Progress
report and reviewed by IFAD supervision missions.
21. Executing RIMS: survey software
Available in English, French, Spanish, Arabic
Reports:
All standard RIMS analyses embedded in software;
Reports produced in tables and graphs;
Child malnutrition measured against new WHO standards;
Relative wealth reports conducted;
All reports and all data can be exported to different
formats;
Follow up surveys can be compared
Manual available online
22. 22
Objective of M & E
To support managing for project results by focusing on improvement of project
performance by
• Tracking progress of project outcome (intermediate impacts) and Impact
based on data collected at baseline, mid-term and at the end-of-project;
• Quarterly, half-yearly and annual monitoring of achievement of project
outputs through the conversion of input to output against AWPB targets; and
• Reflecting, learning and taking actions to improve performance to achieve
results.
24. Background on RIMS: Some salient points
• Where suitable, household-centered indicators introduced to better measure project outreach.
• Rating-based approach for reporting 2nd level results. The ratings supported by a flexible mix of
evidence using qualitative and/or quantitative methods including RIMS 2nd level indicators.
• Projects to choose the most suitable method for measuring 2nd level results based on local context
and characteristics, including that of countries’ existing M&E systems.
• RIMS overall rationale, the guiding principles, features and concepts.
• how RIMS indicators should be selected.
• guidance on each first-level indicator including definitions and operational aspects related to
reporting. methodological issues that are common to several indicators.
• Guidance in formulating assessments of second level results (and includes RIMS second-level
indicators where appropriate).
• the reporting process, including sample report forms.
25. Measurement method
• New measurement approach for 2nd level results introduced.
• Achievement of 2nd level results measured by a rating scale.
A score of 1 corresponds to highly unsatisfactory
effectiveness or very weak sustainability. By contrast, a score
of 6 corresponds to highly satisfactory effectiveness or very
strong sustainability.
• Question to ask about the tradeoff between effectiveness
and sustainability (Union or intersection of the two markers)
26. Measurement issues
• Question- effectiveness and sustainability- union or intersection of
the two
• How does a moderate ranking (say 4) on sustainability or like it
follow? Rankings are ordinal or cardinal?
• Political economy internalized in sustainability?
• How to ensure objectivity in both effectiveness and sustainability?
28. Overview of RIMS First- and Second-Level Results
• Natural resources (land and water)
• Agricultural technologies and production
• Rural financial services
• Markets
• Rural enterprise development and employment
• Policy and community programming
• Social infrastructure
• Total outreach
29.
30. Use of RIMS level 1 and 2
• Comparing targets of 1st level results with actual achievement may lead to
an analysis of factors that positively or negatively affected project
implementation.
• The analysis of 2nd level results provides more in-depth information on the
changes occurred at the level of beneficiaries, households, communities or
institutions.
• E.g. After a training program on livestock veterinary practices, the small number of
trainees adopting the recommended techniques may highlight problems with the
training method like language problems or inaccessible locations.
• Taking into consideration these findings, project management may decide on training
in a different form or that another training service provider will be recruited.
31. RIMS indicator levels
• 1st level: Project outputs
Reported annually
• 2nd level: outcomes
Reported from mid-term onwards
• 3rd level: impact
At baseline and completion:
- Asset ownership
- Child nutrition
- Water, sanitation, housing, etc.
32. Definitions: First-Level Results (Outputs)
• Measure financial and physical progress, mostly quantitative
(numbers and percentages) and are generally planned and
implemented on annual basis.
• Measures of results at either the activity or output level of the
logframe.
33. Definitions: Second-Level Results
(outputs/outcomes)
• Measure improved functionality and/or behavioural change. They are
more qualitative and normally take longer to realise. Should they be
or there is scope or reason to alter this???
• This level corresponds to either the output or objective level of the
Project Logframe.
34. Definitions: Third-Level Results (impact)
• Measure the combined effect of the 1st and 2nd level results.
• quantitative and measured at specific point during project life.
• may refer to the goal level of the project logframe and in some case
to the objective level.
35. Frequently Asked Questions
• Does the list of first-level indicators replace the previous one?
• Yes. Compared to earlier few indicators have been added and the presentation has been reorganized. For
example, “people trained” has been replaced by people trained in natural resources management, people
trained in infrastructure management) or the training recipient (staff of service providers)
• What if RIMS first-level indicators do not cover all activities and outputs that are relevant for my project?
• The list of 1st level indicators cannot be comprehensive of all activities and outputs of all projects. Choose
only first-level indicators that are relevant to the project characteristics.
• Are there any compulsory first-level indicators?
• Yes. At least one indicator that shows the number of individuals and households that during the period
under review have received project services should be reported.
• Do all indicators under a given category need to be reported?
• No, the indicators have been categorized for ease of reference. For a given component, relevant indicators
may be found in any of the categories used in the Handbook.
• Should first level indicators continue to be reported on the RIMS form if they have been dropped?
• No, but the data collected may prove useful for the project M&E.
• What if there are no planned or appraisal target figures?
• If targets are not available, NA should be reported. However, planning for results is necessary for project
accountability and is an important element of the M&E system. The Logframe may need to be revised so
that indicators and appraisal targets are established.
36. 36
The Logframe Matrix
• Used to communicate key information about
project objectives, outcomes, outputs and
activities in a systematic and logical way.
• The basic Logframe matrix contains 4 columns
and 4 rows.
• Describes external factors that influence the
project’s success: assumptions and risks
37. 37
The Logical Framework Matrix
Objectives &
activities
Purpose/
(Outcome)
Goal
(Impact)
Outputs
Activities
Means
Indicators
Means of
verification
Assumptions
Cost
38. Key Elements of an M&E Plan (3)
• Data/Information Sources, Gathering Methods, and
Responsibilities
• How, who, when of data collection
• Data/Information Management Information System
(MIS)
• How, who, when of data storage, synthesis, and
aggregation
• Data/Information Processing and Analysis
• How, who, when of data analysis
39. FAQs: Continued
• Why is achievement of second-level results reported with a rating?
• Ratings introduced to allow projects to report achievement of 2nd level results by using project-specific indicators and any other
evidence available. Assessments allow information from other sources, in particular national systems. Ratings also align RIMS
with other evaluative instruments such as Project Completion Reports and formal evaluations.
• How about the risk that rating may be too subjective?
• Rating should be a realistic and candid assessment by as wide a group of stakeholders and may be validated during supervision
missions and project reviews.
• Who should rate the 2nd level results?
• Unless IFAD and project agree on a different arrangement, the rating of 2nd level results should be done by the project.
• When should second-level results be reported?
• 2nd level results should be reported after the Mid-Term Review. The rating should be updated annually based on new evidence.
2nd level results can be reported earlier if evidence is available.
• What are the implications of a low rating for a second-level result?
• A low rating does not imply that the project management is not committed to achieve the development objectives. Lower-than-
expected results should be used to identify corrective actions
• What if the M&E system does not include indicators for assessing RIMS second-level results?
• Outcome-level indicators need to be included in the project M&E system. Consider reviewing the project Logframe in the next
annual planning phase so that appropriate indicators can be included
40. Qualitative tools
1. Key Performance Questions
2. Knowledge, Attitude, Practice (KAP) Surveys
3. Most Significant Change (MSC)
4. Focus Group Discussions
5. Key Informant Interviews
41. FAQs: continued
• How is the supporting evidence for second level results submitted?
• When the RIMS form is submitted (normally an Excel file), the supporting evidence used
for assessing 2nd level results should be included in an additional worksheet or separate
text document(s).
• Clear indications of the methodology and source should be provided.
• The supporting evidence should be in summary form.
• Where studies or surveys have been carried, it is not necessary to submit the entire
study/survey but clearly reference these as source material.
• The evidence may include RIMS second level indicators which should be reported as
evidence under the relevant second level result.
• When should the RIMS form be sent to IFAD?
• The deadline for submission of the RIMS form is 31 March.
• To what period do RIMS results refer?
• RIMS results refer to the period of the Annual Work Plan and Budget (e.g. January to
December or July to June).
42. Challenges (from IFAD perspective)
Data quality problems:
Problems of double-counting of outputs
Data not produced timely (e.g. before
supervision missions)
Few credible data on outcomes and impact
43. Challenges and risks
RIMS surveys methodology not really adequate to
measure project impact:
No control/comparison group
Sample households are not necessarily project
beneficiaries
Food insecurity and child malnutrition measures
highly sensible to annual variations in food
production
Three malnutrition variables difficult to
interpret
44. RIMS First and Second level reporting
• First section of first level results
• First level results are reported annually
• AWPB target and actual result-km of roads target to be
constructed/rehabilitated and actual km of roads
completed/rehabilitated – Percentage of target met
• Second section of first level results
• Cumulative value of each indicator and comparison with the target
results reported in the Logframe or in the Appraisal documents.
46. Reporting of RIMS second level results
• Recall - Second-level results is reported on the basis of a rating scale from 1 to 6. A
score of 1 corresponds to highly unsatisfactory effectiveness or very weak
sustainability. A rating of 6 corresponds to highly satisfactory effectiveness or very
strong sustainability.
• The rating should be reported under the column of “actual” for the period under
review. No other value or number should be shown in the RIMS form for second-
level results. The section on cumulative and appraisal values does not apply to
RIMS second-level results.
• When the RIMS form is submitted (normally an Excel workbook), supporting
evidence used for the assessments should be included in an additional worksheet
or separate text document(s).
• Clear indications of the methodology and source should be provided. The
supporting evidence should be in summary form.
• RIMS second-level results should be provided at the time of Mid-term Review
(MTR). The ratings of RIMS second-level results should be updated every year on
the basis of the new data and evidence available.
47. Checklist for sending the RIMS form
• Clearly outlined in the RIMS manual - reminder about gold medal, silver medal and bronze
medal gaps
• Are first-level indicators reported in the appropriate units (number, hectares, kilometers,
etc.) as specified in the indicator charts?
• Where relevant, are sex-disaggregated figures reported or other stratification?
• For projects after PY2, are cumulative figures consistent with the data in the previous
years? Have figures for previous years been attached or entered on the spreadsheet?
• If revisions have been undertaken in the Logframe, are targets updated?
• Are the ratings for second-level results shown? Are ratings updated on the basis of the
new evidence and data available?
• Are papers with evidence and supporting indicators of second-level results attached?
48.
49. Challenges in reporting
• Your views!!!
• Is the format demanding – what project specific changes you would
recommend
• Is there an agency problem in reporting?