Monitoring and evaluation are important for public works programs to demonstrate results and accountability. Key goals include measuring income gains for workers and their households, skills acquired, and the utility of projects created. Evaluations assess processes, targeting, and impacts using descriptive, normative, and causal methods. Impact evaluations estimate net program effects using control or comparison groups to determine what outcomes would have been in the absence of the program. Careful planning is needed to identify valid comparison groups and measure appropriate indicators at different points over time.
Planning, monitoring & evaluation of health care programarijitkundu88
this presentation is for the basic idea of planning monitoring and evaluation of health care programs. the details steps of planning is covered. i hope it will help all the persons interested in public health and different health programs.
ReSAKSS-AfricaLead Workshop on Strengthening Capacity for Strategic Agricultural Policy and Investment Planning and Implementation in Africa
Safari Park Hotel, Nairobi, June 25th‐ 26th 2012
Planning, monitoring & evaluation of health care programarijitkundu88
this presentation is for the basic idea of planning monitoring and evaluation of health care programs. the details steps of planning is covered. i hope it will help all the persons interested in public health and different health programs.
ReSAKSS-AfricaLead Workshop on Strengthening Capacity for Strategic Agricultural Policy and Investment Planning and Implementation in Africa
Safari Park Hotel, Nairobi, June 25th‐ 26th 2012
The presentation is to train government and non-government planners to develop their skills for results-based planning and management for social sector programmes and projects.
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
A series of modules on project cycle, planning and the logical framework, aimed at team leaders of international NGOs in developing countries.
Part 7 of 11.
There are two handouts to go with this module, Population Indicators, and a Logframe with blanks. http://www.slideshare.net/Makewa/population-indicators-handout and http://www.slideshare.net/Makewa/exercise-watsan-logframe-with-blanks
Successful organizations are constantly monitoring, evaluating, and improving based off of their successes and failures. Learn how to design your own monitoring and evaluation program with this deck from WAN, and learn more on our free Strategic Advocacy Course, available at: http://worldanimal.net/our-programs/strategic-advocacy-course-new/about
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
The presentation is to train government and non-government planners to develop their skills for results-based planning and management for social sector programmes and projects.
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
A series of modules on project cycle, planning and the logical framework, aimed at team leaders of international NGOs in developing countries.
Part 7 of 11.
There are two handouts to go with this module, Population Indicators, and a Logframe with blanks. http://www.slideshare.net/Makewa/population-indicators-handout and http://www.slideshare.net/Makewa/exercise-watsan-logframe-with-blanks
Successful organizations are constantly monitoring, evaluating, and improving based off of their successes and failures. Learn how to design your own monitoring and evaluation program with this deck from WAN, and learn more on our free Strategic Advocacy Course, available at: http://worldanimal.net/our-programs/strategic-advocacy-course-new/about
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
Planning the Evaluation
Impact models
Types of inference and choice of design
Defining the indicators and obtaining the data
Carrying out the evaluation
Disseminating evaluation findings
Working in large-scale evaluations
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...OECD CFE
Presentation by Jonathan Potter, OECD LEED Senior Policy Analyst, and Stuart Thompson, OECD LEED Policy Analys, tat the seminar organised by the OECD LEED Trento Centre for the Officers of the Autonomous Province of Trento on 13 November 2015.
https://www.trento.oecd.org
During this masterclass, participants will delve into the fundamental concepts, tools, and techniques of project monitoring and evaluation. Through interactive discussions, case studies, and practical exercises, attendees will gain a comprehensive understanding of MEAL principles and their application in diverse project contexts.
Key Objectives
Understand the importance of project monitoring and evaluation in ensuring project success.
Learn how to develop and implement effective monitoring and evaluation frameworks.
Explore various data collection methods and analysis techniques for monitoring and evaluation purposes.
Gain insights into utilizing monitoring and evaluation findings to inform decision-making and improve project outcomes.
Learning Outcomes: By the end of the masterclass, participants will able to:
Define key concepts related to project monitoring and evaluation.
Develop a monitoring and evaluation plan tailored to specific project requirements.
Apply appropriate data collection methods and tools for monitoring and evaluation activities.
Utilize monitoring and evaluation findings to enhance project performance and impact.
Why Attend:
Enhance your professional skills: Acquire practical knowledge and skills in project monitoring and evaluation that can be applied across various sectors and industries.
Boost career prospects: Gain a competitive edge by adding project monitoring and evaluation expertise to your skill set, making you a valuable asset to organizations and employers.
Network with industry professionals: Connect with like-minded individuals, experts, and practitioners in the field of project management and evaluation, fostering valuable relationships and potential collaborations.
Stay updated with industry trends: Learn about the latest trends, best practices, and emerging technologies in project monitoring and evaluation, ensuring you stay ahead in your professional journey.
This presentation is all about the project Management which includes level of success of a project, Monitoring & evaluation, LFA in view of development sector. This presentation has been prepared in view of development/Social or Non-profit sector.
Note: Any kind of feedback from industry experts will always be appreciated.
While continuing the World Bank’s commitment to help countries reach the education Millennium Development Goals (MDGs), the new Education Strategy 2020 focuses on the goal of Learning for All. Learning for All means giving all people equitable opportunities to acquire the knowledge and skills they need to have healthy and satisfying lives, to be good citizens, and to be productive
contributors to their countries’ economic development.
The World Bank invited attendees of Women Deliver 2013 to join a conversation about using Results-Based Financing (RBF) approaches to improve access to health services and health outcomes for mothers, newborns and children in developing countries. The Health Results Innovation Trust Fund (HRITF) presented promising data that is starting to come in from its portfolio of RBF programs.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Epistemic Interaction - tuning interfaces to provide information for AI support
Labor Markets Core Course 2013: Monitoring and evaluation
1. 1
Monitoring and Evaluation
Laura B. Rawlings
Lead Social Protection Specialist
Human Development Network
World Bank
Labor Market Core Course
May 2013
2. 2
Objectives of this session
1. Monitoring and Evaluation – the Foundation
for Results
2. Using a RESULTS Chain
3. Measuring Results in PublicWorks Programs
4. Evaluations
o Process
o Targeting
o Impact
5. Conclusion - Moving Forward
3. Why are Monitoring and Evaluation
Important?
Credible evidence is the foundation for:
Results-based management
• Governments and managers are being judged by their programs’
performance, not their control of inputs
• Shift in focus
from inputs to outcomes
from threats to tools
Accountability and transparency
between government and civil society
between programs and beneficiaries
Knowledge generation on development
effectiveness
• Applied research, notably through impact evaluations, to determine whether
programs are reaching their intended outcomes
3
4. 4
EVALUATION MONITORING
Frequency: Periodic Regular, Continuous
Coverage: Selected programs, All programs
aspects
Data: Sample based Universal
Depth of Tailored, often Tracks implementation,
Information: to performance looks at WHAT
and impact/WHY
Cost: Can be high Cost spread out
Utility: Major program Continuous program
decisions improvement, management
5. 5
Objectives of this session
1. Monitoring and Evaluation – the Foundation
for Results
2. Using a RESULTS Chain
3. Measuring Results in PublicWorks Programs
4. Evaluations
o Process
o Targeting
o Impact
5. Conclusion - Moving Forward
6. 6
Using a Results Chain
Results chains are a simple approach to mapping
the causal logic/theory of change underpinning a
program
best used as a participatory tool, during project design
basis for constructing a M&E approach which will test the
validity of the theory of change
A results chain answers 3 questions
What are the intended results of the program?
How will we achieve the intended results?
How will we know we have achieved the intended
results?
7. What is a results chain?
Inputs
• Financial,
human, and
other resources
mobilized to
support activities
• Budgets, staffing,
other available
resources
Activities
• Actions taken or
work performed
to convert inputs
into specific
outputs
• Series of activities
undertaken to
produce goods and
services
Outputs
• Products
resulting from
converting inputs
into tangible
outputs
• Goods and services
produced and
delivered , under the
control of the
implementing
agency
Outcomes
• Changes
resulting from
use of outputs by
targeted
population
• Not fully under
the control of
implementing
agency
Final
Outcomes
• The final
objective of the
program
• Long-term
goals
• Changes in
outcomes with
multiple drivers
7
Implementation (SUPPLY SIDE) Results (DEMAND + SUPPLY)
8. 8
Objectives of this session
1. Monitoring and Evaluation – the Foundation
for Results
2. Using a RESULTS Chain
3. Measuring Results in PublicWorks Programs
4. Evaluations
o Process
o Targeting
o Impact
5. Conclusion - Moving Forward
9. Public Works Program
Results Chain Example
Inputs
• Budget for PW
Program
• Ministry of Labor
staff
• Staff from
participating
municipalities
Activities
• Setting of sub-
minimum wage
• Information
campaign
• Development and
application of
enrollment
process
• Selection of sites,
contracting and
training of PW
operators
Outputs
(Annual)
• 50,000 jobs
provided by PW
program
• $1,000,000 in
wages transferred
• > 75% of program
costs transferred
as wages
• 2,000 PW
subprojects
produced
Outcomes
• Net income
transfer to
households
• Skills acquired
• Utility,
maintenance of
PWs
Final
Outcomes
•Future income,
employment
• Among beneficiary
households:
-income, assets
-health, nutrition
- education
• Aggregate
unemployment,
poverty
9
Implementation (SUPPLY SIDE) Results (DEMAND + SUPPLY)
10. Goals depend on type of PW program
• Safety net -- temporary or seasonal income
support in response to covariate shocks such as
seasonal droughts, macro-economic crises
• Poverty Alleviation – income transfer to poor
• Employment/Insurance -- employment guarantee
• Education/Training -- skills acquisition with longer
term employment/earnings objectives
• Public goods – from subprojects created
these inform the content of the results chain
Measuring PublicWorks Program Goals
10
11. Multiple, often iterative goals are common
Across beneficiaries:
• Direct beneficiaries
• Direct beneficiaries’ households
• Communities benefitting from PW subprojects
• Region, nation benefitting from PW program
Over time:
• During period of employment – short term outputs,
outcomes
• After period of employment -- longer-term outcomes,
sustainability
• Relative to crisis period – speed, appropriateness of
response
Measuring the Goals of PublicWorks
Programs
11
12. Direct Beneficiaries
Outputs
• Targeting
• Errors of inclusion
• Errors of exclusion
• Gender balance among
beneficiaries
• Income transfer received
• Days/man-hours
employed
Outcomes
• Net wage gain
• Net employment
Longer-term
Outcomes
• Skills acquisition
• Future employment and
earnings
Beneficiaries’
Households
Outcomes
• Net income, consumption
during PW period
• Labor market status of
household members
• Nutritional status/food
security
Longer-Term Outcomes
• Net income, consumption
over longer time period
• Savings, assets
• Education, health, nutrition
• Reliance other types of
public transfers
• Risk management in future
shocks
12
Typical PublicWorks Indicators
Public Works Subprojects
Outputs
• Quality of goods and
services produced
Outcomes
• Sustainability, utility and
impact of subprojects
Public Works Program
Outputs
• Labor intensity
• Component costs
• Wage rate relative to
market, minimum
Outcomes
• Regional, national aggregate
impact on poverty,
employment
• Risk management in future
crises
13. 13
Objectives of this session
1. Monitoring and Evaluation – the Foundation
for Results
2. Using a RESULTS Chain
3. Measuring Results in PublicWorks Programs
4. Evaluations
o Process
o Targeting
o Impact
5. Conclusion - Moving Forward
14. Depend on the type of question being asked (Imas and Rist, 2009)
Descriptive
Seeks to determine what is taking place
Often describes aspects of a process, condition, or set of views
Includes process evaluations, beneficiary assessments
Normative
Compares what is taking place to what should be taking place
Often used to assess targeting, completion of activities
Measures inputs, activities and outputs in results chain
Includes assessments of targeting/benefit incidence, coverage, adequacy
Cause and Effect or Impact
Assesses causal results and looks at outcomes;
Addresses questions of attribution and implies a comparison of performance
Uses before and after and with and without comparisons
Impact evaluations of program level outcomes, operational options
14
Types of Evaluation
15. Process Evaluations – Decriptive - Assesses whether a program is
being implemented as planned
Tailored to program’s institutional arrangements and components
Often include quantitative and qualitative approaches
Particularly useful at early stages of program implementation
Targeting/Incidence Analysis – Normative - Determines whether
the program is reaching its intended beneficiaries
Can be applied at the geographical and household levels
Includes errors of inclusion and exclusion
Needs a reference from national measures of poverty (usually direct
or proxy measures of income or consumption) against which to
benchmark program performance
Can use national surveys with ID of program beneficiaries, and
oversampling if needed and/or regular program registration process
15
Types of Evaluations (examples)
16. Impact Evaluations – Cause and Effect - An assessment of the
causal effect of a project , program or policy on beneficiaries
Uses a counterfactual obtained from a control or comparison group to
estimate the state of the beneficiaries in the absence of the program
Relies on baseline and follow-up data on treatment and comparison
groups
Useful for:
-- Determining intermediate or final outcomes attributable to the
intervention
• Often used to examine questions with less clear answers such as changes in
behavior or outcomes with a range of drivers
-- Testing program design options
• For example, different outreach strategies or the relative effectiveness of
different benefit packages
16
Types of Evaluations (examples)
17. Evaluations are derived from the question posed
and should be tailored accordingly
Evaluations benefit from…
Combining quantitative and qualitative data
Cost – benefit analysis
Ensuring timeliness of measuring results, producing
information to inform key decisions
Early planning!
Keep an eye on costs and take advantage of
available data, national surveys
17
Structuring Evaluations
18. All impact evaluations estimate the counterfactual, using
control or comparison groups: What would the
treatment group be like in the absence of the program?
1. Experimental/Randomized Assignment
- uses randomized assignment to determine who gets program treatment(s) and who
is control among eligible beneficiaries
- can be used ethically in cases where program cannot reach all potential beneficiaries
at once; or to test program alternatives
- random assignment creates statistically equivalent groups (treatment and control)
which allows a valid estimate of the counterfactual
2. Quasi-Experimental
- mimics experimental designs
- methods to create comparison groups include:
Regression Discontinuity
Differences in Differences
InstrumentalVariables
Statistical Matching
Choice of method depends on context. Rules of program operation are key
because they determine eligibility for the program! Use them to ID
comparison group.
18
Impact Evaluation Methods
19. In many cases, the program cannot reach all potential
beneficiaries at the same time – use these opportunities!
Universe of eligible beneficiaries > # beneficiaries
-- Use random selection/lottery to select who is offered benefits, against
those not selected (controls)
-- Fair, transparent and ethical way to assign benefits to equally deserving
populations
Oversubscription:
-- Give each eligible unit the same chance of receiving treatment
-- Compare those offered treatment with those not offered treatment
(controls)
Phase in:
-- Give each eligible unit the same chance of receiving treatment first,
second, third….randomly select order of phase in
-- Compare those offered treatment first, with those offered treatment
later (controls)
19
Experimental Design/Randomized
Assignment
20. Example - Assessing Impact on Net
Income
Key question in PW projects:What is the net
income gain to participating workers’
households?
The income gain of the program does not equal
the gross wage rate (Ravallion, 2009)
Depends on the behavioral responses of the main
recipient. Poor people “cannot afford to be idle”. Need
to forego other forms of income to join PW
Depends on the behavioral response of other
household members (take up displaced activities?)
Depends on the conditions of the local labor market at
the time of the introduction of the program
21. What is the net income gain to
participating workers’ households?
Clearly a question that needs a counterfactual analysis: what would
have happened in the absence of the program?
Idea of impact evaluation is to estimate change in outcomes that is
attributable to the program
Net Gains = Gross Wage – Foregone Income
Estimate of foregone income essential to provide cost-benefit analysis
(Murgai, Ravallion 2005)
Use control or comparison groups to estimate foregone income (ie the
counterfactual – what the income the beneficiaries would have had in
the absence of the program)
Higher foregone income relative to gross wage = less effective
22. What results are needed to assess the performance of
your program?
Use results chains to define a shared view of the project’s theory
of change, causal pathways to reaching the main project
objectives
Establish the M&E framework early on, get good baseline data
Monitor activities, outputs, key performance indicators
Collect cost data for cost-benefit analysis
Do you need to establish that the program caused observed
changes in outcomes? If so, use an impact evaluation
Impact evaluations need good counterfactuals, which depend on
the validity of comparison groups clear rules of program
operation allow you identify valid comparison groups
22
Conclusion