The document summarizes the findings of the AID-EE project, which evaluated 20 energy efficiency policies across Europe. Key lessons learned include: objectives should be specific, measurable, achievable, relevant and time-bound to guide policy; the impact of individual policies is difficult to isolate as most use packages with interacting instruments; and monitoring and evaluation have been a low priority, despite being important to determine policy effects and efficiency. A policy theory approach that defines clear objectives, indicators and expected relationships can help design, monitor and evaluate policies.
Module 7: Monitoring and Evaluation Dima course contentMichael Kenny
This 16 slide presentation Monitoring and Evaluation is Module 7 of a nine (9) module online course for adult education policy makers and practitioners to complement an innovative toolkit to guide adult education policy and practice.
Participation in adult education varies significantly across states and regions of Europe! Why? Evidence and literature suggests a wide disparity in policy making, programming and implementation skills in the adult education sector across Europe. It is imperative that policy makers and programme managers address this disparity to foster life-long learning for a smart-sustainable Europe (see EU2020 https://ec.europa.eu/info/business-economy-euro/economic-and-fiscal-policy-coordination/eu-economic-governance-monitoring-prevention-correction/european-semester/framework/europe-2020-strategy_en) and to achieve a European target of 15% of the adult population engaged in learning.
In response to this challenge, the ERASMUS+ DIMA project (See https://dima-project.eu/index.php/en/, 2015 to 2017) developed a practical 9 module online course to complement an innovative toolkit to guide adult education policy and practice. The DIMA toolkit (See https://dima-project.eu/index.php/en/toolkit) introduces tools for developing, implementing, and monitoring adult education policies, strategies, and practices.
Author: Michael Kenny and DIMA Project partners (https://dima-project.eu/index.php/en/partners)
Module 7: Monitoring and Evaluation Dima course contentMichael Kenny
This 16 slide presentation Monitoring and Evaluation is Module 7 of a nine (9) module online course for adult education policy makers and practitioners to complement an innovative toolkit to guide adult education policy and practice.
Participation in adult education varies significantly across states and regions of Europe! Why? Evidence and literature suggests a wide disparity in policy making, programming and implementation skills in the adult education sector across Europe. It is imperative that policy makers and programme managers address this disparity to foster life-long learning for a smart-sustainable Europe (see EU2020 https://ec.europa.eu/info/business-economy-euro/economic-and-fiscal-policy-coordination/eu-economic-governance-monitoring-prevention-correction/european-semester/framework/europe-2020-strategy_en) and to achieve a European target of 15% of the adult population engaged in learning.
In response to this challenge, the ERASMUS+ DIMA project (See https://dima-project.eu/index.php/en/, 2015 to 2017) developed a practical 9 module online course to complement an innovative toolkit to guide adult education policy and practice. The DIMA toolkit (See https://dima-project.eu/index.php/en/toolkit) introduces tools for developing, implementing, and monitoring adult education policies, strategies, and practices.
Author: Michael Kenny and DIMA Project partners (https://dima-project.eu/index.php/en/partners)
Training on Monitoring & Evaluation (M&E) of Adaptation and the NAP processNAP Events
Presented by: Timo Leiter & Julia Olivier
3c. Developing (sub)national adaptation M&E systems
Participants will be taken through a short training course on the basic steps of developing a national adaptation M&E system with specific reference to the process to formulate and implement NAPs. The training will be based on the guidebook “Developing national adaptation M&E systems” developed by GIZ in collaboration with the LEG and the Adaptation Committee.
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
The role of Monitoring and Evaluation in Improving Public Policies – Challeng...UNDP Policy Centre
IPC-IG's Research Coordinator, Fábio Veras Soares, presentation at the "International Conference on the
Institutionalization of Public Policies Evaluation", held in Rabat, on 5 October.
This presentation explains the difference between Monitoring and Evaluation; the types of M&E frameworks; steps in logical framework and its difference from theory of change.
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
STUDENTS:
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
The presentation is to train government and non-government planners to develop their skills for results-based planning and management for social sector programmes and projects.
Monitoring and evaluation is a vital component that determines the effectiveness of a corporation's assistance by establishing clear links between past, present and future initiatives and results. The process helps in improving the programme performance and achieving desired results. It provides opportunities for fine-tuning, re-orientation and planning of the programme effectively, without which it becomes impossible to measure the success and impact of the programme even if the approach is right.
A method for planning and assessing the social effects and internal performance of projects, programs, and organizations.“A project should see itself as a part of an interconnected web of actors, factors and relationships” (Sarah Earl, 2008 IDRC)
Training on Monitoring & Evaluation (M&E) of Adaptation and the NAP processNAP Events
Presented by: Timo Leiter & Julia Olivier
3c. Developing (sub)national adaptation M&E systems
Participants will be taken through a short training course on the basic steps of developing a national adaptation M&E system with specific reference to the process to formulate and implement NAPs. The training will be based on the guidebook “Developing national adaptation M&E systems” developed by GIZ in collaboration with the LEG and the Adaptation Committee.
During this session we will:
*Review importance of monitoring and evaluation
*Share overview of grant model evaluation plan
*Review methodologies used in previous evaluations
*Share plans for future evaluation methodologies
The role of Monitoring and Evaluation in Improving Public Policies – Challeng...UNDP Policy Centre
IPC-IG's Research Coordinator, Fábio Veras Soares, presentation at the "International Conference on the
Institutionalization of Public Policies Evaluation", held in Rabat, on 5 October.
This presentation explains the difference between Monitoring and Evaluation; the types of M&E frameworks; steps in logical framework and its difference from theory of change.
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
STUDENTS:
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
The presentation is to train government and non-government planners to develop their skills for results-based planning and management for social sector programmes and projects.
Monitoring and evaluation is a vital component that determines the effectiveness of a corporation's assistance by establishing clear links between past, present and future initiatives and results. The process helps in improving the programme performance and achieving desired results. It provides opportunities for fine-tuning, re-orientation and planning of the programme effectively, without which it becomes impossible to measure the success and impact of the programme even if the approach is right.
A method for planning and assessing the social effects and internal performance of projects, programs, and organizations.“A project should see itself as a part of an interconnected web of actors, factors and relationships” (Sarah Earl, 2008 IDRC)
Case Corporate Excellence
Can a sports outfit producer successfully integrate environmental awareness into its business strategy? Is it possible to build a responsible organization based on the values of a different lifestyle and a specific community of customers?
The values of Patagonia are clearly aligned with those of its clients: love of nature and adventure. Instead of turning these values into a tool of communicating its brand, the Company is looking for innovative ways to demonstrate that these values are at the centre of its strategy and are not just the result of the strategy.
Patagonia became more than just another producer and seller of outfits for sports activities in open air, like its competitors. Rather, it positions itself as part of the economic system stressing the importance to be responsible and to take care of the environment. The level of integrating the mission, vision and values of the CSR into the business and the strategy are truly unique.
Presentation Training on Result Based Management (RBM) for M&E StaffFida Karim 🇵🇰
Planning, Monitoring, Evaluation & Reporting together for developmental results: Results-based Management-RBM (RBM)?
Logical Framework Approach (LFA)
Planning for results
Monitoring for results
Evaluating for results
Enhancing the use of knowledge from monitoring and evaluation
Balanced Scorecard for Strategic Planning and MeasurementKenny Ong
ABF Advanced Balanced Scorecard Conference
April 2009
* How BSC can link and facilitate strategy planning
* Performance management measurement through Balanced Scorecard
* BSC as business intelligence to help organisation build strategic direction and measure the progress of strategic execution
How to write an development project evaluation report. Format and principle guidelines for mid-term and for completed projects. This format can be used for any kind of development project.
Presentation by Peter Vagi at the Seminar on Monitoring and Evaluation for representatives of the Turkish Prime Ministry, taking place in Kizilcahamam, Republic of Turkey, 4-5 May 2017 [English].
Monitor and Evaluate Implementation of Land Use Plan.pptxsolomonEshete5
This unit of competence covers the knowledge, skills and attitude required to set:-
the time for monitoring and evaluation of implementation of land use plan.
It includes managing of each planned activities, conducting participatory monitoring and evaluation and revise the land use plan.
Presented by Prof. Dr. Carlos Àlvarez, Instituto de Ingenería Energética, Universidad Politécnica de Valencia, Spain, at the IEA DSM Programme workshop in Madrid, Spain on 19 October 2005.
Presented by Arturo Rodríguez-Garcia, Director General, General Manager, Visual Tools, Spain, at the IEA DSM Programme workshop in Madrid, Spain on 19 October 2005.
Presented by Wolfgang Irrek, Research group "Energy Transport and Climate Policy" Wuppertal Institute for Climate, Environment and Energy, Germany at the IEA DSM Programme workshop in Copenhagen, Denmark on 19 April 2006.
Presented by Ulrich Bang Termansen, the Association of Danish Energy Companies, Denmark at the IEA DSM workshop in Copenhagen, Denmark on 19 April 2006.
Presented by Nicolai Zarganis, Head of Division, Danish Energy Authority, denmark, at the IEA DSM Programme workshop in Copenhagen, Denmark on 19 April 2006.
Presented by Marcella Pavan, head, Energy Efficiency Policy Division, Italian Regulatory Authority for Electricity and Gas, Italy, at the IEA DSM Programme workshop in Copenhagen, Denmark on 19 April 2006.
Presented by Vlasis Oikonomou, SOM Research Institute, Department of Economics, University of Groningen, Netherlands, at the IEA DSM Programme workshop in Maastricht, the Netherlands on 11 October 2006.
Presented by Larry Mansueti, Office of Electricty Delivery and Energy Reliability, U.S. Department of Energy, USA, at the IEA DSM Programme workshop in Seoul, Korea on 18 April 2007.
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
This presentation, created by Syed Faiz ul Hassan, explores the profound influence of media on public perception and behavior. It delves into the evolution of media from oral traditions to modern digital and social media platforms. Key topics include the role of media in information propagation, socialization, crisis awareness, globalization, and education. The presentation also examines media influence through agenda setting, propaganda, and manipulative techniques used by advertisers and marketers. Furthermore, it highlights the impact of surveillance enabled by media technologies on personal behavior and preferences. Through this comprehensive overview, the presentation aims to shed light on how media shapes collective consciousness and public opinion.
Acorn Recovery: Restore IT infra within minutesIP ServerOne
Introducing Acorn Recovery as a Service, a simple, fast, and secure managed disaster recovery (DRaaS) by IP ServerOne. A DR solution that helps restore your IT infra within minutes.
0x01 - Newton's Third Law: Static vs. Dynamic AbusersOWASP Beja
f you offer a service on the web, odds are that someone will abuse it. Be it an API, a SaaS, a PaaS, or even a static website, someone somewhere will try to figure out a way to use it to their own needs. In this talk we'll compare measures that are effective against static attackers and how to battle a dynamic attacker who adapts to your counter-measures.
About the Speaker
===============
Diogo Sousa, Engineering Manager @ Canonical
An opinionated individual with an interest in cryptography and its intersection with secure software development.
Sharpen existing tools or get a new toolbox? Contemporary cluster initiatives...Orkestra
UIIN Conference, Madrid, 27-29 May 2024
James Wilson, Orkestra and Deusto Business School
Emily Wise, Lund University
Madeline Smith, The Glasgow School of Art
This presentation by Morris Kleiner (University of Minnesota), was made during the discussion “Competition and Regulation in Professions and Occupations” held at the Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found out at oe.cd/crps.
This presentation was uploaded with the author’s consent.
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
From theory based policy evaluation to smart policy design: lessons learned from 20 cases studies on energy efficiency improvement
1. From theory based policy evaluation to
smart policy design: lessons learned from
20 case studies on energy efficiency
improvement
Results from the AID-EE project (Active
Implementation of the proposed Directive on
Energy Efficiency)
Copenhagen April 19, 2006
Lars J. Nilsson, Lund University
2. AID-EE project
Objectives
1. Reconstruct and analyze the policy
implementation process with the purpose to
identify and explain key factors behind success
and failure of energy efficiency policies
2. Actively disseminate knowledge on
implementation, monitoring and evaluation of
policy instruments across Europe amongst
others through a number of workshops
3. AID-EE project
Work programme
WP8: Common dissemination activities
WP0:Projectmanagement
WP1: Development of a common framework for assessment of policy instrument
and selection of policy instruments
WP2: Assessment of
selected instruments
in the households and
service sector in the
EU-25
WP3: Assessment of
selected instruments
in the industry sector
in the EU-25
WP4: Assessment of
instruments applied
outside the EU-25, in
other sectors or cross
cutting instruments
WP7: Dissemination actvities
WP5: Overall impact assessment of current policies and potential 'best practice'
policies
WP6: Development of guidelines on monitoring and evaluation and synthesis of
project results
4. AID-EE project
Approach
•Ex-post evaluation of 20 instruments applied in
different sectors (households, services, industry,
transport) across Europe
•Application of a standardised evaluation
methodology based on the ‘theory based policy
evaluation’, which not only focuses on the final
impact (energy savings) but also on intermediate
indicators
5. AID-EE project
Policy instruments included
• Voluntary agreement (DK)
• Audit programme (SF)
• Industrial EE network (NO)
• Energy concept for industrial
branches (DE)
• Eco-driving (NL)
• ACEA agreement (EU)
• FEMP (US)
• Top runner approach (JP)
• Advice service (DE/NRW)
• Mandatory targets for network
companies (BL)
• Appliances labelling (NL)
• Building code (NL)
• KfW Building modernisation
programme (DE)
• EEC (UK)
• Local energy advisors (SE)
• Energy+ (EU)
• AirCond-regulation (CH)
• EE Procurement group (SE)
• Energy manager obligation (IT)
• EE investment deduction
scheme (NL)
6. AID-EE project
Practical approach: 6 steps
1. Characterization of the policy instrument
2. Draw up a policy theory and map out cause-
impact relationships
3. Translate theory to concrete indicators
4. Draw up a flow chart
5. Verify (and adjust) policy theory
6. Collect information to draw-up indicators and
draw conclusions
7. AID-EE project
Relationship with other
instruments
Cause-Impact Relationship Indicators Success and Fail factors
1. Ministry of Trade (MTI) introduces the
Energy Audit Programme (EAP). Motiva is
the implementing organisation.
2a. Motiva carries out various activities to
promote and support energy auditing.
2b. Promotion campaign to make the EAP
known.
Quality and type of promotion;
awareness of EAP.
Awareness of need of promotion;
good relations with media.
2c. Training and authorisation of auditors.
Quality of training; number of
persons authorised; competence
of auditors.
Not main focus of EAP; auditors
responsible for training.
2d. Development of energy audit models and
auditor's tools.
Quality, relevance and
usefulness of models and tools.
Flexible development; co-
operation with stakeholders; role
of Motiva.
3. Motiva introduces subsidies for energy
audits.
Voluntary Agreement
scheme (introduced
1998).
4. Companies and organisations hire auditors
and energy audits are carried out.
Volume of audits.
Connection to VA scheme; level
of subsidies; active promotion.
5. Saving potentials are identified
Savings potentials in companies
and organisations.
Comprehensive programme;
careful monitoring.
6. Motiva controls the quality of energy
audits
Share of audits that are
controlled; quality of energy
audits.
Tight quality control a conscious
decision.
ESCO programme
(introduced 2000).
7. Companies and organiastions carry out
energy saving measures based on the energy
audits.
Energy saving measures carried
out; amount of energy saved.
Saving measures are voluntary;
economic (and other) incentives
for target groups.
Example: policy theory for the
Finnish Energy Audit Program
9. AID-EE project
Lessons learned (1)
•Smart objectives are good starting point for policy
making but they are not always there:
–Specified: be as concrete as possible, what is aimed for,
who is targeted, what seems the most appropriate
instrument or policy package to achieve the target
–Measurable: objectives have to be measurable to
determine whether results / effects have been achieved at
a later stage
–Acceptable: commitment within the target group
facilitates policy implementation
–Realistic: with respect to desired effect, available budget,
the timeframe, a combination of these
–Timeframe: It should be clear when the result / effect is
to be achieved
10. AID-EE project
Lessons learned (2)
• In most cases with policy packages it is not possible to isolate the
energy saving impact of a single policy instrument. Each
instrument has its own specific role:
– Creating awareness, setting a standard, showing opportunities,
providing financial means etc.
– This means that the objective / target of an instrument in the
package is not necessarily an energy saving target.
• The interaction of the policy instruments counts up to the total
impact:
– Would the impact still be the same when leaving out one of the
instruments?
• The interaction is dynamic and asks for proper instrument
management:
– e.g. due to increase of eco-tax the payback time of a measure
declines which might lead to an increased amount of free riders in a
subsidy scheme.
– Be critical on the instrument portfolio
11. AID-EE project
Lessons learned (3)
•Monitoring information is often lacking or is
insufficient to determine the effect and efficiency of
an instrument
–Monitoring does not have priority in the design phase
–The need for monitoring is often not addressed (e.g. by
setting an annual budget for monitoring)
–Because objectives are often not clear and measurable,
monitoring and evaluation becomes difficult.
–An explicit policy theory would facilitate monitoring and
evaluation.
13. AID-EE project
Preliminary summary conclusions
• Often multiple and mumbled objectives.
• There are policy packages and interplay between instruments.
• Monitoring and verification has been a relatively low priority.
• Organization matters – a clear mission and proper funding
seem important for success.
• Acknowledge the different natures of different instruments.
– The concept of smart objectives is relevant for all types of
instruments, but should be applied differently
– Different instruments ask for different monitoring protocols
• One should take into account relevant differences in:
– Behavioral, cultural, and socio-demographic conditions
– Market structures and policy/regulatory style
– Climatic & geographical conditions
• A policy/program theory approach can guide policy design and
subsequent monitoring and evaluation efforts.
14. AID-EE project
E4SD reflections - AID-EE implications
•The directive provides much needed impetus for
running a tighter ship.
•Resource acquisition or market transformation –
will only hard kWh’s count towards target?
–Bottom-up quantifiable energy savings from sales data,
participation rates, engineering estimates, M&V, etc.
–Top-down estimated effect of taxes or tariffs from price
elasticities.
–But what is the effect of building declarations,
development of supporting tools, demonstrations,
education, etc?
•Develop ”approved methodologies” in dialogue
with policy owners (cf. CDM Executive Board)?
15. AID-EE project
Further information:
Lund University, Sweden
Lars J. Nilsson
+46 46 222 4683
email: Lars_J.Nilsson@miljo.lth.se
OR
Project coordinator
Ecofys BV, the Netherlands
Contact person: Mirjam Harmelink
+31 30 2808495, email: M.Harmelink@ecofys.nl
Project website: www.aid-ee.org