D2 pl-02-e-who gpw13 impact measurement
•Download as PPTX, PDF•
0 likes•870 views
D2 pl-02-e-who gpw13 impact measurement
Recommended
More Related Content
What's hot
What's hot (20)
Similar to D2 pl-02-e-who gpw13 impact measurement
Similar to D2 pl-02-e-who gpw13 impact measurement (20)
More from WHO Regional Office for Europe
More from WHO Regional Office for Europe (20)
Recently uploaded
Recently uploaded (20)
D2 pl-02-e-who gpw13 impact measurement
- 1. WHO GPW13 Impact Measurement EURO Regional Committee Meeting
- 2. • The Seventy-second World Health Assembly (WHA72) requested the Director-General to continue developing the Results Framework of GPW 13, 2019-2023, in consultation with the Member States and through regional committees • Consultations on the WHO GPW 13 Impact Framework prior to WHA72: - Online consultations and feedback - Geneva missions briefings - EB and WHA sessions 2 PB Appropriation Resolution 72.1 Source: Resolution WHA 72.1
- 3. 3 Provide progress to date on the development of the measurement of the GPW 13 Results Framework Invite valuable inputs from Member States to finalize the Framework and obtain joint commitment for its implementation Objective
- 4. Strategic priorities | Triple billion targets Constitutional objective | Healthy life expectancy GPW13impactmeasurement Programmebudget Country case studies Balanced Scorecard Outputs Countrycasestudies Measuring the GPW 13 Results Framework Outcomes | Indicators and milestones
- 5. 5 WHO impact measurement: progress 46 outcome indicators and milestones Healthy life expectancy (HALE) Triple billion targets Universal health coverage Health emergencies Healthier populations 1 2 3
- 6. 6 All six themes are in complete alignment Indicator Alignment: EURO Joint Monitoring Framework and GPW 13 Impact Monitoring Domain Category Indicator Thematic Mortality and health expectancy Premature mortality from NCDs Maternal mortality 1 1 Health behaviors and risk factors Physical activity Nutrition Overweight and obesity Alcohol Smoking 1 1 1 1 1 Morbidity – NCDs and communicable diseases Tuberculosis Vaccination Hepatitis B HIV Cancer 1 1 2 1 Health systems Health Expenditure Health worker density 1 1 2 Environmental health Sanitation Air quality 1 1 Health policy International Health Regulations 1 15 indicators address 17 targets
- 7. 7 Consultative process: Next steps Consultation and inputs from Member States on the Results Framework during the regional committees Aug-Oct 2019 01 Technical experts meeting to review the WHO impact measurement methodologies 17-18 Oct 2019 02 Establish baselines and milestones for the outcome indicators Oct-Nov 2019 03 Informal Member State consultation on GPW 13 Results Framework to update on progress and present the draft 04 Nov 2019 04 Report to the Executive Board at its 146th session Feb 2020 and present at WHA in May 2020 05
- 8. Scale Score Strong 4 Satisfactory 3 Weak 2 Unsatisfactory 1 Assessment rating based on similar scale How? - Self-assessment - Guided by objective criteria - Internal validation mechanism, e.g. for VfM and GER dimensions Output scorecard WHO’s performance on the outputs will be summarized by a balanced scorecard that shows aggregated scores for each of the six dimensions
- 9. 17/09/2019 | New approach to output measurement Slide 1 Steps taken immediately after WHA - Pilot testing of approach - Internal consultations across three levels of the Organization (CO, RO, HQ) - Further refinements on the attributes, criteria by external and internal experts through workshops - Testing the refinements at RO, CO - Testing globally through output networks - Final draft of measurement instrument, including leading indicators for dimension 6 - Briefings with Member States - Finalize detailed output scorecard paper the Executive Board 2019 - Development of tool Further steps planned
- 10. Unpacking the dimensions into attributes 17/09/2019 * Attributes are constructed to provide key areas of focus in each Dimension to improve consistency (for example, this is what is meant by Effective Leadership). A 1. Effective Leadership 1 Authoritative advice Deliver authoritative and influential advice to world leaders that drives thinking on key public health risks and priorities 2 Convening Convene world experts to anticipate and address the key public health risks and challenges 3 Negotiating and finding solutions Negotiate innovative solutions with Member States and public and private partners to address politically sensitive issues 4 Driving the agenda (keeping health on the radar) Drive health issues up the political agenda through impactful communication and advocacy 5 Mobilizing and aligning resources Ensure human and financial resources are aligned and mobilized with strategic priorities and deliverables Dimensio n Attributes Strapline Output measurement | A Balanced scorecard approach Output measurement – dimensions & attributes*
- 11. Binary method or non binary Scoring Output 1.1.5 Areasofperformance Dimension: i.e Leadership (Average of below scores) Average of attribute score Score= 4 Average (Attribute 4+Attribute 3+Attribute 4 +etc.) Attribute (Scoring level) Scoring of Attribute Attribute 1: Score 4 Attribute 2: Score 3 Attribute 3: Score 4 Criteria (References for scoring) Reference for scoring Criteria 1: no scoring, presented as a checklist Criteria 2: no scoring, presented as a checklist Criteria 3: no scoring, presented as a checklist OUTPUT 1.1.5 FOCUS ON LEADERSHIP DIMENSION FOR ILLUSTRATION EXAMPLE
- 12. 17/09/2019 | New approach to output measurement Slide 1 Refinements made so far Further refinement of methods (by external and internal experts) - Agreement on the level which will be scored (attribute) - Agreement on how the attributes will be scored (non-binary; guided by criteria) - Draft criteria for each attribute and the approach to measuring them - Refinements of measurement instrument for leaving no one behind dimension (GER), value for money and results dimension Finalization of the detailed methodology document: - Attributes, criteria for each of the dimensions including for the outputs under outcome 4.2. (Leadership and Governance) and 4.3. (Management and Admin) - Leading indicators for Dimension 6; finalization of attributes and criteria for 4.2 and 4.3 outputs - Measurement instrument with guide (including checklists) Further refinements underway
- 13. 13 THANK YOU FOR YOUR ATTENTION!
- 14. 14 Additional Slides for Reference
- 15. 15 Country Case Studies Country experiences and success stories highlighting achievements, successful interventions and lessons learned.
- 16. 16 Data and Health Information Systems Monitor global health trends Provide reliable and actionable data to monitor global, regional and national health trends, SDGs, GPW13, and health inequalities Strengthened country data information systems for health Support countries to use of data, including World Health Data Collection Platform, to drive policies, impact and deliver the triple billion targets Strengthen and scale up research and innovations Strengthen evidence base, prioritize WHO’s norms and standards, and improve research capacity, and scale up innovations in countries in alignment with GPW13 and country priorities As per proposed programme budget 2020-2021 Outcome 4.1 1 2 3
- 17. 17 Reporting schedule 2030 SDG targets 2019 Annual reporting 2020 2021 2022 2023 GPW13 Final results framework report Programme budget period 2018-19 2018 Programme budget period 2020-21 Programme budget period 2022-23
- 18. 18 References All references can be accessed at: https://www.who.int/about/what-we-do/thirteenth-general- programme-of-work-2019-2023/ GPW13 Results Framework: An update 72nd World Health Assembly agenda item 11.1 (9 May 2019) Proposed Programme Budget WHO Impact Framework (WHA72.5) GPW13 Milestones and Indicators: Mapping SDGs to GPW13 GPW13 Milestones and Indicators: Metadata GPW13 Milestones and Indicators: Database (http://bit.ly/gpw13-data) GPW13 Methods Report - Draft (Forthcoming)
Editor's Notes
- Accountability to Member States and to the people we serve is our shared and collective responsibility. The fundamental strategy of GPW13 is to deliver results and ensure we are making a measurable impact on people’s health in countries. The results framework is designed to help track our performance and deliver results. To drive progress and deliver on the GPW 13 triple billion targets and SDGs, it is important to know that: each country can contribute to the GPW13- large or small (no penalization but performance rewards) each country will define its planned contributions, and each country will lead in achieving the targets. We are here to seek your valuable input as we finalize the results framework.
- In the PB appropriation resolution, the Director-General is requested to continue developing the results framework of GPW13, 2019-2023 in consultation with Member States and Regional Committees. You have received the results framework: progress update note. Previous to the WHA72, a series of consultations was organized by the Secretariat through several platforms: online consultations, briefing of Geneva missions, and governing body sessions.
- The aim of this presentation is to provide a very brief overview of the components that make up the WHO Results Framework and how they fit together. And most importantly invite your valuable inputs on next steps as we finalize the framework.
- The results framework has three parts: The impact measurement The balanced scorecard; and Country case studies The WHO Impact Framework is a three layer measurement system that tracks impact through quantitative targets and indicators. The three levels are the healthy life expectancy, triple billion targets, and the outcomes programmatic indicators and milestones. The Balanced Scorecard measures the Secretariat’s outputs, which can be aggregated into measurement of outcomes. Country case studies provide qualitative cross-cutting and wholistic view of WHO’s impact/contributions at country level. These three components will allow us to measure the impact at all levels of the organization with a focus on countries.
- The WHO impact framework is a three-layer measurement system: 46 programmatic indicators and milestones cover a range of health topics and provide a set of measurement indicators that will be used to measure the outcomes in the programme budget (38 of which are identical to SDGs). The triple billion targets are: 1 billion more people benefiting from universal health coverage, 1 billion more people better protected from health emergencies and 1 billion more people enjoying better health and well-being. The goal will be to achieve the triple billion targets by 2023. Each of the triple billion targets will be measured using composite indices. Healthy life expectancy (HALE) quantifies expected years of life in good health at a particular age and can be considered a summary measure of the overall health of populations. It is proposed to use HALE within GPW13 as an overarching and comparable measure of the impact of the triple billion targets.
- The joint monitoring framework consists of 40 indicators, developed based on the alignment of indicators across the Health2020, Sustainable Development Goals, and the Global Action Plan for the prevention and control of NCDs. The Impact Framework has 46 programmatic targets. Of the 40 JMF indicators, 15 (38%) have direct indicator-level alignment to the programmatic targets in the impact framework. These 15 indicators correspond to 17 programmatic targets (JMF collects information on malnutrition while there are separate programmatic targets for stunting and wasting. JMF has all vaccinations under one indicator, while there are separate programmatic targets for different vaccinations). In addition, 6 JMF indicators are thematically aligned with the programmatic targets of the impact framework. This means that the JMF collects information that may not directly address the programmatic targets, but will contribute information that can be used in assessing progress and achievements of the targets. For example, JMF indicators include annual mean levels of fine particulate matter in cities, and one of the programmatic indicators is reduce the mortality rate attributed to household and ambient air pollution by 5%. Another example is the JMF indicators of tuberculosis incidence and hepatitis B incidence, and the programmatic targets of reducing tuberculosis deaths and reducing HBV and HCV deaths. The themes are aligned, but indicators are not. The other indicators in this group include many of the health systems indicators in JMF addressing the first three programmatic targets. In total, 21 JMF indicators (53% of all JMF indicators) address 23 of the programmatic targets (50% of all programmatic targets) either at the indicator or thematic level.
- The next steps to complete the work on the results framework are for the Secretariat to: Continue to receive input from the Member States during the regional committee meetings and Member State consultations- your feedback and ideas are very important. Hold technical meetings to review and refine the methodology- we want to ensure the measurement framework benefits from the best scientific input and is scientifically rigorous. Establish numerical baselines and milestones for the WHO Impact Framework Programmatic indicators so that we can track progress and guide our interventions accordingly. Present it to the Executive Board at its 146th session in January and to WHA in May 2020. Our main objective is to receive input from you so the results framework is relevant.
- Results framework is one of the transformational shift. It is designed to measure the impact of our investments. It will systematically track the joint efforts of the Secretariat, Member States and partners to meet the GPW13 targets, achieve the Sustainable Development Goals, and measure the Secretariat’s contribution.
- In addition to Secretariats reporting, we recognize the importance of documenting and sharing MS experiences and best practices that will provide a more holistic view of achievements that can be replicated to advance the progress across countries and regions. The case studies will highlight achievements, successful interventions and lessons learned, and are currently collected annually by the Country Cooperation team. Country experiences and case case studies will be aligned with the GPW 13 outcomes and outputs.
- The triple billion target is WHO fundamental strategy, all resources of WHO in support of Member States are intended to help achieve the goals. Critically important are investments in data, health information systems and innovations. These are critically important functions that will accelerate the attainment of the SDGs. Reliable, timely data and actionable data to track progress and improve policies and programmes are important. This area of work need particular attention. WHO commits to strengthen country capacity to improve: Countries’ data and health information systems, to facilitate the use of such data and information in policy-making and to deliver impacts, The monitoring of global trends, and Bringing to scale operational research and innovations.
- We are simplifying the reporting cycle. The Secretariat will report on the results framework annually. The annual report will progressively include all aspects of the framework: outputs, outcomes and impact. The report will additionally include qualitative country case studies to provide a more complete picture of WHO’s impact and the difference it makes in people’s lives. At the end of the GPW13 period, in 2023, the Secretariat will present a comprehensive report summarizing progress made towards the programmatic milestones, the triple billion targets and the Secretariat’s contribution measured through the balanced scorecard and the qualitative case studies over the five year period.