This document outlines the strategic workplan for the Country Health Systems Surveillance (CHeSS) platform. CHeSS aims to improve the availability, quality, and use of health data needed to monitor health progress and system performance at the country level. It will pursue this goal through three main workstreams: 1) Improving access to and analysis of health data through a country-focused web platform; 2) Addressing data gaps; and 3) Building institutional capacity in countries. The first workstream focuses on making country health data, statistics, tools, and standards more accessible online to inform decision-making while minimizing reporting burdens.
Opioid Epidemic - Causes, Impact and FutureCitiusTech
In 2017, everyday, more than 130 people died in the US after overdosing on opioids. This document talks about America's worst drug crisis ever and shares how technology can play a role to cope up with this epidemic.
Performance-based financing presentation to the Health Financing AcceleratorReBUILD for Resilience
A presentation to the Health Financing Accelerator and the Global Fund in March 2021 on the challenges and opportunities for international agencies investing in performance-based financing and direct facility financing in fragiole and conflict-affected settings and low income settings. By Sophie Witter, Maria Bertone & Karin Diaconu of Queen Margaret University, UK.
Antoine Mafwilla, MD, MPH, Chief of Monitoring and Evaluation, SANRU shares the challenges of performing evidence-based monitoring and evaluation on health programs in SANRU's program in the Democratic Republic of the Congo.
Opioid Epidemic - Causes, Impact and FutureCitiusTech
In 2017, everyday, more than 130 people died in the US after overdosing on opioids. This document talks about America's worst drug crisis ever and shares how technology can play a role to cope up with this epidemic.
Performance-based financing presentation to the Health Financing AcceleratorReBUILD for Resilience
A presentation to the Health Financing Accelerator and the Global Fund in March 2021 on the challenges and opportunities for international agencies investing in performance-based financing and direct facility financing in fragiole and conflict-affected settings and low income settings. By Sophie Witter, Maria Bertone & Karin Diaconu of Queen Margaret University, UK.
Antoine Mafwilla, MD, MPH, Chief of Monitoring and Evaluation, SANRU shares the challenges of performing evidence-based monitoring and evaluation on health programs in SANRU's program in the Democratic Republic of the Congo.
Lessons from pfm in the health sector finalHFG Project
Over the past five years, the Health Finance and Governance (HFG) project has supported over 35 countries and programs in their efforts to strengthen public financial management (PFM) systems. Activities have been tailored to address key priorities within a health system context, and have ranged from improving financial data systems to conducting costing exercises, financial analyses, and capacity-building workshops. Across these activities, several lessons have emerged.
Insights in this brief stem from analysis of over 200 HFG financing activities; interviews with stakeholders from Ukraine and Vietnam; and experience from cross-cutting program activities. These lessons are shared as a resource for fellow implementing partners, country practitioners, and donor agencies. As the project ends, this brief considers the global context and established frameworks for PFM alongside the contributions of the HFG experience, and suggests a way forward.
Do Better Laws and Regulations Promote Universal Health Coverage? A Review of...HFG Project
The importance of policies, laws, and regulations (referred to collectively below as “policy instances”) as instruments to support progress towards Universal Health Coverage (UHC) in low- and middle-income countries cannot be understated. However, there has been insufficient focus in the literature on the role of these instruments, leading to a lack of evidence as to what constitutes a supportive legal environment that can consistently provide a strong basis for UHC reform processes. In this review, we explore how policies implemented in different country contexts have had an impact on their achievement of UHC goals.
In order to better differentiate the effect of various policy instances on the achievement of UHC goals, we developed a typology for policy instances and then ascribed the different aspects of governance to the instances identified in the literature, based on how they were designed and implemented. Finally, we considered the success of each policy instance identified, in terms of achieving intended UHC-related outcomes.
Governments may have political and process constraints on the number of policy instances they can design and implement in a period leading up to and during health sector reform. In terms of which health system component to focus such change on, we have more evidence for policy instances focused on health financing, given that designing effective financing mechanisms can shape the entire health
sector. Following this, policy instances that address human resources for health and supply chain management should be prioritized as they appear to have key strengthening effects on the provision of healthcare by increasing efficiency, equity, and quality.
This review of the evidence to date of governments’ policy-making experience highlights the importance of effective policy design and implementation with a clear orientation towards better governance, and in particular increased responsiveness and accountability.
A Scoping Review of the Uses and Institutionalization of Knowledge for Health...HFG Project
There is growing interest in the ways different forms of knowledge can be used to strengthen policymaking in low- and middle-income country (LMIC) health systems. Additionally, health policy and systems researchers are increasingly aware of the need to design effective institutions for supporting knowledge utilization in LMICs. In order to clarify the use and institutionalization of knowledge as well as effects on health systems, a scoping review was conducted using the Arksey and O’Malley framework.
The following research question guided our analysis: “What is known from the existing health literature about how actors use and incorporate knowledge into health system policymaking and what sorts of institutional arrangements facilitate this process in LMICs?”
While there is some evidence of how different uses and institutionalization of knowledge can strengthen health systems, the evidence on how these processes can ultimately improve health outcomes remains unclear. Further research on the ways in which knowledge can be effectively utilized and institutionalized is needed to advance collective understanding of the governance dimensions of health systems strengthening and enhance appropriate policy formulation.
Implementing Pro-Poor Universal Health CoverageHFG Project
From The Lancet Global Health: Countries worldwide are embarking on health system reforms that move them closer to UHC, in many cases with a clear pro-poor focus. Along the way, there is a wealth of guidance on the technical aspects of UHC, such as designing health service packages and developing health financing systems. However, there is very little practical guidance on how to implement these policies.
Motivated by a shared interest in helping to close this information gap, a diverse international group of 21 practitioners and academics, including ministry of health officials and representatives of global health agencies and foundations, convened at The Rockefeller Foundation’s Bellagio Center for a three-day workshop from July 7–9, 2015.
The participants shared their experiences of implementing UHC and discussed the limited evidence on how to implement UHC, focusing on a set of seven key “how” questions from across five domains of UHC.
Universal health coverage (UHC)—ensuring that everyone has access to quality, affordable health services when needed—can be a vehicle for improved equity, health, financial well-being, and economic development. In its 2013 report, Global Health 2035, the Commission on Investing in Health (CIH) made the case that progressive (“pro-poor”) pathways towards UHC, which target the poor from the outset, are the most efficient way to achieve both improved health outcomes and increased financial protection (FP). Countries worldwide are now embarking on health system changes to move closer to achieving UHC, often with a clear pro-poor intent. While they can draw on guidance related to the technical aspects of UHC (the “what” of UHC), such as on service package design, there is less information on the “how” of UHC—that is, on how to maximize the chances of successful implementation.
Motivated by a shared interest in helping to close this information gap, a diverse international group of 21 practitioners and academics, including ministry of health officials and representatives of global health agencies and foundations, convened at The Rockefeller Foundation’s Bellagio Center for a three-day workshop from July 7–9, 2015. The participants shared their experiences of implementing UHC and discussed the limited evidence on how to implement UHC, focusing on a set of seven key “how” questions from across five domains of UHC.
Health system strengthening evidence review – A summary of the 2021 updateReBUILD for Resilience
A presentation given by Professor Sophie Witter to the UK government's Foreign, Commonwealth & Development Office. This summarises a 2021 review of a health systems strengthening evidence review originally undertaken for the office in 2019.
Policy Brief: What Steps Are Countries Taking To Implement Pro-Poor Universal...HFG Project
Universal health coverage (UHC)—ensuring that everyone has access to quality, affordable health services when needed—can be a vehicle for improved equity, health, financial well-being, and economic development. In its 2013 report, Global Health 2035: A World Converging within a Generation, the Commission on Investing in Health made the case that pro-poor pathways towards UHC, which target the poor from the outset, are the most efficient way to achieve both improved health outcomes and increased financial protection (FP). Countries worldwide are now embarking on health system changes to move closer to achieving UHC, often with a clear pro-poor intent.
Much has been written about what steps countries have taken and are currently taking to: (1) set and expand guaranteed services, (2) develop health financing systems to fund guaranteed services and ensure FP, (3) ensure high-quality service availability and delivery, (4) improve governance and management of the health sector, and (5) strengthen other aspects of health systems to move closer to UHC. As background for a meeting on UHC implementation, held at the Rockefeller Foundation’s Bellagio Center, Italy, from 7–9 July 2015, we reviewed this body of literature, and conducted interviews with global UHC implementers and researchers. In this short policy brief, we synthesize the key messages from the literature and interviews.
Population Health Management: Enabling Accountable Care in Collaborative Prov...Salus One Ed
This document provides the reader information about population health management (PMH), how it relates to incentive payments for healthcare providers and their health insurance partners (commercial and government). See details about required transformation of care delivery methods, typical accountable care payment models, how to achieve incentives, partnerships between state government (public health) and community shared services needs and necessary technology and data to achieve it.
Emerging Public Health Issues Health Equity (Page 3) Public Health Accreditat...CookCountyPLACEMATTERS
"This tip sheet is provided to accredited health departments to use as they prepare their annual reports." "Health equity is noted as an emerging public health issue because best and promising practices are moving the science and practice of public health beyond the traditional considerations of minority health and health disparities to more comprehensive concepts associated with ensuring deliberate consideration of the multiple determinants of health."
Performance budgeting in health - Caroline Penn, OECDOECD Governance
This presentation was made by Caroline Penn, OECD, at the 3rd Health Systems Joint Network meeting for Central, Eastern and South-eastern European Countries held in Vilnius, Lithuania, on 25-26 April 2019
IX Reunion Relacsis 2019 ARG - Marcelo Dagostino - Information Systems for He...RELACSIS-OPS Red
IX Reunion Relacsis 2019 Argentina
Information Systems for Health (IS4H)
Marcelo Dagostino | OPS/EIH-IS
www.paho.org/relacsis
Comunidad académica y de práctica dedicada al Fortalecimiento de los Sistemas de Información de Salud (SIS)
#SaludParaTodos
Portfolio Summary: JSI's Work in Research, Monitoring, Evaluation & HISJSI
Learn about JSI's work in M&E, health information systems strengthening, and innovations in data and analytics from the past two years. We highlight examples from our global and US portfolios, including work on Innovations for MNCH, USAID | DELIVER PROJECT, SPRING, our bilateral projects in Ethiopia and Nigeria, and more.
Lessons from pfm in the health sector finalHFG Project
Over the past five years, the Health Finance and Governance (HFG) project has supported over 35 countries and programs in their efforts to strengthen public financial management (PFM) systems. Activities have been tailored to address key priorities within a health system context, and have ranged from improving financial data systems to conducting costing exercises, financial analyses, and capacity-building workshops. Across these activities, several lessons have emerged.
Insights in this brief stem from analysis of over 200 HFG financing activities; interviews with stakeholders from Ukraine and Vietnam; and experience from cross-cutting program activities. These lessons are shared as a resource for fellow implementing partners, country practitioners, and donor agencies. As the project ends, this brief considers the global context and established frameworks for PFM alongside the contributions of the HFG experience, and suggests a way forward.
Do Better Laws and Regulations Promote Universal Health Coverage? A Review of...HFG Project
The importance of policies, laws, and regulations (referred to collectively below as “policy instances”) as instruments to support progress towards Universal Health Coverage (UHC) in low- and middle-income countries cannot be understated. However, there has been insufficient focus in the literature on the role of these instruments, leading to a lack of evidence as to what constitutes a supportive legal environment that can consistently provide a strong basis for UHC reform processes. In this review, we explore how policies implemented in different country contexts have had an impact on their achievement of UHC goals.
In order to better differentiate the effect of various policy instances on the achievement of UHC goals, we developed a typology for policy instances and then ascribed the different aspects of governance to the instances identified in the literature, based on how they were designed and implemented. Finally, we considered the success of each policy instance identified, in terms of achieving intended UHC-related outcomes.
Governments may have political and process constraints on the number of policy instances they can design and implement in a period leading up to and during health sector reform. In terms of which health system component to focus such change on, we have more evidence for policy instances focused on health financing, given that designing effective financing mechanisms can shape the entire health
sector. Following this, policy instances that address human resources for health and supply chain management should be prioritized as they appear to have key strengthening effects on the provision of healthcare by increasing efficiency, equity, and quality.
This review of the evidence to date of governments’ policy-making experience highlights the importance of effective policy design and implementation with a clear orientation towards better governance, and in particular increased responsiveness and accountability.
A Scoping Review of the Uses and Institutionalization of Knowledge for Health...HFG Project
There is growing interest in the ways different forms of knowledge can be used to strengthen policymaking in low- and middle-income country (LMIC) health systems. Additionally, health policy and systems researchers are increasingly aware of the need to design effective institutions for supporting knowledge utilization in LMICs. In order to clarify the use and institutionalization of knowledge as well as effects on health systems, a scoping review was conducted using the Arksey and O’Malley framework.
The following research question guided our analysis: “What is known from the existing health literature about how actors use and incorporate knowledge into health system policymaking and what sorts of institutional arrangements facilitate this process in LMICs?”
While there is some evidence of how different uses and institutionalization of knowledge can strengthen health systems, the evidence on how these processes can ultimately improve health outcomes remains unclear. Further research on the ways in which knowledge can be effectively utilized and institutionalized is needed to advance collective understanding of the governance dimensions of health systems strengthening and enhance appropriate policy formulation.
Implementing Pro-Poor Universal Health CoverageHFG Project
From The Lancet Global Health: Countries worldwide are embarking on health system reforms that move them closer to UHC, in many cases with a clear pro-poor focus. Along the way, there is a wealth of guidance on the technical aspects of UHC, such as designing health service packages and developing health financing systems. However, there is very little practical guidance on how to implement these policies.
Motivated by a shared interest in helping to close this information gap, a diverse international group of 21 practitioners and academics, including ministry of health officials and representatives of global health agencies and foundations, convened at The Rockefeller Foundation’s Bellagio Center for a three-day workshop from July 7–9, 2015.
The participants shared their experiences of implementing UHC and discussed the limited evidence on how to implement UHC, focusing on a set of seven key “how” questions from across five domains of UHC.
Universal health coverage (UHC)—ensuring that everyone has access to quality, affordable health services when needed—can be a vehicle for improved equity, health, financial well-being, and economic development. In its 2013 report, Global Health 2035, the Commission on Investing in Health (CIH) made the case that progressive (“pro-poor”) pathways towards UHC, which target the poor from the outset, are the most efficient way to achieve both improved health outcomes and increased financial protection (FP). Countries worldwide are now embarking on health system changes to move closer to achieving UHC, often with a clear pro-poor intent. While they can draw on guidance related to the technical aspects of UHC (the “what” of UHC), such as on service package design, there is less information on the “how” of UHC—that is, on how to maximize the chances of successful implementation.
Motivated by a shared interest in helping to close this information gap, a diverse international group of 21 practitioners and academics, including ministry of health officials and representatives of global health agencies and foundations, convened at The Rockefeller Foundation’s Bellagio Center for a three-day workshop from July 7–9, 2015. The participants shared their experiences of implementing UHC and discussed the limited evidence on how to implement UHC, focusing on a set of seven key “how” questions from across five domains of UHC.
Health system strengthening evidence review – A summary of the 2021 updateReBUILD for Resilience
A presentation given by Professor Sophie Witter to the UK government's Foreign, Commonwealth & Development Office. This summarises a 2021 review of a health systems strengthening evidence review originally undertaken for the office in 2019.
Policy Brief: What Steps Are Countries Taking To Implement Pro-Poor Universal...HFG Project
Universal health coverage (UHC)—ensuring that everyone has access to quality, affordable health services when needed—can be a vehicle for improved equity, health, financial well-being, and economic development. In its 2013 report, Global Health 2035: A World Converging within a Generation, the Commission on Investing in Health made the case that pro-poor pathways towards UHC, which target the poor from the outset, are the most efficient way to achieve both improved health outcomes and increased financial protection (FP). Countries worldwide are now embarking on health system changes to move closer to achieving UHC, often with a clear pro-poor intent.
Much has been written about what steps countries have taken and are currently taking to: (1) set and expand guaranteed services, (2) develop health financing systems to fund guaranteed services and ensure FP, (3) ensure high-quality service availability and delivery, (4) improve governance and management of the health sector, and (5) strengthen other aspects of health systems to move closer to UHC. As background for a meeting on UHC implementation, held at the Rockefeller Foundation’s Bellagio Center, Italy, from 7–9 July 2015, we reviewed this body of literature, and conducted interviews with global UHC implementers and researchers. In this short policy brief, we synthesize the key messages from the literature and interviews.
Population Health Management: Enabling Accountable Care in Collaborative Prov...Salus One Ed
This document provides the reader information about population health management (PMH), how it relates to incentive payments for healthcare providers and their health insurance partners (commercial and government). See details about required transformation of care delivery methods, typical accountable care payment models, how to achieve incentives, partnerships between state government (public health) and community shared services needs and necessary technology and data to achieve it.
Emerging Public Health Issues Health Equity (Page 3) Public Health Accreditat...CookCountyPLACEMATTERS
"This tip sheet is provided to accredited health departments to use as they prepare their annual reports." "Health equity is noted as an emerging public health issue because best and promising practices are moving the science and practice of public health beyond the traditional considerations of minority health and health disparities to more comprehensive concepts associated with ensuring deliberate consideration of the multiple determinants of health."
Performance budgeting in health - Caroline Penn, OECDOECD Governance
This presentation was made by Caroline Penn, OECD, at the 3rd Health Systems Joint Network meeting for Central, Eastern and South-eastern European Countries held in Vilnius, Lithuania, on 25-26 April 2019
IX Reunion Relacsis 2019 ARG - Marcelo Dagostino - Information Systems for He...RELACSIS-OPS Red
IX Reunion Relacsis 2019 Argentina
Information Systems for Health (IS4H)
Marcelo Dagostino | OPS/EIH-IS
www.paho.org/relacsis
Comunidad académica y de práctica dedicada al Fortalecimiento de los Sistemas de Información de Salud (SIS)
#SaludParaTodos
Portfolio Summary: JSI's Work in Research, Monitoring, Evaluation & HISJSI
Learn about JSI's work in M&E, health information systems strengthening, and innovations in data and analytics from the past two years. We highlight examples from our global and US portfolios, including work on Innovations for MNCH, USAID | DELIVER PROJECT, SPRING, our bilateral projects in Ethiopia and Nigeria, and more.
Better Health? Composite Evidence from Four Literature ReviewsHFG Project
The Marshaling the Evidence secretariat agreed that a cross-cutting synthesis paper was necessary to frame the work in the wider context of governance in health systems, drawing distinctions and consensus across all four TWG papers. Members of the secretariat, some of whom also were members of the TWGs, conducted the analysis across each TWG report and wrote the synthesis report. The report compiles results from the TWGs into a searchable database, contained in Annex 1. The report also lays the foundation for future action—from dissemination to further research agendas and policy plans.
C603 regional health observatory-its role in the generation and dissemination...Ramon Martinez
The Regional Health Observatory (RHO) of the Pan American health Organization (PAHO) is presented, highlighting its objective, functions and components. Its role as a mean to facilitate access to health data, disseminate health information and evidence to support decision-making in public health is also illustrated. Nowadays, the Health Observatory is an essential and key health information resource for PAHO, Member States, public health professionals and civil society.
MEASURE Evaluation’s Health Information System Strengthening ModelMEASURE Evaluation
This PowerPoint presentation provides an updated overview of MEASURE Evaluation’s Health Information System Strengthening Model, or the HISS Model. The slides describe the purpose of the model and each of the model’s areas and sub-areas.
In November 2016, over 60 government technicians, policymakers and technical advisors from 47 countries across the Americas, Africa, Asia and Europe participated in the first global Health Accounts Peer-Learning Workshop. During this workshop, participants shared their experiences and ideas on how to improve Health Accounts production and increase the uptake of Health Accounts results for policy.
The aim of the workshop was to bring together Health Accounts practitioners from countries to share strategies to overcome challenges when producing and using Health Accounts. It also sought to provide an environment for practitioners to build relationships and long-lasting networks so participants could continue to learn from each other after the workshop.
As a result, participants would have a better sense of tried-and-tested solutions to the challenges they face when producing and using Health Accounts. The workshop was also an opportunity to use feedback from countries and Health Accounts experts to inform WHO’s global health resource tracking strategy. A vast spectrum of ideas and country experiences were shared during the week. What follows is a summary of the most common challenges and solutions that the participants shared and analyzed during the week’s discussions.
Health Accounts Peer-Learning Workshop: Summary of Key Themes and DiscussionsHFG Project
In November 2016, over 60 government technicians, policymakers and technical advisors from 47 countries across the Americas, Africa, Asia and Europe participated in the first global Health Accounts Peer-Learning Workshop. During this workshop, participants shared their experiences and ideas on how to improve Health Accounts production and increase the uptake of Health Accounts results for policy.
Innovations in Information Communication Technology
Country Health Systems Surveillance (Chess) En
1. Country Health Systems Surveillance (CHeSS)
Improving data availability, quality and use for better performance
STRATEGIC WORKPLAN
Background
Recent substantial increases in international funding for health have been accompanied by
demands for statistics that accurately track health progress and performance, evaluate its
impact, and ensure accountability at country and global levels. The use of results‐based
financing mechanisms by major global donors has created further demand for timely and
reliable data for decision‐making. In addition, there is increasing in‐country demand for data in
the context of annual health sector reviews, including in countries that have established IHP+
compacts. Responding to this demand is constrained by limited data availability and quality. Few
developing countries are able to produce data of sufficient quality to permit the regular tracking
of the progress made in results of scaling‐up and strengthening health systems. Data gaps span
across the range of input, output, outcome and impact indicators.
An increasing number of stakeholders, including global health partnerships, bilateral donors, UN
agencies, and academic institutions are engaged in health information, including the
development of standards, tools and methods, investments in data collection, compilation and
analysis, monitoring progress towards targets, results‐based funding, and evaluation of large‐
scale programmes. This occurs both in the context of disease‐specific programmes and as part
of health systems strengthening. For instance, the Global Fund has invested considerably in
measuring progress in countries as part of its five‐year evaluation and has started to address
major data gaps. GAVI relies on immunization coverage to monitor progress and disburse funds
and is focusing on strengthening the monitoring systems in conjunction with other health
interventions. The US Government is continuing to invest in data generation through major
efforts such as Demographic and Health Surveys, HIV and malaria indicator surveys, and
improving clinical information systems such as ART and TB control monitoring. UNICEF is
stepping up its support to household surveys on maternal, neonatal and child health surveys
(MICS). Various forms or results‐based funding related to for instance the global health
partnerships or World Bank grants is increasingly common with immediate needs for high
quality data.
There is a need for a well‐coordinated approach to improving health information systems, in line
with the general Health Metrics Network framework, building upon country national health
sector plans and monitoring practices, as outlined in the IHP+ common accountability and
results framework. The framework translates the Paris declaration tenets to the field of health
information, including issues related to alignment with country processes, collective action,
harmonization and capacity building.1 The H8 outlined four global health information goals to
improve monitoring of results and accountability at country and global levels: increase the level
and efficiency of international investments; enhance access to data and statistics; support the
1
Monitoring performance and evaluating progress in the context of the scale‐up for better health. A proposed
common evaluation framework. Prepared by the M&E working group of the IHP+ led by WHO and the World Bank.
2008. Evaluating the scale‐up for maternal and child survival. Catalytic Initiative to Save One Million Lives. Prepared
by Institute for International Programmes consortium based at Johns Hopkins University. 2008.
2. Draft 26 April 2009
WHO/HSI
development of a common data architecture and strengthen performance monitoring and
evaluation practices, including minimizing country reporting requirements. 2 The global goals
are aiming to strengthen country health information systems, with a focus on results and use for
decision‐making. The Country Health Systems Surveillance (CHeSS) platform aims to guide and
facilitate the implementation of the H8 global goals at the country level.
Main goal and approach
The main goal of CHeSS is to improve the availability, quality and use of the data needed to
inform country health sector reviews and planning processes, and to monitor health progress
and system performance. Such improvements should be supported in such a way that global
monitoring, including reporting in the context of global goals or major global health investments,
is also strengthened while minimizing the reporting burden for countries. 3
The improvement of the capacity of countries to monitor health‐system strengthening will need
to strike the right balance between standardization and country specificity, building on existing
approaches and introducing appropriate tools and methods. A Bellagio meeting in 2008 formed
the basis for a plan of action for the CHeSS platform which consists of three main work streams:
1. Improving access and analysis
2. Addressing data gaps
3. Building institutional capacity.
A core CHeSS principle is to build upon country experience and strengthen in‐country processes.
A rapid country assessment of current practices is a useful starting point and should take stock
of current demand and use of health information in major planning and evaluation cycles, the
supply of data and statistics and the institutional capacity (see Box).
Main areas of focus of a rapid situation analysis
Demand and use of information:
Existence of processes for annual reviews and evidence‐based planning
Use of indicators, data and analyses to inform such processes: use of core indicators with targets and
trends, analysis of equity and subnational performance, and benchmarking of country performance
Supply of data and statistics:
Strength of data sources and data gaps
Existence of quality control mechanisms and transparency
Levels of access to data and analysis
Methods and effectiveness of dissemination and communication of results
Institutional capacity
Planning and data collection
Data quality assessment and adjustment
Analysis and synthesis
Dissemination and communication.
2
The H8 is an informal meeting arrangement for health leaders of Bill and Melinda Gates Foundation, GAVI, Global
Fund, UNAIDS, UNFPA, UNICEF, WHO, World Bank. A health information background paper was prepared by the
heads of statistics of the H8 (URL).
3
Monitoring country health systems and their performance. An outline plan of action. Outcome of a WHO technical
meeting held at the Rockefeller Centre, Bellagio, Italy, 28‐30 October 2008.
2
3. Draft 26 April 2009
WHO/HSI
Workstream 1 Improving access and analyses
Rationale
Five areas for improvement can be identified. These include availability and quality of databases
of statistics, communication of main results on key indicators, access to health data and
analyses documents, linkages between global estimates for key health indicators and country
use, and access to standards for health information.
Global agencies compile data from countries and maintain databases which may be publicly
accessible. These include disease specific databases and cross‐cutting databases that are kept by
WHO, UNICEF, World Bank and others. Countries may also have health indicator databases, kept
mostly by the Ministry of Health, and multi‐sectoral databases at National Statistical Offices.
There is considerable scope for improvement of the quality and public access to these databases.
Effective communication of data is likely to enhance information use for decision‐making.
Global actors and countries have developed various ways of disseminating and communicating
health data and results from analysis. Country health profiles, fact sheets, dashboards,
interactive graphics and mapping techniques all aim to summarize information about levels,
trends and differentials for key health indicators. Examples are country profiles produced by
international organizations for health and disease programmes or the Maternal, Neonatal and
Child Survival Countdown 2015 country profiles, interactive maps of disease outbreaks,
HIV/AIDS Epi Fact sheets and Gapminder time trend graphs. An easy way to produce such
effective ways to communicate results is not easily available for most countries.
Countries and partners produce a significant number of documents related to health data and
statistics. These include health statistical abstracts, survey reports, facility assessment reports,
health sector reviews, disease specific reports and in‐depth analysis. The reports of data
collection efforts and analytical work ought to be easily accessible and many countries have
websites that allow downloading pdf files with full reports. In general, however, access and
sharing of the health statistical and analytical documents from countries is often limited and
many documents rapidly become irretrievable.
WHO, UNICEF and other international organizations produce comparable estimates for key
health indicators based on available data and methods to correct for data deficiencies and
predict in time and space. The results are available in global databases and for some health
indicators, such as HIV prevalence and child mortality, it is possible to obtain further insights
from web sites and use tools to make or reproduce the global estimate. In general, however,
access to methods, tools and results is piecemeal, countries use is limited and there is a need to
facilitate country access. This needs to be combined with capacity building.
Standards and tools for health information are essential to obtain comparable information over
time. This ranges from basic terminologies and classification (such as ICD) to indicators
definitions, data collection instruments and analytical methods. The introduction of health
information technologies further corroborates the need for standardization and interoperability
of data. In spite of global efforts there is still considerable variation in the extent to which
countries apply appropriate standards to guide health data collection, compilation and analysis.
3
4. Draft 26 April 2009
WHO/HSI
Approach
A country‐focused, web‐based platform will be established and aim to improve access to all
available data on key health indicators and on systems performance. The platform will build
upon existing national and international efforts to bring together health and health systems
data. 4 It will be established to address the five challenges identified above and provide easy
access to country health data and statistics documents, country health statistics, estimation
tools and results, communication tools and results, and international standards.
The web platform will be maintained by WHO with remote entry facilities by programmes,
country offices, countries and international partners. It will be an essential part of the Global
Health Observatory which will is under development. The web platform is not intended to
replace existing or planned country websites which often cover multiple purposes. Ministries of
Health and National Statistical Offices maintained websites however should be able to draw
freely and easily from the health observatory country pages.
Country web page (health observatory)
Country Name
Country Name
Country data display
Presentation formats for core indicators, fact sheet, dashboard, mapping library, etc.
MDG Health system Diseases Outbreaks Countdown Others
MNCH
Data Base of Core Indicators
Core statistics on health system building blocks, access and service coverage, health outcomes, determinants
Repository of country health information documents Enter
Library of country data collection, statistical, health sector review and analytical documents docs
Global estimates of key health indicators
Links and imported data and graphs from global estimation processes
Library of standards and tools
Global and local standards for data collection, measurement and analysis
Links to descriptive / qualitative information
on health programs and systems
1 Database
The global WHOSIS data base pulls together data from WHO programmes, UN and other
databases and provides a series of functionalities to display the data in tabular, graphic or
mapping format. In some cases, this may include both global estimates and country reported
data. The statistical data will highlight the data for the specific country in comparison with other
countries.
4
For instance, WHO's Global Health Observatory, UNICEF's DevInfo, USAID‐supported Health Systems 2020, UNSDs
UNData, OECD data and statistics, Gapminder.
4
5. Draft 26 April 2009
WHO/HSI
2 Customized data displays
The country pages will have a set of customized user interfaces. Some of those use the WHOSIS
database as the basis, others will be pulled off directly from efforts by other organizations and
initiatives. The WHOSIS database derived displays include dynamic pdf files with multiple data
and statistics, dynamic dashboards with core indicators, interactive maps, combined tabulations
and graphs (e.g. using Instant Atlas), and interactive figures (such as those developed by
Gapminder).
The contents covers priority health topics including the MDGs (maternal and child health,
nutrition, HIV, TB and malaria), outbreak diseases, health systems surveillance, burden of
disease and non‐communicable diseases, etc. Examples of links to existing profiles include the
Countdown for maternal, neonatal and child survival 2015 and country profiles/fact sheets for
specific diseases published by TB, HIV, malaria, EPI, other health and regional programmes.
Others still need to be developed in close collaboration with countries. For instance, a country
health systems surveillance dashboard will pull together the different data and analyses to
monitor health systems performance through the assessment of trends in key health indicators
(towards targets if appropriate), subnational analyses and benchmarking country performance
against other countries. The consistency of data presented in the different profiles will have to
be assured.
3 Repository of country health data documents
A central repository at WHO will ensure easy access to country documents. The documents
primarily cover documents that provide results of data collection efforts (surveys, facility
assessments, census, surveillance, health statistical abstracts) and analytical work (disease
reviews, systems performance assessments, annual health sector reviews etc.). The web
platform will be open source, aligned with the WHO global information repository and allow
uploading of documents by all users (with a short list of characteristics of the document). WHO
will maintain the responsibility over the system, but will seek close collaboration with partners.
This will be done by HQ and regional offices.
4 Estimates of key health indicators
The country health observatory pages will be a one‐stop‐shop for access to all publicly
accessible estimates for key health indicators that are done by UN agencies and their partners.
The links will directly lead to the country estimates for the health indicator with underlying data
and associated methods. This will include child mortality, HIV prevalence, immunization
coverage and others. There will also be an entry point for providing comments and queries on
the estimates, directed to those responsible for the estimates, to promote greater country use.
5 Library of standards and tools
This component will be the same for all countries. It includes the WHO registry of indicators
and metadata, which has detailed descriptions of all relevant indicators. It will also include
references to standard terminologies and classifications (e.g. ICD, ICF), standards for data
5
6. Draft 26 April 2009
WHO/HSI
collection (e.g. survey modules). A WHO registry of indicators and metadata will aim to bring
together all major indicators.
Activities
Set up web‐based platform with country‐specific observatories, linked to the Global Health
Observatory and regional efforts
Develop country‐specific database interface, starting with WHOSIS and expanding to
programme and regional databases and adding subnational data.
Develop customised data and analytical displays and user interfaces and link with existing
partner efforts
Link to existing work on estimates, expand and fill gaps
Develop a library of standards and tools
Workstream 2 Improving data availability and quality for reviews and global reporting
Rationale
The first workstream primarily focuses on building upon already available data and
strengthening capacities to analyse and use them most effectively. However, for a
comprehensive examination of health progress and systems performance, it is necessary to deal
with the substantial gaps in the availability of quality data that cannot be addressed through
analytic and statistical procedures alone.
Data deficiencies are likely to be multiple and varied across countries but a common feature
observed everywhere is that routine reports from health facilities and districts are often subject
to bias, incompleteness, tardiness, and poor quality. The need to systematically address such
problems is particularly acute in the light of the increasing use of performance‐based
disbursement mechanisms used by funds and donors, including annual health sector reviews.
Currently, performance is often assessed on the basis of routine reporting from health facilities,
yet it is clear that there are multiple problems in clinic and programme‐based reporting systems.
Financial incentives tend to aggravate the problems and create incentives for gaming and for
data manipulation. The application of tools to assess health facilities and district performance
would not only fill important data gaps, but also provide a mechanism for validating routine
facility and district reports. What is needed is a standard set of tools and methods that are
relevant and feasible in diverse settings.
It will be essential to fill data gaps on all components of health systems functioning along the
causal chain from inputs, processes and outputs, to outcomes and impact. A comprehensive
plan to improve the information available on health progress and systems performance should
include relevant data sources with particular emphasis on:
1. strengthening vital events monitoring with causes of death, through existing civil
registration systems, demographic surveillance sites, or hospital statistics;
6
7. Draft 26 April 2009
WHO/HSI
2. harmonizing health surveys through a country‐led national plan for population‐based health
surveys with a focus on service coverage, equity and population health outcomes, and using
global standards;
3. improving the timeliness, completeness and quality of facility generated data with the help
of information technology and supported by an up‐to‐date national health‐facility database
that covers all public and private health facilities with data on infrastructure, equipment and
commodities, service delivery, and health workforce;
4. a system of tracking financial resource flows and expenditures to subnational levels;
In addition, greater use of existing data from population‐based, clinical and administrative
sources is required to assess progress and performance. Improved synthesis and analysis of data
from multiple sources is needed to better inform annual health sector and other review
processes. This includes improving data availability and quality, developing and disseminating
analytical tools, and building capacity for analysis.
Approach
To improve the availability and quality of data to inform annual health sector reviews and other
processes special efforts need to be made to fill data gaps in the five areas identified above. For
each areas standards and tools are required to guide strengthening efforts through technical
assistance and capacity building.
Area Standards and tools Key issues
Monitoring ‐ Manual of civil registration systems (UNSD) ‐ Link with disease mortality
of vital ‐ ICD for coding causes of death (WHO) surveillance investments
events ‐ Verbal autopsy tool (WHO) (especially HIV)
‐ Data quality assessment tool for civil registration ‐ Clear guidance for countries with
systems (under development (UQ/WHO/HM) no functioning civil registration
‐ Demographic surveillance systems starter kit systems
(INDEPTH) ‐ Strengthening hospital cause of
death data
Surveys ‐ Modules for core indicators (several available; Both activities need more
MACRO, UNICEF, World Bank, IHSN, WHO) investment from partnerships,
‐ Guidance for national survey plan (partly, HMN) donors and international agencies
Health ‐ DHIS /Open Health (partly, HISP, WHO, HMN) ‐ IT to improve reporting systems
facility data ‐ Disease or intervention‐specific reporting systems ‐ Quality of recording may
(e.g. outbreak diseases, TB, HIV, EPI) (UN agencies, improve with EHR and mHealth
bilateral donors) introduction
‐ Facility and service databases (WHO, USG) ‐ Requires national facility census
‐ Facility assessments (under development, WHO, and district updating systems
IHFAN/USG, UNICEF)
Financial ‐ Country specific tools, including IT ‐ Demand for data by programme
tracking ‐ Public expenditure reviews or disease and subnational data
‐ National Health Accounts ‐ standard data collection tools
Data quality ‐ Range of tools used to assess facility and ‐ Data quality assessment
assessment subnational data quality (but no standard) generally weak in countries
and analysis ‐ Range of analytical methods and tools to bring ‐ Poor availability of global tools
together data from different sources and develop for adjustment and estimation for
estimates most diseases
‐ Use of global methods limited at
country level
7
8. Draft 26 April 2009
WHO/HSI
Activities
Develop country guidance on monitoring progress and assessing performance in the context
of annual health sector strategic plans and country compacts (if IHP+ country), based on the
IHP+ common accountability and results framework
Develop guidance with a set of standard tools and methods to address data gaps and
promote the implementation, including:
o vital events monitoring: for countries with partial registration systems and for
countries with very limited data;
o health surveys: for the development of a long term national survey plan, with
standards and tools for data collection and analysis
o facility data: for the effective transmission of data and statistics, and feedback
of results from facilities and districts to national levels
o service data: developing a comprehensive data base of facilities with GPS
coordinates, services, and human resources
o financial data
Develop a tools and a system to assess data quality through regular health‐facility and
district assessments, and analyses of data from multiple sources
Workstream 3 Institutional capacity strengthening
Rationale
A major constraint faced by many countries relates to the individual and institutional capacities
required across a range of issues associated with data collection, management, analysis and
sharing. The many global initiatives launched to address health systems weaknesses may be
jeopardized if there is no strong in‐country capacity to monitor and evaluate the effects of
investments. Capacity‐building requires support to institutions complemented by investment in
training of individuals. In the health sector, there has been relatively little attention to
institutional capacity‐building in support of such functions. 5 Establishing stronger partnerships
for capacity building between research institutes and ministries of health could go some way
towards filling the capacity deficit. The institutional component is critical in terms of long‐term
sustainability.
Different organizational forms for such institutions can be envisaged, from an integral part of a
Ministry of Health to an entirely separate private, non‐profit organization. Governance and
financing structures may also differ. However, evidence from a number of countries suggests
that capacity‐strengthening efforts should preferably be directed towards institutions that are
independent of programme implementation so as to maximize objectivity and minimize risks
associated with vested interests. In some countries, national statistics offices that have aligned
5
A recent review of statistical capacity‐building activities by the agencies of the United Nations system,
found that extensive support to statistical capacity building was directed to data collection and processing
for household surveys but noted that sector statistics (including health) appear to receive little support for
capacity‐building.
8
9. Draft 26 April 2009
WHO/HSI
themselves with the Fundamental Principles of Official Statistics 6 can provide this degree of
objectivity and transparency. Elsewhere, academic, research and public health institutes may be
well placed to provide this function. Landscaping of the institutional context would be included
in the country‐based web platform described above, and would serve as the foundation for
decision‐making regarding capacity strengthening activities.
The specific areas in which capacity‐building is required include:
Data compilation and storage, bringing together for analytic purposes data generated by the
national statistics office, ministries of health, researchers, donors, development partners,
funds, NGOs, others;
Data analysis and synthesis: bringing together data from multiple sources for the purpose of
health sector reviews and planning, policy analysis, country, regional and global reporting,
and evaluation;
Data quality assessment, validation and adjustment: independent assessment of the quality
of data generated from clinical and administrative sources, ad hoc surveys etc.;
Estimation and statistical modelling: application of global standards, tools and methods to
correct for bias and missing values, generate estimates and forecast for planning purposes,
focusing on key statistics (child mortality, immunization coverage, HIV prevalence etc.)
Approach
The CHeSS platform will promote an institutional approach and maintain a summary of country
institutional capacity on the web. It will be critical however to link with existing or new efforts to
strengthen institutional capacity.
6
http://unstats.un.org/unsd/dnss/gp/fundprinciples.aspx
9
10. Draft 26 April 2009
WHO/HSI
Annex A (Workstream 2 ‐ improving data quality)
Meeting on "The quality of health facility data: assessment and adjustment."
Rationale
Data quality issues are likely to be multiple and varied across countries and affect all data
sources. A common feature observed everywhere is that routine reports from health facilities
and districts are often subject to bias, incompleteness, tardiness, and poor quality. The need to
systematically address such problems is particularly acute in the light of the importance of
regular annual data to inform health sector review processes and of the increasing use of
performance‐based disbursement mechanisms used by funds and donors. In both cases, routine
reporting from health facilities is the main source of data, yet it is clear that there are multiple
problems in clinic and programme‐based reporting systems. Financial incentives tend to
aggravate the problems and create incentives for gaming and for data manipulation.
There are two main issues that affect the quality of data generated from health facilities. First,
recording of events may be incomplete or inaccurate. Incompleteness may stem from poor
recording practices, and may lead to both under‐ and overrecording of the event. For instance, a
vaccination tally sheet may have more or less vaccinations than were actually given. An
outpatient register may show more or less patients than actually were seen. The health worker
may make errors deliberately or not. Incomplete recording may also originate from lack of
knowledge of the outcome of the event. For instance, a maternity register may not record a
maternal death which occurs following re‐admission for post partum sepsis.
Inaccurate recording generally occurs when the health worker lacks the right knowledge. This
may lead to omission or misclassification of events. For instance, a poor diagnosis of for instance
malaria or incorrect use of ICD coding rules leads to a faulty recording of the event. A death of a
person on TB treatment or ARV therapy can be recorded as loss to follow up.
The second set of issues is related to reporting of the recorded data. There are two types.
Aggregation errors may occur during different stages: aggregating the individual data at the
facility level, aggregating the facility summaries at the district level, summarizing the district
data at provincial and at national levels. Incomplete reporting occurs within facilities (e.g.
specific time periods are missed), at district (missing facilities), province and national levels
(missing districts). This also includes poor inclusion or poor reporting by private facilities, but
may also include poor reporting by hospitals which sometimes have a separate reporting system.
Representativeness of facility data is affected because the data are only related to those that
make use of health facilities. This is not strictly a data quality issue but will need to be taken into
account when making population inferences from facility data.
Approach
The assessment of data quality has different components. First, a general picture of data quality
can be obtained by analyzing data from multiple sources. This may include comparison of results,
on for instance intervention coverage, from population based household surveys with facility
10
11. Draft 26 April 2009
WHO/HSI
reports. While population‐based surveys may also have measurement error and data quality
issues that need to be taken into account, they are usually considered the gold standard.
To assess the completeness and accuracy of recording of events observational and follow‐up
studies are required. One may also assess data quality by comparison of commodity and drug
distribution figures with service provision data, since the former number has to be larger than
the latter.
The accuracy and completeness of recording is difficult to assess. For some indicators the results
may indicate data quality problems, e.g. a highly unusual cause of hospital death distribution or
an exceptionally low mortality rate among patients on TB or ARV. For other indicators unusually
high numbers of events may suggest over‐recording, e.g. for vaccinations. This assessment often
depends on accurate knowledge of the denominator, i.e. the target population. At local levels
this often presents a problem, due to the long time interval between the last census and the
year of interest, migration, or poor definition of catch population. The consistency over time in
of numbers of events may be an indicator of complete recording, although recording problems
can easily be "concealed" by adjustments made at the facility, district or higher level by
adjusting the data without proper documentation.
The most visible reporting problem is non‐reporting of facilities, districts or provinces. Errors in
aggregating data are much harder to detect. Comparisons of individual data at the facility level
(registers, tally sheets) with aggregate reports from the facilities and at the district level may
provide insights into such errors.
The assessment of data quality should form the basis for adjustments of the statistics. Missing
facilities and districts should be taken into account using standardized methods for adjustment.
Limited reporting by the private sector should be taken into account, and can benefit from
population‐based surveys. In addition, IT based reporting systems have great potential to
improve such systems, not only in terms of timeliness but also in terms of quality.
Meeting
A range of disease programmes and studies have developed data quality assessment and
adjustment methods and tools. For instance, GAVI uses a data quality audit to assess reporting
problems. The Global Fund has develop a set of tools to assess data quality. Disease
programmes, such as TB and HIV, are using a range of analytical methods and tools to adjust for
recording and reporting problems. Also several countries have developed ways to adjust for
data quality problems.
Data quality assessment needs to look at different levels of the system of data collection and
aggregation, from facility to district, provincial and national level.
Develop a core set of analytical tools to ascertain data quality and make adjustment as
appropriate
Design a tool to assess the quality of data and statistics through a review recording and
reporting practices at the facility and district levels
11
12. Draft 26 April 2009
WHO/HSI
Districts are often the main administrative unit of country health systems that provide key
information on progress towards health goals. District assessments aim to provide regular
information on the quality of data generated by districts, especially facilities (HMIS), and provide
additional information on the state of health services and system through facility assessments
(including public and private sector) and expenditure reviews. The overall picture provided by a
sample of health facilities or a sample of districts aims to provide information on the national
situation.
Participants
GAVI DQA;
GF evaluation study DQA tools
Country DQA tools (e.g. South Africa, Zambia, Tanzania)
Disease programmes (TB, HIV, immunization, other)
Analytical methods to assess quality by using data from different sources: local and national level
Analytical methods to assess quality by using international methods and tools
HMN synthesis from Seattle meeting on local surveys and other data collection: tools, sampling, data
analysis
12