Health Information System Performance Monitoring Tool

•

0 likes•972 views

This document introduces the Health Information System Performance Monitoring Tool (HISPMT), which is designed to help HIS managers systematically review key health information data sources and assess their performance. The HISPMT involves mapping indicators to 12 common data sources, assessing the validity and reliability of each source, and generating automated scores on the demand for and quality of data from each. The tool is intended to inform stakeholders and guide prioritization of investments to strengthen health information systems. It is targeted towards managers in low and middle-income countries and is being finalized for electronic use by June 2018.

Health & Medicine

Health Information System
Performance Monitoring Tool
Fern Greenwell, PhD MPH
MEASURE Evaluation
December 2017
HISPMT

Outline
1. Why the HISPMT?
2. Who is it for, when is it used?
3. Where are the boundaries?
4. How does it work?
5. What kind of results?
6. Current status and next steps

Why the HISPMT?
Purpose
To guide HIS managers in a systematic
review across the main HIS data sources
that generate data needed to monitor the
health system.
Results are intended to inform stakeholders about
which data sources bear the highest demand for
generating data, and the performance of each data
source.
The tool provides evidence needed for decision
makers to prioritize HIS-strengthening interventions.

Who, when, where?
Who? Use by a HIS manager*
* To complete the tool, she/he will need to consult with
managers of specific data sources both within and outside
of the health sector.
When? Periodic application prior to:
• Reviews or revisions of the national health strategy
• Health sector and/or sector-wide planning and budget
allocation meetings, e.g., SWAp
Where? Use anywhere, with a focus on low-and
middle-income countries (LMICs) because:
• HIS strengthening is needed
• International and national investments present demand
and opportunities for use
MEASURE Evaluation designed the HISPMT for…

Where are HISPMT boundaries?
12 HIS data
sources
Population-based
Institution-based
Mixed

4 Steps
Indicator mix:
assume these
indicators are
relevant to
the country.
Take into
account data
elements in the
numerators and
denominators.
Map data elements
to the 12 preferred
data sources
(summarized
demand on each).
Complete each rapid
assessment with 15-25
questions to assess
validity and reliability
for each data source.
How does HISPMT work?

HISPMT results(2,3)
Demand on Data Sources

HISPMT results (4)
Automated scores summarize the data sources’ performance in
generating valid and reliable data vis-à-vis the demand for data.

Status and next steps
▪ Content – drafted, pending finalization
▪ Automation – by end of May
▪ Availability – electronic platform by
June 1
For support in applying the HISPMT, contact:
Fern Greenwell, MEASURE Evaluation
fern.greenwell@icf.com

This presentation was produced with the support of the United
States Agency for International Development (USAID) under
the terms of MEASURE Evaluation cooperative agreement
AID-OAA-L-14-00004. MEASURE Evaluation is implemented by
the Carolina Population Center, University of North Carolina at
Chapel Hill in partnership with ICF International; John Snow,
Inc.; Management Sciences for Health; Palladium; and Tulane
University. Views expressed are not necessarily those of USAID
or the United States government.
www.measureevaluation.org

MEASURE Evaluation has developed tools and concepts for health information system (HIS) measurement in Phase IV. Strengthening an HIS is accomplished through assessment, identification, planning, implementation, and monitoring and evaluation of interventions based on the current state and context. Measurement requires a baseline assessment and monitoring of key indicators to evaluate specific HIS interventions. MEASURE is developing a catalog of HIS assessment and monitoring tools to be available in May 2017, which are cataloged by purpose, method, sampling, timing, level of health system assessed, and areas of the Health Information System Strengthening Model assessed. Examples of tools mentioned are PRISM, RAT, DQR, and MECAT.

Scaling Mobile Community-Based Information Systems

MEASURE Evaluation

MEASURE Evaluation’s Health Information System Strengthening Model

MEASURE Evaluation

MEASURE Evaluation: Results framework and resources

MEASURE Evaluation

MEASURE Evaluation presented resources at a USAID meeting in Malawi. Their results framework focused on strengthening health data collection and use, improving health information system management, and increasing evaluation capacity. They highlighted several resources including skills for health information and systems, an indicator toolkit for child and household well-being, evaluation and learning capabilities, support for health information system strengthening to achieve PEPFAR results, a learning agenda for demonstrating health information system strengthening, and gender sensitive approaches including a youth assessment method. MEASURE Evaluation is funded by USAID to work with various partners to strengthen health information systems.

Custom Country Tool: Global Application

MEASURE Evaluation

Molly Cannon developed a custom country tool to identify and prioritize vulnerable households for an OVC program in Uganda. The tool was adapted from an existing vulnerability index and revised based on stakeholder feedback to focus on key vulnerability indicators. It was then adapted for use in South Sudan and Lesotho. Cannon discusses the tool development process, key design considerations around purpose and data collection, and plans to develop global guidance for adapting the tool in other contexts through a USAID program.

RHINO Forum: How can RHIS improve the delivery of HIV/AIDS services?

MEASURE Evaluation

This document discusses how routine health information systems (RHIS) can be improved to better monitor linkages between HIV/AIDS services and other health services. Integrating separate vertical program reporting systems into a single national RHIS could facilitate client referrals, continuity of care, and achievement of program goals. However, challenges include harmonizing different recording forms and integrating programs not designed to be combined. The discussion forum explores issues around monitoring individual clients versus aggregates, defining linkage indicators, and ensuring data quality when integrating systems.

Building Resilient Health Information Systems in Ebola-Affected Countries: E...

MEASURE Evaluation

MEASURE Evaluation worked in Liberia, Guinea, and Sierra Leone to build resilient health information systems following the Ebola outbreak. Advisors embedded in Ministries of Health helped develop strategic and operational plans for health information systems and build institutional capacity. This included implementing DHIS 2, developing master facility lists, and integrating various health information sub-systems. Challenges included poor infrastructure, interoperability issues, and lack of resources and leadership. Recommendations focused on assessments, interoperability, strengthening capacity and coordination.

eHealth/mHealth: Building Fundamentals in South Africa through the SIFSA Asso...

MEASURE Evaluation

MEval-SIFSA has contributed to strengthening eHealth and mHealth in South Africa in several key ways: 1) It helped develop a facility coding system and supported implementation of the national ePHC project to digitize patient records. 2) MEval-SIFSA provided input on South Africa's mHealth strategy and is now assisting with implementation, such as creating an mHealth project repository. 3) Other efforts include linking helpdesk systems, developing technical briefs, and supporting initiatives that can help achieve health goals. The overall aim is to build capacity and help the country implement its eHealth strategy through standards, coordination, and using technology to improve health services and outcomes.

This document discusses information products to drive decision making in health systems. It summarizes research conducted in Kenya and Tanzania on the availability and use of information products from routine health information systems. Key findings include that staff value regular, standardized information products that provide feedback on performance against targets and recommendations for improvement. However, limited workforce and technical capacity are barriers to effective data use. The presentation provides examples of how information products can be designed and tested to promote greater use of routine health data for decision making.

Centralizing Evidence: Health Information Systems Strengthening Resource Center

MEASURE Evaluation

HIS Strategic Planning in Afghanistan 2009 and 2015

MEASURE Evaluation

The document outlines the strategic planning process for Afghanistan's health information system (HIS) in 2009 and 2015. It describes the characteristics of the HIS strategic planning process, including being government owned and oriented toward national public health goals. The planning focused on priority HIS systems like HMIS, surveillance, and human resources. Initial products of the planning process included assessments of past achievements, current gaps, and priorities for each subsystem. Remaining tasks for finalizing the strategic plan included cost estimates, an implementation plan, and a monitoring framework.

Health Information Systems Strengthening (HISS) in Kenya

MEASURE Evaluation

This document discusses lessons learned from strengthening health information systems (HIS) in Kenya through the Health Information Systems Strengthening (HISS) model. It outlines how the MEASURE Evaluation PIMA project mapped its interventions to the HISS model components of creating an enabling environment, information generation, and ensuring HIS performance. Key contributions included tools and approaches for assessments, capacity building, and prioritizing data use. Moving forward, priorities include ensuring government ownership and sustainability, cost-effective capacity building, incorporating new technologies, and continuous learning to document best practices.

Interoperability & Crowdsourcing: Can these improve the management of ANC pro...

MEASURE Evaluation

The document discusses how the MomConnect program in South Africa is using interoperability and crowdsourcing to improve access to and quality of antenatal care (ANC). MomConnect allows pregnant women to register for services via cell phone, collecting registration data that is integrated with other health information systems. It also uses crowdsourcing by sending surveys to women to provide feedback on clinic services. This feedback has helped identify issues and improve clinics. The program aims to register all pregnancies early and provide targeted health messages and feedback mechanisms to support maternal health. Over 500,000 women registered in the first year.

Key Populations and the HIV Epidemic: Lessons Learned in M&E and Future Direc...

MEASURE Evaluation

MEASURE Evaluation is a global health project funded by USAID to strengthen health information systems in over 25 countries. The project works to improve collection, analysis and use of health data to support decision making. Sharon Weir presented on lessons learned from monitoring and evaluating programs for key populations affected by HIV. She discussed how surveillance can provide more immediate information for programs if distinguished from other monitoring and evaluation activities. The presentation also covered adaptations made to the PLACE method over time to better align with prevention goals and strategically target local HIV epidemics.

Surfing a Great Wave: Data Science and Global Health

MEASURE Evaluation

1) Data science integrates locating key data, turning data into actionable information, and communicating information effectively to address challenges in analyzing the growing amount of global data. 2) MEASURE Evaluation uses data science to strengthen health information systems and decision-making in over 25 countries by improving data collection, analysis, and management capacity. 3) Examples show how data science can leverage new data sources like mobile phones and social media to provide insights into health issues and help achieve USAID priorities like the AIDS Free Generation.

Improving Health Information Systems to Meet the Needs of the Health Sector

MEASURE Evaluation

MEASURE Evaluation is a 5-year, $180 million project funded by USAID to strengthen health information systems in over 25 countries. The presentation discusses MEASURE Evaluation's approach to health information system strengthening, which includes developing a model and sharing experiences from Kenya. The model involves strengthening various components of health information systems, such as policies, infrastructure, data collection and analysis, to produce high-quality data that can inform decision-making at both national and global levels.

Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...

MEASURE Evaluation

This document provides guidelines for monitoring and evaluating HIV programs for sex workers, men who have sex with men, and transgender people at the national, sub-national, and service delivery levels. It outlines an 8-step public health model approach involving understanding the epidemic, determinants of transmission, developing combination prevention programs, and evaluating impact. Key concepts covered include causal pathways, indicators, and emphasizing quality and involvement of key populations. The guidelines are meant to be adapted to local contexts.

Health Information System: Interoperability and Integration to Maximize Effec...

MEASURE Evaluation

This document summarizes a presentation on health information system (HIS) interoperability and integration given by Manish Kumar and Sam Wambugu of MEASURE Evaluation. It describes issues with HIS in low and middle income countries like weak systems, lack of standards and data quality. It discusses the importance of interoperability, data standards, and collaboration. Country experiences from Liberia and Swaziland show efforts to develop HIS strategies, integrate systems, and use data for decision making. Key messages are promoting country ownership, stakeholder collaboration, agreed information architecture and standards, and institutional data use.

Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...

MEASURE Evaluation

This document provides the baseline results of an evaluation of approaches to strengthen health facility operation and management committees (HFOMCs) in Nepal. The evaluation aims to examine the impacts of integrating gender equality and social inclusion training and community engagement approaches into HFOMC capacity building. Key findings from the baseline include: HFOMCs are generally perceived as inactive with unclear roles and responsibilities. Awareness of HFOMCs is low, especially among disadvantaged groups. Travel times to health facilities vary between districts and social groups. While most women rate health service quality positively, 31-40% report concerns like lack of medicines. The baseline establishes a benchmark for comparing impacts of the HFOMC strengthening interventions.

Standards and Best Practices for Confidentiality of Electronic Health Records

MEASURE Evaluation

This document summarizes standards and best practices for ensuring confidentiality of electronic health records. It discusses key concepts like privacy, security and confidentiality in the context of electronic health records. It outlines the situation in lower and middle income countries, where expertise and legal frameworks around eHealth privacy and security is often lacking. The document reviews global standards set by organizations like ISO, and emphasizes that while standards are important, non-technical factors like policy, processes and compliance are also critical to protecting health information privacy and security.

Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...

MEASURE Evaluation

Measuring National M&E System Strengthening in Nigeria: Application of the Mo...

MEASURE Evaluation

This document summarizes a study that used the Most Significant Change technique to measure strengthening of Nigeria's national M&E system from 2007-2012. Key stakeholders identified several most significant changes, including the harmonization of indicators to improve reporting, improved data quality through training, states now analyzing and using data, and the evolution of paper-based information systems to an integrated electronic system. These most significant changes were then verified through interviews and workshops to understand how the M&E system in Nigeria was strengthened over that period.

Enterprise Architecture: Treating Health Information System as an Enterprise

MEASURE Evaluation

Sam Wambugu from MEASURE Evaluation gave a presentation on using an enterprise architecture approach to strengthen health information systems in low- and middle-income countries. He discussed challenges facing health systems like inefficiencies and fragmentation. An enterprise architecture treats the health system as a single entity to improve integration and interoperability. It involves standardizing business processes, data, applications, and technologies. This approach can increase efficiency, reduce duplication, and make critical information more accessible to support decision making and better health outcomes.

Small grants, big opportunities: Using the small grants mechanism to build l...

MEASURE Evaluation

15 research projects were completed across multiple countries, focusing on topics like integrating family planning data and assessing quality of services. The grants improved local research capacity in areas like proposal writing, data analysis, and reporting. Findings were disseminated through reports, conferences, and online to inform programs and policies. The small grants were found to be a cost-effective way to fill local evidence gaps and promote data use for family planning.

RHINO Gender and Health Information Systems Forum Kick-off Webinar

MEASURE Evaluation

Demystifying Disaggregated Data: Factors that Affect Collection and Use of Se...

MEASURE Evaluation

What Makes a Good Performance Management Plan? A new tool for managers

MEASURE Evaluation

The document provides guidance on what makes a good performance management plan (PMP). It outlines 14 key factors for a quality PMP, including having a clear results framework, indicators that reflect project objectives, and practical plans for collecting high-quality data. A good PMP is easy to follow, with the right level of indicators to assess results while still being manageable. It also identifies costs for implementation and opportunities for evaluation. Developing a strong PMP upfront helps guide effective management and decision making.

Hmn Arusha Symposium Jan09

MEASURE Evaluation

The Health Metrics Network (HMN) was launched in 2005 with the goal of increasing the availability and use of timely and reliable health information. It aims to do this by coordinating investments in core country health information systems. The HMN has three main objectives: establish a common health information system framework, strengthen individual country health information systems, and improve access to and use of health data. It has provided tools like an assessment tool and strategic planning tool to help countries evaluate and improve their health information systems. To date, the HMN has facilitated health information system assessments and planning in over 66 countries.

How to Assess and Continuously Improve Maturity of Health Information Systems...

MEASURE Evaluation

This document describes a new toolkit for assessing and continuously improving health information systems (HIS) to achieve better health outcomes. The toolkit includes: 1) A five-stage scale to measure the maturity of six HIS components, from emerging to optimized. 2) An assessment tool that maps the current and desired future stages to guide improvement planning. It is administered through key informant interviews and a stakeholder workshop. 3) The goal is to help countries strengthen their HIS through a collaborative, participatory process focused on setting priorities and tracking progress over time.

What's hot

Data Visualization for Decision Making in HIV Programs

MEASURE Evaluation

Information Products to Drive Decision Making

MEASURE Evaluation

Centralizing Evidence: Health Information Systems Strengthening Resource Center

MEASURE Evaluation

HIS Strategic Planning in Afghanistan 2009 and 2015

MEASURE Evaluation

Health Information Systems Strengthening (HISS) in Kenya

MEASURE Evaluation

Interoperability & Crowdsourcing: Can these improve the management of ANC pro...

MEASURE Evaluation

Key Populations and the HIV Epidemic: Lessons Learned in M&E and Future Direc...

MEASURE Evaluation

Surfing a Great Wave: Data Science and Global Health

MEASURE Evaluation

Improving Health Information Systems to Meet the Needs of the Health Sector

MEASURE Evaluation

Operational Guidelines for Monitoring and Evaluation of HIV Programmes for Se...

MEASURE Evaluation

Health Information System: Interoperability and Integration to Maximize Effec...

MEASURE Evaluation

Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...

MEASURE Evaluation

Standards and Best Practices for Confidentiality of Electronic Health Records

MEASURE Evaluation

Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...

MEASURE Evaluation

Measuring National M&E System Strengthening in Nigeria: Application of the Mo...

MEASURE Evaluation

Enterprise Architecture: Treating Health Information System as an Enterprise

MEASURE Evaluation

Small grants, big opportunities: Using the small grants mechanism to build l...

MEASURE Evaluation

RHINO Gender and Health Information Systems Forum Kick-off Webinar

MEASURE Evaluation

Demystifying Disaggregated Data: Factors that Affect Collection and Use of Se...

MEASURE Evaluation

What Makes a Good Performance Management Plan? A new tool for managers

MEASURE Evaluation

What's hot (20)