Presentation of the proliferation of measurement in health care and how organizations should redesign indicator selection processes to engage and motivate managers to improve performance. Presentation to eHealth students based on 2023 PhD dissertation.
Dokumen tersebut membahas tentang pengaruh gizi pada atlet, termasuk kebutuhan energi dan zat gizi atlet saat latihan, pertandingan, dan pasca pertandingan serta prinsip pemberian makanan pada masing-masing fase tersebut.
Presented at ‘Training of Trainers’ Latihan Penilaian Kesihatan Mental & Psikososial untuk Permintaan Pengguguran
Peringkat Nasional, Ministry of Health Malaysia . 22-23 August 2017.
This document contains two lists of students' names from Class 2 Jupiter, taught by Pn Norlela Wa Laila bt Satar. The first list contains 35 students' names along with their identification numbers. The second list simply repeats the names of the 35 students in Class 2 Jupiter without the identification numbers. Both lists do not contain any dates.
Dokumen tersebut membahas tentang pengaruh gizi pada atlet, termasuk kebutuhan energi dan zat gizi atlet saat latihan, pertandingan, dan pasca pertandingan serta prinsip pemberian makanan pada masing-masing fase tersebut.
Presented at ‘Training of Trainers’ Latihan Penilaian Kesihatan Mental & Psikososial untuk Permintaan Pengguguran
Peringkat Nasional, Ministry of Health Malaysia . 22-23 August 2017.
This document contains two lists of students' names from Class 2 Jupiter, taught by Pn Norlela Wa Laila bt Satar. The first list contains 35 students' names along with their identification numbers. The second list simply repeats the names of the 35 students in Class 2 Jupiter without the identification numbers. Both lists do not contain any dates.
Dokumen tersebut merupakan senarai semak untuk pemantauan kantin sekolah, kesihatan sekolah, dan pengurusan kebersihan sekolah. Ia mencakupi aspek pengurusan dan kebersihan kantin, program kesihatan seperti pencegahan penyakit, dan pengurusan sisa pepejal sekolah. Senarai semak ini digunakan untuk menilai sendiri sekolah dalam pelaksanaan program tersebut.
This document contains the meeting and event schedule for Carta Gantt Unit Kurikulum for 2014. It lists 20 items on the agenda including monthly staff meetings, curriculum meetings, committee meetings for UPSR and examinations, monthly assessments, and transition programs. It also includes a schedule assigning responsibilities for each item to different subject panels including English, Moral, Science, and others for each month of the year.
Dokumen tersebut berisi 18 halaman latihan soal matematika tahun 2 untuk mengisi petak, menambah, mengurang, dan menyebutkan nama-nama hari serta bulan. Guru matematika meminta siswa untuk menyelesaikan latihan-latihan tersebut dan menandatangani lembar kerja.
[Ringkasan]
Dokumen tersebut memberikan panduan pelaksanaan Penilaian Bersepadu Pegawai Perkhidmatan Pendidikan (PBPPP) bagi tahun 2021. Ia menjelaskan konsep, matlamat, proses, tanggungjawab jawatankuasa dan pegawai penilai serta sistem pelaporan penilaian.
Dokumen ini membahas tentang Standard Kecergasan Fisikal Kebangsaan (SEGAK) di Malaysia. SEGAK adalah ujian standar untuk mengukur tingkat kecergasan fisik siswa melalui serangkaian tes yang mencakup kekuatan, daya tahan, dan fleksibilitas tubuh. Dokumen ini menjelaskan tujuan, prosedur, dan jadwal pelaksanaan ujian SEGAK serta petunjuk untuk siswa dan orang tua.
Healthcare quality improvement for meaningful useSamantha Haas
The document discusses meaningful use of electronic health records and quality improvement processes for healthcare providers. Meaningful use involves using certified electronic health records to improve care quality, engage patients, improve care coordination, and maintain privacy. Providers must meet objectives across three stages related to clinical quality reporting. The quality improvement process involves defining aims, measuring baselines, analyzing processes, testing changes through PDSA cycles, and tracking results. Resources for meaningful use and quality improvement include the CMS website and regional extension centers.
The document discusses seven leadership leverage points for increasing quality and safety in healthcare organizations proposed by the Institute for Healthcare Improvement (IHI). The leverage points are: 1) establish system-level aims and oversight at the governance level, 2) develop an executable strategy to achieve aims, 3) channel leadership attention to system improvement, 4) include patients and families on improvement teams, 5) engage chief financial officers to champion quality, 6) engage physicians in improvement efforts, and 7) build improvement capability. Implementing these leverage points can help organizations successfully achieve sustained quality and safety gains through strategic planning and leadership commitment.
Dokumen tersebut merupakan senarai semak untuk pemantauan kantin sekolah, kesihatan sekolah, dan pengurusan kebersihan sekolah. Ia mencakupi aspek pengurusan dan kebersihan kantin, program kesihatan seperti pencegahan penyakit, dan pengurusan sisa pepejal sekolah. Senarai semak ini digunakan untuk menilai sendiri sekolah dalam pelaksanaan program tersebut.
This document contains the meeting and event schedule for Carta Gantt Unit Kurikulum for 2014. It lists 20 items on the agenda including monthly staff meetings, curriculum meetings, committee meetings for UPSR and examinations, monthly assessments, and transition programs. It also includes a schedule assigning responsibilities for each item to different subject panels including English, Moral, Science, and others for each month of the year.
Dokumen tersebut berisi 18 halaman latihan soal matematika tahun 2 untuk mengisi petak, menambah, mengurang, dan menyebutkan nama-nama hari serta bulan. Guru matematika meminta siswa untuk menyelesaikan latihan-latihan tersebut dan menandatangani lembar kerja.
[Ringkasan]
Dokumen tersebut memberikan panduan pelaksanaan Penilaian Bersepadu Pegawai Perkhidmatan Pendidikan (PBPPP) bagi tahun 2021. Ia menjelaskan konsep, matlamat, proses, tanggungjawab jawatankuasa dan pegawai penilai serta sistem pelaporan penilaian.
Dokumen ini membahas tentang Standard Kecergasan Fisikal Kebangsaan (SEGAK) di Malaysia. SEGAK adalah ujian standar untuk mengukur tingkat kecergasan fisik siswa melalui serangkaian tes yang mencakup kekuatan, daya tahan, dan fleksibilitas tubuh. Dokumen ini menjelaskan tujuan, prosedur, dan jadwal pelaksanaan ujian SEGAK serta petunjuk untuk siswa dan orang tua.
Healthcare quality improvement for meaningful useSamantha Haas
The document discusses meaningful use of electronic health records and quality improvement processes for healthcare providers. Meaningful use involves using certified electronic health records to improve care quality, engage patients, improve care coordination, and maintain privacy. Providers must meet objectives across three stages related to clinical quality reporting. The quality improvement process involves defining aims, measuring baselines, analyzing processes, testing changes through PDSA cycles, and tracking results. Resources for meaningful use and quality improvement include the CMS website and regional extension centers.
The document discusses seven leadership leverage points for increasing quality and safety in healthcare organizations proposed by the Institute for Healthcare Improvement (IHI). The leverage points are: 1) establish system-level aims and oversight at the governance level, 2) develop an executable strategy to achieve aims, 3) channel leadership attention to system improvement, 4) include patients and families on improvement teams, 5) engage chief financial officers to champion quality, 6) engage physicians in improvement efforts, and 7) build improvement capability. Implementing these leverage points can help organizations successfully achieve sustained quality and safety gains through strategic planning and leadership commitment.
Escalating healthcare costs, heightened awareness of medical errors, and a higher-than-ever number of insured Americans have drawn attention to the need for quality improvement in US healthcare. Today, many efforts around patient outcomes and safety, care coordination, efficiency, and cost-cutting are underway and care redesign initiatives are being evaluated to guide future healthcare quality improvements. The following tips may aid you in your healthcare improvement efforts.
This document discusses key concepts related to quality assurance in healthcare. It defines terms like quality, quality management, continuous quality improvement, and accreditation. It describes models for quality assurance like the Donabedian model and discusses factors that can affect quality assurance in nursing care. The document also outlines standards, indicators, and tools that can be used for quality control and improvement efforts. Overall, the document provides a comprehensive overview of the principles, approaches, and considerations involved in quality assurance programs for healthcare organizations.
This document discusses healthcare management and governance in Africa. It defines key concepts like governance, clinical governance, integrated governance and their importance. It outlines components of clinical governance like quality assurance, standards, risk management and performance measurement. It emphasizes that governance requires clear structures, accountability, information systems, standards, and continuous quality improvement through strategies like process mapping and Lean. The overall goal of governance is to continually improve patient care and safety.
The document discusses the limitations of performance indicators in driving continuous improvement in healthcare systems. It summarizes research finding that quality of care initially improved for conditions tied to incentives but gains did not persist over time. Both clinicians and patients reported negatives impacts on relationship-centered care. The document advocates measuring key development indicators along with traditional metrics to better support staff capacity building and a balanced focus on quality, outcomes, relationships and learning. A more holistic approach is needed to unlock potential and achieve sustainable performance gains.
This document discusses measurement for quality improvement in healthcare. It defines measurement as the systematic collection of quantifiable data about processes and outcomes over time or at a single point in time. The purpose of measurement is to identify ways to improve, track performance improvements, and focus efforts on the right areas. Measurement should involve employees and measure effectiveness, efficiency, and support for strategic initiatives. Examples of potential measures for male and female wards are provided, including outcomes, processes, balancing measures. Cause and effect diagrams and building a cascading system of measures from the hospital board level down to individual caregivers and patients is also discussed.
This document discusses measurement for quality improvement in healthcare. It defines measurement as the systematic collection of quantifiable data over time or at a single point in time about processes and outcomes. The purpose of measurement is to identify areas for improvement, track performance changes, and focus efforts on strategic priorities. The document recommends measuring effectiveness, efficiency, and factors that support strategic goals using simple metrics developed with employee input. Examples provided include measures for length of stay, patient satisfaction, and infection rates. Cause-and-effect diagrams and a framework for cascading measures across different system levels are also presented.
This document discusses fundamentals of quality in healthcare. It defines key terms like quality assurance, quality of care, and factors driving attention to quality like limited resources and patient demands. It describes Donabedian's framework for assessing quality, which looks at structure, process and outcomes. Achieving quality requires accessible, efficient and acceptable services. Ensuring quality involves continuous quality improvement approaches like plan-do-check-act cycles and evidence-based medicine. The goal is to provide high quality care through ongoing evaluation and improvement.
This document discusses fundamentals of quality in healthcare. It defines key terms like quality assurance, total quality management, and continuous quality improvement. It explains that quality can be assessed based on structure, process, and outcomes. Structure looks at the environment where care is provided. Process examines the care provided by practitioners. Outcomes assess the benefits achieved by patients. Achieving quality requires accessible, efficient, and acceptable services based on current knowledge. Continuous efforts are needed to monitor, assess, and improve healthcare quality.
HS410 Unit 6 Quality Management - DiscussionDiscussionThi.docxAlysonDuongtw
HS410 Unit 6: Quality Management - Discussion
Discussion
This is a graded Discussion
. Please refer to the Discussion Board Grading Rubric in Course Home / Grading Rubrics.
Respond to all of the following questions and be sure to respond to two of your other classmates’ postings:
1.
What are the steps in the quality improvement model and how is benchmarking involved?
2. What are the stages in which data quality errors found in a health record most commonly occur?
3. What is the definition of risk management?
4. What are the parts of an effective risk management program?
5. What is utilization review and why is it important in healthcare?
6. What is the process of utilization review?
Please paper should be 400-500 words and in an essay format, strictly on topic, original with real scholar references to support your answers.
NO PHARGIARISM PLEASE!
This is the Chapter reading for this assignment:
Read Chapter 7 in
Today’s Health Information Management
.
INTRODUCTION
Quality health care “means doing the right thing at the right time, in the right way, for the right person, and getting the best possible results.”1 The term quality, by definition, can mean excellence, status, or grade; thus, it can be measured and quantified. The patient, and perhaps the patient's family, may interpret quality health care differently from the way that health care providers interpret it. Therefore, it is important to determine—if possible—what is “right” and what is “wrong” with regard to quality health care. The study and analysis of health care are important to maintain a level of quality that is satisfactory to all parties involved. As a result of the current focus on patient safety, and in an attempt to reduce deaths and complications, providing the best quality health care while maintaining cost controls has become a challenge to all involved. Current quality initiatives are multifaceted and include government-directed, private sectorsupported, and consumer-driven projects.
This chapter explores the historical development of health care quality including a review of the important pioneers and the tools they developed. Their work has been studied, refined, and widely used in a variety of applications related to performance-improvement activities. Risk management is discussed, with emphasis on the importance of coordination with quality activities. The evolution of utilization management is also reviewed, with a focus on its relationship to quality management.
In addition, this chapter explores current trends in data collection and storage, and their application to improvements in quality care and patient safety. Current events are identified that influence and provide direction to legislative support and funding. This chapter also provides multiple tips and tools for both personal and institutional use.
DATA QUALITY
Data quality refers to the high grade, superiority, or excellence of data. Data quality is intertwined with the concept of.
• Performance management overview and relevance to public health
• Turning Point Performance Management System Framework overview
• Turning Point Performance Management System Framework 2012 refresh
• Tools to help your organization assess performance management capacity
• Performance management resources
The document discusses various approaches to quality improvement in healthcare, including Six Sigma, Total Quality Management (TQM), and the FADE model. Six Sigma uses statistical methods and aims for near-zero defect rates. TQM takes a customer-focused approach to continuous process improvement through methods like scientific problem-solving and participation at all levels. The FADE model outlines five steps for quality improvement projects: focus, analyze, develop, execute, and evaluate. Microsystems thinking views individual care units as the building blocks for organizational outcomes.
This document discusses clinical audit, which seeks to improve patient care through systematic review of care against criteria and implementing changes where needed. It defines audit and outlines the audit cycle of selecting a topic, identifying standards, collecting data on performance, implementing changes if needed, and monitoring further to ensure improvement. The document provides examples of what can be audited, such as structure, processes of care, or outcomes. It emphasizes that audit criteria should be evidence-based and measurable. The goal of audit is to continuously improve quality of care.
Paying for performance to improve the delivery of health interventions in LMICsReBUILD for Resilience
This presentation from Sophie Witter & Karin Diaconu of Queen Margaret University, UK outlines the findings from a Cochrane review undertaken by the team on paying for performance to improve the delivery of health interventions in low and middle-income countries.
MEDICAL AUDIT
Evaluation of data, documents, and resources to check performance of systems meets specified standards
PRESCRIPTION MONITORING, ADR, DRUG RELATED PROBLEMS, staff safety, data,defining standards,
collecting data,
identifying areas for improvement,
making necessary changes
back round to defining new standards.
The document discusses how public health agencies can implement enterprise performance management (EPM) to strengthen their infrastructure and improve health outcomes. EPM involves using integrated processes, tools, and technology to define an organization's mission, values, vision, and strategy, and then linking objectives and key performance indicators to improve decision-making and manage performance. The CDC has provided funding to help public health departments implement EPM. EPM requires establishing foundational elements like mission and values, and then using tools like the balanced scorecard to cascade objectives and measures throughout an organization. The document outlines EPM frameworks and provides an example of how the CDC implemented EPM in its COTPER division with success.
Knowledge Translation: Practical Strategies for Success v1Imad Hassan
This document discusses knowledge translation (KT), which is the process of moving research findings and evidence into clinical practice. It provides an overview of KT and outlines a framework for conducting KT comprising 9 steps: 1) identifying a knowledge-practice gap; 2) measuring the magnitude and root cause; 3) forming a KT team; 4) finding and appraising the evidence; 5) assessing barriers; 6) adapting knowledge; 7) selecting and implementing interventions; 8) monitoring process and outcomes; and 9) sustaining improvements. The document then provides a practical example of using this framework to improve documentation of red flags for low back pain patient referrals to physical therapy.
This document discusses quality improvement and patient safety in anesthesia. It defines key terms like quality improvement, continuous quality improvement and differentiates it from traditional quality assurance. It outlines frameworks for improvement like the Model for Improvement and discusses tools used for quality improvement like Lean methodology, Six Sigma and PDSA cycles. It discusses important measures for quality improvement like process, outcome and balancing measures. Methods for analyzing and displaying quality improvement data like control charts and dashboards are described. Sources of quality improvement information and the importance of incident reporting are also summarized.
Standards Compliance And Quality ManagementRick Jones
The document discusses standards compliance and quality management in the Northern Cape Department of Health. It covers the relationship between standards, safety, and quality. It proposes management committee structures to support clinical governance and quality improvement. It emphasizes developing an "improvement culture" through leadership, goal setting, learning from mistakes, and testing new approaches. The quality improvement strategy involves setting standards, self-assessment, developing annual quality improvement plans, and performance monitoring over three years. The goal is to improve quality of care based on what patients want through proper governance and the national core standards.
Similar to M Heenan_PhD Dissertation Lecture_eHealth Lecture_Engaging Leaders in KPI Selection_Final_July 2023 (20)
About CentiUP - Product Information Slide.pdfCentiUP
A heightened child formula, with the trio of Nano Calcium, HMO, and DHA mixed in the golden ratio, combined with NANO technology to help nourish the body deeply and comprehensively, helps children increase height, boost brain power, and improve the immune system and overall well-being.
2024 Media Preferences of Older Adults: Consumer Survey and Marketing Implica...Media Logic
When it comes to creating marketing strategies that target older adults, it is crucial to have insight into their media habits and preferences. Understanding how older adults consume and use media is key to creating acquisition and retention strategies. We recently conducted our seventh annual survey to gain insight into the media preferences of older adults in 2024. Here are the survey responses and marketing implications that stood out to us.
8. CONTRAINDICATIONS: MOVEMENT IN YOGA
8. Introduction to Contraindications
Students come to yoga classes with a variety of physical, mental, and emotional conditions that should be given special attention and support by teachers.
While making clear the distinction between yoga teacher and licensed medical or mental health professional, as teachers we are responsible for creating a safe and supportive environment for all students, including those with injuries, depression, age-related needs, and conditions such as pregnancy and menopause.
Here we will look at practical approaches to working with students whose bodies, hearts, and minds (which are not really separate) indicate the need for special accommodation in classes or in one-on-one sessions. Bringing a specifically yogic perspective to this aspect of teaching starts with looking at and appreciating every student as the whole person he or she is, offering tools and techniques for using various challenging conditions to heal, feel better, and move into a deeper quality of integration.
About CentiUP - Introduction and Products.pdfCentiUP
A heightened child formula, with the trio of Nano Calcium, HMO, and DHA mixed in the golden ratio, combined with NANO technology to help nourish the body deeply and comprehensively, helps children increase height, boost brain power, and improve the immune system and overall well-being.
Bashundhara Toiletries Logo Guideline 2024khabri85
It outlines the basic identity elements such as symbol, logotype, colors, and typefaces. It provides examples of applying the identity to materials like letterhead, business cards, reports, folders, and websites.
Simple Steps to Make Her Choose You Every DayLucas Smith
Simple Steps to Make Her Choose You Every Day" and unlock the secrets to building a strong, lasting relationship. This comprehensive guide takes you on a journey to self-improvement, enhancing your communication and emotional skills, ensuring that your partner chooses you without hesitation. Forget about complications and start applying easy, straightforward steps that make her see you as the ideal person she can't live without. Gain the key to her heart and enjoy a relationship filled with love and mutual respect. This isn't just a book; it's an investment in your happiness and the happiness of your partner
At Malayali Kerala Spa Ajman we providing the top quality massage services for our customers.
Our massage center prioritizes efficiency to ensure a quality massage experience for our clients at Malayali Kerala Spa Ajman. We offer a convenient appointment system and precise massage services.
Reach us at Villa No 7, Near Ammar Bin Yasir Street Al Rashidiya 2 - Ajman - United Arab Emirates.
Phone : +971 529818279
Dr. Sherman Lai, MD — Guelph's Dedicated Medical ProfessionalSherman Lai Guelph
Guelph native Dr. Sherman Lai, MD, is a committed medical practitioner renowned for his thorough medical knowledge and caring patient care. Dr. Lai guarantees that every patient receives the best possible medical care and assistance that is customized to meet their specific needs. She has years of experience and is dedicated to providing individualized health solutions.
M Heenan_PhD Dissertation Lecture_eHealth Lecture_Engaging Leaders in KPI Selection_Final_July 2023
1. Health care indicator selection processes:
How to select engaging metrics to motivate front-line managers.
Dr. Michael A. Heenan, PhD
McMaster University, eHealth Summer Program
PhD Dissertation Based Presentation
July 26, 2023
2. Mike Heenan, Ph.D.
• Hospital Executive Vice-President
• Sessional Lecturer, McMaster University – DeGroote School
of Business
• PhD, Business Administration, Health Policy Management,
2023
• Thesis research: how health care organizations selected key
performance metrics and how the process of indicator
selection impacts front line managers motivation to
improve performance.
2
3. Session Format
3
eHealth – Why this Lecture?
The Literature and Our Problem – Metric Madness
Hospital Executive Perception of Front-Line Manager’s Knowledge
What Indicators Motivate Front-Line Clinical Managers?
What did the pandemic teach us?
The 5-P Indicator Selection Process Framework
The Politics of Improvement: Your Challenge as eHealth Leaders
5. eHealth – Why this Lecture?
Your program objectives:
1. Understand eHealth concepts
2. Communicate effectively in eHealth contexts
3. Apply eHealth Knowledge in practical contexts
5
6. Key Readings We will Reference
• Damschroder LJ, Robinson CH, Francis J, et al. Effects of Performance Measure Implementation on Clinical
Manager and Provider Motivation. J Gen Intern Med. 2014; 29(S4):877-884. DOI: 10.1007/s11606-014-
3020-9.
• Elliot C, Mcullagh C, Brydon M, Zwi K. Developing key performance indicators for a tertiary children’s
hospital network. Australian Health Review. 2018; 42(5):491-500. DOI: 10.1071/AH17263.
• Ginsburg LS. Factors that Influence Line Managers’ Perceptions of Hospital Performance Data. Health
Services Research. 2003; 38(1):261-286. DOI: 10.1111/1475-6773.00115.
• Heenan MA, Randall GE, Evans JM. Selecting Performance Indicators and Targets in Health Care: An
International Scoping Review and Standardized Process Framework. Risk Management and Healthcare
Policy. 2022; 15:747-764. DOI: 10.2147/RMHP.S357561.
• Mannion R, Braithwaite J. Unintended consequences of performance measurement in health care: 20 salutary
lessons from the English National Health Service. Internal Medicine Journal. 2012; 42(5):569–574. DOI:
10.1111/j.1445-5994.2012.02766.x
6
7. To Start …
Two Key Definitions
Performance Measurement is defined as the collection, use and public
reporting of data for the purpose of quality improvement, accountability,
and transparency.
America Academy of Family Physicians Performance Measurement Criteria. [Internet] 2022. [Cited 27 Nov 2022].
Available from: https://www.aafp.org/about/policies/all/performance-measures.html
Indicators are defined as measurable elements of practice performance that
relate to clinical, population health, financial, or organizational performance.
Lawrence M, Olesen F. Indicators of Quality in Health Care. The European Journal of General Practice.
1997; 3(3):103-108. DOI: 10.3109/13814789709160336
7
8. To Start …
Indicators are Metrics, Metrics are Indicators
Indicators also known as
• Key Performance Indicators
• Performance Indicators
• Quality Indicators
• Performance Metrics
• Performance Measures
• Quality Metrics
8
9. To Start …
Donabedian Framework
Framework for evaluating health care service quality.
Information on quality of care can be seen through three types of indicators:
Structure: factors that affect the context in which care is delivered
Process: actions the describe how care is delivered
Outcome: effects of healthcare delivery on patients or populations, including
changes to health status, behavior, or knowledge as well as patient satisfaction
and health-related quality of life
9
Donabedian A. The quality of care: how can it be assessed? JAMA. 1988 Sep 23; 260(12):1743-8. DOI: 10.1001/jama.1988.03410120089033.
11. Needed Measurement Led to Too Much Measurement
• USA, 1999 - Approximately 98,000 Americans lost their lives each year due to medical error.
• Canada, 2004 - Average of 7.5% of hospital admissions resulting in an adverse event.
• Multiple governments, regulatory agencies, and funding bodies have mandated the
collection and monitoring of hundreds of KPIs by hospitals
11
Kohn LT, Corrigan JM, Donaldson MS. To Err is Human: Building a Safer Health System. Washington, DC: National Academy Press, 2000.
Baker GR, Norton P, Flintoff V, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. Canadian Medical Association Journal.
2004; 170(11):1678-1686. DOI: 10.1503/cmaj.1040498
12. Needed Measurement has Led to Too Much Measurement
12
USA:
• Centre for Medicare and Medicaid Services (CMS) monitors over 1700 KPIs
• National Quality Forum (NQF) approved KPIs grew from 200 in 2005 to over 700 in 2011
• Study concluded over 550 distinct KPIs were being collected across 48 states
Canada
Ontario Hospital Association and Health Quality Ontario argue there are over 300 quality KPIs reported
by hospitals.
International
Over-measurement has been echoed in the United Kingdom and Australia (Mannion and Braithwaite 2011).
Panzer RJ 2013; Wilensky G 2018; Meyer GS 2012; Greenburg A 2019; Mannion R 2012;
13. The Management Problem:
Overabundance of KPIs has resulted in unintended consequences
13
• Data mandated by state bodies do not necessarily reflect every local context and may be
used inappropriately
• Public reporting of KPIs without local input has resulted in a lack of trust between
providers and political bodies, and gaming
• Reporting mandates have also increased financial costs to organizations
• Building of the information technology and data infrastructure required to support
measurement has amplified the amount of data available to health care organizations
Mannion R and Braithwaite 2011; Safavi 2006; Teare 2014; Meyer et al 201, Berwick 2016
14. Perla: The U Curve
Paralyzed decision making (Cassel et al 2014, Perla 2013).
14
Perla R. Commentary: Health Systems Must Strive for Data Maturity. American Journal of Medical Quality. 2013; 28(3):263-264. DOI:10.1177/1062860612465000.
15. Call for Balance and Parsimony
1. Measure process quality
2. Measure value
3. Design data systems for internal quality needs and spinoff external
quality measures
4. Use return on investment
5. Establish ongoing process to refine and select core measures
15
Meyer GS, Nelson EC, Pryor DB, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012; 21(11):964-968.
DOI: 10.1136/bmjqs-2012-001081.
16. Question # 1
How does eHealth further hinder the phenomenon of over-
measurement?
16
17. A Call for Balance, but…
Not Directly Linked to Goal Theory
Some agencies have heeded these calls.
• Institute of Medicine (2015) recommends 15 national KPIs that systems should monitor (Blumenthal and
McGinnis 2015).
• National Quality Forum (2019) instituted annual review process that endorses certain KPIs for adoption to
ensure their relevancy to overall system goals. (NQF 2019)
• World Health Organization started examining processes in 2008 and offered criteria to narrow KPI selection
(Smith et al 2008).
• Research papers describe Delphi methods used to select KPIs in clinical areas (Schull et al 2011, Madsen et al
2016, Harvey 2016, Murphy 2016).
These reports describe criteria and methods to select an appropriate number of quality and patient safety
KPIs at the system or clinical service level, but…
a) They do not clarify who should be involved in KPI and Target selection, or,
b) how health service provider organizations like hospitals should use selection processes as an
instrument to motivate leaders to achieve agreed upon goals.
17
19. What processes do hospitals use to select performance indicators and do they align with best
practices? A multiple-case study of four hospitals in Ontario, Canada
Qualitative, multiple-case study of four acute care hospitals and how they select indicators
Results
• Process elements largely absent include:
• adopting evidence-based selection criteria
• considering finance and human resources indicators;
• considering if indicators measure structure, process or outcomes,
• engaging a broader set of end-users in the selection process.
• Revealed senior management teams had little confidence in clinical unit managers’
ability to use indicators to improve performance.
19
21. Who are and why do we care about
Front-Line Managers?
Who
• Clinical unit / Front-Line managers are employees who are both supervised by an
organization’s top managers and who themselves supervise front-line employees.10
Why
• Managers’ commitment and ability to implement innovative change at the unit level
has been linked to strategy realization, efficiency of operations, cost control, and overall
achievement of quality outcomes.10-12
• If positively motivated and engaged, Managers can effectively support innovation and
change. If managers are disengaged and not motivated, it can impede improvement in
the units they oversee.13-15
• Managers’ motivation and commitment increases when their senior managers support
them with the infrastructure and resources necessary for change.14,16
21
22. Managers and Goal-Setting Theory of Motivation
Goal-Setting Theory of Motivation emphasizes the relationship between goals and
performance.
Task performance is influenced by the manager’s ability; the stated goal’s content, intensity,
and duration; the manager’s self-efficacy; and the personal goals of the manager.
Key Attributes:
1. Benefit of participating in goal setting processes is cognition on what’s important and why;
2. Specific goals with harder to reach improvements result in a greater effort by managers;
3. Regular feedback increases performance effort by improving manager’s self-efficacy.
4. Managers that feel supported by their leadership have improved self-efficacy;
5. Managers that feel part of a larger team improve effort through both a shared understanding of the
goal’s direction and shared-accountability; and,
6. Managers increased confidence leads to greater motivation to act and perform tasks.
22
Locke EA, Latham GP. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist. 2002; 57(9): 705–717. DOI:
10.1037//0003-066x.57.9.705
23. Need to understand base motivations:
Why clinicians become managers
• Clinical managers never thought of becoming a manager when completing
their initial clinical education.
• Front-line clinicians move into management to help improve quality and
the working conditions of their fellow staff.
• When asked what indicators they prefer clinical unit managers referenced
process indicators that help advance clinical practice, and front-line staff
engagement as criteria by which they would choose indicators.
23
Kleinman CS. Leadership Roles, Competencies, and Education: How Prepared Are Our Nurse Managers? Journal of Nursing Administration. 2003; 33(9):451-455.
DOI: 10.1097/00005110-200309000-00005.
White J. Motivation for Seeking a Nurse manager Position. [dissertation]. San Diego, CA: University of San Diego, 2015.
Available from: https://digital.sandiego.edu/dissertations/17
24. Why do managers use performance data?
24
Ivankovic D, Poldrugovac M, Garel P, Klazinga NS, Kringos DS (2020) Why, what and how do European healthcare managers use performance data? Results of a survey and workshop
among members of the European Hospital and Healthcare Federation. PLoS ONE 15 (4): e0231345. https://doi.org/10.1371/journal.pone.0231345
25. What barriers do managers face in using data?
• Managers gave three barriers: lack of training
and knowledge on measurement, workload,
and job experience.
• Managers need to obtain is the understanding,
interpretation, and use of performance data for
evidence-based decision making.
• Clinicians are often appointed to managerial
roles without business skills, and they therefore
need to learn them through trial and error.
25
“My education is based on how to be a
nurse, not how to decipher data and know
what it means. So, some of this stuff is
foreign to me and it’s been trial by fire for
me.”
Case B-Manager 3
Birken SA, Lee SYD, Weiner BJ. 2012; DOI: 10.1186/1748-5908-7-28.
Naranjo-Gil D. 2009; DOI: 10.1097/HMR.0b013e31819e8fd0.
Kleinman CS. 2003; DOI: 10.1097/00005110-200309000-00005.
McCallin AM, Frankson C. 2010; 1DOI: 10.1111/j.1365-2834.2010.01067.x
Heenan, MA. 2023. (Doctoral dissertation).
“I have not received any training or
education on measurement here. When I
started in the role, it was kind of just sink or
swim.”
Case A-Manager 3
26. How clinical unit managers’ roles in selecting hospital indicators impacts their motivation and
self-efficacy to improve performance: A qualitative multiple-case study.
Qualitative multiple-case study of four hospitals involving 22 managers. Semi-structured
Interviews. Thematic Analysis.
Results:
• Managers reported being unaware of the criteria hospitals used to select indicators, are
not trained in measurement, feel they have little control over the indicators they were
accountable for, and were fearful of reporting on performance.
• Managers motivated by process indicators focused on clinical quality and patient
experience vs. outcome or business indicators.
• Managers gained confidence over time and by learning how to communicate the utility
of indicators to front-line staff.
26
Heenan, M. A. (2023). Health Care Indicator Selection Processes and their Impact on Clinical Unit Managers’ Motivation and Self-Efficacy to Improve
Performance (Doctoral dissertation).
27. Ginsburg: Factors that Influence Line Managers’
Perceptions of Hospital Performance Data
27
Ginsburg LS. Factors that Influence Line Managers’ Perceptions of Hospital Performance Data. Health Services Research. 2003; 38(1):261-286. DOI: 10.1111/1475-6773.00115
“Simply generating performance data will not, in and of itself, lead to improvement.”
Factors Significant Correlation to
Perceived Usefulness of Data
• Data quality
• Data relevance
• Report complexity
• Intensity of dissemination
28. Damschroder: Effects of Performance Measure
Implementation on Manager Motivation
• Indicators need to be
designed to both incent
individuals and build
coalitions.
• Indicators sit within a QI
foundation but only effective
if seen positively by fully
engaged staff and
management.
28
Damschroder LJ, Robinson CH, Francis J, et al. Effects of Performance Measure Implementation on Clinical Manager and Provider Motivation. J Gen Intern Med. 2014;
29(S4):877-884. DOI: 10.1007/s11606-014-3020-9.
29. Question # 2
Now knowing the motivations and challenges end-users have
in using data, how can eHealth help the phenomena of over-
measurement?
29
31. What did the pandemic teach us?
Executive Perspectives
• Senior management leaders
mentioned that some clinical
practice, supply chain, and human
resource indicators, once thought
not important to regular
monitoring, had surfaced as
priorities.
31
Heenan MA. Health Care Indicator Selection Processes and their Impact on Clinical Unit Managers’ Motivation and Self-Efficacy to Improve Performance (Doctoral dissertation).
“COVID taught us that after years of trying to get the
organization to make data-driven decisions that often fell
on deaf ears, the organization was thirsty for data about
this new disease. This demand for data was likely a result
of operating in a new unknown environment and the need
to base operational decisions on emerging data compared
to traditional lagging indicators.
COVID also taught us that we likely had been
providing the wrong data before the pandemic. COVID
forced us to prioritize our efforts and stopped us from
chasing too many indicators. It led us to provide more
leading process-based indicators that clinical units found
useful in planning their day versus lagging outcome data
that government wanted.”
Case B-Executive 2
32. What did the pandemic teach us?
Front-Line Manager Perspectives
Clinical unit managers uniformly shared that the
pandemic:
• created a single priority for their organizations;
• involved greater engagement in, and lead to,
faster decision making;
• Focus on process indicators related to practice
and staff safety.
• Example, new indicator monitored more
closely – personal protective equipment (PPE)
Inventory Levels
32
“COVID has changed everything. I've seen
senior leader sentiment sort of evolve from
when people are being told to do things versus
asking us why we're doing them. Senior leaders
have become clinically focused. We see them
maybe a little bit better for who they are now
because the data is not being shoved down our
throats. We are being asked if certain data
makes sense to us. My VP is just, yep, whatever
you need, so I get that support, which makes a
huge difference.”
Case A-Manager 4.
Heenan MA. Health Care Indicator Selection Processes and their Impact on Clinical Unit Managers’ Motivation and Self-Efficacy to Improve Performance (Doctoral dissertation).
33. Lessons
1. Crises create opportunities to see new needs and new ways
2. Decision making structures get flatter, relationships gets stronger,
because you engage the end-user deliberately and quickly
3. Process metrics matter and help inform priority actions
4. Managers want to be engaged to better understand their accountabilities
and help select process indicators that measure quality, clinical practice,
patient experience and staff engagement
33
34. In designing or selecting indicators, what framework
should guide us?
The 5-P Indicator Selection Process Framework
34
35. Selecting performance indicators and targets in health care:
An international scoping review and standardized process framework
Purpose: Synthesize international approaches to indicator selection and develop a standardized process
framework.
Methods:
• PRISMA-ScR Scoping review using Pub Med & Web of Science.
• English-language papers from 11 countries, 2010-2020.
• Reviewed 33 peer-reviewed papers and 11 grey-literature documents.
• Looked at processes with a lens to: Aim; Governance; Preparation; Process Methods; Validation
Results:
• Some processes used Appraisal of Indicators through Research and Evaluation (AIRE) Instrumentand the
Quality Indicator Critical Appraisal (QICA) tool to guide which individual indicators should be considered.
• No standardized indicator selection process framework exists that focuses on engagement that solicits buy
in and drives motivation.
35
Heenan MA, Randall GE, Evans JM. Selecting Performance Indicators and Targets in Health Care: An International Scoping Review and Standardized Process Framework.
Risk Management and Healthcare Policy. 2022; 15:747-764.
36. The 5-P Indicator Selection Process Framework
Incomplete indicator selection processes
risk:
o over-measurement,
o lack of prioritizing strategic and
operational goals,
o lack of support by end-users
o paralyzed decision-making ability.
• Standardized framework developed to
assist organizations complete a
comprehensive indicator and target
selection process.
36
Domain Element
Clarify Aim
Develop Guiding Principles
Identify Level of Use
Build Governance Structures
Recruit Participants
Seek End-User Input
Research Evidence-Based Literature
Build an Inventory of Potential Indicators
Categorize Potential Indicators into Strategic
Orient and Train Participants
Utilize a Consensus Building Method
Identify a Facilitator
Indicator Selection Criteria
Analytical Assess Indicators
Set Indicator Targets
Assess Data Quality
Validate with End-Users
5-P Indicator Selection Process Framework
Prepare
Procedure
Prove
Purpose
Polity
Heenan, MA, Randall GE, Evans JA. Selecting performance indicators and targets in health care: An international scoping review and standardized process framework. Risk Management and
Healthcare Policy. 2022; 15:747-764. DOI: 10.2147/RMHP.S357561.
37. Domain: Purpose
37
“Purpose” sets out the reasons why an indicator selection and target setting process is undertaken
– facilitating a shared understanding of what the organization is setting out to achieve.
Elements
• Clarify Aim
• Set Guiding Principles
• Identify Level of Use
38. Purpose: Three Elements
38
Watkins: Setting clear aims and guiding principles allows participants to understand the desired goals a process is
aiming to achieve and the actions to which they are expected to contribute.
Watkins MD. Demystifying Strategy: The What, Who How and Why. Harvard Business Review. September 10, 2007. Available from: https://hbr.org/2007/09/demystifying-strategy-the-what
39. Elliot, 2018
39
Elliot C, Mcullagh C, Brydon M, Zwi K. Developing key performance indicators for a tertiary children’s hospital network. Australian Health Review. 2018; 42(5):491-500. DOI: 10.1071/AH17263.
Aim:
Following merger ad strategic plan, to address executive level
performance indicators for pediatric tertiary care services across two
campus
Guiding Principles:
KPIs must address the mission statement, “working in partnership to
improve heath and well being of children through clinical care, research
education and advocacy”.
Drive quality improvement in child health outcomes
Level of Use:
Executive Level / Board
40. Domain: Polity
Elements
• Build Governance Structures
• Recruit Participants
40
“Polity” identifies the governance structures that manage the selection process, how the process
will be resourced, and who participates.
41. Polity: Two Elements
41
Aktaa: Expert panels have inherent bias. Therefore, expansion of participants is important mitigation. Indicator
selection processes that have broader participation are more likely than others to have a more inclusive view of
front-line operations
Aktaa S, Batra G, Wallentin L, et al. European Society of Cardiology methodology for the development of quality indicators for the quantification of cardiovascular care and outcomes. European
Heart Journal Quality of Care and Clinical Outcomes. 2022; 8(1):4-13. DOI: 10.1093/ehjqcco/qcaa069.
42. Example: Elliot, 2018
42
Elliot C, Mcullagh C, Brydon M, Zwi K. Developing key performance indicators for a tertiary children’s hospital network. Australian Health Review. 2018; 42(5):491-500. DOI: 10.1071/AH17263.
Governance Structure
Single body - Executive Group
Participants / Inputs:
Network Executives;
Clinical Directors;
Medical, Allied Health and Nurse Managers.
43. Domain: Prepare
Elements
• Seek End-User Input
• Research Evidence Base Literature
• Build an Inventory of Indicators
• Categorize Indicators into Strategic Themes
• Orient and Train Participants
43
“Prepare” addresses how to plan for selection.
44. Prepare: Five Elements
44
Heenan
• Final list of indicators built from comprehensive sources improves their relevancy to end-users while enabling future
comparability and benchmarking.
• End-user input upfront on indicator knowledge and user requirements and issued orientation materials increased
participant engagement and improved understanding of the process among participants.
49. Domain: Procedure
Elements
• Utilize a Consensus Building Methodology
• Identify a Facilitator
• Set Indicator Selection Criteria
• Analytically Assess Indicators
• Set Indicator Targets
49
“Procedure” describes the how to steps used to assess indicators and targets and gain consensus.
50. Procedure: Five Elements
50
Stetler: Internal facilitation may bias processes whereas external facilitators have an ability to play both a problem
solving and supportive role that might otherwise be difficult when only internal parties are engaged. External
facilitation is valued when a process is focused on an interactive problem or distinct activity.
Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace CM. Role of external facilitation in implementation of research findings: a qualitative
evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science. 2006; 1(1):1-5. DOI: 10.1186/1748-5908-1-23.
52. Domain: Prove
Elements
• Assess Data Quality (Quantitatively)
• Validate with End-Users (Qualitatively)
52
“Prove” describes the validation processes used to test any final set of indicators for data quality
and relevance with end-users.
53. Prove: Two Elements
53
Heenan
• Processes that statistically test indicators increase scientific soundness and better informs target setting.
• Processes that validate a final list of indicators with end-users improve relevance and usability by users, especially in
cases where the expert panels did not include front-line directors, managers, or patients.
Heenan, MA, Randall GE, Evans JA. Selecting performance indicators and targets in health care: An international scoping review and standardized process framework. Risk Management and
Healthcare Policy. 2022; 15:747-764. DOI: 10.2147/RMHP.S357561.
54. Examples: Elliot, 2018 and Heenan, 2023
54
QUALITATIVE: Noted Limitation (Elliot)
“There was little or no consultation with less senior staff members, which risks losing the
support of staff who will be relied upon to provide data and ensure accurate reporting”
QUANTITATIVE: 2022 Case Study of 4 Ontario Hospitals (Heenan)
• None quantitatively validated KPIs - reasoned most of the indicators they monitor are
mandated by external funding agencies, and it is therefore assumed these indicators
were previously validated.
• This is a false assumption.
• While the technical formula of an indicator may have been validated by an external
agency, the data that is generated from the different local hospital information systems
may be of different quality than the data by which an indicator was tested by the
external agency. (e-heath)
55. Key Conclusion
Recall
• Overabundance of indicators has paralyzed decision making, and eroded trust
between those who ask for indicators and those who are expected to use them to
make change.
• Many policy institutes and academics have called for a more appropriate, lower
number of indicators.
Therefore
• Indicator selection or reduction processes cannot occur by happenstance.
• The 5-P Indicator Selection Process Framework to ensure a systematic, evidence-
based, and inclusive approach that engages measurement experts and those who
use indicators to monitor and improve performance in both selection and
validation. 55
56. Question # 3
What domain and element of the 5-P Indicator Selection
Process Framework can eHealth most help with? Why?
56
57. The politics of improvement:
Your challenge as eHealth Leaders
57
Process improvement is not only about adopting evidence but includes the process of
engaging those responsible for implementing the prescribed change
58. Beyond the evidence (or technology):
You’re not just an eHealth Leader but a Change Leader
58
• Quality Improvement initiatives are not simple
• Evidence is insufficient in itself to ensure implementation
Distributed Nature of Costs
and Benefits
Variety of Value Systems
Underlying Interventions
What’s in it ?
For Whom ?
What ideologies and
ethics are involved ?
Langley A, Denis J. Beyond evidence: the micropolitics of improvement. BMJ Quality and Safety. 2014; 20:i43-i46. DOI: 10.1136/bmjqs.2010.046482.
59. Hard Core and Soft Periphery
Hard core = Evidence that is
irreducible and carries key benefit.
(The Technical What)
Soft Periphery = Complex delivery
systems that take different forms and
if poorly organized may destroy the
benefit of the hard core.
(The Cultural Why & People)
59
60. Navigate:
The Micro-Political / Change Leader Check List
1. Understand the evidence
2. Identify who it will impact
3. Understand how it will change practice
4. Don’t make change alone: find a champion(s)
5. Solicit input on how to adopt locally
6. Sell the why (involve end-users)
7. Teach: Be a coach not a consultant
60
62. Your Program Objectives:
You hold knowledge and power, Use it Wisely
1. Understand eHealth Concepts
• The technology and systems you build and promote will be used to
make change by producing information and data.
• This information and data (indicators) can overwhelm the end-
users not aware of eHealth concepts.
2. Communicate Effectively in eHealth Contexts
• Ask why are we producing the information?
3. Apply eHealth Knowledge in practical contexts
• What will it be used for? And by Whom?
62
63. Final Conclusions
Answering … “How to select engaging performance metrics?”
1. Have a Structured, Open, Transparent Process
2. Include End-Users as Participants
3. Educate and Train participants on concepts
4. Allow Input on Past Experience before Selection
5. People Process Things to get to Outcomes so Process Metrics Matter
6. Validate Data in Real Environments
63
64. Abd then don’t forget …The U Curve
64
Perla R. Commentary: Health Systems Must Strive for Data Maturity. American Journal of Medical Quality. 2013; 28(3):263-264. DOI:10.1177/1062860612465000.
66. Dissertation Reference
66
Heenan, M. A. (2023). Health Care Indicator Selection Processes and their Impact on Clinical Unit Managers’
Motivation and Self-Efficacy to Improve Performance (Doctoral dissertation).
https://macsphere.mcmaster.ca/bitstream/11375/28348/2/Heenan_Michael_A_20
2302_PhD.pdf