Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures
Report
Share
•2 likes•387 views
![Introduction ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-2-2048.jpg?cb=1669203846)
![Prior Surveillance Work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-3-2048.jpg?cb=1669203846)
![Goal/Main Idea/Thesis (?) ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-4-2048.jpg?cb=1669203846)
![Passive Alerts ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-5-2048.jpg?cb=1669203846)
![Interruptive Alerts ,[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-6-2048.jpg?cb=1669203846)
![Order Sets ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-7-2048.jpg?cb=1669203846)
![Complex Ordering Advisors ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-8-2048.jpg?cb=1669203846)
![Surveillance Applications ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-9-2048.jpg?cb=1669203846)
![Prototype ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-10-2048.jpg?cb=1669203846)
![Surveillance View ,[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-11-2048.jpg?cb=1669203846)
![Patient Detail View ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-13-2048.jpg?cb=1669203846)
![Requirements ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-16-2048.jpg?cb=1669203846)
![Conclusions ,[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-17-2048.jpg?cb=1669203846)
![Acknowledgments ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/mccoynlm2009-091102090905-phpapp02/75/realtime-surveillance-for-rapid-correction-of-clinical-decision-support-failures-18-2048.jpg?cb=1669203846)
Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures
•2 likes•387 views
Report
Share
The utilization of clinical decision support (CDS) is increasing among healthcare facilities which have implemented computerized physician order entry or electronic medical records. Formal prospective evaluation of CDS implementations occurs rarely, and misuse or flaws in system design are often unrecognized. Retrospective review can identify failures but is too late to make critical corrections or initiate redesign efforts. Real-time surveillance of user responses and patient outcomes comprises one approach to give immediate feedback to CDS designers and help operate a safety net which intercepts CDS failures. We outline four types of CDS (passive alerts, interruptive alerts, order sets, and complex ordering advisors) and describe common failures with surveillance applications for high-alert medications such as aminoglycosides, anticoagulants, and insulin. We then present a computerized tool for high-alert medication prescriptions which serves developers, clinical pharmacists, and institutional physician leaders. The tool has two views: the surveillance view allows users to scan all CDS failures and prioritize high-risk scenarios, and the patient detail view provides context for understanding CDS failures. Entries on the surveillance tool populate automatically when CDS is used or ignored, allowing verification of prescription safety and accuracy.
Recommended
More Related Content
What's hot
What's hot(20)
Similar to Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures
Similar to Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures(20)
More from Allison McCoy
More from Allison McCoy(11)
Recently uploaded
Recently uploaded(20)
Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures
- 1. Real-Time Surveillance for Rapid Correction of Clinical Decision Support Failures Allison Beck McCoy, MS
Editor's Notes
- Increasing numbers of healthcare facilities are implementing computerized provider order entry (CPOE) and electronic medical records (EMRs). Within these systems exists clinical decision support (CDS) functionality to assist providers in a variety of roles, such as promoting correct orders and providing patient-specific recommendations. Although CDS improves patient care in many settings, CDS failures are common, particularly at the point of first implementation. Failures include unjustified provider overrides and error-producing conditions within the technology. Understanding these failures is critical to avoiding user dissatisfaction and preventing other unintended adverse consequences.
- Many facilities are implementing surveillance methods to reduce errors. One method of surveillance utilizes e-mail messages to notify care team members about changes in patient conditions. Pharmacy surveillance of ordered doses is often conducted with daily paper printouts or computerized displays of patients receiving a drug. Other surveillance tools have been implemented to evaluate CDS in real-time, but these have evaluated usage in the aggregate and not at the patient level. Failures are not often readily apparent outside the context of an individual patient care episode, and it can be difficult to differentiate a technical failure from a usage failure without sufficient clinical detail presented in tandem with the CDS triggers and user response.
- We present common CDS implementations for high-alert medications, describing potential failures and applications for surveillance. Based on a working prototype within our development environment, we discuss how use of a surveillance tool for rapid evaluation of CDS may improve the quality and efficacy of hospital information systems.
- Systems commonly employ alerts that display text without interrupting the workflow to notify providers of drug interactions, changing laboratory values, or other information relevant to the patient’s medical condition. Passive alerts may fail when they are intentionally ignored or unnoticed by busy providers due to suboptimal placement or other design flaws. Surveillance allows a third party, such as a clinical pharmacist or quality manager, to identify passive alerts that persist for extended time periods and to take action, when necessary, to prevent patient harm. Surveillance can also identify the need to educate providers regarding alert objectives or function. Alerts with particularly high failure rates that are deemed important by institutional leaders or content experts may be promoted by developers to interruptive alerts in order to increase appropriate usage.
- CDS interventions which interrupt workflow to display information are frequently implemented to communicate safety information regarding high-alert medications. Providers must acknowledge the alert or record a response in order to resume working. Interruptive alerts are frequently overridden in multiple content domains, including drug-drug interactions, drug-allergy warnings, and drug-laboratory interactions (e.g. a nephrotoxin in setting of rising creatinine). Overrides or deviations from CDS recommendations occur frequently for interruptive alerts. Surveillance applications for interruptive alerts are similar to those presented for passive alerts. Reviewers can identify patients at particularly high risk for adverse drug events following overrides. Developers can also identify overrides that may be appropriate, for example if an alert appeared to a clinician outside of the providing team or if an alert does not apply to the patient based on an excluding condition.
- Order sets comprise an approach frequently implemented to promote adherence to clinical guidelines. Order sets may ensure that patients with a given condition receive appropriate medications and promote drug level monitoring for high-risk medications. Failures occur when providers do not use applicable order sets for a given patient condition or deviate from recommendations. For example, providers may fail to order an appropriate drug or monitoring laboratory tests from the order set. The use, nonuse, or misuse of order sets warrants surveillance in a number of clinical scenarios. Surveillance augments retrospective evaluation by providing patient context and user information which could be used to improve understanding of the strengths and weaknesses of the order set. Monitoring by clinicians permits real-time interventions for optimal patient care. Surveillance can also identify order sets with minimal or no usage, in which case providers could receive additional education.
- In many CPOE systems, providers interact with intricate computerized tools to generate orders that adhere to drug selection or dosing guidelines and protocols. These advisors may assist providers with calculations, administration intervals, and appropriate laboratory test monitoring. Common failures include incorrect inputs for calculation, unclear or confusing workflow, and incomplete use of the advisor. Surveillance can highlight failures related to misuse, allowing a content expert to intervene and prevent inappropriate dosing. Recurring misuse identified by surveillance can expose the need for provider training on correct usage of the advisors.
- Potential failures and surveillance applications vary for distinct CDS types. However, many of these surveillance applications generalize to themes common to all CDS types. The primary motivation for surveillance is the ability to act as a safety net to prevent patient harm. Reviewers can identify overrides or deviations from recommendations and take actions to correct orders. Surveillance also allows developers and institutional leaders to easily identify CDS that is not working as intended and quickly generate solutions to improve functionality. These failures may be technical in nature and not related to provider error. Some technical failures may be corrected through user education, while others may require adjustments to the CDS rules or approach.
- Utilizing an existing web-based pharmacy surveillance dashboard, we developed a prototype tool for surveillance of CDS failures. The tool allows various users, including developers, clinical pharmacists, and institutional leaders to review high-risk medication CDS usage across all units and services. At any point during a patient’s admission that CDS is triggered, whether it is used or ignored, entries automatically populate on the surveillance tool.
- The first type, the surveillance view, displays all currently admitted patients that have experienced a CDS interaction in a table format. This view allows pharmacists or other safety net providers to identify patients at high risk for harm following multiple CDS failures. Developers can also use this tool to identify CDS modules with high failure rates in order to initiate further evaluation or redesign efforts.
- Screenshots here
- The second view type, the patient detail view, displays a detailed timeline for an individual patient in reverse chronological order to give context for the CDS interaction events populated on the surveillance view. The timeline includes all orders, order administrations, laboratory values, and CDS interactions. Surveillance team members can use the detail view to understand provider actions and patient condition changes occurring in conjunction with CDS failures without having to redirect to and search a patient’s EMR. At this point, the cause of the CDS failure, whether it resulted from provider or design error, may be apparent.
- Screenshots here
- Though we present many complex CDS applications for surveillance, a valuable surveillance tool may be developed at other institutions using a small number of basic CDS implementations. To build the tool, developers must be able to query data of interest, including patient laboratory results, ordering history, and CDS logs, at a minimum. Additional data, such as medication administrations or detailed CDS usage information, adds to the reviewer understanding of patient context, but it does not prevent the tool from adding some benefit to patient care and CDS evaluation. In addition to technology, a requirement for a successful surveillance tool includes monitoring staff. Clinical pharmacists or care team leaders must be able and willing to regularly devote time to monitoring the tool. In some cases, this may involve hiring of additional staff or rearranging existing workflow processes.
- The tool allows surveillance team members to rapidly identify CDS failures and take actions to prevent further patient harm, in addition to initiating CDS improvement. The two views available for the tool allow flexibility in use. The surveillance view permits quick identification of high-risk patients and prioritization of those in danger following a CDS failure. In contrast, the patient summary view provides context to CDS failures and allows in-depth understanding of provider actions. Errors in both use and design contribute to commonly occurring failures for all CDS types. Surveillance by clinicians and developers allows identification of these failures with time for patient care interventions and early design corrections.
- R01 LM 009965-01 and R03 LM 009238-02