SlideShare a Scribd company logo
1 of 70
Dr Dave Pao
Electronic Medical
Records:
the search for clinical meaning
UXD Amsterdam 2019
https://medicalfuturist.com/
The
Electronic
Medical
Record
(EMR)
dpao@nhs.net
Imison, C.
Delivering the benefits
of digital health care.
The Nuffield Trust, 2017
The
Electronic
Medical
Record
(EMR)
DATA COLLECTED
[OR VERIFIED]
AT THE POINT OF
CLINICAL CARE
dpao@nhs.net
Electronic
Medical
Record
(EMR)
Lisa Strausfeld
Pangaro
Personal
Health
Record
(PHR)
‘EXPLANATION
for the
uninitiated...’
‘EXPLORATION
for the
experts.’
dpao@nhs.net
Not only tasks…
dpao@nhs.net
… and procedures
We examine the patient, we may take
swabs, do a procedure, use a
microscope, do urine and blood point of
care tests etc. etc. – more data input
dpao@nhs.net
… we need the previous history
We need data coming back at us from
previous visits, quickly and accurately.
This supports our clinical reasoning.
dpao@nhs.net
Clinical reasoning
“The use of a patient's history,
physical signs, symptoms,
laboratory data, and radiological
images to arrive at a diagnosis and
formulate a plan of treatment.”
dpao@nhs.net
dpao@nhs.net
Elwyn, G, 2014
Patientgate - digital recordings change everything.
British Medical Journal, vol. 348. p. 2078,
‘We have medical records, but they are like
the shadows on the wall of a cave,
punctuated by codes and jargon.’
dpao@nhs.net
We need to re-imagine ubiquitous EMR
layout and move beyond dropdowns, tabs
and text panels…
dpao@nhs.net
Commercial
Regulatory
EMR Development
UX / Vis
Research
Where is
medicine?
dpao@nhs.net
Current UX needs deeper
medical collaboration with
research that starts
BEFORE the ubiquitous
EMR layout
Zhang, Jiajie
Journal of Biomedical Informatics
2011; 44: 1056–1067
Zhang, Jiajie
Journal of Biomedical Informatics
2011; 44: 1056–1067dpao@nhs.net
Zhang, Jiajie
Journal of Biomedical Informatics
2011; 44: 1056–1067
AMIA / TURF Usability Principles
dpao@nhs.net
Zhang, Jiajie
Journal of Biomedical Informatics
2011; 44: 1056–1067
Violations of usability principles AHLTA EHR
The first six principles (consistency, visibility, match, minimalist,
memory, and feedback) are all about the representation properties of
the user interfaces, and they are considered as one type of
representation analysis.dpao@nhs.net
Tracks computer-based activity, speech
interaction, visual attention and body
movements, and automatically
synchronize and segment these data.
EMR Development
UX / Vis
Research
Medicine
dpao@nhs.net
‘...a graphical summary should
encourage doctors and nurses to
reshape, perhaps re-invent, the
medical record before computer
programmers cast institutional
convenience into silicon’ [1997]
dpao@nhs.net
dpao@nhs.net
Think fast, think slow
Kahneman, D. 2011dpao@nhs.net
http://clinical-reasoning.orgdpao@nhs.net
Powsner, SM, et al.
Graphical summary of patient status
Lancet, vol. 344(8919), pp. 386-9, 1994
Visualisation using Metaphor
Horn, W, 2001
Lifelines, 1998
Plaisant & Shneiderman
PROVOTYPE
DASHBOARD,
DESIGN AND IMPACT
dpao@nhs.net
Boer, L et al. Provotypes for participatory innovation.
Proceedings of the Designing Interactive Systems
Conference. Newcastle, UK, 11 – 15 June, 2012
Belief: visualisation supports
clinical reasoning
Method: a provotype
dashboard explores usability
principles for clinical reasoning
APPROACH
dpao@nhs.net
Boer, L et al. Provotypes for participatory innovation.
Proceedings of the Designing Interactive Systems
Conference. Newcastle, UK, 11 – 15 June, 2012
A provocative prototype
provokes and engages people
to imagine possible futures
PROVOTYPE
dpao@nhs.net
METHODOLOGY
dpao@nhs.net
Regarding the EPR that you use, how much do you agree or disagree
with these statements? [7-point Likert]:
1. It is easy to search for things
2. There is good use of graphics
3. Accuracy of records improves with more visits
4. The screen layout reflects clinical real life
5. It is easy to get an overview of the patient’s history
6. I am satisfied with how the EPR supports my job
7. What I write can get lost in the system*
8. I wish I didn’t have to double-click so much*
9. It helps my memory work more effectively
10.There are redundant words / boxes on the screen*
11.I enjoy using it
12.It is easy to make sense of laboratory results
13.It is easy to set alerts about important issues
14.Information is in easily understood patterns
*denotes negative statement
dpao@nhs.net
DRAFT QUESTIONNAIRE
n=55
n=43
dpao@nhs.net
1. Competence
2. Relationship with patient
3. Clinician you want to be
4. Frustrate
5. Like
6. Could it be better
QUALITATIVE BOXES
dpao@nhs.net
“Our EPR is unsafe as it is
difficult or almost impossible
to track what has happened to a
patient in the past We have had
several serious incidents.”
2500 words
dpao@nhs.net
11/18
“...does not allow for 1000s of
possible bits of information
that a patient may offer that
don’t quite fit into tick
boxes.”
dpao@nhs.net
“More templates, more get-
arounds, more headaches and
frustration!”
dpao@nhs.net
17/18
“... the user interface needs to
be on one page with the data
items in a logical order that
mirrors the clinical
consultation with minimal
clicks/pages to go through.”
dpao@nhs.net
13/18
“It is not intuitive and
wastes clinical time.”
dpao@nhs.net
16/18
“I use paper recording
during consultations then
enter EMR after patient
out of room.”
dpao@nhs.net
Performance
Frustration, sense of incompetence, time inefficiency, poor
history overview, poor clinical relevance, repeated questioning,
difficulty with complex patients, difficulty with patients with
multiple previous visits, impaired flow of consultation, difficulty
maintaining eye contact / rapport and some even using paper
before transcribing into EMR, not ‘losing’ records, benefit of
remote site accessibility
Interface:
Unintuitive information accessibility, low data density,
nonsensical data location, multiple windows, too much double-
clicking, getting lost, difficulty understanding results, confusing,
difficulty accessing: vaccination history, treatment history,
allergies, test results and critical alert, legibility
Qualitative
dpao@nhs.net
1. Competence
2. Relationship with patient
3. Clinician you want to be
4. Frustrate
5. Like
6. Could it be better
Qualitative
dpao@nhs.net
Functionality
Getting lost: too many windows
Flow: reflect clinical reality, our landscape
Time-dependent data: timeline overview, semantic zoom
Complex Data: chunking, glyphs, screen ‘real estate’
Template: data input
Time-independent data: data salience, at a glance
1. Competence
2. Relationship with patient
3. Clinician you want to be
4. Frustrate
5. Like
6. Could it be better
Qualitative
dpao@nhs.net
dpao@nhs.net
dpao@nhs.net
Test drives
dpao@nhs.net
Test drives
• 117 clinical users, all levels
• Repeat survey
• 12 hours of workshop audio
• Refinement of CRUX principles
dpao@nhs.net
Test drives
• 117 clinical users, all levels
• Repeat survey
• 12 hours of workshop audio
• Refinement of CRUX principles
dpao@nhs.net
n=55
n=43
n=76
dpao@nhs.net
500 words
“Really helpful and efficient to
have windows opening, rather
than hopping in and out of
screens (which slows down
consultations). Loved it.”
dpao@nhs.net
“Intuitive. In just a few coloured
dots I can recognise what the
clinical picture is.”
dpao@nhs.net
“It would be user-friendly and
enable us as clinicians to
engage with the patient more
rather than screw through every
episode trying to find what has
gone before.”
dpao@nhs.net
“Really like the flexibility
‘just shoot’ learning style of
use.”
dpao@nhs.net
“Great way of presenting info,
can we have it tomorrow please?
”
dpao@nhs.net
Test drives
• 117 clinical users, all levels
• Repeat survey
• 12 hours of workshop audio
• Refinement of CRUX principles
dpao@nhs.net
Performance:
Desire to try in a real clinic, ‘want this now’, vast
improvement, looks brilliant, highly intuitive, more
satisfying, easier, safer, better engagement, more
time efficient, less repeated questioning likely
Interface:
Good history overview, good use of colour, efficiency
of single window, easy pattern recognition despite
complexity, daunting at first but quick to learn, love
use of glyphs, user-friendly, good information
visualisation, good data density (not overcrowded),
useful salient information
dpao@nhs.net
‘Regarding the clinical dashboard or EMR that you use, how much do you
agree or disagree with these statements?’ (7-point Likert scale responses required)
1. It gives me a good overview of the patient history with minimal clicking
2. Salient social and clinical data is always visible at a high level
3. Laboratory results are laid out in intuitive patterns with drill-down capability
4. I do not have to jump in and out of different screens
5. Salient previous history pulls through so I do not have to ask the same
questions repeatedly
6. Information becomes more streamlined each time the patient attends
7. It supports the flow of the consultation and patient eye contact
8. It helps my memory work effectively by offering pattern recognition
9. I can quickly learn to use this system by practice, rather than by instruction
10.I can easily navigate and explore a complex information landscape
UX QUESTIONNAIRE
for clinical reasoning
dpao@nhs.net
https://medicalfuturist.com/dpao@nhs.net
dpao@nhs.net
https://www.mobihealthnews.com
Interoperability
dpao@nhs.net
dpao@nhs.net
dpao@nhs.net
Ethical Design
https://2017.ind.ie/ethical-design/dpao@nhs.net
Cross, N. Designerly ways of knowing
Design Studies vol. 3(4), pp. 221-227, 1982
Design as 3rd Culture
dpao@nhs.net
As an aesthetic principle, the machinic
[interface] is associated with process
rather than object, with dynamics
rather than finality, with instability
rather than permanence, with
communication rather than
representation, with action and with
play.
‘Remove the Controls’
Essay by Andreas Broeckmann (1997
Machine Aesthetics
dpao@nhs.net
Health UX principles tell us what, not how
The consultation is an unfolding, unknown,
uncertain landscape for everyone
Institutionalised silicon
- dropdowns, tabs and text panels
Task alone is not enough, we need exploration
- clinical reasoning, experiential knowledge
Problem ‘worrying’ is OK; don’t hide problems
Takeaways
dpao@nhs.net
Thank you dpao@nhs.net
drdavepao
dpao@nhs.net

More Related Content

What's hot

Essentials for Setting up a New Clinical Research Center
Essentials for Setting up a New Clinical Research CenterEssentials for Setting up a New Clinical Research Center
Essentials for Setting up a New Clinical Research CenterTrialJoin
 
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuffMeasure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuffMatt Hansen
 
Stout Healthcare Analytics Midwestern University
Stout Healthcare Analytics Midwestern UniversityStout Healthcare Analytics Midwestern University
Stout Healthcare Analytics Midwestern UniversityDr. Chris Stout
 
7 Pitfalls to Avoid in mHealth Web or App Design— White Paper
7 Pitfalls to Avoid in mHealth Web or App Design— White Paper7 Pitfalls to Avoid in mHealth Web or App Design— White Paper
7 Pitfalls to Avoid in mHealth Web or App Design— White PaperUBM Canon
 
New Drug Application - How to Speed Up FDA Approval
New Drug Application - How to Speed Up FDA ApprovalNew Drug Application - How to Speed Up FDA Approval
New Drug Application - How to Speed Up FDA ApprovalTrialJoin
 
Helpful information for sponsors: How to best spend your resources and avoid ...
Helpful information for sponsors: How to best spend your resources and avoid ...Helpful information for sponsors: How to best spend your resources and avoid ...
Helpful information for sponsors: How to best spend your resources and avoid ...TrialJoin
 

What's hot (6)

Essentials for Setting up a New Clinical Research Center
Essentials for Setting up a New Clinical Research CenterEssentials for Setting up a New Clinical Research Center
Essentials for Setting up a New Clinical Research Center
 
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuffMeasure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
 
Stout Healthcare Analytics Midwestern University
Stout Healthcare Analytics Midwestern UniversityStout Healthcare Analytics Midwestern University
Stout Healthcare Analytics Midwestern University
 
7 Pitfalls to Avoid in mHealth Web or App Design— White Paper
7 Pitfalls to Avoid in mHealth Web or App Design— White Paper7 Pitfalls to Avoid in mHealth Web or App Design— White Paper
7 Pitfalls to Avoid in mHealth Web or App Design— White Paper
 
New Drug Application - How to Speed Up FDA Approval
New Drug Application - How to Speed Up FDA ApprovalNew Drug Application - How to Speed Up FDA Approval
New Drug Application - How to Speed Up FDA Approval
 
Helpful information for sponsors: How to best spend your resources and avoid ...
Helpful information for sponsors: How to best spend your resources and avoid ...Helpful information for sponsors: How to best spend your resources and avoid ...
Helpful information for sponsors: How to best spend your resources and avoid ...
 

Similar to Electronic Medical Records: the search for clinical meaning

Case Study: Advanced analytics in healthcare using unstructured data
Case Study: Advanced analytics in healthcare using unstructured dataCase Study: Advanced analytics in healthcare using unstructured data
Case Study: Advanced analytics in healthcare using unstructured dataDamo Consulting Inc.
 
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...Scott Abel
 
Physician Know Thy Customers
Physician Know Thy CustomersPhysician Know Thy Customers
Physician Know Thy Customerssundong
 
Intuitive Technology Notes
Intuitive Technology NotesIntuitive Technology Notes
Intuitive Technology NotesMProcun
 
MPayumo_Portfolio_2013_small
MPayumo_Portfolio_2013_smallMPayumo_Portfolio_2013_small
MPayumo_Portfolio_2013_smallMaynard Payumo
 
Articulation
Articulation Articulation
Articulation butest
 
Performance Improvement Article Hfm 12 06
Performance Improvement Article Hfm 12 06Performance Improvement Article Hfm 12 06
Performance Improvement Article Hfm 12 06McKesson Corporation
 
optimizing_site_performance
optimizing_site_performanceoptimizing_site_performance
optimizing_site_performanceBryan Farrow
 
Exercise 1  Risk Analysis Before you begin this assignment, be .docx
Exercise 1  Risk Analysis Before you begin this assignment, be .docxExercise 1  Risk Analysis Before you begin this assignment, be .docx
Exercise 1  Risk Analysis Before you begin this assignment, be .docxgitagrimston
 
The clinician’s perspective on electronic health records and how they can aff...
The clinician’s perspective on electronic health records and how they can aff...The clinician’s perspective on electronic health records and how they can aff...
The clinician’s perspective on electronic health records and how they can aff...Miguel Angel Vazquez Mmembrillo
 
AllegroGraph - Cognitive Probability Graph webcast
AllegroGraph - Cognitive Probability Graph webcastAllegroGraph - Cognitive Probability Graph webcast
AllegroGraph - Cognitive Probability Graph webcastFranz Inc. - AllegroGraph
 
Left Brain Meets Right Brain
Left Brain Meets Right BrainLeft Brain Meets Right Brain
Left Brain Meets Right Brainclinicalsolutions
 
Innovation hub solution examples
Innovation hub solution examplesInnovation hub solution examples
Innovation hub solution examplesMargaret Gold
 
Simulated Patient Care Pathways
Simulated Patient Care PathwaysSimulated Patient Care Pathways
Simulated Patient Care PathwaysKevin Russell
 
Embracing Electronic PRO
Embracing Electronic PROEmbracing Electronic PRO
Embracing Electronic PROCRF Health
 

Similar to Electronic Medical Records: the search for clinical meaning (20)

Case Study: Advanced analytics in healthcare using unstructured data
Case Study: Advanced analytics in healthcare using unstructured dataCase Study: Advanced analytics in healthcare using unstructured data
Case Study: Advanced analytics in healthcare using unstructured data
 
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...
[Case Study] Physician, Know Thy User: Using Personas to Target Content and U...
 
Physician Know Thy Customers
Physician Know Thy CustomersPhysician Know Thy Customers
Physician Know Thy Customers
 
Intuitive Technology Notes
Intuitive Technology NotesIntuitive Technology Notes
Intuitive Technology Notes
 
MPayumo_Portfolio_2013_small
MPayumo_Portfolio_2013_smallMPayumo_Portfolio_2013_small
MPayumo_Portfolio_2013_small
 
Articulation
Articulation Articulation
Articulation
 
Performance Improvement Article Hfm 12 06
Performance Improvement Article Hfm 12 06Performance Improvement Article Hfm 12 06
Performance Improvement Article Hfm 12 06
 
optimizing_site_performance
optimizing_site_performanceoptimizing_site_performance
optimizing_site_performance
 
Exercise 1  Risk Analysis Before you begin this assignment, be .docx
Exercise 1  Risk Analysis Before you begin this assignment, be .docxExercise 1  Risk Analysis Before you begin this assignment, be .docx
Exercise 1  Risk Analysis Before you begin this assignment, be .docx
 
The clinician’s perspective on electronic health records and how they can aff...
The clinician’s perspective on electronic health records and how they can aff...The clinician’s perspective on electronic health records and how they can aff...
The clinician’s perspective on electronic health records and how they can aff...
 
Nursing informatics
Nursing informaticsNursing informatics
Nursing informatics
 
Nursing informatics 2011
Nursing informatics 2011Nursing informatics 2011
Nursing informatics 2011
 
Briefing - April 2016
Briefing - April 2016Briefing - April 2016
Briefing - April 2016
 
AllegroGraph - Cognitive Probability Graph webcast
AllegroGraph - Cognitive Probability Graph webcastAllegroGraph - Cognitive Probability Graph webcast
AllegroGraph - Cognitive Probability Graph webcast
 
Homeward bound
Homeward boundHomeward bound
Homeward bound
 
Left Brain Meets Right Brain
Left Brain Meets Right BrainLeft Brain Meets Right Brain
Left Brain Meets Right Brain
 
Improving EMRs 2009
Improving EMRs 2009Improving EMRs 2009
Improving EMRs 2009
 
Innovation hub solution examples
Innovation hub solution examplesInnovation hub solution examples
Innovation hub solution examples
 
Simulated Patient Care Pathways
Simulated Patient Care PathwaysSimulated Patient Care Pathways
Simulated Patient Care Pathways
 
Embracing Electronic PRO
Embracing Electronic PROEmbracing Electronic PRO
Embracing Electronic PRO
 

Recently uploaded

❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF ...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF  ...❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF  ...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF ...Gfnyt.com
 
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★indiancallgirl4rent
 
Basics of Anatomy- Language of Anatomy.pptx
Basics of Anatomy- Language of Anatomy.pptxBasics of Anatomy- Language of Anatomy.pptx
Basics of Anatomy- Language of Anatomy.pptxAyush Gupta
 
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...gragteena
 
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...indiancallgirl4rent
 
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsi
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsiindian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsi
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana TulsiHigh Profile Call Girls Chandigarh Aarushi
 
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012Call Girls Service Gurgaon
 
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR Call G...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR   Call G...❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR   Call G...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR Call G...Gfnyt.com
 
Hot Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In Ludhiana
Hot  Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In LudhianaHot  Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In Ludhiana
Hot Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In LudhianaRussian Call Girls in Ludhiana
 
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋Sheetaleventcompany
 
No Advance 9053900678 Chandigarh Call Girls , Indian Call Girls For Full Ni...
No Advance 9053900678 Chandigarh  Call Girls , Indian Call Girls  For Full Ni...No Advance 9053900678 Chandigarh  Call Girls , Indian Call Girls  For Full Ni...
No Advance 9053900678 Chandigarh Call Girls , Indian Call Girls For Full Ni...Vip call girls In Chandigarh
 
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7Miss joya
 
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...Russian Call Girls Amritsar
 
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meet
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real MeetChandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meet
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meetpriyashah722354
 
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking Models
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking ModelsDehradun Call Girls Service 08854095900 Real Russian Girls Looking Models
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking Modelsindiancallgirl4rent
 
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591adityaroy0215
 
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabad
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In FaridabadCall Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabad
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabadgragmanisha42
 
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.ktanvi103
 

Recently uploaded (20)

❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF ...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF  ...❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF  ...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Jaispreet Call Girl Services in Jaipur QRYPCF ...
 
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★
Enjoyment ★ 8854095900 Indian Call Girls In Dehradun 🍆🍌 By Dehradun Call Girl ★
 
Model Call Girl in Subhash Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Subhash Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Subhash Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Subhash Nagar Delhi reach out to us at 🔝9953056974🔝
 
Basics of Anatomy- Language of Anatomy.pptx
Basics of Anatomy- Language of Anatomy.pptxBasics of Anatomy- Language of Anatomy.pptx
Basics of Anatomy- Language of Anatomy.pptx
 
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...
Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Book me...
 
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...
(Sonam Bajaj) Call Girl in Jaipur- 09257276172 Escorts Service 50% Off with C...
 
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsi
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsiindian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsi
indian Call Girl Panchkula ❤️🍑 9907093804 Low Rate Call Girls Ludhiana Tulsi
 
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012
VIP Call Girls Sector 67 Gurgaon Just Call Me 9711199012
 
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR Call G...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR   Call G...❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR   Call G...
❤️♀️@ Jaipur Call Girls ❤️♀️@ Meghna Jaipur Call Girls Number CRTHNR Call G...
 
Hot Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In Ludhiana
Hot  Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In LudhianaHot  Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In Ludhiana
Hot Call Girl In Ludhiana 👅🥵 9053'900678 Call Girls Service In Ludhiana
 
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋
💚😋Mumbai Escort Service Call Girls, ₹5000 To 25K With AC💚😋
 
No Advance 9053900678 Chandigarh Call Girls , Indian Call Girls For Full Ni...
No Advance 9053900678 Chandigarh  Call Girls , Indian Call Girls  For Full Ni...No Advance 9053900678 Chandigarh  Call Girls , Indian Call Girls  For Full Ni...
No Advance 9053900678 Chandigarh Call Girls , Indian Call Girls For Full Ni...
 
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 9907093804 Top Class Call Girl Service Available
 
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7
Vip Kolkata Call Girls Cossipore 👉 8250192130 ❣️💯 Available With Room 24×7
 
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...
Local Housewife and effective ☎️ 8250192130 🍉🍓 Sexy Girls VIP Call Girls Chan...
 
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meet
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real MeetChandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meet
Chandigarh Call Girls 👙 7001035870 👙 Genuine WhatsApp Number for Real Meet
 
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking Models
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking ModelsDehradun Call Girls Service 08854095900 Real Russian Girls Looking Models
Dehradun Call Girls Service 08854095900 Real Russian Girls Looking Models
 
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591
VIP Call Girl Sector 25 Gurgaon Just Call Me 9899900591
 
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabad
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In FaridabadCall Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabad
Call Girls Service Faridabad 📲 9999965857 ヅ10k NiGhT Call Girls In Faridabad
 
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.
Call Now ☎ 9999965857 !! Call Girls in Hauz Khas Escort Service Delhi N.C.R.
 

Electronic Medical Records: the search for clinical meaning

  • 1. Dr Dave Pao Electronic Medical Records: the search for clinical meaning UXD Amsterdam 2019
  • 3. Imison, C. Delivering the benefits of digital health care. The Nuffield Trust, 2017 The Electronic Medical Record (EMR) DATA COLLECTED [OR VERIFIED] AT THE POINT OF CLINICAL CARE dpao@nhs.net
  • 6. … and procedures We examine the patient, we may take swabs, do a procedure, use a microscope, do urine and blood point of care tests etc. etc. – more data input dpao@nhs.net
  • 7. … we need the previous history We need data coming back at us from previous visits, quickly and accurately. This supports our clinical reasoning. dpao@nhs.net
  • 8. Clinical reasoning “The use of a patient's history, physical signs, symptoms, laboratory data, and radiological images to arrive at a diagnosis and formulate a plan of treatment.” dpao@nhs.net
  • 10. Elwyn, G, 2014 Patientgate - digital recordings change everything. British Medical Journal, vol. 348. p. 2078, ‘We have medical records, but they are like the shadows on the wall of a cave, punctuated by codes and jargon.’ dpao@nhs.net
  • 11. We need to re-imagine ubiquitous EMR layout and move beyond dropdowns, tabs and text panels… dpao@nhs.net
  • 12.
  • 13.
  • 14.
  • 15. Commercial Regulatory EMR Development UX / Vis Research Where is medicine? dpao@nhs.net
  • 16. Current UX needs deeper medical collaboration with research that starts BEFORE the ubiquitous EMR layout
  • 17. Zhang, Jiajie Journal of Biomedical Informatics 2011; 44: 1056–1067
  • 18. Zhang, Jiajie Journal of Biomedical Informatics 2011; 44: 1056–1067dpao@nhs.net
  • 19. Zhang, Jiajie Journal of Biomedical Informatics 2011; 44: 1056–1067 AMIA / TURF Usability Principles dpao@nhs.net
  • 20. Zhang, Jiajie Journal of Biomedical Informatics 2011; 44: 1056–1067 Violations of usability principles AHLTA EHR The first six principles (consistency, visibility, match, minimalist, memory, and feedback) are all about the representation properties of the user interfaces, and they are considered as one type of representation analysis.dpao@nhs.net
  • 21. Tracks computer-based activity, speech interaction, visual attention and body movements, and automatically synchronize and segment these data.
  • 22. EMR Development UX / Vis Research Medicine dpao@nhs.net
  • 23. ‘...a graphical summary should encourage doctors and nurses to reshape, perhaps re-invent, the medical record before computer programmers cast institutional convenience into silicon’ [1997] dpao@nhs.net
  • 25. Think fast, think slow Kahneman, D. 2011dpao@nhs.net
  • 27.
  • 28. Powsner, SM, et al. Graphical summary of patient status Lancet, vol. 344(8919), pp. 386-9, 1994
  • 32. Boer, L et al. Provotypes for participatory innovation. Proceedings of the Designing Interactive Systems Conference. Newcastle, UK, 11 – 15 June, 2012 Belief: visualisation supports clinical reasoning Method: a provotype dashboard explores usability principles for clinical reasoning APPROACH dpao@nhs.net
  • 33. Boer, L et al. Provotypes for participatory innovation. Proceedings of the Designing Interactive Systems Conference. Newcastle, UK, 11 – 15 June, 2012 A provocative prototype provokes and engages people to imagine possible futures PROVOTYPE dpao@nhs.net
  • 35. Regarding the EPR that you use, how much do you agree or disagree with these statements? [7-point Likert]: 1. It is easy to search for things 2. There is good use of graphics 3. Accuracy of records improves with more visits 4. The screen layout reflects clinical real life 5. It is easy to get an overview of the patient’s history 6. I am satisfied with how the EPR supports my job 7. What I write can get lost in the system* 8. I wish I didn’t have to double-click so much* 9. It helps my memory work more effectively 10.There are redundant words / boxes on the screen* 11.I enjoy using it 12.It is easy to make sense of laboratory results 13.It is easy to set alerts about important issues 14.Information is in easily understood patterns *denotes negative statement dpao@nhs.net DRAFT QUESTIONNAIRE
  • 37. 1. Competence 2. Relationship with patient 3. Clinician you want to be 4. Frustrate 5. Like 6. Could it be better QUALITATIVE BOXES dpao@nhs.net
  • 38. “Our EPR is unsafe as it is difficult or almost impossible to track what has happened to a patient in the past We have had several serious incidents.” 2500 words dpao@nhs.net
  • 39. 11/18 “...does not allow for 1000s of possible bits of information that a patient may offer that don’t quite fit into tick boxes.” dpao@nhs.net
  • 40. “More templates, more get- arounds, more headaches and frustration!” dpao@nhs.net
  • 41. 17/18 “... the user interface needs to be on one page with the data items in a logical order that mirrors the clinical consultation with minimal clicks/pages to go through.” dpao@nhs.net
  • 42. 13/18 “It is not intuitive and wastes clinical time.” dpao@nhs.net
  • 43. 16/18 “I use paper recording during consultations then enter EMR after patient out of room.” dpao@nhs.net
  • 44. Performance Frustration, sense of incompetence, time inefficiency, poor history overview, poor clinical relevance, repeated questioning, difficulty with complex patients, difficulty with patients with multiple previous visits, impaired flow of consultation, difficulty maintaining eye contact / rapport and some even using paper before transcribing into EMR, not ‘losing’ records, benefit of remote site accessibility Interface: Unintuitive information accessibility, low data density, nonsensical data location, multiple windows, too much double- clicking, getting lost, difficulty understanding results, confusing, difficulty accessing: vaccination history, treatment history, allergies, test results and critical alert, legibility Qualitative dpao@nhs.net
  • 45. 1. Competence 2. Relationship with patient 3. Clinician you want to be 4. Frustrate 5. Like 6. Could it be better Qualitative dpao@nhs.net
  • 46. Functionality Getting lost: too many windows Flow: reflect clinical reality, our landscape Time-dependent data: timeline overview, semantic zoom Complex Data: chunking, glyphs, screen ‘real estate’ Template: data input Time-independent data: data salience, at a glance 1. Competence 2. Relationship with patient 3. Clinician you want to be 4. Frustrate 5. Like 6. Could it be better Qualitative dpao@nhs.net
  • 50. Test drives • 117 clinical users, all levels • Repeat survey • 12 hours of workshop audio • Refinement of CRUX principles dpao@nhs.net
  • 51. Test drives • 117 clinical users, all levels • Repeat survey • 12 hours of workshop audio • Refinement of CRUX principles dpao@nhs.net
  • 53. 500 words “Really helpful and efficient to have windows opening, rather than hopping in and out of screens (which slows down consultations). Loved it.” dpao@nhs.net
  • 54. “Intuitive. In just a few coloured dots I can recognise what the clinical picture is.” dpao@nhs.net
  • 55. “It would be user-friendly and enable us as clinicians to engage with the patient more rather than screw through every episode trying to find what has gone before.” dpao@nhs.net
  • 56. “Really like the flexibility ‘just shoot’ learning style of use.” dpao@nhs.net
  • 57. “Great way of presenting info, can we have it tomorrow please? ” dpao@nhs.net
  • 58. Test drives • 117 clinical users, all levels • Repeat survey • 12 hours of workshop audio • Refinement of CRUX principles dpao@nhs.net
  • 59. Performance: Desire to try in a real clinic, ‘want this now’, vast improvement, looks brilliant, highly intuitive, more satisfying, easier, safer, better engagement, more time efficient, less repeated questioning likely Interface: Good history overview, good use of colour, efficiency of single window, easy pattern recognition despite complexity, daunting at first but quick to learn, love use of glyphs, user-friendly, good information visualisation, good data density (not overcrowded), useful salient information dpao@nhs.net
  • 60. ‘Regarding the clinical dashboard or EMR that you use, how much do you agree or disagree with these statements?’ (7-point Likert scale responses required) 1. It gives me a good overview of the patient history with minimal clicking 2. Salient social and clinical data is always visible at a high level 3. Laboratory results are laid out in intuitive patterns with drill-down capability 4. I do not have to jump in and out of different screens 5. Salient previous history pulls through so I do not have to ask the same questions repeatedly 6. Information becomes more streamlined each time the patient attends 7. It supports the flow of the consultation and patient eye contact 8. It helps my memory work effectively by offering pattern recognition 9. I can quickly learn to use this system by practice, rather than by instruction 10.I can easily navigate and explore a complex information landscape UX QUESTIONNAIRE for clinical reasoning dpao@nhs.net
  • 67. Cross, N. Designerly ways of knowing Design Studies vol. 3(4), pp. 221-227, 1982 Design as 3rd Culture dpao@nhs.net
  • 68. As an aesthetic principle, the machinic [interface] is associated with process rather than object, with dynamics rather than finality, with instability rather than permanence, with communication rather than representation, with action and with play. ‘Remove the Controls’ Essay by Andreas Broeckmann (1997 Machine Aesthetics dpao@nhs.net
  • 69. Health UX principles tell us what, not how The consultation is an unfolding, unknown, uncertain landscape for everyone Institutionalised silicon - dropdowns, tabs and text panels Task alone is not enough, we need exploration - clinical reasoning, experiential knowledge Problem ‘worrying’ is OK; don’t hide problems Takeaways dpao@nhs.net

Editor's Notes

  1. Paul Pangaro
  2. The first six principles (consistency, visibility, match, minimalist, memory, and feedback) are all about the representation properties of the user interfaces, and they are considered as one type of representation analysis.
  3. This talk describes a design method that holds to this ideal whilst at the same time supporting the work of the ‘computer programmer’
  4. Once in, recall data? HISTORY. ARCHIVE. Demographics, clinical notes, letters to, letters from, from pt, scan reports, 100’s of result sheets Nuance, visuals, flicking – thickness tells all Tactile Delight
  5. 17
  6. 17
  7. Competence: Getting lost, ‘It must feel for patients occasionally like we are meeting for the first time during follow-up appointments’ Relationship: FLOW, Eye contact, ‘EPR should aid and support clinical consultation and management process - the one HINDERS‘ Clinician: No overview, impossible to get story Frustrate: Complex Patients, Missing really important info, U18, SA, vax, STS, results Like: Nothing! Simple patients Better: I would like important info on the patient to stay with you as you move to new screen Pull-through historical data (e.g. Past Medical History, Drug history, allergies) Questions are asked repeatedly of patients, re-take History every time,, Amazon, other EPRs
  8. Competence: Getting lost, ‘It must feel for patients occasionally like we are meeting for the first time during follow-up appointments’ Relationship: FLOW, Eye contact, ‘EPR should aid and support clinical consultation and management process - the one HINDERS‘ Clinician: No overview, impossible to get story Frustrate: Complex Patients, Missing really important info, U18, SA, vax, STS, results Like: Nothing! Simple patients Better: I would like important info on the patient to stay with you as you move to new screen Pull-through historical data (e.g. Past Medical History, Drug history, allergies) Questions are asked repeatedly of patients, re-take History every time,, Amazon, other EPRs
  9. Microscopy by me – one page Test ordered grey – one page Test result neg green – another page Test result pos Hover result Double click certificate
  10. Microscopy by me – one page Test ordered grey – one page Test result neg green – another page Test result pos Hover result Double click certificate
  11. Microscopy by me – one page Test ordered grey – one page Test result neg green – another page Test result pos Hover result Double click certificate