Your SlideShare is downloading. ×
0
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
EMRs: Only Meaningful When They're Usable
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

EMRs: Only Meaningful When They're Usable

1,515

Published on

Take a look at what makes an EMR usable. It’s more than user satisfaction. Learn how EMR Usability is getting more attention at the national level in certification, standards, research, and …

Take a look at what makes an EMR usable. It’s more than user satisfaction. Learn how EMR Usability is getting more attention at the national level in certification, standards, research, and policy.

Closing keynote presentation at HIMSS 2010 Academic Forum in Atlanta GA.

0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,515
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
65
Comments
0
Likes
6
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Setting up a usability test involves carefully creating a scenario , or realistic situation, wherein the person performs a list of tasks using the product being tested while observers watch and take notes. Several other test instruments such as scripted instructions, paper prototypes , and pre- and post-test questionnaires are also used to gather feedback on the product being tested. For example, to test the attachment function of an e-mail program, a scenario would describe a situation where a person needs to send an e-mail attachment, and ask him or her to undertake this task. The aim is to observe how people function in a realistic manner, so that developers can see problem areas, and what people like. Techniques popularly used to gather data during a usability test include think aloud protocol and eye tracking .
  • Setting up a usability test involves carefully creating a scenario , or realistic situation, wherein the person performs a list of tasks using the product being tested while observers watch and take notes. Several other test instruments such as scripted instructions, paper prototypes , and pre- and post-test questionnaires are also used to gather feedback on the product being tested. For example, to test the attachment function of an e-mail program, a scenario would describe a situation where a person needs to send an e-mail attachment, and ask him or her to undertake this task. The aim is to observe how people function in a realistic manner, so that developers can see problem areas, and what people like. Techniques popularly used to gather data during a usability test include think aloud protocol and eye tracking .
  • Also people’s opinion (perceptions) can be different from their performance. E.g., after struggling through a task (maybe failing to complete the task) participants will rate the task (verbally and/or with post task questionnaires) as easy to do or not so hard…even if they failed. Now the usability needs to prioritize performance data versus perception/opinion data.
  • Transcript

    • 1. EMRs Only Meaningful When They’re Usable
    • 2. Conflict of Interest Disclosure Jeff Belden MD Dr. Belden is on the faculty at University of Missouri - Columbia, which has a contractual consulting relationship with Cerner for EMR research and development. Dr. Belden has no financial interest.
    • 3. Adoption
    • 4. Adoption What’s the friction ?
    • 5. Acquisition Costs <ul><li>Lost productivity </li></ul><ul><li>Long training times </li></ul><ul><li>Rebellion </li></ul>Poor Usability Smelcer 2009
    • 6. What is usability? EMR ^
    • 7. Usability is <ul><li>Effectiveness </li></ul><ul><li>Efficiency </li></ul><ul><li>Satisfaction </li></ul>ISO 2003
    • 8. Usability means <ul><li>Learnable </li></ul><ul><li>Efficient </li></ul><ul><li>Memorable </li></ul><ul><li>Error-free </li></ul><ul><li>Satisfying </li></ul>Useit.com
    • 9. Usability is…
    • 10. 10 Principles <ul><li>Simplicity </li></ul><ul><li>Naturalness </li></ul><ul><li>Consistency </li></ul><ul><li>Minimizing cognitive load </li></ul><ul><li>Efficient interactions </li></ul><ul><li>Forgiveness </li></ul>http://bit.ly/UsabilityHIMSS <ul><li>Feedback </li></ul><ul><li>Effective use of language </li></ul><ul><li>Effective information presentation </li></ul><ul><li>Preservation of context </li></ul>
    • 11. Simplicity
    • 12. For doing refills For overview only Simplicity
    • 13. Naturalness
    • 14. Naturalness Old way – lots of drill-down clicking
    • 15. Naturalness Better way we know the body already
    • 16. Consistency
    • 17. Consistency Name and identifying info consistently placed
    • 18. Minimizing Cognitive Load
    • 19. Minimizing Cognitive Load Exact past dates <ul><li>This requires mental math </li></ul>
    • 20. Minimizing Cognitive Load Relative past dates <ul><li>Easier. No extra thinking. </li></ul>
    • 21. Minimizing Cognitive Load <ul><li>Have it both ways </li></ul>Hover to see more detail
    • 22. Efficient Interactions
    • 23. Efficient Interactions Dashboard efficiency
    • 24. Efficient Interactions <ul><li>6 minutes </li></ul>50 Clicks…
    • 25. Efficient Interactions <ul><li>1-2 minutes </li></ul>2 Clicks…
    • 26. Forgiveness
    • 27. Forgiveness Let users discover by exploring without fear of destroying Let users recover gracefully from mistakes
    • 28. Forgiveness <ul><li>A bad example… </li></ul>
    • 29. Feedback
    • 30. Acceptable
    • 31. Better <ul><li>Please wait while we check 10,357 records… </li></ul>
    • 32. Best <ul><li>Please wait while we check 10,357 records… </li></ul>Time remaining… 8 seconds
    • 33. Effective Use of Language
    • 34. Plain English for patient Terse for doctor
    • 35. Effective Information Presentation
    • 36. Effective Information Presentation Sorted alphabetically, not randomly Better yet, allow sort by other criteria, too
    • 37. Preservation of Context
    • 38. Preservation of Context
    • 39. Usability Methods
    • 40.  
    • 41.  
    • 42. Prototyping
    • 43. Prototyping <ul><li>Should look preliminary </li></ul><ul><li>Encourages user suggestions for change </li></ul>
    • 44. Prototyping methods <ul><li>Paper </li></ul><ul><li>Simple wireframe </li></ul><ul><ul><li>PowerPoint </li></ul></ul><ul><ul><li>Keynote (Mac) </li></ul></ul><ul><ul><li>Interactive </li></ul></ul><ul><ul><ul><li>Visio (Win) or OmniGraffle (Mac) </li></ul></ul></ul>
    • 45. Think-Aloud Testing
    • 46. Think-Aloud Testing <ul><li>Let me record you as you test/use my software. </li></ul>
    • 47. Think-Aloud Testing <ul><li>Learn more </li></ul><ul><li>Read this book </li></ul><ul><li>Download the instructions to do your own testing. </li></ul><ul><ul><li>http://bit.ly/Dthink </li></ul></ul>
    • 48. Test Early & Often
    • 49. Test Early & Often <ul><li>Test 5 users, fix, repeat </li></ul><ul><li>Reduces need to rework later </li></ul>
    • 50. Watch Users <ul><li>Don’t believe what we say we do </li></ul><ul><ul><li>See what we do, instead. </li></ul></ul><ul><li>User’s perception may be different from performance </li></ul><ul><ul><li>“ I failed to complete that task?” </li></ul></ul><ul><li>Users may not know what we want until we see what’s possible </li></ul>
    • 51. Finding Users <ul><li>Wander like Gandhi </li></ul><ul><li>Collect them keep a Rolodex </li></ul><ul><li>Go to their hangouts like Kinsey </li></ul>
    • 52. Emerging Trends
    • 53. CCHIT 5-star Ratings
    • 54. CCHIT Usability Testing <ul><li>Gathering baseline data </li></ul><ul><li>9 products tested so far (Jan 2009) </li></ul><ul><li>Mean score = 4.4 </li></ul><ul><ul><li>Too generous? </li></ul></ul>
    • 55. AHRQ Research & Policy Agenda
    • 56. AHRQ Papers <ul><li>EHR Usability: Evaluation & Use Case Framework </li></ul><ul><ul><ul><li>http://bit.ly/AHRQux1 </li></ul></ul></ul><ul><li>EHR Usability: Interface Design Considerations </li></ul><ul><ul><ul><li>http://bit.ly/AHRQux2 </li></ul></ul></ul>
    • 57. Data mining user behavior
    • 58. Data mining <ul><li>Collect analytics data on EMR users </li></ul><ul><ul><li>Find patterns of difficult use </li></ul></ul><ul><ul><li>Find user errors </li></ul></ul><ul><ul><li>Do think-aloud test </li></ul></ul><ul><ul><li>Retool, retrain, or retrench </li></ul></ul>
    • 59. Vendor-User Collaboration in vivo If the mountain won’t come to Mohammed, Mohammed must go to the mountain
    • 60. Take the usability lab to the interruptive clinical environment <ul><li>New technologies make this more possible </li></ul>
    • 61. Webcams built-in WiFi
    • 62. Morae software records user face, voice, clicks, keystrokes, times
    • 63. Small, cheap, good video cameras
    • 64. Web capture from ASP model EMRs
    • 65. Social networking
    • 66. Want to learn more? <ul><li>EMR Usability Principles and Proposed Testing </li></ul><ul><ul><ul><li>http://bit.ly/UsabilityHIMSS </li></ul></ul></ul><ul><li>Checklist - Evaluating EMR Usability before you buy </li></ul><ul><ul><li>http://bit.ly/shopEMR </li></ul></ul><ul><li>HIMSS 2010 </li></ul><ul><ul><li>Session 57: </li></ul></ul><ul><ul><ul><li>ARRA and EMR Usability: What Providers Need to Know </li></ul></ul></ul><ul><ul><li>E-Session 409: </li></ul></ul><ul><ul><ul><li>EHR Usability: Pain Points Evaluation and Results </li></ul></ul></ul>
    • 67. Questions? EMRs: Only Meaningful When They’re Usable Jeff Belden MD | [email_address] www.toomanyclicks.com

    ×