Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Inc             Moderator:             Pamela Stoffregen-G...
UATAesthetic                              Functional               Attitude & Opinion            (These are not behavior)
SAY ≠DO
A couple of caveats…              4
User Experience Encompasses Usability                  User               Experience                  (UX)                ...
Utility (Usefulness)                       Useful Does Not Mean Usable                       Usable Does Not Mean Useful  ...
yü-zə-ˈbí lə-tē        -from O.Fr. usable (1311), from user (see use). Not a common word before c.1840.The extent to which...
Psychology  Cognitive   Human Factors       Engineering::Physics                as     Human Factors::Psychology    Usabil...
Methods of measuring            Principles of behavior thatbehavior                        inform design Reaction time  ...
Methods of measuring            Principles of behavior thatbehavior                        inform design Reaction time  ...
A Negative                     A Positive statement,statement, with No                 with Yes (affirmative)(negative) re...
Negative statement,                                     Positive statement,    with No (negative)                         ...
Positive                            Logically                            Negative                            Equivalent   ...
Statement Type        Use When True/Affirmative    Fast, easy, low-cost-to-user outcome,                      confirmatio...
Methods of measuring            Principles of behavior thatbehavior                        inform design Reaction time  ...
Ready…
When was the patient’shighest platelet count?
Human performance depends on  how well tools are designed      Change interface              =     Change performance
How do we measure that       change?How do we understand  users, tasks and   environments?
Usability / UX Methods                                                     Access                                         ...
Eye Tracking              Cognitive   Formative Usability              Modeling         Testing                           ...
Describe Improve  FieldLab                    Environment/Tasks                                                    Use...
Fully                                              Deployed                                              Eye tracking     ...
Behavior                                                      Eye tracking    Validation                                  ...
Collaborators:                     Supported & Improved by:- Svetlana Lowry, NIST              - SHARPC - Jiajie Zhang’s L...
 Apply existing established human  factors methods in the technical  evaluation (i.e., measurement) of EHR  Usability Fo...
Who are the users?What is the user’s environment?What are their tasks?How well does the application do thetasks in the env...
An evaluation of the critical components of the user interfaceby executing various use case scenarios.Clinical subject mat...
                                                              image    •   In order to assure independence in the revie...
•   •    ••    •••    •
•••••••
••••••
•••
•••
••••
••
•••    •    •    •••
•    o    o    o•
CommonIndustry Format (CIF)                        • Specifies format for reporting                          results of a ...
•    o    o••
Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Incrschumacher@usercentric.com                   User Cent...
Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Incrschumacher@usercentric.com                   User Cent...
Usability and Electronic Health Records
Usability and Electronic Health Records
Usability and Electronic Health Records
Usability and Electronic Health Records
Usability and Electronic Health Records
Usability and Electronic Health Records
Usability and Electronic Health Records
Upcoming SlideShare
Loading in …5
×

Usability and Electronic Health Records

1,364 views

Published on

During this webinar, Managing Director Robert Schumacher discussed the recently released Electronic Health Record (EHR) Usability Protocol from the National Institute of Standards and Technology. User Centric has been heavily involved in ensuring EHRs are evaluated for usability.

This webinar provides insights and tactics to help you:
• Position usability next to other methods of evaluating electronic health records
• Show the application of some key human performance principles to EHR design
• Discuss the emerging methods of expert review and validation testing for evaluating and measuring user performance of EHRs

(With audio: http://vimeo.com/36793907)

http://www.usercentric.com/healthcare

Published in: Health & Medicine, Technology

Usability and Electronic Health Records

  1. 1. Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Inc Moderator: Pamela Stoffregen-Gay Sr. Marketing Manager User Centric, Inc #uxlunch
  2. 2. UATAesthetic Functional Attitude & Opinion (These are not behavior)
  3. 3. SAY ≠DO
  4. 4. A couple of caveats… 4
  5. 5. User Experience Encompasses Usability User Experience (UX) Usability 5
  6. 6. Utility (Usefulness) Useful Does Not Mean Usable Usable Does Not Mean Useful Usability
  7. 7. yü-zə-ˈbí lə-tē -from O.Fr. usable (1311), from user (see use). Not a common word before c.1840.The extent to which a product can be usedby specified users to achieve specifiedgoals with effectiveness, efficiency, andsatisfaction in a specified context of use ISO definition
  8. 8. Psychology Cognitive Human Factors Engineering::Physics as Human Factors::Psychology Usability
  9. 9. Methods of measuring Principles of behavior thatbehavior inform design Reaction time  Performance  Memory Errors  Cognitive workload  Motor capabilities Eye tracking  Attention  Signal detection …  Psycholinguistics  Choice theory  …There is a rich history of Knowledge of humanconstructing studies to capabilities embodied in userunderstand and explain interface design can optimizehuman performance user performance
  10. 10. Methods of measuring Principles of behavior thatbehavior inform design Reaction time  Performance  Memory Errors  Cognitive workload  Motor capabilities Eye tracking  Attention  Signal detection …  Psycholinguistics  Choice theory  …There is a rich history of Knowledge of humanconstructing studies to capabilities embodied in userunderstand and explain interface design can optimizehuman performance user performance
  11. 11. A Negative A Positive statement,statement, with No with Yes (affirmative)(negative) response response Yes or No? The circle isis above the star The circle not above the star
  12. 12. Negative statement, Positive statement, with No (negative) with Yes (affirmative) response response The circle is not The circle is above the star above the star• Positive statements evoke faster responses than negative statements• Yes responses are much faster than No responses (~ 500 msec)
  13. 13. Positive Logically Negative Equivalent Affirmative Negative Response ResponseDifferent phrasings are used when you want different responses- Large variability in cognitive processing times- Significant impact on error
  14. 14. Statement Type Use When True/Affirmative Fast, easy, low-cost-to-user outcome, confirmation only False/Affirmative Need user to think about the response, high cost to use True/Negative Should almost never use False/Negative Never use, unless trying to deceive user e.g., Opt out response
  15. 15. Methods of measuring Principles of behavior thatbehavior inform design Reaction time  Performance  Memory Errors  Cognitive workload  Motor capabilities  Signal detection Eye tracking  Attention  Psycholinguistics …  Choice theory  …There is a rich history of Knowledge of humanconstructing studies to capabilities embodied in userunderstand and explain human interface design can optimizeperformance user performance
  16. 16. Ready…
  17. 17. When was the patient’shighest platelet count?
  18. 18. Human performance depends on how well tools are designed Change interface = Change performance
  19. 19. How do we measure that change?How do we understand users, tasks and environments?
  20. 20. Usability / UX Methods Access Testing Card sortingUser Experience Participatory design (UX) Research Methods Focus groups Eye tracking Ethnographic Cognitive research walkthrough Usability Validation testing Evaluation Methods Formative usability Heuristic evaluation testing KLM- GOMS SurveysDo not involve users Involve users 25
  21. 21. Eye Tracking Cognitive Formative Usability Modeling Testing Validation TestingFocus Group Expert ReviewThe trick is to know when to use each tool ; ; ;
  22. 22. Describe Improve FieldLab Environment/Tasks Users DevelopmentDeployed Users QualitativeQuantitative AbsoluteRelative Tasks/Users Users NovicesExperts Walk Up And UseRequire TrainingTasks/Environment Attitudinal Behavioral Users
  23. 23. Fully Deployed Eye tracking Validation testing Expert EvaluationDescribe Improve Cognitive Walkthrough Formative usability Heuristic Evaluation testing Focus groups Observational Participatory research design Card sorting Early Development
  24. 24. Behavior Eye tracking Validation Validation testing testing Formative Formative Heuristic Evaluation usability usability testing testing Expert Evaluation Expert Evaluation Quantitative Cognitive WalkthroughQualitative Ethnographic research Participatory design Focus groups Card sorting Surveys Attitude
  25. 25. Collaborators: Supported & Improved by:- Svetlana Lowry, NIST - SHARPC - Jiajie Zhang’s Lab- Emily Patterson, OSU and others…- M. Chris Gibbons, Johns Hopkins- Robert North, Human Centered Technologies
  26. 26.  Apply existing established human factors methods in the technical evaluation (i.e., measurement) of EHR Usability Focus on critical aspects of usability (related to patient safety) Provide detailed systematic steps for conducting measurement usability validation studies Provide a framework for reporting usability findings Not a policy document or framework
  27. 27. Who are the users?What is the user’s environment?What are their tasks?How well does the application do thetasks in the environment for the users?What mistakes might users make?How has the application been designed to mitigate mistakes andoptimize usability?
  28. 28. An evaluation of the critical components of the user interfaceby executing various use case scenarios.Clinical subject matter experts together with usability / humanfactors experts conduct a structured evaluation of the userinterface.
  29. 29.  image • In order to assure independence in the review process, each expert reviews the user interface on his/her own and produces a set of ratings and findings. • Once all experts have completed the evaluations, a lead expert consolidates all the findings into a single report.
  30. 30. • • •• ••• •
  31. 31. •••••••
  32. 32. ••••••
  33. 33. •••
  34. 34. •••
  35. 35. ••••
  36. 36. ••
  37. 37. ••• • • •••
  38. 38. • o o o•
  39. 39. CommonIndustry Format (CIF) • Specifies format for reporting results of a summative usability evaluation • CIF approved as ISO standard ISO/IEC 25062:2006 • CIF format was agreed by the IUSR working group: IBM, Microsoft, HP, Boeing, U S West, Kodak • See NIST IR 7742
  40. 40. • o o••
  41. 41. Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Incrschumacher@usercentric.com User Centric is a global user experience research and design firm. We believe experiences matter.TM www.usercentric.com Oakbrook Terrace  Chicago  Atlanta 630-320-3900 Connect with us: @UserCentricInc Webinar Schedule (www.usercentric.com/webinars): Behaviors First, Colors Second: The Importance of Interaction Design Thursday, March 8 Medical Devices: Catching up to the FDA Tuesday, March 27
  42. 42. Presenter:Robert Schumacher, PhD.Managing DirectorUser Centric, Incrschumacher@usercentric.com User Centric is a global user experience research and design firm. We believe experiences matter.TM www.usercentric.com Oakbrook Terrace  Chicago  Atlanta 630-320-3900 Connect with us: @UserCentricInc Webinar Schedule (www.usercentric.com/webinars): Behaviors First, Colors Second: The Importance of Interaction Design Thursday, March 8 Medical Devices: Catching up to the FDA Tuesday, March 27

×