The University of Connecticut's five regional campus libraries conducted experimental Virtual Focus Groups. Discover how they were set up and the results.
- Why user-centered design and user needs assessment is important
- Selling user needs assessment
- Gathering good information about your users
- Understanding the information you gathered
Applying a Quality Framework to the Focus Group MethodRoller Research
A brief overview of the focus group method followed by key considerations when applying the Total Quality Framework that allows researchers to maximize quality outcomes & mitigate error.
This presentation explores the intersection between UX strategy and research:
Part 1: Why do research, anyway?
Part 2: Understand the landscape
Part 3: Pushback & pitfalls
Part 4: Exploring the toolbox
Part 5: Case Study: ATB
Originally presented at VanUE on April 29, 2014.
The University of Connecticut's five regional campus libraries conducted experimental Virtual Focus Groups. Discover how they were set up and the results.
- Why user-centered design and user needs assessment is important
- Selling user needs assessment
- Gathering good information about your users
- Understanding the information you gathered
Applying a Quality Framework to the Focus Group MethodRoller Research
A brief overview of the focus group method followed by key considerations when applying the Total Quality Framework that allows researchers to maximize quality outcomes & mitigate error.
This presentation explores the intersection between UX strategy and research:
Part 1: Why do research, anyway?
Part 2: Understand the landscape
Part 3: Pushback & pitfalls
Part 4: Exploring the toolbox
Part 5: Case Study: ATB
Originally presented at VanUE on April 29, 2014.
It's been 30 years since Nielsen and Molich provided the first practical and widely applied framework to evaluate the usability of digital products.
How well has this venerable set of the 10 Commandments for UX stood the test of time as the technology and user expectations changed?
We'll discuss the original purpose of the heuristics, how to apply them to a structured UX evaluation, if they've stood the test of time, and whether they will apply as technology continues to evolve.
We’ll also explore whether new heuristics should be developed to account for other, recent aspects of the modern interaction and technology landscape. To illustrate this we will introduce a proposed new set of heuristics for a specific and important part of our digital interactions – social media.
Design Thinking: 5 Steps to Healthy Healthcare AppsJeffery Belden
Learn the steps of "design thinking" in the healthcare IT context. Co-presented at HIMSS 16 in Las Vegas on March 3, 2106 with Lorraine Chapman, Sr. Director for Healthcare at Macadamian.
A content strategy case study: Where we started, what we did, what we found, lessons learned. With a strong, solid foundation of knowledge, creating sustainable guidelines comes together more smoothly and easily
Presentation on cognitive issues and usability, presented to Baobab Health Trust, 2015. Topics include usability measures, perception, cognition, mental models, etc.
More Related Content
Similar to Notes on evaluation and usability inspection, Baobab Health Trust, March 2014
It's been 30 years since Nielsen and Molich provided the first practical and widely applied framework to evaluate the usability of digital products.
How well has this venerable set of the 10 Commandments for UX stood the test of time as the technology and user expectations changed?
We'll discuss the original purpose of the heuristics, how to apply them to a structured UX evaluation, if they've stood the test of time, and whether they will apply as technology continues to evolve.
We’ll also explore whether new heuristics should be developed to account for other, recent aspects of the modern interaction and technology landscape. To illustrate this we will introduce a proposed new set of heuristics for a specific and important part of our digital interactions – social media.
Design Thinking: 5 Steps to Healthy Healthcare AppsJeffery Belden
Learn the steps of "design thinking" in the healthcare IT context. Co-presented at HIMSS 16 in Las Vegas on March 3, 2106 with Lorraine Chapman, Sr. Director for Healthcare at Macadamian.
A content strategy case study: Where we started, what we did, what we found, lessons learned. With a strong, solid foundation of knowledge, creating sustainable guidelines comes together more smoothly and easily
Similar to Notes on evaluation and usability inspection, Baobab Health Trust, March 2014 (20)
Presentation on cognitive issues and usability, presented to Baobab Health Trust, 2015. Topics include usability measures, perception, cognition, mental models, etc.
Notes on redesign of Baobab Health Trust Prescribing InterfaceHarry Hochheiser
Introductory sides for exercise in redesign of Baobab Health Trust's prescription interfaces for EMR modules. Presented to Baobab Health Trust, Lilongwe, Malawi, March 2014.
Modeling and Design Notes for HIV Testing and Counseling, Baobab HealthHarry Hochheiser
Notes on modeling and design based on interviews and observations for HIV Testing and Counseling. Presented to Baobab Health Trust, Lilongwe, Malawi, March 2014.
Unit 8 - Information and Communication Technology (Paper I).pdfThiyagu K
This slides describes the basic concepts of ICT, basics of Email, Emerging Technology and Digital Initiatives in Education. This presentations aligns with the UGC Paper I syllabus.
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdfTechSoup
In this webinar you will learn how your organization can access TechSoup's wide variety of product discount and donation programs. From hardware to software, we'll give you a tour of the tools available to help your nonprofit with productivity, collaboration, financial management, donor tracking, security, and more.
We all have good and bad thoughts from time to time and situation to situation. We are bombarded daily with spiraling thoughts(both negative and positive) creating all-consuming feel , making us difficult to manage with associated suffering. Good thoughts are like our Mob Signal (Positive thought) amidst noise(negative thought) in the atmosphere. Negative thoughts like noise outweigh positive thoughts. These thoughts often create unwanted confusion, trouble, stress and frustration in our mind as well as chaos in our physical world. Negative thoughts are also known as “distorted thinking”.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
How to Split Bills in the Odoo 17 POS ModuleCeline George
Bills have a main role in point of sale procedure. It will help to track sales, handling payments and giving receipts to customers. Bill splitting also has an important role in POS. For example, If some friends come together for dinner and if they want to divide the bill then it is possible by POS bill splitting. This slide will show how to split bills in odoo 17 POS.
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxEduSkills OECD
Andreas Schleicher presents at the OECD webinar ‘Digital devices in schools: detrimental distraction or secret to success?’ on 27 May 2024. The presentation was based on findings from PISA 2022 results and the webinar helped launch the PISA in Focus ‘Managing screen time: How to protect and equip students against distraction’ https://www.oecd-ilibrary.org/education/managing-screen-time_7c225af4-en and the OECD Education Policy Perspective ‘Students, digital devices and success’ can be found here - https://oe.cd/il/5yV
This is a presentation by Dada Robert in a Your Skill Boost masterclass organised by the Excellence Foundation for South Sudan (EFSS) on Saturday, the 25th and Sunday, the 26th of May 2024.
He discussed the concept of quality improvement, emphasizing its applicability to various aspects of life, including personal, project, and program improvements. He defined quality as doing the right thing at the right time in the right way to achieve the best possible results and discussed the concept of the "gap" between what we know and what we do, and how this gap represents the areas we need to improve. He explained the scientific approach to quality improvement, which involves systematic performance analysis, testing and learning, and implementing change ideas. He also highlighted the importance of client focus and a team approach to quality improvement.
Ethnobotany and Ethnopharmacology:
Ethnobotany in herbal drug evaluation,
Impact of Ethnobotany in traditional medicine,
New development in herbals,
Bio-prospecting tools for drug discovery,
Role of Ethnopharmacology in drug evaluation,
Reverse Pharmacology.
Overview on Edible Vaccine: Pros & Cons with Mechanism
Notes on evaluation and usability inspection, Baobab Health Trust, March 2014
1. Boabab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Evaluation
Harry Hochheiser
University of Pittsburgh
Department of Biomedical Informatics
harryh@pitt.edu
+1 412 648 9300
Attribution-ShareAlike
CC BY-SA
3. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Why Evaluation?
Show that it works?
Figure out what doesn’t work?
Figure out how to make things better?
Allocate resources effectively?
Support investment of resources
Justify scaling up
4. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
DECIDE Evaluation Framework
Preece, Rogers, Sharpe, Interaction Design, 2011
Determine the goals.
Explore the questions.
Choose the evaluation methods.
Identify the practical issues.
Decide how to deal with the ethical issues.
Evaluate, analyze, interpret and present the data.
5. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Determine the goals
You already know the goals!
Decided during design
Costs
Quality
Time/Efficiency
Satisfaction
Materials,
Capital,
Revenue
Patient, Staff, MOH
Capacity,
Wait times,
Turnaround time
Safety
Waste Removal,
Best Practices
IMPROVE Safety,
Quality, Satisfaction
DECREASE Costs
6. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Tradeoffs?
• Evaluation results may not be clear cut…
• Increased efficiency but decreased satisfaction?
• Increased quality but decreased efficiency?
• Decreased cost and decreased satisfaction?
• Mixed signals are not uncommon!
7. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Evaluation Study types
8. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Spectrum of Methods
Inspection Methods
Heuristic Evaluation
Cognitive Walkthrough
Lab Usability Studies
“think-aloud”
Comparative Empirical Studies
in situ evaluation
Quantitative and qualitative
Low
Cost
Low
Fidelity
High
Cost
High
Fidelity
Formative
Summative
9. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
No bright dividing line in process
Design
Fully-functional
Prototype
Paper
Prototype
Release
Usability Inspections
Usability Studies
Empirical User Studies, Case
Studies, Longitudinal Studies,
Acceptance Tests
Low
cost,
low
validity Higher
cost,
validity
10. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Usability Assessments
• This is where we start talking about how to assess
usability!
• Goals - discuss usability measurements that can
• Inexpensively identify problems
• both potential and real
• Guide design
• ideally early, before deploymen
11. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Goals of Usability Assessments
• Can users complete tasks?
• Appropriateness of mental models
• Comparative efficiency
• Subjective satisfaction
• How do we assess?
12. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Usability Inspections
• “clean-room” static examination of usability
• Methodically scrutinize interfaces in search of potential
problems
• Pros:
– Inexpensive – no users, relatively easy
– Identify major issues at a relatively early stage
• Cons:
– May miss problems: generally find < 50%
– All results are hypothetical – don’t know which problems might
really lead to errors
13. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Common Questions
•Who inspects?
•Background
•How many?
• Which tasks?
• How to interpret findings?
•Problems are not “real” problems experienced by users
•How important are they?
14. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Two broad classes of usability
inspections
Heuristic Evaluations: How well does an interface conform to
guidelines for interface design?
Walkthroughs: Analytic examination of interface and interaction
requirements, usually informed by some model of the user
Many variants...
15. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic inspection
Usability experts
Domain experts
Combination? (Double experts)
Users should participate as users
when possible
3-5 experts? (Nielsen)
Or more...
Work alone, or in teams..
Walkthroughs
May require more cognitive
background
Domain expert feedback helpful
Conducted by a team?
Who inspects?
16. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic inspections
Set tasks
Open-ended exploration
Walkthroughs
Generally, specific tasks
Tasks
17. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Results
Nielsen and Molich 1990 , Nielsen 1993
• Few false positives
• Find < 50% of errors
• “In general, we would expect aggregates of five
evaluators to find about two thirds of the usability
problems which is really quite good for an informal and
inexpensive technique like heuristic evaluation.”
18. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Results
Nielsen and Molich 1990
Source of the “you only need 5 evaluators” rule…
Hotly contested…
19. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Which Evaluators?
Nielsen, 1992
• “Double Experts” - Domain and Usability expertise – considered best
• Not always available – use some of each, or teams
20. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
When to conduct inspections?
Paper prototypes?
Working system?
Early and often…
21. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Evaluators work alone
(except for when they work in teams)
Optional observer can help explain confusing issues and to
record issues.
Go through interface several times
overview and specific
Heuristic focus or task focus
Note discrepancies between interface and heuristic
Individual evaluators meet to aggregate results
Heuristic Evaluation Procedure
22. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Nielsen's Heuristics
Nielsen, 1994 - http://www.nngroup.com/articles/ten-usability-heuristics/
• Visibility of system status
• Match between system and real world
• User control and freedom
• Consistency and standards
• Error prevention
• Recognition rather than recall
• Flexibility and efficiency of use
• Aesthetic and minimalist design
• Help users recognize, diagnose, and recover from errors
• Help and documentation
23. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Nielsen's Heuristics
Nielsen, 1994 - http://www.nngroup.com/articles/ten-usability-heuristics/
• Visibility of system status
•“The system should always keep users informed about what is going on, through
appropriate feedback within reasonable time”
• Match between system and real world
“The system should speak the users’ language, with words, phrases, and
concepts familiar to the user, rather than system-oriented terms. Follow real-world
conventions, making information appear in a natural and logical order.”
• User control and freedom
“Users often choose system functions by mistake and will need a clearly marked
"emergency exit" to leave the unwanted state without having to go through an extended
dialogue. Support undo and redo.”
24. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Nielsen's Heuristics
Nielsen, 1994 - http://www.nngroup.com/articles/ten-usability-heuristics/
• Consistency and standards
“Users should not have to wonder whether different words, situations,
or actions mean the same thing. Follow platform conventions.”
• Error prevention
“Even better than good error messages is a careful design which prevents a
problem from occurring in the first place. Either eliminate error-prone conditions or
check for them and present users with a confirmation option before they commit to the
action.”
• Recognition rather than recall
“Minimize the user's memory load by making objects, actions, and options visible.
The user should not have to remember information from one part of the dialogue to
another. Instructions for use of the system should be visible or easily retrievable
whenever appropriate.”
25. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Nielsen's Heuristics
Nielsen, 1994 - http://www.nngroup.com/articles/ten-usability-heuristics/
• Flexibility and efficiency of use
“Accelerators -- unseen by the novice user -- may often speed up the
interaction for the expert user such that the system can cater to both
inexperienced and experienced users. Allow users to tailor frequent
actions.”
• Aesthetic and minimalist design
•
“Dialogues should not contain information which is irrelevant or rarely
needed. Every extra unit of information in a dialogue competes with the
relevant units of information and diminishes their relative visibility.”
26. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Nielsen's Heuristics
Nielsen, 1994 - http://www.nngroup.com/articles/ten-usability-heuristics/
• Help users recognize, diagnose, and recover from errors
“Error messages should be expressed in plain language (no codes), precisely
indicate the problem, and constructively suggest a solution.”
• Help and documentation
“Even though it is better if the system can be used without documentation, it
may be necessary to provide help and documentation. Any such information should be
easy to search, focused on the user's task, list concrete steps to be carried out, and
not be too large.”
27. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.edu
Recording Heuristic Violations
• Which Heuristic
• Description
• Severity
• Proposed revisions
28. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Use severity judgments to prioritize fixes
Frequency of problem
Impact of problem
Persistence – will users be repeatedly bothered?
Multiple independent raters increase reliability
Bigger questions – does this design work at all?
As with usability studies, try to generalize
Don't solve lots of small problems if the design is inherently problematic
Interpretation
29. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Making use of heuristic evaluation
results?
●
Have member of development team present during
inspection?
Can be done with usability studies and other inspections as well
They should observe, not analyze
●
Debriefing session to explore fixes
Consider redesigns where appropriate.
30. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Other Inspection Methods
http://www.useit.com/papers/heuristic/inspection_summary.html
Heuristic estimation – compare interfaces
Feature Inspection – look for long sequences
of operations, unnatural sequences,
those requiring extensive skill...
Consistency inspection – compare designs for consistency
Standards Inspection
31. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Which Heuristics?
• Multiple versions of Nielsen’s list
• Other versions
– Special cases?
• More heuristics – more focus
– ..but less study
• Too many heuristics – cumbersome, complicated
32. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Web Usability Heuristics
http://www.andybudd.com/archives/2007/01/
heuristics_for_modern_web_application_development/index.htm
• Design for user expectations
• Clarity
• Minimize Unnecessary Complexity and Cognitive Load
• Efficiency and Task Completion
• Provide Users with Context
• Consistency and Standards
• Prevent Errors
• Help users, notice, understand, and recover from errors
• Promote a pleasurable and positive web experience
33. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Using usability heuristics to evaluate patient safety of
medical devices
Zhang, et al. 2003
• Nielsen heuristics + Shneiderman’s 8 golden rules
• Revised and clarified
• New severity ratings
• Demonstrations of use…
– … but less study than Nielsen’s list
34. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Zhang, et al. 2003 - Heuristics
• Consistency
• Visibility
• Match
• Minimalist
• Memory load
• Feedback
• Flexibility
• Messages (errors)
• Errors (prevention)
• Closure
• Language
• Control
• Document
Severity Rating
0. No problem
1. Cosmetic
2. Minor
3. Major
4. Catastrophe
35. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Zhang, et al. 2003 - Heuristics
• Severity rating
• “As a guideline for rating the problems, we consider the
proportion of users who will experience it, the impact it
will have on their experience with the product, and
whether the usability problem will be a problem only the
first time they encounter it, or whether it will
persistently bother them. A persistent problem with a
major impact that most users will encounter will get
the highest severity rating.”
• What about rare but potentially catastrophic
problems?
36. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a telemedicine-based
Medication Delivery Unit for older adults through
inspection methods
Ligons, et al. 2011
●
EMMA: The Electronic
Medication Management
Assistant (INRangeSystems, Aloona
PA)
●
Electronic medication
delivery + wireless
communication with pharmacy
●
Track adherence
●
Adjust dosage
●
Touch screen interface
37. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a telemedicine-based
Medication Delivery Unit …
Ligons, et al. 2011
• Goal: use MDUs to improve adherence among older
patients
• Concern – touch-screen might be hard to use
– Calibration of touch
– Low vision or blindness - difficulty seeing screen/reading?
– Cognitive challenges – understanding use?
• Use Heuristic evaluation for first-pass investigation of
usability
– Question – “Can users use the system?”, not
“How can we improve the system?”
38. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a telemedicine-based
Medication Delivery Unit …
Ligons, et al. 2011
NLM guidelines for website
design for older adults
• User only sans-serif font,
12-14 point, medium or bold
weight, double-spaced, left-
justified
• Avoid blue, yellow, and green, in
close proximity
• Use light background with dark
text or dark backgrounds with
light text
• Modified Nielsen (1990)
heuristics
Simple and Natural Dialog
Speak the user’s language
Minimize memory load
Be consistent
Provide Feedback
Provide clearly marked exits
User good error messages
Prevent errors
Provide shortcuts
39. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a telemedicine-based
Medication Delivery Unit …
Ligons, et al. 2011
• Explore interface with respect to each heuristic
– Multiple passes
40. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a
telemedicine-based Medication
Delivery Unit …
Ligons, et al. 2011
• Minimize memory load - major issues
– Confusing buttons complicate access to help system
– “Drop” menu for advance indications doesn’t include displays of
appropriate dates and medications
• Be Consistent – minor issues
– “back” button vs. “cancel” buttons
– “medication drops” vs. “advance drops” on different screens
• Provide Feedback – medium
– No feedback when buttons are pressed
– Slow response
41. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Assessing the usability of a telemedicine-based
Medication Delivery Unit …
Ligons, et al. 2011
• Prevent Errors – medium
– Small buttons with low tolerance
– Complicated process of loading and unloading medication packs
• Typeface
– Small fonts for on-screen medication and information on
blister packs
42. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Usability Evaluation of an Electronic Medication
Administration Record (eMAR) Application
Guo, et al. 2011
• Medication Administration Record - record of drug delivery
• eMAR tasks
– Access to drug information, policies, and procedures related to
meds
– Context-specific patient clinical results
– Facilitate communication between nurses and pharmacists
– Verification of the five “rights” (patient, drug, dose, route, and
time)
• Heuristic Evaluation for usability
• Using Zhang’s heuristics and severity ratings
43. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Electronic Medication Administration Record (eMAR)
Application
Guo, et al. 2011
44. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic evaluation of eMAR
Guo, et al. 2011
• Tasks
– Login
– Order and modify medication
– Verify medication orders
– Access drug references
– Administer medication
– Edit eMAR
– Generate reports and review
• Procedure
– Train evaluators
– Conduct evaluation
– Calculate agreement
– Build consensus
– Review with staff – conduct tasks
45. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic evaluation of eMAR
Guo, et al. 2011
• Observations
– classified by heuristic,
– grouped into usability problems
– Organized by task
46. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic evaluation of eMAR
Guo, et al. 2011
47. Baobab Health, March 2014Harry Hochheiser, harryh@pitt.eduHarry Hochheiser, harryh@pitt.edu Baobab Health, March 2014
Heuristic evaluation of eMAR
Guo, et al. 2011