Measuring Usability
Usability is defined by 5 quality components:
1.Learnability: How easy is it for users to accomplish basic
tasks the first time they encounter the design?
2.Efficiency: Once users have learned the design, how quickly
can they perform tasks?
3.Memorability:When users return to the design after a period
of not using it, how easily can they reestablish proficiency?
4.Errors: How many errors do users make, how severe are
these errors, and how easily can they recover from the errors?
5.Satisfaction: How pleasant is it to use the design?
https://www.nngroup.com/articles/usability-101-introduction-to-usability/
Usability
Usability Metrics
Performance1
Behavioral3
Issue metrics2
Self-reported4
Performance1
Behavioral3
Issue metrics2
Self-reported4
Task success Time on task Errors Efficiency
Performance1
Behavioral3
Issue metrics2
Self-reported4
Task success Time on task Errors Efficiency
Identify Issue Issue Severity
Performance1
Behavioral3
Issue metrics2
Self-reported4
Task success Time on task Errors Efficiency
Identify Issue Issue Severity
Obs:Verbal bhvr Obs: Nonverbal bhvr
Performance1
Behavioral3
Issue metrics2
Self-reported4
Task success Time on task Errors Efficiency
Identify Issue Issue Severity
Obs:Verbal bhvr Obs: Nonverbal bhvr
Ease Satisfaction Clarity Comprehension etc.
The Usability Test
Opening1
UT Session: Tasks3
Pre-session Questionnaire2
Post-session Questionnaire4
Opening1
UT Session: Tasks3
Pre-session Questionnaire2
Post-session Questionnaire4
A. Introductions B. Explanation C. IRB D. Qs???
Opening1
UT Session: Tasks3
Pre-session Questionnaire2
Post-session Questionnaire4
A. Introductions B. Explanation C. IRB D. Qs???
Any variables that could influence metrics: demographics,
familiarity, attitudes, etc.
Opening1
UT Session: Tasks3
Pre-session Questionnaire2
Post-session Questionnaire4
A. Pre-task questionnaire
B. Task
C. Post-task questionnaire
D. Post-task interview
A. Introductions B. Explanation C. IRB D. Qs???
Any variables that could influence metrics: demographics,
familiarity, attitudes, etc.
Opening1
UT Session: Tasks3
Pre-session Questionnaire2
Post-session Questionnaire4
Any variables that could influence metrics: demographics,
familiarity, attitudes, etc.
A. Pre-task questionnaire
B. Task
C. Post-task questionnaire
D. Post-task interview
A. Introductions B. Explanation C. IRB D. Qs???
A. Satisfaction B. Organization C. Clarity D. Aesthetics
Website Experience
Analysis
What specific UI elements
account for aspects of the user
experience?
interpretation UX prominence
specific UI
elements
feelings
opinions
attitudes
etc.
interpretation UX prominence
specific UI
elements
feelings
opinions
attitudes
etc.
I trust…
SA 1234567 SD
interpretation UX prominence
specific UI
elements
feelings
opinions
attitudes
etc.
I trust…
SA 1234567 SD
What about this
UI makes you feel
this way?

usability testing - usability metrics and wea