Usability testing refers to evaluating a product or service by testing it with representative users. We will discuss about: - Usability Testing - Type of Usability Testing - Usability Testing Methodology - Usability Testing Tools - Usability Tips and trick - Usability Case Studies

1. Anggita Satriya K.
Local Leader IxDA Malang & COO INDUX
USABILITY
TESTING TO
IMPROVE
USER EXPERIENCE

3. Table
Of Content
1. Usability Testing
2. Type of Usability Testing
3. Usability Testing Methodology
4. Usability Testing Tools
5. Usability Tips and trick
6. Usability Case Studies

4. Usability
Testing

5. What is Usability Testing?
Usability testing refers to evaluating a product or service by testing it with
representative users.

6. Benefit Usability Testing
Usability testing lets the design and development teams identify an early problem,
and lets us know what part should be improved

7. During usability test, you will:
• Learn if participants are able to complete specified tasks successfully and
• Identify how long it takes to complete specified tasks
• Find out how satisfied participants are with your Web site or other product
• Identify changes required to improve user performance and satisfaction
• And analyze the performance to see if it meets your usability objectives

8. You Don’t Need a Formal Labs
You can conduct in every place, an effective usability test does not require a
formal lab or any private room. your participant must feel at home and
comfortable.

9. Trying this step, for setting up your own labs.
• Productive cafe or Coworking space
• Preparing voice recorder
• Camera for global activity and main activity
• Screen recorder if the product is digital(apps/website)
• Remotely, with the user in a different location (either moderated or
unmoderated)

10. Type of Usability
Testing

11. Moderated Usability Testing
Moderated usability testing is a usability testing technique that involves the active
participation of a trained facilitator or moderator, and is usually performed in a lab
or corporate setting.

12. Unmoderated Usability Testing
Unmoderated usability testing is completed by test participants in their own
environment without a facilitator present.

13. Usability Testing
Methodology

14. Quantitative vs Qualitative
Quantitative This type of research is focused on numbers and measurement while
Qualitative research, an approach that’s all about the ‘why’

15. Heuristic Evaluation
method for finding the usability problems in a user interface design so that they
can be attended to as part of an iterative design process.

16. Tree Testing
In a tree test, participants attempt to complete tasks using only the category
structure of your site.

17. Aye Tracking
Measures the gaze of the eye, allowing the observer to ‘see’ what the user sees.

18. PURE
(Pragmatic Usability Rate by Expert)
PURE is a usability-evaluation method in which usability experts assign one or more
quantitative ratings to a design based on a set of criteria and then combine all these
ratings into a final score and easy-to-understand visual representation

19. Usability Testing
Tools

22. Usability Testing
Tips and Tricks

23. Isn’t best tips and trick
• Build a persona and segmented your participant
• Describe your product with a meaning short words and make your participant
understand
• Understanding your participant
• Don’t try solving everything at once
• Engage the whole team in the process
• Deep dive into user behavior
• Don’t forget to set the goal

24. Usability Testing
Case Studies

25. PURE Rubric
The step can be accomplished easily by the target user, due to low cognitive
load or because it’s a known pattern, such as the acceptance of a terms-of-service
agreement.
The step requires a notable degree of cognitive load (or physical effort)
by the target user, but can generally be accomplished with some effort.
The step is difficult for the target user, due to significant cognitive load or
confusion; some target users would likely fail or abandon the task at this point.

26. PURE
(Pragmatic Usability Rating by Expert)
PURE is like a Tomatometer for
usability. It provides a score obtained
by aggregating ratings (on a
predefined rating scale)
from a panel of experts familiar
with UX principles and heuristics.
PURE Scores: Measures of Friction
PURE scores for two tasks

27. PURE Scoring By
Task
The PURE score for a product is
the sum of the scores for each
fundamental task that can be
accomplished with that product.

28. How To Conduct PURE
Step 1: Target User Types
Step 2: Fundamental Tasks
Step 3: Happy Paths
Step 4: Step Boundaries
Step 5: Review by Three Expert Raters
Step 6: Interrater Reliability Calculations (IRR)
Step 7: The Decided PURE Score
Step 8: Summing It Up into Green, Yellow, and Red
Step 9 (optional): It’s Not All Quantitative
Step 10 (optional): Comparing PURE Scores

29. Happy Path
The “Happy Path” of each Fundamental Task is defined as the most desired path
to accomplish the task, as specified by the Design Lead.

30. Comparing PURE
Scores
Scores from three PURE evaluations
on the same product indicate
significant UX improvements in
the new versions of the product.

31. PURE Project

32. PURE Project

33. PURE Project

34. PURE Project

35. PURE Project

36. PURE Project

37. PURE Project

38. Heuristic Evaluation
Jakob Nielsen's 10 general principles
for interaction design. They are called
"heuristics" because they are broad
rules of thumb and not specific
usability guidelines.
#1: Visibility of system status
#2: Match between system and the real world
#3: User control and freedom
#4: Consistency and standards
#5: Error prevention
#6: Recognition rather than recall
#7: Flexibility and efficiency of use
#8: Aesthetic and minimalist design
#9: Help users recognize, diagnose, and
recover from errors
#10: Help and documentation

39. Psychological Heuristic
Evaluation
a heuristic implementation by the psychological side of human behavior

40. Heuristic Evaluation Project

41. Heuristic Evaluation Project

42. Heuristic Evaluation Project

43. Heuristic Evaluation Project

44. Heuristic Evaluation Project

45. Heuristic Evaluation Project

46. Heuristic Evaluation Project

47. Heuristic Evaluation Project

48. Related link
1. nngroup.com
2. measuringu.com
3. hotjar.com
4. usability.gov
You can download this slide at: bit.ly/ut-mqa

49. THANK YOU
@ixda_malang
fb.com/IxDAMalang
@MalangIxda
ixda-malang.org
HQ : Jl. Basuki Rahmat No. 7-9, Klojen,
Kota Malang