This document summarizes key aspects of usability testing based on a literature review. It defines usability testing as evaluating a product's ease of use and learnability through observing users. Usability testing identifies problems, aims to keep users central to the design process, and replaces opinions with empirical data. The document outlines methodologies, criteria for web design, interpreting data, and reporting results. It provides examples of usability testing principles, types of tests, and goals for user-centered design.

1. Usability Test
Riawan Arbi Kusuma
PT Ansvia

2. Introduction

3. Usability Testing: Why?
• “Probably the best reason to test for usability
is to eliminate those interminable arguments
about the right way to do something. With
human-factors input and testing, however,
you can replace opinion with data. Real data
tend to make arguments evaporate and
meeting schedules shrink.” (Fowler, 1998,
Appendix, p. 283)

4. Usability Testing: Definition
 Degree to which a user can successfully learn and use a product to
achieve a goal
 Research methodology
• Evaluation
• Experimental design
 Observation and analysis of user behavior while users use a product
or product prototype to achieve a goal (Dumas and Reddish, 1993,
p.22)
 “User-centered design” process involving user from initial design to
product upgrade (Norlin and Winters, 2002)
 Approach is to be a servant to the users of a system NOT to be
subservient to technology (Gluck, 1998)
 Goal is to identify usability problems and make recommendations
for fixing and improving the design (Rubin, 1994)

5. Usability Testing: Background
 Relatively new methodology (Norlin and Winters,
2002)
• Origins in aircraft design
• Traced back to marketing
• Development of a product
• Popular in 1980s with widespread access to
computers
• Initiation of human computer interface usability
studies
• Evolved from human ethnographic observation,
ergonomics, and cognitive psychology
• Qualitative and quantitative data

6. Usability Testing: Purpose
 Evaluation tool
 Identify problem areas
 “Determine the fit of the design to the
intended users” (Norlin and Winters, 2002, p.
5)

7. Usability Testing: Principles
 Keep the end user in mind
 Achieve superiority through simplicity
 Improve performance through design
 Refine and iterate (Norlin and Winters, 2002,
p.10)

8. Usability Testing: Web Design Criteria
 Links must be consistent and predictable
 Group like things on the same page
 Be consistent with language
 Most important information should be on the
first screen
 Provide keywords for quick reading/scanning
 Do not use animation or sounds
 Make links look like links
 Distinguish text from graphics
 Avoid jargon (Spool, 1999)

9. Usability Testing: Web Design Criteria
 Ten Usability Heuristics (Nielsen)
• Visibility of system status
• Match between system and the real world
• User control and freedom
• Consistency and standards
• Error prevention
• Recognition rather than recall
• Flexibility and efficiency of use
• Aesthetic and minimalist design
• Help users recognize, diagnose, and recover from errors
• Help and documentation

10. Usability Testing: Web Design Criteria
 Goals for user-centered design
• Enable users to
• Achieve their particular goals and meet their needs
• Move quickly and with few errors
• Create a site that users like
• More likely to perform well on a product that provides
satisfaction

11. Usability Testing: Methodology
 Artificial environment (laboratory)
• Maintain more control
• May provide more specific data on a particular
feature
 Natural environment
• Better holistic representation of real people doing
real work

12. Usability Testing: Methodology
 Four types of usability tests (Rubin, 1994, p.
31-46)
• Exploratory test – early product development
• Assessment test – most typical, either early or
midway in the product development
• Validation test – verification of product’s usability
• Comparison test – compare two or more designs;
can be used with other three types of tests

13. Usability Testing: Interpret Data
 Usable Web site: (Rubin, 1994)
• Usefulness
• Establish whether it does what the user needs it to do
• Effectiveness
• Ease of use to achieve the desired task
• Learnability
• Ease of learning application and moving from being a novice
to a skilled user
• User satisfaction
• User’s attitude about the site—how enjoyable it is to use

14. Usability Testing: Report Results
 Executive summary
 Report
• Describe methodology
• Who, what, when, where, and how
• Describe how tests were conducted
• Profile users and describe sampling
• Detail data collection methods
• Succinctly explain the analysis
• Provide screen captures
• Include tables and graphs
• Provide examples
• Identify strengths and weaknesses
• Recommend improvements

15. Beberapa Feedback User Mindtalk
• “Aku wes gabung channel akeh, tapi jebule
channel e mati”
• “Kok lemot to bro?”
• “Arbi, itu dialog buat post baru sering error
ya? Button send postnya sering ilang-ilang
sendiri”
• “Ada yang aneh dengan page popular bro, can
u see that?”

16. Terimakasih