Usability refers to five factors: ease of learning, efficiency of use, memorability, error frequency and recovery, and subjective satisfaction. Reviewing involves revising, editing, and proofreading a draft. Evaluating involves having others review the draft and provide feedback on its strengths and weaknesses. Testing involves formal observation of users completing tasks using the draft to identify usability issues.

1. Usability refers to five factors of use:
• ease of learning
• efficiency of use
• memorability
• error frequency, severity, and recovery
• subjective satisfaction
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 1

2. What are reviewing,
evaluating, and testing?
• Reviewing refers to three techniques—revising,
editing, and proofreading—that you can use to study
your draft and change it to make it easier to use.
• Evaluating refers to having other people help you by
reading the draft and commenting on its strengths and
weaknesses.
• Testing refers to formal techniques of observing
people and analyzing their actions as they try to use
your draft to carry out tasks.
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 2

3. Understand the relationships among
reviewing, evaluating, and testing:
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 3

4. Consider three factors when deciding
whether to evaluate or test:
• the importance of the document or site
• your time
• your money
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 4

5. Ask these four questions to get the
“big picture” before editing your draft:
• Is the design effective?
• Does my draft meet my readers’ expectations?
• Is my draft honest, and does it adhere to
appropriate legal standards?
• Do I come across as reliable, honest, and
helpful?
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 5

6. Ask these four questions about organization
and development when editing your draft:
• Have I left out anything in turning my outline into
a draft?
• Is the organization logical?
• Is the emphasis appropriate throughout the
draft?
• Are my arguments well developed?
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 6

7. Ask these four questions about the
verbal and visual elements of your draft:
• Are all the elements presented consistently?
• Are my paragraphs well developed?
• Are my sentences clear, emphatic, and correct?
• Have I used graphics appropriately?
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 7

8. There are five types of usability evaluations:
• surveying or interviewing users
• observing users
• interviewing SMEs and usability experts
• conducting focus groups
• using a commercial usability service
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 8

9. Usability testing rests on three principles:
• Usability testing permeates product
development.
• Usability testing involves studying real users as
they use the product.
• Usability testing involves setting measurable
goals and determining whether the product
meets them.
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 9

10. Usability testing occurs in three stages:
• preparing for the usability test
• conducting the usability test
• interpreting and reporting the data from a
usability test
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 10

11. Preparing for a usability
test requires eight steps:
1. Understand users’ needs.
2. Determine the purpose of the test.
3. Staff the test team.
4. Set up the test environment.
5. Develop a test plan.
6. Select participants.
7. Prepare the test materials.
8. Conduct a pilot test.
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 11

12. A typical usability testing lab
Source: Xperience Consulting, 2008 <www.xperienceconsulting.com/eng/serviceios.asp?ap=25#3>.
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 12

13. Obtain informed consent
for tests that involve recording:
• Explain that the test participant can stop the test.
• Ask for permission before recording begins.
• Explain how the recording will be used.
• Explain who will have access to the recording and
where it might be shown.
• Explain how the test participant’s identity will be
disguised—if at all—if the recording is shown publicly.
• Let the test participant view the recording and change
his or her mind about how it might be used.
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 13

14. Conducting a usability
test involves two tasks:
• interacting with the test participant during the
test
• debriefing the test participant after the test
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 14

15. Interpreting and reporting the data
from a usability test requires three steps:
• tabulating the information
• analyzing the information
• reporting the information
Chapter 13. Reviewing, Evaluating, and Testing © 2012 by Bedford/St. Martin's 15