The purpose of usability testing is to identify areas of a design that interfere with a user’s ability to use that product effectively, efficiently, and enjoyably. Therefore, we observe while a small group of representative users completes a set of tasks; however, rarely are people with disabilities included in usability tests. That is, unless the purpose is to specifically identify accessibility issues. Why do we keep these studies separate? Are people with disabilities not completing the same tasks as everyone else? Rather than separating usability and accessibility testing, or worse, not including people with disabilities in testing at all, why not simply include them as participants in your usability tests? In this presentation, we’ll show you how easy it can be to do just that and when it is most appropriate. While, yes, there are some extra considerations, usability testing with people with disabilities proves to be worthwhile.

1. D a n a D o u g l a s a n d K r i s te n D a v i s
U s e r Wo r k s , I n c .
w w w . u s e r w o r k s . c o m
@ u s e r w o r k s

2. 2
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Gather data that more accurately represents
whole user population
 Identify areas that interfere with any user’s
ability to interact with a system
Why include PWDs in testing?

3. 3
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Significant, expensive accessibility issues
can be identified early
 It doesn’t require much additional effort,
budget, or time
 Only minor adjustments when:
• Recruiting participants
• Collecting data
• Analyzing data
Why include PWDs in testing?

4. 4
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5

5. 5
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Consider your target audience
• Including just one or two PWDs will lead
to informative findings
 Consider which disabilities could be most
affected when using your product and
make sure to include people who
represent those needs
Who to Recruit

6. 6
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Utilize existing resources
(e.g., recruiting agencies)
 Use community resources
• Personal recommendations
(i.e., word of mouth)
• Social media and forums
• Advocacy organizations
• Libraries
• Day centers, churches, schools
• Independent living centers
How to Recruit

7. 7
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Make in-person accommodations
• Consider accessibility of your facility
• Identify transit options
• Cover transportation costs
 Offer remote sessions
How to Recruit

8. 8
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Signature guide.
Source: Washington
Secretary of State website
 Send a text-based version of consent form
in advance
 Provide options for signing
• Response via email
• Verbal agreement
• Online form or digital
signature
• In-person signature guide
How to Obtain Consent

9. 9
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5

10. 10
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Consider remote testing
• Avoids transportation issues
• Allows users to participate in a comfortable,
familiar environment
 Use tools that the participant is already
familiar with
 Loosen requirements for screen sharing or
recording if they cause a barrier
Provide Accommodations

11. 11
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Adjust equipment as needed (if in-person)
• Allow participants to use own devices
• Allow time to set up those devices
• Adjust recording method (microphone or
camera setup) accordingly
 Print out or display tasks for easier reading
 Consider online chat for participants who
are hearing impaired
Provide Accommodations

12. 12
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Keep same tasks and general
methodology, but:
• Allow more time to complete tasks
• Consider redefining what constitutes a
successful task
• Do not require thinking aloud
• Avoid interrupting to ask probing
questions; wait until later
Be Flexible with Methods

13. 13
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Note any interesting methods used to
overcome accessibility problems or
obstacles
 Note any interesting
customization settings
Make Special Observations

14. 14
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Not Using AT

15. 15
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Using Screen Reader

16. 16
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Using Speech Recognition

17. Findings from Sample Sessions
 Identified usability issues
 Discovered accessibility issues
 Revealed a more robust view of how
various users might experience the site
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5 17

18. 18
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5

19. 19
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
 Analyze data in aggregate
 Report accessibility issues alongside
broader usability issues
 Use video clips to demonstrate issues
How to Analyze the Data

20. Summary
 Gather a more accurate representation of
the whole user population
 Be flexible with methods
 Identify issues that may not have been
identified otherwise
 A little bit more effort can have a big
impact on the user experience
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5 20

21. 21
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5

22. 22
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Better Accessibility Through Your User Research – Whitney
Quesenbery, UIE Webinar
DigitalGov articles:
 Usability Testing with People Who Have Vision Impairment
 Looking at User Experience through Two Lenses
 User Experience Impossible: The Line Between
Accessibility and Usability
Just Ask: Integrating Accessibility Throughout Design – Shawn
Lawton Henry, Book (Online version; Section on usability)
Usability Testing by People with Disabilities: Some Guerrilla
Tactics – UX Magazine
Resources: Usability Testing with PWDs

23. 23
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Kristen Davis
Senior User Experience Specialist
kdavis@userworks.com
Dana Douglas
Senior User Experience Specialist
ddouglas@userworks.com
Questions or comments?