Adrian Roselli's presentation on inclusive usability testing emphasizes the importance of comprehensive accessibility remediation, planning, and accommodating participants' needs. Key considerations include participant recruitment through community organizations, ensuring venue accessibility, and addressing privacy concerns related to personal health information. The process also involves using the participants' systems during testing and being respectful of their configurations and experiences.

1. Inclusive Usability Testing
Presented by Adrian Roselli (@aardrian)
for a11yTO Camp.
Slides from this talk will be available at
rosel.li/a11yTOCamp.

2. • I’ve written some stuff,
• Member of W3C,
• Building for the web
since 1993,
• Learn more at
AdrianRoselli.com,
• Avoid on Twitter
@aardrian.
Great bedtime reading!
About Adrian Roselli

3. Overview
• Concerns
• Planning
• Payment • Venue
• Recruitment
• Accommodation • Tech
• Process
• Privacy

4. CONCERNS
Photo by Save the Dream, CC BY 2.0

5. Concerns
• Accessibility remediation must be complete.

6. Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.

7. Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.
• This is not disability tourism.

8. Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.
• This is not disability tourism.
• Be clear on that with all stakeholders.

9. PLANNING
Photo by Save the Dream, CC BY 2.0Photo by benjaminlansky, CC BY 2.0

10. Planning
• Review your tests and format.

11. Planning
• Review your tests and format.
• Are they structured? Informal? Remote?

12. Planning
• Review your tests and format.
• Are they structured? Informal? Remote?
• How many participants are you planning?

13. Planning
• Review your tests and format.
• Are they structured? Informal? Remote?
• How many participants are you planning?
• Have you budgeted for paying participants?

14. PAYMENT
Photo by Mike Mozart, CC BY 2.0

15. Payment
• Expect to pay participants more than you
usually do.

16. Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:

17. Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,

18. Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,

19. Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,
• May be underemployed.

20. Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,
• May be underemployed.
• Gift cards that can be accepted where they
shop.

21. VENUE
Photo by Chris Waits, CC BY 2.0

22. Venue
• It must be accessible.

23. Venue
• It must be accessible.
• Not just the building, but the entire route.

24. Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.

25. Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.
• Meet them at the door.

26. Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.
• Meet them at the door.
• Relief area for service animals.

27. RECRUITMENT
Photo by NASA Goddard Space Flight Center, CC BY 2.0

28. Recruitment
• Now you can find participants!

29. Recruitment
• Now you can find participants!
• Community / support organizations:

30. Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,

31. Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,

32. Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,

33. Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,
• Contextual support.

34. Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,
• Contextual support.
• Let the organization recruit.

35. ACCOMMODATION
Photo by David Luders, CC BY 2.0

36. Accommodation
• Build extra time for every task.

37. Accommodation
• Build extra time for every task.
• Allow them to be late.

38. Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.

39. Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.

40. Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.
• Different seating options: widths, arms, wheels,
etc.

41. Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.
• Different seating options: widths, arms, wheels,
etc.
• A place to park scooters, chairs, etc.

42. TECH
Photo by City University Interaction Lab, CC BY 2.0

43. Tech
• Use the participant’s system (or community
org system).

44. Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.

45. Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.

46. Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.
• If necessary to modify, ask permission for any and
every change.

47. Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.
• If necessary to modify, ask permission for any and
every change.
• Return it to the way you found it when done.

48. PROCESS
Photo by Eelke, CC BY 2.0

49. Process
• Be prepared to read agreements, instructions,
etc. aloud.

50. Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.

51. Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.

52. Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.

53. Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.
• Reassure user none of the mistakes are his/her
fault.

54. Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.
• Reassure user none of the mistakes are his/her
fault.
• Users may apologize for finding errors.

55. PRIVACY
Photo by frankieleon, CC BY 2.0

56. Privacy
• Some personal health information may be
revealed.

57. Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.

58. Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.
• Where possible, anonymize data for reporting.

59. Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.
• Where possible, anonymize data for reporting.
• Coordinate with recruiting organization.

60. Oslo Davis, https://twitter.com/oslodavis/status/373219062697840640

61. Inclusive Usability Testing
Presented by Adrian Roselli (@aardrian)
for a11yTO Camp.
Slides from this talk will be available at
rosel.li/a11yTOCamp.