Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Inclusive Usability Testing - WordCamp London

484 views

Published on

Running tests with real users is critical for so many organizations, whether when evaluating MVPs or just as part of iterative updates. For an organization that already has embraced inclusive design, the next step is to integrate it into user testing by incorporating users with disabilities into your normal testing process. Note that this is not the same as accessibility testing. Ideally your accessibility work is done so that you can test a fully functional and accessible site/application for usability regardless of disability. I will discuss how to plan for and execute these sessions as well as pitfalls to avoid. Ideally you will walk away with high-level understanding of where to start.

Published in: Technology
  • Hello! Get Your Professional Job-Winning Resume Here - Check our website! https://vk.cc/818RFv
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Inclusive Usability Testing - WordCamp London

  1. 1. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for WordCamp London. Slides from this talk will be available at rosel.li/WCLDN.
  2. 2. • I’ve written some stuff, • Member of W3C, • Building for the web since 1993, • Learn more at AdrianRoselli.com, • Avoid on Twitter @aardrian. About Adrian Roselli
  3. 3. Types of Disabilities • Hearing Impaired • Blind • Low Vision • Physical Impairment • Cognitive
  4. 4. Selfish Accessibility
  5. 5. “I encourage you to fail in interacting with people with disabilities because you will learn a bunch. You will learn what not to say and what people care about. You’ll learn about where the obstacles are—both the designed, physical barriers and the constructed emotional ones that exist within yourself.” — Wendy Chisholm, http://sp1ral.com/2014/04/
  6. 6. Overview • Concerns • Planning • Payment • Venue • Recruitment • Accommodation • Tech • Process • Privacy
  7. 7. CONCERNS Photo by Save the Dream, CC BY 2.0
  8. 8. Concerns • Accessibility remediation must be complete.
  9. 9. Concerns • Accessibility remediation must be complete. • This is not accessibility testing.
  10. 10. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism.
  11. 11. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism. • Be clear on that with all stakeholders.
  12. 12. PLANNING Photo by Save the Dream, CC BY 2.0 Photo by benjaminlansky, CC BY 2.0
  13. 13. Planning • Review your tests and format.
  14. 14. Planning • Review your tests and format. • Are they structured? Informal? Remote?
  15. 15. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning?
  16. 16. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning? • Have you budgeted for compensating participants?
  17. 17. COMPENSATION Photo by Mike Mozart, CC BY 2.0
  18. 18. Compensation • Expect to pay participants more than you usually do.
  19. 19. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate:
  20. 20. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost,
  21. 21. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work,
  22. 22. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed,
  23. 23. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed, • Aides.
  24. 24. Compensation • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed, • Aides. • Gift cards that can be accepted where they shop.
  25. 25. VENUE Photo by Chris Waits, CC BY 2.0
  26. 26. Venue • It must be accessible.
  27. 27. Venue • It must be accessible. • Not just the building, but the entire route.
  28. 28. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc.
  29. 29. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door.
  30. 30. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door. • Relief area for service animals.
  31. 31. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door. • Relief area for service animals. • Exiting the venue.
  32. 32. RECRUITMENT Photo by NASA Goddard Space Flight Center, CC BY 2.0
  33. 33. Recruitment • Now you can find participants!
  34. 34. Recruitment • Now you can find participants! • Community / support organizations:
  35. 35. Recruitment • Now you can find participants! • Community / support organizations: • Demographics,
  36. 36. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition,
  37. 37. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships,
  38. 38. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support.
  39. 39. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support. • Let the organization recruit.
  40. 40. ACCOMMODATION Photo by David Luders, CC BY 2.0
  41. 41. Accommodation • Build extra time for every task.
  42. 42. Accommodation • Build extra time for every task. • Allow them to be late.
  43. 43. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables.
  44. 44. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table.
  45. 45. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc.
  46. 46. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc. • A place to park scooters, chairs, etc.
  47. 47. TECH Photo by City University Interaction Lab, CC BY 2.0
  48. 48. Tech • Use the participant’s system (or community org system).
  49. 49. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts.
  50. 50. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration.
  51. 51. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change.
  52. 52. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change. • Return it to the way you found it when done.
  53. 53. PROCESS Photo by Eelke, CC BY 2.0
  54. 54. Process • Be prepared to read agreements, instructions, etc. aloud.
  55. 55. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions.
  56. 56. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it.
  57. 57. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT.
  58. 58. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault.
  59. 59. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault. • Users may apologize for finding errors.
  60. 60. PRIVACY Photo by frankieleon, CC BY 2.0
  61. 61. Privacy • Some personal health information may be revealed.
  62. 62. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential.
  63. 63. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting.
  64. 64. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting. • Coordinate with recruiting organization.
  65. 65. Wrap-up Joe Dolson working with Léonie Watson to perform screen reader testing on Gutenberg at CSUN Assistive Technology Conference.
  66. 66. Resources • Tips For Conducting Usability Studies With Participants With Disabilities https://www.smashingmagazine.com/2018/03/tips-conducting-usability-studies-participants-disabilities/ • Microsoft Inclusive Design Toolkit https://www.microsoft.com/en-us/design/inclusive • Selfish Accessibility http://adrianroselli.com/2017/03/selfish-accessibility-slides-from-wordcamp-london-2017.html • W3C Web Accessibility Perspectives https://www.w3.org/WAI/perspectives/
  67. 67. Coming up… Saturday, 5 May CSS Display Properties versus HTML Semantics 14—16 June Prototyping Accessibility
  68. 68. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for WordCamp London. Slides from this talk will be available at rosel.li/WCLDN.

×