Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Simplifying the Web Accessibility Test Lab


Published on

Testing on every assistive technology, browser and mobile device could take forever. We present practical solutions for supporting the "long tail" of diverse user technologies.

Presented 3/20/2014 at CSUN International Technology & Persons with Disabilities Conference

Published in: Technology
  • Be the first to comment

Simplifying the Web Accessibility Test Lab

  1. 1. Simplifying the Web Accessibility Test Lab Mitchell Evan and Kevin Chao JPMorgan Chase #csun14 #ATtestlab For details in the slide notes, download the PowerPoint
  2. 2. With limited resources, how do we support limitless diversity of AT users? • What we’re doing today • What we can do better
  3. 3. Two requests 1. Challenge your own assumptions. 2. Challenge me. How can we keep improving?
  4. 4. Simplify.
  5. 5. Simple for an organization =
  6. 6. Simple for a customer (client, etc.) =
  7. 7. It takes a lot of work to make it simple.
  8. 8. Browser Recommendations We have detected that you are using a browser which is not compatible with our application. Our application requires that you use Internet Explorer version 8.0 or greater Nice and simple for the organization!
  9. 9. BYOD: Bring Your Own Device
  10. 10. BYOC: Bring Your Own Combo hardware + browser + assistive tech
  11. 11. BYOB
  12. 12. What goes into the combos? • Desktop and mobile operating systems (OS) • Browsers • AT software and hardware -- for vision, learning, and mobility • Versions • Configurations
  13. 13. Potential combos Windows: 1200 Mac: 150 Linux: 10 iOS: 12 Android: 5000 Symbian: 4
  14. 14. Conclusion: Give up. Thank you. Mitchell Evan @MitchellREvan Kevin Chao @KevinChao89
  15. 15. Just kidding!
  16. 16. Diverse people use diverse technology Diversity matters.
  17. 17. Simulate diversity >
  18. 18. You can’t test all combos... ...but consider all of the potential combos, when you plan your testing.
  19. 19. You get to choose. The WCAG Working group and the W3C do not specify which or how many assistive technologies must support a Web technology in order for it to be classified as accessibility supported.
  20. 20. Web standards are essential… …but you still have to test. •Make sure it’s usable •For WCAG conformance, it must work in AT. Only accessibility-supported ways of using technologies can be relied upon for conformance. -- WCAG 2.0 (normative)
  21. 21. Principles
  22. 22. Quiz: What does “A 11 Y” stand for? 1) Accessibility 2) Affordability
  23. 23. Financial barriers Support by just one assistive technology (for a given disability) would not usually be enough, especially if most users who need it in order to access content do not have and cannot afford that assistive technology.
  24. 24. Principles 1. Make it affordable. 2. Support every disability group. 3. Include a free AT for each disability group. 4. Focus on popular, capable combos. 5. Browser versions: use the same list as the rest of your organization. 6. AT versions: Current minus 2 versions? Or current minus x years?
  25. 25. Put the principles into practice Principles Matrix Efficiencies
  26. 26. Choose your Big Matrix • Chop out combos that are irrelevant for your organization. • Expect customers to upgrade. • Define “incapable” combos closer to the cutting edge.
  27. 27. Survey: what do you use for testing? Org Test Suite or Support Principle Yahoo! NVDA, FF on PC; VO & Saf on Mac; VO & Saf on iOS; TalkBack & FF on Android. Spot check JAWS; Chrome Android. Latest versions. Affordable Intuit JAWS + IE, older and newer versions. NVDA lastest version. Firefox, Chrome, Safari latest versions. Capable: needs to work with ARIA. UC Berkeley Internal: latest versions only Providing AT directly to community
  28. 28. Survey: what do you use for testing? Org Test Suite or Support Principle Bank A Desktop screen readers, iOS, mobile keyboards Capable: work reasonably well with ARIA Bank B Desktop screen readers (first round plus spot check), iOS, Android Capable: work with older versions publisher Screen readers (vision and dyslexia use cases), screen magnifiers, switch access, voice control, literacy aids, browser settings Support many groups
  29. 29. Which of these organizations did it the right way? Answer: All of the above
  30. 30. Prevent bugs in the first place • Train your managers, designers, and developers • Write standards-based code. Efficiencies
  31. 31. Pure time savings • Test UI components at the framework level. • Phase your testing. • Test two configurations a the same time. • Write custom-scripted automated tests. Efficiencies
  32. 32. Lower priority of some combos • Assume similar combos will give similar results; concentrate on combos that are more different from each other. • Bookend strategy: skip the middle version. Efficiencies
  33. 33. Accept some defects • Embrace “graded AT support” • If you write “good code” and it fails in one AT: “not my problem” Efficiencies
  34. 34. Reduce scope of testing • Deep test your framework. Anything that’s not framework, test more lightly. • With each release, rotate which combos you test with. Efficiencies
  35. 35. Reduce more drastically • Test the Accessibility API directly • Heuristic evaluation • Trust what you read on the web. • Let your customers test for you Efficiencies
  36. 36. Talk to your customers • On your accessibility page, be straightforward about what you do and don’t support. • If you offer live customer support, make sure they are trained.
  37. 37. Listen to your customers • Online feedback form • Customers submit issues directly to an issue tracking system
  38. 38. Future efficiency: Element-Level Support One way for authors to locate uses of a technology that are accessibility supported would be to consult compilations of uses that are documented to be accessibility supported. – WCAG “accessibility supported”
  39. 39. Another explosion! • 107 HTML elements • 61 ARIA roles • 35 ARIA states and properties • 50 JavaScript interactions (estimate)
  40. 40. Crowdsourced element testing
  41. 41. Envision the result Crowdsource element testing Publish known issues Fix the frameworks Fix the Internet Users find what we missed Fix the AT, browser, or OS
  42. 42. It’s starting now • TPG Bug Bash: Tonight 5:30-6:30, Suite 3233 Harbor Tower • Saturday hack-a-thon: Launch the Open Accessibility Testing initiative
  43. 43. Discussion How can we simplify, yet test well? How do we advance quality and affordability? #ATtestlab Mitchell Evan @MitchellREvan Kevin Chao @KevinChao89