Accessibility Support Baseline: Balancing User Needs Against Test Effort

Aidan Tierney
Aidan TierneyManager Digital Accessibility at TD
THE ACCESSIBILITY SUPPORT BASELINE
Aidan Tierney
@AidanA11y
CSUN
March 25, 2016
"It can be difficult to know where to start,
and more difficult to know where to stop."
- Chetan Bakhru @cbakhru
Accessibility Support Baseline
"the minimum set of combinations of
operating systems, web browsers,
assistive technologies, and other user
agents that the website is expected to
work with"
Website Accessibility Conformance Evaluation
Methodology (WCAG-EM) 1.0
http://www.w3.org/TR/WCAG-EM/
Examples of 'combinations'
Windows 10,
IE 11,
Jaws 16,
Android 5.1.1,
TalkBack 4.2,
Nexus 6
iOS 9.2.x,
Safari,
VoiceOver,
iPad Air 2
Balancing…
User needs &
EXPECTATIONS
Effort to
develop, test
& SUPPORT
Lip service
Insincere support or
respect expressed but
not put into practice.
Support
Anticipating and
addressing
user needs &
expectations
Evidence of support for AT
• We could speak to the person reporting the
issue and not say something embarrassing like
"what's JAWS?"
• We have knowledge of the AT and ability to use
it on a device to replicate an issue within a
day or two
• We have already tested the app with the AT
• We can investigate or fix the issue
• We have licensing, firewall clearance, and
basic training in place for this AT
Assistive
Technology
(AT)
Version #
E.g. JAWS 17,
NVDA 2016.1
Operating
System (OS)
Version #
E.g. Windows 10,
OSX 10.11,
iOS 8.4
Browser
Version #
E.g. IE 11,
Chrome 49
Device
Mostly for
mobile
E.g. iPhone 6 Plus,
Samsung Galaxy
S6,
iPad Air 2
Things to account for in baseline
And users of course!
Tens or even hundreds of
possible combinations
Support for additional combinations will
likely impact effort, cost & timelines
Development QA
Customer/user
support teams
Project
delivery
timelines
Tools &
training
Levels of support
• Full
• Reduced
• Targeted
• On Demand
• None (at this time)
Support level before & after launch -
May not need to be the same
• QA before launch
• Customer support
• E.g. Projects tests
with JAWS 17 but will
support customers on
JAWS 15, 16 also
Level Before launch:
QA & Dev
After launch:
User –reported issues
Full QA tests all screens and user flows QA validates & Dev addresses all
issues
Reduced Scope defined by project
Factors to consider: core
functionality, templates
QA validates & Dev addresses all
issues
Targeted QA tests only specific content
related to known differences for a
particular combination
Only used before launch.
On
Demand
No QA activity before launch QA validates all issues. Remedial
action taken by Dev only where code
does not conform to WCAG and where
feasible.
None No QA activity prior to release. No QA or Dev activity, but
Customer Service does support user.
Levels of Support Defined
14
WCAG &
the baseline
It SHOULD work It DOES work
Accessibility Support Baseline
MOBILE APPS
OS OS Version Assistive
Technolog
y (AT)
Device Level of
Test/ QA
Level of
user
support
iOS
Latest major
version
VoiceOver
Late-
model
Full Full
Android
Latest major
version
with > 10% share
TalkBack
Late-
model,
minimal
bloatware
Full Full
Mobile App Baseline - Basics
OS OS
Version
AT Device Level of
Test/ QA
Level of
user
support
iOS iOS 9.x VoiceOver iPhone 6 Full Full
Android
Android
5.x
TalkBack Nexus 6 Full Full
Mobile App Baseline – Basics w. specific versions
iOS versions stats:
https://developer.apple.com/support/app-store/
Android version stats:
https://developer.android.com/about/dashboards/index.html
iOS 9 adoption – almost overnight
https://mixpanel.com/trends/#report/ios_9
Android adoption – a different story
https://mixpanel.com/trends/#report/android_os_adoption
OS OS Version AT Device Level of
Test/QA
Level of
user
support
iOS Latest major version VO Late-model Full Full
iOS Prior major version VO
Different,
late-model
Reduced Full
iOS
All other versions the
app supports
None None None On Demand
iOS
Future version,
if expected soon after
launch
VO Late-model Reduced Full
Android
Latest major version
with > 10% share
TB
Late-model,
minimal bloatware
Full Full
Android Prior Android version TB
Most popular
Android device
(if known)
Reduced Full
Android Other versions None None None None
Mobile App Baseline - Generic
Accessibility Support Baseline
WEB/DESKTOP
OS AT/ mode Browser Level of
Test/QA
Level of
user
support
Windows JAWS (n-1) IE 11 Full? Full?
Windows
JAWS (n, n-
2)
IE 11 None On Demand
Windows NVDA FF (latest) Full? Full?
Windows
WindowEyes
ZoomText?
Other AT?
OSX VoiceOver Safari
Web/Desktop Baseline – fill in the blanks
MOBILE WEB & RESPONSIVE WEB
Responsive web
• Browser based
• Smartphone, Tablet, Desktop
• Breakpoints:
– May be more than 3
– Portrait vs. Landscape
– Interface components change
– Include targeted testing for changes
OS OS Version AT Browser Device Level of
Test/QA
Level of
user
support
iOS iOS 9.2.x VO Safari
Late-model iPad
–landscape view
Full Full
iOS iOS 9.2.x VO Safari
Late-model iPad
–portrait view
Targeted Full
iOS
Other versions
site supports
VO Safari Late-model None On Demand
Android Android 5.1.x TB
Chrome?
Firefox?
Nexus 10 –
landscape view
Full Full
Android Android 5.1.x TB
Chrome?
Firefox?
Nexus 10
portrait view
Targeted Full
Android
Other versions
site supports
TB Any Late-model None On Demand
Responsive Web for Tablet Baseline - Specific
Each organization or team needs
to make its own call on what is
the right baseline.
Accessibility Support Baseline: Balancing User Needs Against Test Effort
THE ACCESSIBILITY SUPPORT BASELINE
Aidan Tierney
@AidanA11y
CSUN
March 25, 2016
1 of 29

Recommended

The 7 minute accessibility assessment and app rating system by
The 7 minute accessibility assessment and app rating systemThe 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating systemAidan Tierney
2.9K views40 slides
Accessibility Testing 101 by
Accessibility Testing 101Accessibility Testing 101
Accessibility Testing 101Patrick Dunphy
4.3K views24 slides
A11y user stories csun 2018 by
A11y user stories csun 2018A11y user stories csun 2018
A11y user stories csun 2018Intopia
1.9K views29 slides
What Is Accessibility Testing? by
What Is Accessibility Testing?What Is Accessibility Testing?
What Is Accessibility Testing?QA InfoTech
3.2K views19 slides
Practical tools for Web Accessibility testing by
Practical tools for Web Accessibility testingPractical tools for Web Accessibility testing
Practical tools for Web Accessibility testingToufic Sbeiti
275 views49 slides
Accessibility Testing Approach by
Accessibility Testing ApproachAccessibility Testing Approach
Accessibility Testing ApproachJatin Kochhar
253 views18 slides

More Related Content

What's hot

Automated-Accessibility-Testing by
Automated-Accessibility-TestingAutomated-Accessibility-Testing
Automated-Accessibility-TestingManoj Kumar Kumar
4.6K views52 slides
TestCraft by
TestCraftTestCraft
TestCraftRachitaNayak1
240 views14 slides
Mobile Accessibility (MobA11y) by
Mobile Accessibility (MobA11y)Mobile Accessibility (MobA11y)
Mobile Accessibility (MobA11y)Henny Swan
9.6K views75 slides
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1 by
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Bill Tyler
149 views61 slides
Negative Testing by
Negative TestingNegative Testing
Negative TestingMindfire Solutions
1.3K views21 slides
Web and Mobile App Accessibility Testing by
Web and Mobile App Accessibility TestingWeb and Mobile App Accessibility Testing
Web and Mobile App Accessibility TestingTechWell
1.3K views14 slides

What's hot(20)

Mobile Accessibility (MobA11y) by Henny Swan
Mobile Accessibility (MobA11y)Mobile Accessibility (MobA11y)
Mobile Accessibility (MobA11y)
Henny Swan9.6K views
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1 by Bill Tyler
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Bill Tyler149 views
Web and Mobile App Accessibility Testing by TechWell
Web and Mobile App Accessibility TestingWeb and Mobile App Accessibility Testing
Web and Mobile App Accessibility Testing
TechWell1.3K views
Cross browser testing by Sauce Labs
Cross browser testingCross browser testing
Cross browser testing
Sauce Labs3.5K views
Introduction to Swagger by Knoldus Inc.
Introduction to SwaggerIntroduction to Swagger
Introduction to Swagger
Knoldus Inc.5.9K views
Accessibility Testing - Using Asqatasun - Meetup Webinar by Keyur Shah
Accessibility Testing - Using Asqatasun - Meetup WebinarAccessibility Testing - Using Asqatasun - Meetup Webinar
Accessibility Testing - Using Asqatasun - Meetup Webinar
Keyur Shah2.8K views
Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele... by Simplilearn
Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele...Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele...
Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele...
Simplilearn981 views
UI Testing Automation by AgileEngine
UI Testing AutomationUI Testing Automation
UI Testing Automation
AgileEngine10.3K views
Understanding REST APIs in 5 Simple Steps by Tessa Mero
Understanding REST APIs in 5 Simple StepsUnderstanding REST APIs in 5 Simple Steps
Understanding REST APIs in 5 Simple Steps
Tessa Mero5K views
Hybrid Automation Framework Development introduction by Ganuka Yashantha
Hybrid Automation Framework Development introductionHybrid Automation Framework Development introduction
Hybrid Automation Framework Development introduction
Ganuka Yashantha1.7K views
API Testing: The heart of functional testing" with Bj Rollison by TEST Huddle
API Testing: The heart of functional testing" with Bj RollisonAPI Testing: The heart of functional testing" with Bj Rollison
API Testing: The heart of functional testing" with Bj Rollison
TEST Huddle8K views
Spring - Part 1 - IoC, Di and Beans by Hitesh-Java
Spring - Part 1 - IoC, Di and Beans Spring - Part 1 - IoC, Di and Beans
Spring - Part 1 - IoC, Di and Beans
Hitesh-Java1.3K views
Selenium introduction by Pankaj Dubey
Selenium introductionSelenium introduction
Selenium introduction
Pankaj Dubey386 views
Web Application Testing by Richa Goel
Web Application TestingWeb Application Testing
Web Application Testing
Richa Goel10.7K views
Introduction to Progressive Web Apps (PWA) by Sandip Nirmal
Introduction to Progressive Web Apps (PWA)Introduction to Progressive Web Apps (PWA)
Introduction to Progressive Web Apps (PWA)
Sandip Nirmal356 views

Viewers also liked

ARIA Techniques for Accessible Web Forms by
ARIA Techniques for Accessible Web FormsARIA Techniques for Accessible Web Forms
ARIA Techniques for Accessible Web FormsAidan Tierney
1.5K views28 slides
iOS VoiceOver Testing Techniques & Procedures for Absolute Beginners by
iOS VoiceOver Testing Techniques & Procedures for Absolute BeginnersiOS VoiceOver Testing Techniques & Procedures for Absolute Beginners
iOS VoiceOver Testing Techniques & Procedures for Absolute BeginnersAidan Tierney
3.1K views50 slides
Mobile Accessibility Best Practices & Trends by
Mobile Accessibility Best Practices & TrendsMobile Accessibility Best Practices & Trends
Mobile Accessibility Best Practices & TrendsAidan Tierney
4.7K views60 slides
CSUN 2017 VPATs For Business or Measure by
CSUN 2017 VPATs For Business or MeasureCSUN 2017 VPATs For Business or Measure
CSUN 2017 VPATs For Business or MeasureTed Gies
1.4K views24 slides
Early prevention of accessibility issues with mockup & wireframe reviews by
Early prevention of accessibility issues with mockup & wireframe reviewsEarly prevention of accessibility issues with mockup & wireframe reviews
Early prevention of accessibility issues with mockup & wireframe reviewsAidan Tierney
4.9K views40 slides
Mystery Meat 2.0 – Making hidden mobile interactions accessible by
Mystery Meat 2.0 – Making hidden mobile interactions accessibleMystery Meat 2.0 – Making hidden mobile interactions accessible
Mystery Meat 2.0 – Making hidden mobile interactions accessibleTed Drake
2K views23 slides

Viewers also liked(20)

ARIA Techniques for Accessible Web Forms by Aidan Tierney
ARIA Techniques for Accessible Web FormsARIA Techniques for Accessible Web Forms
ARIA Techniques for Accessible Web Forms
Aidan Tierney1.5K views
iOS VoiceOver Testing Techniques & Procedures for Absolute Beginners by Aidan Tierney
iOS VoiceOver Testing Techniques & Procedures for Absolute BeginnersiOS VoiceOver Testing Techniques & Procedures for Absolute Beginners
iOS VoiceOver Testing Techniques & Procedures for Absolute Beginners
Aidan Tierney3.1K views
Mobile Accessibility Best Practices & Trends by Aidan Tierney
Mobile Accessibility Best Practices & TrendsMobile Accessibility Best Practices & Trends
Mobile Accessibility Best Practices & Trends
Aidan Tierney4.7K views
CSUN 2017 VPATs For Business or Measure by Ted Gies
CSUN 2017 VPATs For Business or MeasureCSUN 2017 VPATs For Business or Measure
CSUN 2017 VPATs For Business or Measure
Ted Gies1.4K views
Early prevention of accessibility issues with mockup & wireframe reviews by Aidan Tierney
Early prevention of accessibility issues with mockup & wireframe reviewsEarly prevention of accessibility issues with mockup & wireframe reviews
Early prevention of accessibility issues with mockup & wireframe reviews
Aidan Tierney4.9K views
Mystery Meat 2.0 – Making hidden mobile interactions accessible by Ted Drake
Mystery Meat 2.0 – Making hidden mobile interactions accessibleMystery Meat 2.0 – Making hidden mobile interactions accessible
Mystery Meat 2.0 – Making hidden mobile interactions accessible
Ted Drake2K views
Accessibility microinteractions: better user experience, happier developers by Aidan Tierney
Accessibility microinteractions: better user experience, happier developersAccessibility microinteractions: better user experience, happier developers
Accessibility microinteractions: better user experience, happier developers
Aidan Tierney2.3K views
iOS Accessibility Testing with VoiceOver - A Crash Course by Aidan Tierney
iOS Accessibility Testing with VoiceOver - A Crash CourseiOS Accessibility Testing with VoiceOver - A Crash Course
iOS Accessibility Testing with VoiceOver - A Crash Course
Aidan Tierney1.7K views
CSUN 2017 Success Criteria: Dependencies and Prioritization by Sean Kelly
CSUN 2017 Success Criteria: Dependencies and PrioritizationCSUN 2017 Success Criteria: Dependencies and Prioritization
CSUN 2017 Success Criteria: Dependencies and Prioritization
Sean Kelly1.8K views
Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017 by Bill Tyler
Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017
Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017
Bill Tyler3K views
Reusable acceptance criteria and test cases for accessibility by Intopia
Reusable acceptance criteria and test cases for accessibilityReusable acceptance criteria and test cases for accessibility
Reusable acceptance criteria and test cases for accessibility
Intopia4.9K views
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN) by Lainey Feingold
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)
Lainey Feingold2.4K views
Designing with Accessibility in Mind: How IA and Visual Design Decisions Impa... by November Samnee
Designing with Accessibility in Mind: How IA and Visual Design Decisions Impa...Designing with Accessibility in Mind: How IA and Visual Design Decisions Impa...
Designing with Accessibility in Mind: How IA and Visual Design Decisions Impa...
November Samnee596 views
Lessons learn from building accessible complex web apps by Intopia
Lessons learn from building accessible complex web appsLessons learn from building accessible complex web apps
Lessons learn from building accessible complex web apps
Intopia364 views
Single Page Apps in Sitecore by sheidt818
Single Page Apps in SitecoreSingle Page Apps in Sitecore
Single Page Apps in Sitecore
sheidt818571 views
Original Access U 2013 - 508 Refresh by Barry Johnson
Original Access U 2013 - 508 RefreshOriginal Access U 2013 - 508 Refresh
Original Access U 2013 - 508 Refresh
Barry Johnson574 views
Accessible reading solutions from mainstream publishers by DAISY Consortium
Accessible reading solutions from mainstream publishersAccessible reading solutions from mainstream publishers
Accessible reading solutions from mainstream publishers
DAISY Consortium984 views
Dynamic and accessible web content with WAI-ARIA by Access iQ
Dynamic and accessible web content with WAI-ARIADynamic and accessible web content with WAI-ARIA
Dynamic and accessible web content with WAI-ARIA
Access iQ2.7K views
Ubiquitous Transactions - Financial Future and Accessibility by Ted Drake
Ubiquitous Transactions - Financial Future and AccessibilityUbiquitous Transactions - Financial Future and Accessibility
Ubiquitous Transactions - Financial Future and Accessibility
Ted Drake1.9K views
Preparing the enterprise for 508 refresh, ibm csun2017 by Michael Gower
Preparing the enterprise for 508 refresh, ibm csun2017Preparing the enterprise for 508 refresh, ibm csun2017
Preparing the enterprise for 508 refresh, ibm csun2017
Michael Gower1K views

Similar to Accessibility Support Baseline: Balancing User Needs Against Test Effort

Best Practices for DevOps in Mobile App Testing by
Best Practices for DevOps in Mobile App TestingBest Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App TestingBitbar
4.3K views34 slides
Mobile Apps Delivery - Evolution and Tools by
Mobile Apps Delivery - Evolution and ToolsMobile Apps Delivery - Evolution and Tools
Mobile Apps Delivery - Evolution and ToolsAsaf Saar
823 views31 slides
Meetup kickoff slides - Perfecto Mobile, September 2014 by
Meetup kickoff slides - Perfecto Mobile, September 2014Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014Perfecto Mobile
954 views24 slides
Mapping mobileandweblandscape motb by
Mapping mobileandweblandscape motbMapping mobileandweblandscape motb
Mapping mobileandweblandscape motbPerfecto Mobile
202 views35 slides
Introduction to the CII Badge Programe, OW2con'16, Paris. by
Introduction to the CII Badge Programe, OW2con'16, Paris. Introduction to the CII Badge Programe, OW2con'16, Paris.
Introduction to the CII Badge Programe, OW2con'16, Paris. OW2
149 views30 slides
Mobile Test Automation Framework : Presented By Shankar Garg by
Mobile Test Automation Framework : Presented By Shankar GargMobile Test Automation Framework : Presented By Shankar Garg
Mobile Test Automation Framework : Presented By Shankar GargoGuild .
662 views25 slides

Similar to Accessibility Support Baseline: Balancing User Needs Against Test Effort(20)

Best Practices for DevOps in Mobile App Testing by Bitbar
Best Practices for DevOps in Mobile App TestingBest Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App Testing
Bitbar4.3K views
Mobile Apps Delivery - Evolution and Tools by Asaf Saar
Mobile Apps Delivery - Evolution and ToolsMobile Apps Delivery - Evolution and Tools
Mobile Apps Delivery - Evolution and Tools
Asaf Saar823 views
Meetup kickoff slides - Perfecto Mobile, September 2014 by Perfecto Mobile
Meetup kickoff slides - Perfecto Mobile, September 2014Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014
Perfecto Mobile954 views
Mapping mobileandweblandscape motb by Perfecto Mobile
Mapping mobileandweblandscape motbMapping mobileandweblandscape motb
Mapping mobileandweblandscape motb
Perfecto Mobile202 views
Introduction to the CII Badge Programe, OW2con'16, Paris. by OW2
Introduction to the CII Badge Programe, OW2con'16, Paris. Introduction to the CII Badge Programe, OW2con'16, Paris.
Introduction to the CII Badge Programe, OW2con'16, Paris.
OW2149 views
Mobile Test Automation Framework : Presented By Shankar Garg by oGuild .
Mobile Test Automation Framework : Presented By Shankar GargMobile Test Automation Framework : Presented By Shankar Garg
Mobile Test Automation Framework : Presented By Shankar Garg
oGuild .662 views
Accessibility Testing Criteria for Android Applications by Collette Costello
Accessibility Testing Criteria for Android ApplicationsAccessibility Testing Criteria for Android Applications
Accessibility Testing Criteria for Android Applications
Collette Costello128 views
Using Selenium To Test Mobile? Meet Appium! by Sauce Labs
Using Selenium To Test Mobile? Meet Appium!Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!
Sauce Labs596 views
Ubertesters israel-mobile-summitt-2013 by rachlinr
Ubertesters israel-mobile-summitt-2013Ubertesters israel-mobile-summitt-2013
Ubertesters israel-mobile-summitt-2013
rachlinr563 views
Visual Studio 2015 - Lançamento está próximo by Daniel Semedo
Visual Studio 2015 - Lançamento está próximoVisual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximo
Daniel Semedo617 views
Is the mobile web enabled or disabled by design? by Henny Swan
Is the mobile web enabled or disabled by design?Is the mobile web enabled or disabled by design?
Is the mobile web enabled or disabled by design?
Henny Swan2K views
HTML5: the new frontier of the web by Ivano Malavolta
HTML5: the new frontier of the webHTML5: the new frontier of the web
HTML5: the new frontier of the web
Ivano Malavolta2.4K views

Recently uploaded

Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...ShapeBlue
162 views25 slides
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue by
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueShapeBlue
137 views13 slides
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream by
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamEvaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamAlpen-Adria-Universität
38 views34 slides
Initiating and Advancing Your Strategic GIS Governance Strategy by
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
184 views68 slides
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueShapeBlue
139 views15 slides
Optimizing Communication to Optimize Human Behavior - LCBM by
Optimizing Communication to Optimize Human Behavior - LCBMOptimizing Communication to Optimize Human Behavior - LCBM
Optimizing Communication to Optimize Human Behavior - LCBMYaman Kumar
38 views49 slides

Recently uploaded(20)

Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue162 views
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue by ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
ShapeBlue137 views
Initiating and Advancing Your Strategic GIS Governance Strategy by Safe Software
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software184 views
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
ShapeBlue139 views
Optimizing Communication to Optimize Human Behavior - LCBM by Yaman Kumar
Optimizing Communication to Optimize Human Behavior - LCBMOptimizing Communication to Optimize Human Behavior - LCBM
Optimizing Communication to Optimize Human Behavior - LCBM
Yaman Kumar38 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue303 views
Business Analyst Series 2023 - Week 4 Session 7 by DianaGray10
Business Analyst Series 2023 -  Week 4 Session 7Business Analyst Series 2023 -  Week 4 Session 7
Business Analyst Series 2023 - Week 4 Session 7
DianaGray10146 views
"Node.js Development in 2024: trends and tools", Nikita Galkin by Fwdays
"Node.js Development in 2024: trends and tools", Nikita Galkin "Node.js Development in 2024: trends and tools", Nikita Galkin
"Node.js Development in 2024: trends and tools", Nikita Galkin
Fwdays33 views
"Running students' code in isolation. The hard way", Yurii Holiuk by Fwdays
"Running students' code in isolation. The hard way", Yurii Holiuk "Running students' code in isolation. The hard way", Yurii Holiuk
"Running students' code in isolation. The hard way", Yurii Holiuk
Fwdays36 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue247 views
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT by ShapeBlue
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBITUpdates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
ShapeBlue208 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue183 views
"Package management in monorepos", Zoltan Kochan by Fwdays
"Package management in monorepos", Zoltan Kochan"Package management in monorepos", Zoltan Kochan
"Package management in monorepos", Zoltan Kochan
Fwdays34 views
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ... by ShapeBlue
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
ShapeBlue129 views
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... by ShapeBlue
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
ShapeBlue120 views

Accessibility Support Baseline: Balancing User Needs Against Test Effort

  • 1. THE ACCESSIBILITY SUPPORT BASELINE Aidan Tierney @AidanA11y CSUN March 25, 2016
  • 2. "It can be difficult to know where to start, and more difficult to know where to stop." - Chetan Bakhru @cbakhru
  • 3. Accessibility Support Baseline "the minimum set of combinations of operating systems, web browsers, assistive technologies, and other user agents that the website is expected to work with" Website Accessibility Conformance Evaluation Methodology (WCAG-EM) 1.0 http://www.w3.org/TR/WCAG-EM/
  • 4. Examples of 'combinations' Windows 10, IE 11, Jaws 16, Android 5.1.1, TalkBack 4.2, Nexus 6 iOS 9.2.x, Safari, VoiceOver, iPad Air 2
  • 6. Lip service Insincere support or respect expressed but not put into practice.
  • 8. Evidence of support for AT • We could speak to the person reporting the issue and not say something embarrassing like "what's JAWS?" • We have knowledge of the AT and ability to use it on a device to replicate an issue within a day or two • We have already tested the app with the AT • We can investigate or fix the issue • We have licensing, firewall clearance, and basic training in place for this AT
  • 9. Assistive Technology (AT) Version # E.g. JAWS 17, NVDA 2016.1 Operating System (OS) Version # E.g. Windows 10, OSX 10.11, iOS 8.4 Browser Version # E.g. IE 11, Chrome 49 Device Mostly for mobile E.g. iPhone 6 Plus, Samsung Galaxy S6, iPad Air 2 Things to account for in baseline And users of course!
  • 10. Tens or even hundreds of possible combinations
  • 11. Support for additional combinations will likely impact effort, cost & timelines Development QA Customer/user support teams Project delivery timelines Tools & training
  • 12. Levels of support • Full • Reduced • Targeted • On Demand • None (at this time)
  • 13. Support level before & after launch - May not need to be the same • QA before launch • Customer support • E.g. Projects tests with JAWS 17 but will support customers on JAWS 15, 16 also
  • 14. Level Before launch: QA & Dev After launch: User –reported issues Full QA tests all screens and user flows QA validates & Dev addresses all issues Reduced Scope defined by project Factors to consider: core functionality, templates QA validates & Dev addresses all issues Targeted QA tests only specific content related to known differences for a particular combination Only used before launch. On Demand No QA activity before launch QA validates all issues. Remedial action taken by Dev only where code does not conform to WCAG and where feasible. None No QA activity prior to release. No QA or Dev activity, but Customer Service does support user. Levels of Support Defined 14
  • 15. WCAG & the baseline It SHOULD work It DOES work
  • 17. OS OS Version Assistive Technolog y (AT) Device Level of Test/ QA Level of user support iOS Latest major version VoiceOver Late- model Full Full Android Latest major version with > 10% share TalkBack Late- model, minimal bloatware Full Full Mobile App Baseline - Basics
  • 18. OS OS Version AT Device Level of Test/ QA Level of user support iOS iOS 9.x VoiceOver iPhone 6 Full Full Android Android 5.x TalkBack Nexus 6 Full Full Mobile App Baseline – Basics w. specific versions iOS versions stats: https://developer.apple.com/support/app-store/ Android version stats: https://developer.android.com/about/dashboards/index.html
  • 19. iOS 9 adoption – almost overnight https://mixpanel.com/trends/#report/ios_9
  • 20. Android adoption – a different story https://mixpanel.com/trends/#report/android_os_adoption
  • 21. OS OS Version AT Device Level of Test/QA Level of user support iOS Latest major version VO Late-model Full Full iOS Prior major version VO Different, late-model Reduced Full iOS All other versions the app supports None None None On Demand iOS Future version, if expected soon after launch VO Late-model Reduced Full Android Latest major version with > 10% share TB Late-model, minimal bloatware Full Full Android Prior Android version TB Most popular Android device (if known) Reduced Full Android Other versions None None None None Mobile App Baseline - Generic
  • 23. OS AT/ mode Browser Level of Test/QA Level of user support Windows JAWS (n-1) IE 11 Full? Full? Windows JAWS (n, n- 2) IE 11 None On Demand Windows NVDA FF (latest) Full? Full? Windows WindowEyes ZoomText? Other AT? OSX VoiceOver Safari Web/Desktop Baseline – fill in the blanks
  • 24. MOBILE WEB & RESPONSIVE WEB
  • 25. Responsive web • Browser based • Smartphone, Tablet, Desktop • Breakpoints: – May be more than 3 – Portrait vs. Landscape – Interface components change – Include targeted testing for changes
  • 26. OS OS Version AT Browser Device Level of Test/QA Level of user support iOS iOS 9.2.x VO Safari Late-model iPad –landscape view Full Full iOS iOS 9.2.x VO Safari Late-model iPad –portrait view Targeted Full iOS Other versions site supports VO Safari Late-model None On Demand Android Android 5.1.x TB Chrome? Firefox? Nexus 10 – landscape view Full Full Android Android 5.1.x TB Chrome? Firefox? Nexus 10 portrait view Targeted Full Android Other versions site supports TB Any Late-model None On Demand Responsive Web for Tablet Baseline - Specific
  • 27. Each organization or team needs to make its own call on what is the right baseline.
  • 29. THE ACCESSIBILITY SUPPORT BASELINE Aidan Tierney @AidanA11y CSUN March 25, 2016