Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017

Bill Tyler
Bill TylerDigital Accessibility Engineer at Optum Technology
CSUN 2017, San Diego
Bill Tyler
March 2, 2017
Rethinking Accessibility:
Role-Based Analysis of
WCAG 2.0
My Experience
30+ yrs. of UI/UX Design & Development
12+ yrs. in medical devices
15+ yrs. in plans & providers
2X dot-com survivor
Started Web 1996
Started Accessibility 2002
Materials Presented
3+ yrs. of ongoing accessibility research & analysis at Optum Technology
Background
2
The
Problem
3
No one thinks about accessibility
… EXCEPT the accessibility expert
Accessibility testing comes at END of development
…and LONG after other design decisions are made
All issues found are directed to DEVELOPERS to fix
…with help from accessibility expert
Final Result: “Sort of” Accessible Result
The Problem: The Usual Approach to Accessibility
4
5
Typical Development Sequence (by Role)
Add
A11y
Here QA / A11y Testing
Developers
Content Author
Visual (Vx) Designer
Interaction (IX) Designer
Business Owner
6
There’s something very wrong with this picture
Add
A11y
Here QA / A11y Testing
Developers
Content Author
Visual (Vx) Designer
Interaction (IX) Designer
Business Owner
The
Assumptions
7
The Assumptions are:
Developers…
…code accessibility…
using “accessibility-specific”
Knowledge.
8
Questioning the
Assumptions
9
Three Questions for Each Success Criterion
Who?
developer
When?
coding
10
Who?
11
Testing Roles
12
Decision Making Roles
• Standard
agile role
• Project
initiator
• Requirements
definer
• Result
approver
• Business
liaison
• Requirement
author
• Wireframe
creator
• UX / Usability
expert
• Presentation
owner
• Style expert
• Layout
creator
• Design
enforcer
• Style guide
author
• Design comp
artist
• Image file
producer
• Author of All
Text “Large &
Small”
Large: sections
Small: words
• Content
proofreader
• Includes time-
based media
• Script writer
• Audio & video
file creator
• Front-End
Programmer
• Last stop
before testing
• Primary target
for all defects
13
Of a like mind…
14
Accessibility Responsibility Breakdown
• Denis Boudreau / W3C / WAI-Engage Community, April 2012
Source: http://www.w3.org/community/wai-engage/wiki/Accessibility_Responsibility_Breakdown
– 12 Roles
Interactive WCAG 2.0
• Jeremy Fields / Viget, January 2015
Source: http://code.viget.com/interactive-wcag/
– 5 Roles
Accessibility is Everyone’s Job: A Role-Based Model for
Teams
• Mark Palmer / Simply Accessible, June 2016
Source: http://simplyaccessible.com/article/role-based-a11y
– 6 Roles
Differences in our approach
15
Decision Ownership
• Roles not just identified as part of process
RACI Model Levels
• Levels of ownership based on impact to deliverable
Additional Analysis
• Examined (much) more than just ownership (or phases)
Actionable
• Apply to enterprise distribution of work and responsibility
RACI (RASCI) Modeling
Responsible – Owns the issueR
Accountable – to Responsible “owner”A
Supportive – but not accountableS
Consulted – to address issueC
Informed – of results, but not consultedI
16
Source: http://www.valuebasedmanagement.net/methods_raci.html
Role Ownership Model
Primary – Individual role with “final approval”P
Secondary – actively involved in decisionS
Contributor – affect, but not deeply involvedC
17
Example: SC1.4.1 Use of Color
Visual Designer Interaction Designer Business Owner
18
Is it the Developer?
Who?
19
No.
20
21
Primary Success Criteria Ownership
IX Designer: 37% (14)
Content Author: 24% (9)
Developer: 21% (8)
Vx Designer: 16% (6)
Business Owner: 3% (1)
Observations
Developers only own 1 in 5 criteria
Developers are third in ownership
Need to work with other roles
When?
22
Software Design Lifecycle Entry Points
Code (front-end development: HTML, CSS, JavaScript)
Content (text, terminology, and includes video & audio)
Design Comps (page or feature final presentation)
Style Guides (site presentation, branding, colors, logos)
Wireframes (structure of page, interface, interactions)
User Story / Standard Requirements
23
Of a like mind…
24
Accessibility Responsibility Breakdown
• Government of Canada, April 2014
Source: https://wet-boew.github.io/themes-dist/GCWeb/demos/arb-rra/arb-rra-en.html
– 7 “Production Phases”
As with roles, we went further and added levels
• Levels based upon expected frequency
Entry Point Level Model
Primary – single, most significant (typical) entry pointP
Secondary – other significant entry pointsS
Impact – other minor sources of design inputI
25
When?
26
Is it Code?
No.
27
28
Primary Success Criteria Entry Points
Wireframes: 50% (19)
User Story/Std. Req.: 24% (9)
Style Guides: 18% (7)
Code: 5% (2)
Content: 2% (1)
Design Comps: “0%”
Observations
95% of decisions come before code
Half are defined in wireframes
A quarter are in user stories
Nearly a fifth in style guide
What?
29
Three Criteria Types
30
What?
31
Is it Accessibility?
No.
32
33
Success Criteria Types
Best Practices: 53% (20)
Primarily A11y: 39% (15)
User Stories: 8% (3)
Observations
• Over half of decisions are
best practices roles should
already know
• Accessibility training could
focus on topics they don’t
Examples
34
Example (of what NOT to do): “Press the green button on the right.”
Notes:
• Rare instance of single owner, no secondary owner or contributor
• Example of a “Never” event
SC1.3.3 Sensory Characteristics
35
Example: “Session times out in 5 minutes. Continue? Yes / No”
Notes:
• Business Owner’s only primary ownership criterion
• Rare Standard Requirement case
SC2.2.1 Timing Adjustable
36
Example: Search, Site Map, Breadcrumbs, Top-nav, In-page links
Notes:
• One of several Interaction Designer-only primary criteria
SC2.4.5 Multiple Ways
37
(Questionable) Example: “Blue on ‘light’ blue”
Notes:
• One of several Visual Designer primary ownership crits
• Visual Designer has no secondary ownership
SC1.4.3 Color Contrast (Minimum)
38
(Bad) Example: “Missing alt attribute in <img>”
Notes:
• Code reviews should already include code validation
SC4.1.1 Parsing
39
Changes
40
Opportunities to improve efficiency and quality for both new
and existing sites
Involvement should be early in the design process
• Includes project intake
• For more:
Success Criteria Dependencies & Prioritization: Implication & Use
Sean Kelly, Bill Tyler
3:20PM Old Town AB
Distribute and assign ownership (resolution) to other roles
All roles should have training tailored to their role
Checklists for reviewing all design deliverables before sign-off
Changes: General
41
Distribute most common issue remediation to roles
• Agile teams become more self-sufficient
• Design roles make better decisions preventing issues at the start
• Trained team members can identify and return issues at earlier steps
• Train QA to do basic a11y testing
Accessibility SME can focus on difficult issues that require
their expertise
Net Result: Reduce the total number of accessibility
SMEs across the enterprise
• Important for organizations with hundreds of sites
Changes: Accessibility Role
42
Integrate accessibility early in the design process
Distribute accessibility ownership to key decision makers
Targeted, role-based training
• Refresher on existing best practices
• Accessibility training only on topics they own or impact
Changes: New Projects
43
44
New Approach for New Projects
QA / A11y Testing
Developers
Content Author
Visual (Vx) Designer
Interaction (IX) Designer
Business Owner
ADD
A11Y
HERE
As with new projects, all roles should have targeted role-
based training
As issues are found they should be directed to the correct role
owner, not simply the developer
• Issues directed to specific roles will demonstrate how previous
decisions impacted accessibility
Changes: Triage of Existing Sites
45
46
New Approach for Triage Projects
QA / A11y Testing
Developers
Content Author
Visual (Vx) Designer
Interaction (IX) Designer
Business Owner
ADDRESS
A11Y HERE
47
Contact information:
Thank you.
Bill Tyler
Sr. Digital Accessibility Engineer
btyler@optum.com
@billtyler
48
1 of 48

Recommended

A11y by Design 2018 Rethinking Accessibility 2018-05-08 by
A11y by Design 2018 Rethinking Accessibility 2018-05-08A11y by Design 2018 Rethinking Accessibility 2018-05-08
A11y by Design 2018 Rethinking Accessibility 2018-05-08Bill Tyler
1.2K views59 slides
Moneyball AA11y Minnebar 11.aprile.2015 by
Moneyball AA11y Minnebar 11.aprile.2015Moneyball AA11y Minnebar 11.aprile.2015
Moneyball AA11y Minnebar 11.aprile.2015Bill Tyler
488 views59 slides
Accessibility and Design: Where Productivity and Philosophy Meet by
Accessibility and Design:  Where Productivity and Philosophy MeetAccessibility and Design:  Where Productivity and Philosophy Meet
Accessibility and Design: Where Productivity and Philosophy MeetJoe Lonsky
1.6K views26 slides
CSUN 2017 Success Criteria: Dependencies and Prioritization by
CSUN 2017 Success Criteria: Dependencies and PrioritizationCSUN 2017 Success Criteria: Dependencies and Prioritization
CSUN 2017 Success Criteria: Dependencies and PrioritizationSean Kelly
1.8K views43 slides
CSUN 2017 VPATs For Business or Measure by
CSUN 2017 VPATs For Business or MeasureCSUN 2017 VPATs For Business or Measure
CSUN 2017 VPATs For Business or MeasureTed Gies
1.4K views24 slides
Managing Accessibility Compliance in the Enterprise by
Managing Accessibility Compliance in the EnterpriseManaging Accessibility Compliance in the Enterprise
Managing Accessibility Compliance in the EnterpriseKarl Groves
2.4K views81 slides

More Related Content

What's hot

Implementing WCAG 2.2 into Your Digital Strategy by
Implementing WCAG 2.2 into Your Digital StrategyImplementing WCAG 2.2 into Your Digital Strategy
Implementing WCAG 2.2 into Your Digital Strategy3Play Media
728 views27 slides
Agile Vs Traditional Models by
Agile Vs Traditional ModelsAgile Vs Traditional Models
Agile Vs Traditional ModelsSabir Ali Khuhro
1.5K views17 slides
Design i/o - Creating Visual Interfaces for Digital Systems by
Design i/o - Creating Visual Interfaces for Digital SystemsDesign i/o - Creating Visual Interfaces for Digital Systems
Design i/o - Creating Visual Interfaces for Digital SystemsCantina
185 views47 slides
Agile+Lean, Alum Meet Apr23 2016 - Short Version by
Agile+Lean, Alum Meet Apr23 2016 - Short VersionAgile+Lean, Alum Meet Apr23 2016 - Short Version
Agile+Lean, Alum Meet Apr23 2016 - Short VersionHemant Elhence
595 views21 slides
Agile UX by
Agile UXAgile UX
Agile UXThomas Callaghan
1.4K views46 slides
Accessibility is More Than a Compliance Checkbox by
Accessibility is More Than a Compliance CheckboxAccessibility is More Than a Compliance Checkbox
Accessibility is More Than a Compliance CheckboxApplause
94 views19 slides

What's hot(20)

Implementing WCAG 2.2 into Your Digital Strategy by 3Play Media
Implementing WCAG 2.2 into Your Digital StrategyImplementing WCAG 2.2 into Your Digital Strategy
Implementing WCAG 2.2 into Your Digital Strategy
3Play Media728 views
Design i/o - Creating Visual Interfaces for Digital Systems by Cantina
Design i/o - Creating Visual Interfaces for Digital SystemsDesign i/o - Creating Visual Interfaces for Digital Systems
Design i/o - Creating Visual Interfaces for Digital Systems
Cantina185 views
Agile+Lean, Alum Meet Apr23 2016 - Short Version by Hemant Elhence
Agile+Lean, Alum Meet Apr23 2016 - Short VersionAgile+Lean, Alum Meet Apr23 2016 - Short Version
Agile+Lean, Alum Meet Apr23 2016 - Short Version
Hemant Elhence595 views
Accessibility is More Than a Compliance Checkbox by Applause
Accessibility is More Than a Compliance CheckboxAccessibility is More Than a Compliance Checkbox
Accessibility is More Than a Compliance Checkbox
Applause94 views
Working with software architects - advice to project managers by Yaniv Pessach
Working with software architects - advice to project managersWorking with software architects - advice to project managers
Working with software architects - advice to project managers
Yaniv Pessach1.2K views
Agile And Open Development by Ross Gardler
Agile And Open DevelopmentAgile And Open Development
Agile And Open Development
Ross Gardler1.5K views
Requirements gathering for developers by Dorje McKinnon
Requirements gathering for developersRequirements gathering for developers
Requirements gathering for developers
Dorje McKinnon279 views
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps by Future Processing
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
Future Processing157 views
Requirements Gathering: What Could Possibly Go Wrong? by Eugene O'Loughlin
Requirements Gathering: What Could Possibly Go Wrong?Requirements Gathering: What Could Possibly Go Wrong?
Requirements Gathering: What Could Possibly Go Wrong?
Eugene O'Loughlin3.9K views
Web Usability (Slideshare Version) by Carles Farré
Web Usability (Slideshare Version)Web Usability (Slideshare Version)
Web Usability (Slideshare Version)
Carles Farré5.4K views
Agile Requirements Engineering Practices: An Empirical Study by Asanka Dilruk
Agile Requirements Engineering Practices: An Empirical StudyAgile Requirements Engineering Practices: An Empirical Study
Agile Requirements Engineering Practices: An Empirical Study
Asanka Dilruk1K views
Optimizing a11y-remediation-process-tierney-chen by Richard Chen
Optimizing a11y-remediation-process-tierney-chenOptimizing a11y-remediation-process-tierney-chen
Optimizing a11y-remediation-process-tierney-chen
Richard Chen217 views
Telling Your UX Metrics Story - The 21st Century Metrics Model by UserZoom
Telling Your UX Metrics Story - The 21st Century Metrics ModelTelling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics Model
UserZoom1K views
Building Lean Products with Distributed Agile Teams - Igor Moochnick at Produ... by ProductCamp Boston
Building Lean Products with Distributed Agile Teams - Igor Moochnick at Produ...Building Lean Products with Distributed Agile Teams - Igor Moochnick at Produ...
Building Lean Products with Distributed Agile Teams - Igor Moochnick at Produ...
ProductCamp Boston424 views
Non-Negotiable Usability by Bonitasoft
Non-Negotiable UsabilityNon-Negotiable Usability
Non-Negotiable Usability
Bonitasoft579 views
QA Role In Agile Teams - by Michael Hall by Synerzip
QA Role In Agile Teams - by Michael HallQA Role In Agile Teams - by Michael Hall
QA Role In Agile Teams - by Michael Hall
Synerzip18 views

Viewers also liked

Mystery Meat 2.0 – Making hidden mobile interactions accessible by
Mystery Meat 2.0 – Making hidden mobile interactions accessibleMystery Meat 2.0 – Making hidden mobile interactions accessible
Mystery Meat 2.0 – Making hidden mobile interactions accessibleTed Drake
2K views23 slides
Reusable acceptance criteria and test cases for accessibility by
Reusable acceptance criteria and test cases for accessibilityReusable acceptance criteria and test cases for accessibility
Reusable acceptance criteria and test cases for accessibilityIntopia
4.9K views27 slides
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes... by
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...Ted Drake
3.7K views36 slides
A Multidisciplinary Approach to Universal Design by
A Multidisciplinary Approach to Universal DesignA Multidisciplinary Approach to Universal Design
A Multidisciplinary Approach to Universal DesignAnders Skifte
1.3K views42 slides
2017 CSUN Color Contrast by
2017 CSUN Color Contrast2017 CSUN Color Contrast
2017 CSUN Color ContrastCrystal Baker
1.2K views26 slides
Mind your lang (for role=drinks at CSUN 2017) by
Mind your lang (for role=drinks at CSUN 2017)Mind your lang (for role=drinks at CSUN 2017)
Mind your lang (for role=drinks at CSUN 2017)Adrian Roselli
1.9K views44 slides

Viewers also liked(20)

Mystery Meat 2.0 – Making hidden mobile interactions accessible by Ted Drake
Mystery Meat 2.0 – Making hidden mobile interactions accessibleMystery Meat 2.0 – Making hidden mobile interactions accessible
Mystery Meat 2.0 – Making hidden mobile interactions accessible
Ted Drake2K views
Reusable acceptance criteria and test cases for accessibility by Intopia
Reusable acceptance criteria and test cases for accessibilityReusable acceptance criteria and test cases for accessibility
Reusable acceptance criteria and test cases for accessibility
Intopia4.9K views
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes... by Ted Drake
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...
Accessibility metrics Accessibility Data Metrics and Reporting – Industry Bes...
Ted Drake3.7K views
A Multidisciplinary Approach to Universal Design by Anders Skifte
A Multidisciplinary Approach to Universal DesignA Multidisciplinary Approach to Universal Design
A Multidisciplinary Approach to Universal Design
Anders Skifte1.3K views
2017 CSUN Color Contrast by Crystal Baker
2017 CSUN Color Contrast2017 CSUN Color Contrast
2017 CSUN Color Contrast
Crystal Baker1.2K views
Mind your lang (for role=drinks at CSUN 2017) by Adrian Roselli
Mind your lang (for role=drinks at CSUN 2017)Mind your lang (for role=drinks at CSUN 2017)
Mind your lang (for role=drinks at CSUN 2017)
Adrian Roselli1.9K views
Cognitive theory of multimedia learning, krista greear, csun 2017 by Krista Greear
Cognitive theory of multimedia learning, krista greear, csun 2017Cognitive theory of multimedia learning, krista greear, csun 2017
Cognitive theory of multimedia learning, krista greear, csun 2017
Krista Greear1.1K views
2017 CSUN The Art of Language in Accessibility by Crystal Baker
2017 CSUN The Art of Language in Accessibility2017 CSUN The Art of Language in Accessibility
2017 CSUN The Art of Language in Accessibility
Crystal Baker649 views
Accessibility microinteractions: better user experience, happier developers by Aidan Tierney
Accessibility microinteractions: better user experience, happier developersAccessibility microinteractions: better user experience, happier developers
Accessibility microinteractions: better user experience, happier developers
Aidan Tierney2.3K views
The 7 minute accessibility assessment and app rating system by Aidan Tierney
The 7 minute accessibility assessment and app rating systemThe 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating system
Aidan Tierney2.9K views
Csun presentation-170302-hykim by hyunyoung kim
Csun presentation-170302-hykimCsun presentation-170302-hykim
Csun presentation-170302-hykim
hyunyoung kim329 views
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN) by Lainey Feingold
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)
Digital Accessibility Legal Update - CSUNATC 2017 (CSUN)
Lainey Feingold2.4K views
Preparing the enterprise for 508 refresh, ibm csun2017 by Michael Gower
Preparing the enterprise for 508 refresh, ibm csun2017Preparing the enterprise for 508 refresh, ibm csun2017
Preparing the enterprise for 508 refresh, ibm csun2017
Michael Gower1K views
Android Accessibility - The missing manual by Ted Drake
Android Accessibility - The missing manualAndroid Accessibility - The missing manual
Android Accessibility - The missing manual
Ted Drake14K views
Ubiquitous Transactions - Financial Future and Accessibility by Ted Drake
Ubiquitous Transactions - Financial Future and AccessibilityUbiquitous Transactions - Financial Future and Accessibility
Ubiquitous Transactions - Financial Future and Accessibility
Ted Drake1.9K views
Early prevention of accessibility issues with mockup & wireframe reviews by Aidan Tierney
Early prevention of accessibility issues with mockup & wireframe reviewsEarly prevention of accessibility issues with mockup & wireframe reviews
Early prevention of accessibility issues with mockup & wireframe reviews
Aidan Tierney4.9K views
CSUN 2017 - ACT Now: Accessibility Conformance Testing for WCAG by Mary Jo Mueller
CSUN 2017 - ACT Now: Accessibility Conformance Testing for WCAGCSUN 2017 - ACT Now: Accessibility Conformance Testing for WCAG
CSUN 2017 - ACT Now: Accessibility Conformance Testing for WCAG
Mary Jo Mueller900 views

Similar to Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017

Rethinking Accessibility: Role-based Accessibility of WCAG 2.1 by
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Bill Tyler
149 views61 slides
Why Usability Testing should be part of your accessibility testing strategy by
Why Usability Testing should be part of your accessibility testing strategyWhy Usability Testing should be part of your accessibility testing strategy
Why Usability Testing should be part of your accessibility testing strategypmcnallyux
148 views44 slides
Just Married: User Centered Design and Agile by
Just Married: User Centered Design and AgileJust Married: User Centered Design and Agile
Just Married: User Centered Design and AgileMemi Beltrame
4.1K views74 slides
Software Engineering Past Papers Notes by
Software Engineering Past Papers Notes Software Engineering Past Papers Notes
Software Engineering Past Papers Notes MuhammadTalha436
152 views35 slides
Key Challenges in Agile RE @XP2017 by
Key Challenges in Agile RE @XP2017Key Challenges in Agile RE @XP2017
Key Challenges in Agile RE @XP2017Prof. Dr. Eva-Maria Schön
374 views20 slides
Agile UX Breakfast Briefing Jun13 by
Agile UX Breakfast Briefing Jun13Agile UX Breakfast Briefing Jun13
Agile UX Breakfast Briefing Jun13User Vision
1.9K views46 slides

Similar to Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017(20)

Rethinking Accessibility: Role-based Accessibility of WCAG 2.1 by Bill Tyler
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Bill Tyler149 views
Why Usability Testing should be part of your accessibility testing strategy by pmcnallyux
Why Usability Testing should be part of your accessibility testing strategyWhy Usability Testing should be part of your accessibility testing strategy
Why Usability Testing should be part of your accessibility testing strategy
pmcnallyux148 views
Just Married: User Centered Design and Agile by Memi Beltrame
Just Married: User Centered Design and AgileJust Married: User Centered Design and Agile
Just Married: User Centered Design and Agile
Memi Beltrame4.1K views
Software Engineering Past Papers Notes by MuhammadTalha436
Software Engineering Past Papers Notes Software Engineering Past Papers Notes
Software Engineering Past Papers Notes
MuhammadTalha436152 views
Agile UX Breakfast Briefing Jun13 by User Vision
Agile UX Breakfast Briefing Jun13Agile UX Breakfast Briefing Jun13
Agile UX Breakfast Briefing Jun13
User Vision1.9K views
Agile UX Breakfast Briefing jun13 by Ross Philip
Agile UX Breakfast Briefing jun13Agile UX Breakfast Briefing jun13
Agile UX Breakfast Briefing jun13
Ross Philip771 views
Early Signal Testing: Designing Atlassian’s New Look by Atlassian
Early Signal Testing: Designing Atlassian’s New LookEarly Signal Testing: Designing Atlassian’s New Look
Early Signal Testing: Designing Atlassian’s New Look
Atlassian9.5K views
The Power of the UX Evaluation by Jon Fukuda
The Power of the UX EvaluationThe Power of the UX Evaluation
The Power of the UX Evaluation
Jon Fukuda1.6K views
Os Leung by oscon2007
Os LeungOs Leung
Os Leung
oscon2007401 views
Chapter 9 id2e_slides by oopscrash1
Chapter 9 id2e_slidesChapter 9 id2e_slides
Chapter 9 id2e_slides
oopscrash11.2K views
Agile Methods: Fact or Fiction by Matt Ganis
Agile Methods: Fact or FictionAgile Methods: Fact or Fiction
Agile Methods: Fact or Fiction
Matt Ganis2.3K views
What to Fix First? Remediation Order Matters by Sean Kelly
What to Fix First? Remediation Order Matters What to Fix First? Remediation Order Matters
What to Fix First? Remediation Order Matters
Sean Kelly576 views
Is Agile Project Management Right for your Nonprofit by Norman Reiss
Is Agile Project Management Right for your NonprofitIs Agile Project Management Right for your Nonprofit
Is Agile Project Management Right for your Nonprofit
Norman Reiss2.9K views
Is Agile Project Management Right for My Nonprofit? by 501 Tech NYC
Is Agile Project Management Right for My Nonprofit?Is Agile Project Management Right for My Nonprofit?
Is Agile Project Management Right for My Nonprofit?
501 Tech NYC417 views

More from Bill Tyler

Shift Left - Require Right WRT A11yTC 2023-07-31.pptx by
Shift Left - Require Right WRT A11yTC 2023-07-31.pptxShift Left - Require Right WRT A11yTC 2023-07-31.pptx
Shift Left - Require Right WRT A11yTC 2023-07-31.pptxBill Tyler
39 views88 slides
A11yTC MeetUp: Role-based Analysis of WCAG 2.2 by
A11yTC MeetUp: Role-based Analysis of WCAG 2.2A11yTC MeetUp: Role-based Analysis of WCAG 2.2
A11yTC MeetUp: Role-based Analysis of WCAG 2.2Bill Tyler
61 views57 slides
CSUN 2022 Role-based analysis update: WCAG 2.2 by
CSUN 2022 Role-based analysis update: WCAG 2.2CSUN 2022 Role-based analysis update: WCAG 2.2
CSUN 2022 Role-based analysis update: WCAG 2.2Bill Tyler
110 views42 slides
Introducing WCAG 2.2 by
Introducing WCAG 2.2Introducing WCAG 2.2
Introducing WCAG 2.2Bill Tyler
641 views40 slides
Introducing ARRM: A Framework To Fight Accessibility Apathy by
Introducing ARRM: A Framework To Fight Accessibility ApathyIntroducing ARRM: A Framework To Fight Accessibility Apathy
Introducing ARRM: A Framework To Fight Accessibility ApathyBill Tyler
121 views29 slides
Introducing ARRM: A Framework to Fight Accessibility Apathy by
Introducing ARRM: A Framework to Fight Accessibility ApathyIntroducing ARRM: A Framework to Fight Accessibility Apathy
Introducing ARRM: A Framework to Fight Accessibility ApathyBill Tyler
567 views20 slides

More from Bill Tyler(8)

Shift Left - Require Right WRT A11yTC 2023-07-31.pptx by Bill Tyler
Shift Left - Require Right WRT A11yTC 2023-07-31.pptxShift Left - Require Right WRT A11yTC 2023-07-31.pptx
Shift Left - Require Right WRT A11yTC 2023-07-31.pptx
Bill Tyler39 views
A11yTC MeetUp: Role-based Analysis of WCAG 2.2 by Bill Tyler
A11yTC MeetUp: Role-based Analysis of WCAG 2.2A11yTC MeetUp: Role-based Analysis of WCAG 2.2
A11yTC MeetUp: Role-based Analysis of WCAG 2.2
Bill Tyler61 views
CSUN 2022 Role-based analysis update: WCAG 2.2 by Bill Tyler
CSUN 2022 Role-based analysis update: WCAG 2.2CSUN 2022 Role-based analysis update: WCAG 2.2
CSUN 2022 Role-based analysis update: WCAG 2.2
Bill Tyler110 views
Introducing WCAG 2.2 by Bill Tyler
Introducing WCAG 2.2Introducing WCAG 2.2
Introducing WCAG 2.2
Bill Tyler641 views
Introducing ARRM: A Framework To Fight Accessibility Apathy by Bill Tyler
Introducing ARRM: A Framework To Fight Accessibility ApathyIntroducing ARRM: A Framework To Fight Accessibility Apathy
Introducing ARRM: A Framework To Fight Accessibility Apathy
Bill Tyler121 views
Introducing ARRM: A Framework to Fight Accessibility Apathy by Bill Tyler
Introducing ARRM: A Framework to Fight Accessibility ApathyIntroducing ARRM: A Framework to Fight Accessibility Apathy
Introducing ARRM: A Framework to Fight Accessibility Apathy
Bill Tyler567 views
WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15 by Bill Tyler
WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15
WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15
Bill Tyler1.2K views
CSUN 2018 Analyzing and Extending WCAG Beyond 3 Digits by Bill Tyler
CSUN 2018 Analyzing and Extending WCAG Beyond 3 DigitsCSUN 2018 Analyzing and Extending WCAG Beyond 3 Digits
CSUN 2018 Analyzing and Extending WCAG Beyond 3 Digits
Bill Tyler605 views

Recently uploaded

The Dark Web : Hidden Services by
The Dark Web : Hidden ServicesThe Dark Web : Hidden Services
The Dark Web : Hidden ServicesAnshu Singh
19 views24 slides
Amine el bouzalimi by
Amine el bouzalimiAmine el bouzalimi
Amine el bouzalimiAmine EL BOUZALIMI
5 views38 slides
cis5-Project-11a-Harry Lai by
cis5-Project-11a-Harry Laicis5-Project-11a-Harry Lai
cis5-Project-11a-Harry Laiharrylai126
9 views11 slides
hamro digital logics.pptx by
hamro digital logics.pptxhamro digital logics.pptx
hamro digital logics.pptxtupeshghimire
11 views36 slides
WITS Deck by
WITS DeckWITS Deck
WITS DeckW.I.T.S.
18 views22 slides
Marketing and Community Building in Web3 by
Marketing and Community Building in Web3Marketing and Community Building in Web3
Marketing and Community Building in Web3Federico Ast
15 views64 slides

Recently uploaded(10)

Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017

  • 1. CSUN 2017, San Diego Bill Tyler March 2, 2017 Rethinking Accessibility: Role-Based Analysis of WCAG 2.0
  • 2. My Experience 30+ yrs. of UI/UX Design & Development 12+ yrs. in medical devices 15+ yrs. in plans & providers 2X dot-com survivor Started Web 1996 Started Accessibility 2002 Materials Presented 3+ yrs. of ongoing accessibility research & analysis at Optum Technology Background 2
  • 4. No one thinks about accessibility … EXCEPT the accessibility expert Accessibility testing comes at END of development …and LONG after other design decisions are made All issues found are directed to DEVELOPERS to fix …with help from accessibility expert Final Result: “Sort of” Accessible Result The Problem: The Usual Approach to Accessibility 4
  • 5. 5 Typical Development Sequence (by Role) Add A11y Here QA / A11y Testing Developers Content Author Visual (Vx) Designer Interaction (IX) Designer Business Owner
  • 6. 6 There’s something very wrong with this picture Add A11y Here QA / A11y Testing Developers Content Author Visual (Vx) Designer Interaction (IX) Designer Business Owner
  • 8. The Assumptions are: Developers… …code accessibility… using “accessibility-specific” Knowledge. 8
  • 10. Three Questions for Each Success Criterion Who? developer When? coding 10
  • 13. Decision Making Roles • Standard agile role • Project initiator • Requirements definer • Result approver • Business liaison • Requirement author • Wireframe creator • UX / Usability expert • Presentation owner • Style expert • Layout creator • Design enforcer • Style guide author • Design comp artist • Image file producer • Author of All Text “Large & Small” Large: sections Small: words • Content proofreader • Includes time- based media • Script writer • Audio & video file creator • Front-End Programmer • Last stop before testing • Primary target for all defects 13
  • 14. Of a like mind… 14 Accessibility Responsibility Breakdown • Denis Boudreau / W3C / WAI-Engage Community, April 2012 Source: http://www.w3.org/community/wai-engage/wiki/Accessibility_Responsibility_Breakdown – 12 Roles Interactive WCAG 2.0 • Jeremy Fields / Viget, January 2015 Source: http://code.viget.com/interactive-wcag/ – 5 Roles Accessibility is Everyone’s Job: A Role-Based Model for Teams • Mark Palmer / Simply Accessible, June 2016 Source: http://simplyaccessible.com/article/role-based-a11y – 6 Roles
  • 15. Differences in our approach 15 Decision Ownership • Roles not just identified as part of process RACI Model Levels • Levels of ownership based on impact to deliverable Additional Analysis • Examined (much) more than just ownership (or phases) Actionable • Apply to enterprise distribution of work and responsibility
  • 16. RACI (RASCI) Modeling Responsible – Owns the issueR Accountable – to Responsible “owner”A Supportive – but not accountableS Consulted – to address issueC Informed – of results, but not consultedI 16 Source: http://www.valuebasedmanagement.net/methods_raci.html
  • 17. Role Ownership Model Primary – Individual role with “final approval”P Secondary – actively involved in decisionS Contributor – affect, but not deeply involvedC 17
  • 18. Example: SC1.4.1 Use of Color Visual Designer Interaction Designer Business Owner 18
  • 19. Is it the Developer? Who? 19
  • 21. 21 Primary Success Criteria Ownership IX Designer: 37% (14) Content Author: 24% (9) Developer: 21% (8) Vx Designer: 16% (6) Business Owner: 3% (1) Observations Developers only own 1 in 5 criteria Developers are third in ownership Need to work with other roles
  • 23. Software Design Lifecycle Entry Points Code (front-end development: HTML, CSS, JavaScript) Content (text, terminology, and includes video & audio) Design Comps (page or feature final presentation) Style Guides (site presentation, branding, colors, logos) Wireframes (structure of page, interface, interactions) User Story / Standard Requirements 23
  • 24. Of a like mind… 24 Accessibility Responsibility Breakdown • Government of Canada, April 2014 Source: https://wet-boew.github.io/themes-dist/GCWeb/demos/arb-rra/arb-rra-en.html – 7 “Production Phases” As with roles, we went further and added levels • Levels based upon expected frequency
  • 25. Entry Point Level Model Primary – single, most significant (typical) entry pointP Secondary – other significant entry pointsS Impact – other minor sources of design inputI 25
  • 28. 28 Primary Success Criteria Entry Points Wireframes: 50% (19) User Story/Std. Req.: 24% (9) Style Guides: 18% (7) Code: 5% (2) Content: 2% (1) Design Comps: “0%” Observations 95% of decisions come before code Half are defined in wireframes A quarter are in user stories Nearly a fifth in style guide
  • 33. 33 Success Criteria Types Best Practices: 53% (20) Primarily A11y: 39% (15) User Stories: 8% (3) Observations • Over half of decisions are best practices roles should already know • Accessibility training could focus on topics they don’t
  • 35. Example (of what NOT to do): “Press the green button on the right.” Notes: • Rare instance of single owner, no secondary owner or contributor • Example of a “Never” event SC1.3.3 Sensory Characteristics 35
  • 36. Example: “Session times out in 5 minutes. Continue? Yes / No” Notes: • Business Owner’s only primary ownership criterion • Rare Standard Requirement case SC2.2.1 Timing Adjustable 36
  • 37. Example: Search, Site Map, Breadcrumbs, Top-nav, In-page links Notes: • One of several Interaction Designer-only primary criteria SC2.4.5 Multiple Ways 37
  • 38. (Questionable) Example: “Blue on ‘light’ blue” Notes: • One of several Visual Designer primary ownership crits • Visual Designer has no secondary ownership SC1.4.3 Color Contrast (Minimum) 38
  • 39. (Bad) Example: “Missing alt attribute in <img>” Notes: • Code reviews should already include code validation SC4.1.1 Parsing 39
  • 41. Opportunities to improve efficiency and quality for both new and existing sites Involvement should be early in the design process • Includes project intake • For more: Success Criteria Dependencies & Prioritization: Implication & Use Sean Kelly, Bill Tyler 3:20PM Old Town AB Distribute and assign ownership (resolution) to other roles All roles should have training tailored to their role Checklists for reviewing all design deliverables before sign-off Changes: General 41
  • 42. Distribute most common issue remediation to roles • Agile teams become more self-sufficient • Design roles make better decisions preventing issues at the start • Trained team members can identify and return issues at earlier steps • Train QA to do basic a11y testing Accessibility SME can focus on difficult issues that require their expertise Net Result: Reduce the total number of accessibility SMEs across the enterprise • Important for organizations with hundreds of sites Changes: Accessibility Role 42
  • 43. Integrate accessibility early in the design process Distribute accessibility ownership to key decision makers Targeted, role-based training • Refresher on existing best practices • Accessibility training only on topics they own or impact Changes: New Projects 43
  • 44. 44 New Approach for New Projects QA / A11y Testing Developers Content Author Visual (Vx) Designer Interaction (IX) Designer Business Owner ADD A11Y HERE
  • 45. As with new projects, all roles should have targeted role- based training As issues are found they should be directed to the correct role owner, not simply the developer • Issues directed to specific roles will demonstrate how previous decisions impacted accessibility Changes: Triage of Existing Sites 45
  • 46. 46 New Approach for Triage Projects QA / A11y Testing Developers Content Author Visual (Vx) Designer Interaction (IX) Designer Business Owner ADDRESS A11Y HERE
  • 47. 47
  • 48. Contact information: Thank you. Bill Tyler Sr. Digital Accessibility Engineer btyler@optum.com @billtyler 48