SlideShare a Scribd company logo
Inclusive Usability Testing
Presented by Adrian Roselli (@aardrian)
for a11yTO Camp.
Slides from this talk will be available at
rosel.li/a11yTOCamp.
• I’ve written some stuff,
• Member of W3C,
• Building for the web
since 1993,
• Learn more at
AdrianRoselli.com,
• Avoid on Twitter
@aardrian.
Great bedtime reading!
About Adrian Roselli
Overview
• Concerns
• Planning
• Payment • Venue
• Recruitment
• Accommodation • Tech
• Process
• Privacy
CONCERNS
Photo by Save the Dream, CC BY 2.0
Concerns
• Accessibility remediation must be complete.
Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.
Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.
• This is not disability tourism.
Concerns
• Accessibility remediation must be complete.
• This is not accessibility testing.
• This is not disability tourism.
• Be clear on that with all stakeholders.
PLANNING
Photo by Save the Dream, CC BY 2.0Photo by benjaminlansky, CC BY 2.0
Planning
• Review your tests and format.
Planning
• Review your tests and format.
• Are they structured? Informal? Remote?
Planning
• Review your tests and format.
• Are they structured? Informal? Remote?
• How many participants are you planning?
Planning
• Review your tests and format.
• Are they structured? Informal? Remote?
• How many participants are you planning?
• Have you budgeted for paying participants?
PAYMENT
Photo by Mike Mozart, CC BY 2.0
Payment
• Expect to pay participants more than you
usually do.
Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,
Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,
• May be underemployed.
Payment
• Expect to pay participants more than you
usually do.
• Additional burdens to participate:
• Transportation cost,
• Time off work,
• May be underemployed.
• Gift cards that can be accepted where they
shop.
VENUE
Photo by Chris Waits, CC BY 2.0
Venue
• It must be accessible.
Venue
• It must be accessible.
• Not just the building, but the entire route.
Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.
Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.
• Meet them at the door.
Venue
• It must be accessible.
• Not just the building, but the entire route.
• Bus line, transport services, etc.
• Meet them at the door.
• Relief area for service animals.
RECRUITMENT
Photo by NASA Goddard Space Flight Center, CC BY 2.0
Recruitment
• Now you can find participants!
Recruitment
• Now you can find participants!
• Community / support organizations:
Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,
Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,
• Contextual support.
Recruitment
• Now you can find participants!
• Community / support organizations:
• Demographics,
• Name recognition,
• Existing relationships,
• Contextual support.
• Let the organization recruit.
ACCOMMODATION
Photo by David Luders, CC BY 2.0
Accommodation
• Build extra time for every task.
Accommodation
• Build extra time for every task.
• Allow them to be late.
Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.
Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.
• Different seating options: widths, arms, wheels,
etc.
Accommodation
• Build extra time for every task.
• Allow them to be late.
• Service animals, canes, etc. do not play well with
tripods and cables.
• Service animals need a clear space under the
table.
• Different seating options: widths, arms, wheels,
etc.
• A place to park scooters, chairs, etc.
TECH
Photo by City University Interaction Lab, CC BY 2.0
Tech
• Use the participant’s system (or community
org system).
Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.
Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.
• If necessary to modify, ask permission for any and
every change.
Tech
• Use the participant’s system (or community
org system).
• For mobile testing, do not use mounts.
• Do not mess with the user’s configuration.
• If necessary to modify, ask permission for any and
every change.
• Return it to the way you found it when done.
PROCESS
Photo by Eelke, CC BY 2.0
Process
• Be prepared to read agreements, instructions,
etc. aloud.
Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.
Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.
• Reassure user none of the mistakes are his/her
fault.
Process
• Be prepared to read agreements, instructions,
etc. aloud.
• Point a camera at the user and interactions.
• Drive a second monitor from device and record it.
• Do not interrupt the user when using AT.
• Reassure user none of the mistakes are his/her
fault.
• Users may apologize for finding errors.
PRIVACY
Photo by frankieleon, CC BY 2.0
Privacy
• Some personal health information may be
revealed.
Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.
Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.
• Where possible, anonymize data for reporting.
Privacy
• Some personal health information may be
revealed.
• Be prepared to treat it as confidential.
• Where possible, anonymize data for reporting.
• Coordinate with recruiting organization.
Oslo Davis, https://twitter.com/oslodavis/status/373219062697840640
Inclusive Usability Testing
Presented by Adrian Roselli (@aardrian)
for a11yTO Camp.
Slides from this talk will be available at
rosel.li/a11yTOCamp.

More Related Content

Similar to Inclusive Usability Testing — a11yTOCamp

Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
OpenCredo
 
Hertz in-app rental process design
Hertz in-app rental process designHertz in-app rental process design
Hertz in-app rental process design
Robert Boler
 
SXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
SXSW 2015 Shredding Wireframes: Intro to Rapid PrototypingSXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
SXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
Kyle Outlaw
 
Don't fear our new robot overlords – A new way to test on mobile
Don't fear our new robot overlords – A new way to test on mobileDon't fear our new robot overlords – A new way to test on mobile
Don't fear our new robot overlords – A new way to test on mobile
Philip Brechler
 
The business case for contributing code
The business case for contributing codeThe business case for contributing code
The business case for contributing code
Zivtech, LLC
 
Surviving your frontend (WIP - Sneak Peak)
Surviving your frontend (WIP - Sneak Peak)Surviving your frontend (WIP - Sneak Peak)
Surviving your frontend (WIP - Sneak Peak)
Sebastian Schürmann
 
UTICamp-2020. The Traveling Translator’s Toolkit
UTICamp-2020. The Traveling Translator’s ToolkitUTICamp-2020. The Traveling Translator’s Toolkit
UTICamp-2020. The Traveling Translator’s Toolkit
UTICamp
 
Designing IoT
Designing IoTDesigning IoT
Designing IoT
Stephen Bolen
 
Trends In Usability Testing
Trends In  Usability  TestingTrends In  Usability  Testing
Trends In Usability Testing
Kyle Soucy
 
Cyberethics and accessibility
Cyberethics and accessibilityCyberethics and accessibility
Cyberethics and accessibilityIan Pouncey
 
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDATrends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Kyle Soucy
 
Software Craftsmanship: Agile is Not Enough
Software Craftsmanship: Agile is Not EnoughSoftware Craftsmanship: Agile is Not Enough
Software Craftsmanship: Agile is Not Enough
Ken Auer
 
Software Craftsmanship: Agile Is Not Enough
Software Craftsmanship: Agile Is Not EnoughSoftware Craftsmanship: Agile Is Not Enough
Software Craftsmanship: Agile Is Not Enough
Ken Auer
 
The deep bootstrap framework review
The deep bootstrap framework reviewThe deep bootstrap framework review
The deep bootstrap framework review
taeseon ryu
 
Going Remote: User experiences at a distance
Going Remote: User experiences at a distanceGoing Remote: User experiences at a distance
Going Remote: User experiences at a distancelinoleumjet
 
The convergence of all things (wdu keynote)
The convergence of all things (wdu keynote)The convergence of all things (wdu keynote)
The convergence of all things (wdu keynote)Chris Wilson
 
Ds @ bol
Ds @ bolDs @ bol
Ds @ bol
Asparuh Hristov
 
The Usability of Usability
The Usability of UsabilityThe Usability of Usability
The Usability of Usability
Andrew Chak
 
Cloud Security: Ten Things
Cloud Security: Ten ThingsCloud Security: Ten Things
Cloud Security: Ten Things
Coastal Pet Products, Inc.
 

Similar to Inclusive Usability Testing — a11yTOCamp (20)

Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
Goto Chicago; Journeys To Cloud Native Architecture: Sun, Sea And Emergencies...
 
Hertz in-app rental process design
Hertz in-app rental process designHertz in-app rental process design
Hertz in-app rental process design
 
SXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
SXSW 2015 Shredding Wireframes: Intro to Rapid PrototypingSXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
SXSW 2015 Shredding Wireframes: Intro to Rapid Prototyping
 
Don't fear our new robot overlords – A new way to test on mobile
Don't fear our new robot overlords – A new way to test on mobileDon't fear our new robot overlords – A new way to test on mobile
Don't fear our new robot overlords – A new way to test on mobile
 
The business case for contributing code
The business case for contributing codeThe business case for contributing code
The business case for contributing code
 
Surviving your frontend (WIP - Sneak Peak)
Surviving your frontend (WIP - Sneak Peak)Surviving your frontend (WIP - Sneak Peak)
Surviving your frontend (WIP - Sneak Peak)
 
UTICamp-2020. The Traveling Translator’s Toolkit
UTICamp-2020. The Traveling Translator’s ToolkitUTICamp-2020. The Traveling Translator’s Toolkit
UTICamp-2020. The Traveling Translator’s Toolkit
 
Designing IoT
Designing IoTDesigning IoT
Designing IoT
 
Trends In Usability Testing
Trends In  Usability  TestingTrends In  Usability  Testing
Trends In Usability Testing
 
Cyberethics and accessibility
Cyberethics and accessibilityCyberethics and accessibility
Cyberethics and accessibility
 
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDATrends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
 
Software Craftsmanship: Agile is Not Enough
Software Craftsmanship: Agile is Not EnoughSoftware Craftsmanship: Agile is Not Enough
Software Craftsmanship: Agile is Not Enough
 
Software Craftsmanship: Agile Is Not Enough
Software Craftsmanship: Agile Is Not EnoughSoftware Craftsmanship: Agile Is Not Enough
Software Craftsmanship: Agile Is Not Enough
 
EPQ Presentation
EPQ PresentationEPQ Presentation
EPQ Presentation
 
The deep bootstrap framework review
The deep bootstrap framework reviewThe deep bootstrap framework review
The deep bootstrap framework review
 
Going Remote: User experiences at a distance
Going Remote: User experiences at a distanceGoing Remote: User experiences at a distance
Going Remote: User experiences at a distance
 
The convergence of all things (wdu keynote)
The convergence of all things (wdu keynote)The convergence of all things (wdu keynote)
The convergence of all things (wdu keynote)
 
Ds @ bol
Ds @ bolDs @ bol
Ds @ bol
 
The Usability of Usability
The Usability of UsabilityThe Usability of Usability
The Usability of Usability
 
Cloud Security: Ten Things
Cloud Security: Ten ThingsCloud Security: Ten Things
Cloud Security: Ten Things
 

More from Adrian Roselli

CSUN 2020: CSS Display Properties Versus HTML Semantics
CSUN 2020: CSS Display Properties Versus HTML SemanticsCSUN 2020: CSS Display Properties Versus HTML Semantics
CSUN 2020: CSS Display Properties Versus HTML Semantics
Adrian Roselli
 
Selfish Accessibility —DevOpsDays Buffalo
Selfish Accessibility —DevOpsDays BuffaloSelfish Accessibility —DevOpsDays Buffalo
Selfish Accessibility —DevOpsDays Buffalo
Adrian Roselli
 
Selfish Accessibility — YGLF Vilnius
Selfish Accessibility — YGLF VilniusSelfish Accessibility — YGLF Vilnius
Selfish Accessibility — YGLF Vilnius
Adrian Roselli
 
Role of Design in Accessibility — VilniusJS Meet-up
Role of Design in Accessibility — VilniusJS Meet-upRole of Design in Accessibility — VilniusJS Meet-up
Role of Design in Accessibility — VilniusJS Meet-up
Adrian Roselli
 
The Role of Design in Accessibility — a11yTO Meet-up
The Role of Design in Accessibility — a11yTO Meet-upThe Role of Design in Accessibility — a11yTO Meet-up
The Role of Design in Accessibility — a11yTO Meet-up
Adrian Roselli
 
Prototyping Accessibility: Booster 2019
Prototyping Accessibility: Booster 2019Prototyping Accessibility: Booster 2019
Prototyping Accessibility: Booster 2019
Adrian Roselli
 
Selfish Accessibility — Harbour Front HK
Selfish Accessibility — Harbour Front HKSelfish Accessibility — Harbour Front HK
Selfish Accessibility — Harbour Front HK
Adrian Roselli
 
Selfish Accessibility — CodeDaze
Selfish Accessibility — CodeDazeSelfish Accessibility — CodeDaze
Selfish Accessibility — CodeDaze
Adrian Roselli
 
Prototyping Accessibility - WordCamp Europe 2018
Prototyping Accessibility - WordCamp Europe 2018Prototyping Accessibility - WordCamp Europe 2018
Prototyping Accessibility - WordCamp Europe 2018
Adrian Roselli
 
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
Adrian Roselli
 
Fringe Accessibility — Portland UX
Fringe Accessibility — Portland UXFringe Accessibility — Portland UX
Fringe Accessibility — Portland UX
Adrian Roselli
 
WCBuf: CSS Display Properties versus HTML Semantics
WCBuf: CSS Display Properties versus HTML SemanticsWCBuf: CSS Display Properties versus HTML Semantics
WCBuf: CSS Display Properties versus HTML Semantics
Adrian Roselli
 
Mind Your Lang — London Web Standards
Mind Your Lang — London Web StandardsMind Your Lang — London Web Standards
Mind Your Lang — London Web Standards
Adrian Roselli
 
CSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
CSUN 2018: Everything I Know About Accessibility I Learned from Stack OverflowCSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
CSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
Adrian Roselli
 
Selfish Accessibility - Girl Develop It Buffalo
Selfish Accessibility - Girl Develop It BuffaloSelfish Accessibility - Girl Develop It Buffalo
Selfish Accessibility - Girl Develop It Buffalo
Adrian Roselli
 
Everything I Know About Accessibility I Learned from Stack Overflow
Everything I Know About Accessibility I Learned from Stack OverflowEverything I Know About Accessibility I Learned from Stack Overflow
Everything I Know About Accessibility I Learned from Stack Overflow
Adrian Roselli
 
Selfish Accessibility — WordCamp Europe 2017
Selfish Accessibility — WordCamp Europe 2017Selfish Accessibility — WordCamp Europe 2017
Selfish Accessibility — WordCamp Europe 2017
Adrian Roselli
 
Selfish Accessibility: MinneWebCon 2017
Selfish Accessibility: MinneWebCon 2017Selfish Accessibility: MinneWebCon 2017
Selfish Accessibility: MinneWebCon 2017
Adrian Roselli
 
Fringe Accessibility: London Web Standards
Fringe Accessibility: London Web StandardsFringe Accessibility: London Web Standards
Fringe Accessibility: London Web Standards
Adrian Roselli
 
Selfish Accessibility: Government Digital Service
Selfish Accessibility: Government Digital ServiceSelfish Accessibility: Government Digital Service
Selfish Accessibility: Government Digital Service
Adrian Roselli
 

More from Adrian Roselli (20)

CSUN 2020: CSS Display Properties Versus HTML Semantics
CSUN 2020: CSS Display Properties Versus HTML SemanticsCSUN 2020: CSS Display Properties Versus HTML Semantics
CSUN 2020: CSS Display Properties Versus HTML Semantics
 
Selfish Accessibility —DevOpsDays Buffalo
Selfish Accessibility —DevOpsDays BuffaloSelfish Accessibility —DevOpsDays Buffalo
Selfish Accessibility —DevOpsDays Buffalo
 
Selfish Accessibility — YGLF Vilnius
Selfish Accessibility — YGLF VilniusSelfish Accessibility — YGLF Vilnius
Selfish Accessibility — YGLF Vilnius
 
Role of Design in Accessibility — VilniusJS Meet-up
Role of Design in Accessibility — VilniusJS Meet-upRole of Design in Accessibility — VilniusJS Meet-up
Role of Design in Accessibility — VilniusJS Meet-up
 
The Role of Design in Accessibility — a11yTO Meet-up
The Role of Design in Accessibility — a11yTO Meet-upThe Role of Design in Accessibility — a11yTO Meet-up
The Role of Design in Accessibility — a11yTO Meet-up
 
Prototyping Accessibility: Booster 2019
Prototyping Accessibility: Booster 2019Prototyping Accessibility: Booster 2019
Prototyping Accessibility: Booster 2019
 
Selfish Accessibility — Harbour Front HK
Selfish Accessibility — Harbour Front HKSelfish Accessibility — Harbour Front HK
Selfish Accessibility — Harbour Front HK
 
Selfish Accessibility — CodeDaze
Selfish Accessibility — CodeDazeSelfish Accessibility — CodeDaze
Selfish Accessibility — CodeDaze
 
Prototyping Accessibility - WordCamp Europe 2018
Prototyping Accessibility - WordCamp Europe 2018Prototyping Accessibility - WordCamp Europe 2018
Prototyping Accessibility - WordCamp Europe 2018
 
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
Guelph A11y Conf: Everything I Know About Accessibility I Learned from Stack ...
 
Fringe Accessibility — Portland UX
Fringe Accessibility — Portland UXFringe Accessibility — Portland UX
Fringe Accessibility — Portland UX
 
WCBuf: CSS Display Properties versus HTML Semantics
WCBuf: CSS Display Properties versus HTML SemanticsWCBuf: CSS Display Properties versus HTML Semantics
WCBuf: CSS Display Properties versus HTML Semantics
 
Mind Your Lang — London Web Standards
Mind Your Lang — London Web StandardsMind Your Lang — London Web Standards
Mind Your Lang — London Web Standards
 
CSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
CSUN 2018: Everything I Know About Accessibility I Learned from Stack OverflowCSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
CSUN 2018: Everything I Know About Accessibility I Learned from Stack Overflow
 
Selfish Accessibility - Girl Develop It Buffalo
Selfish Accessibility - Girl Develop It BuffaloSelfish Accessibility - Girl Develop It Buffalo
Selfish Accessibility - Girl Develop It Buffalo
 
Everything I Know About Accessibility I Learned from Stack Overflow
Everything I Know About Accessibility I Learned from Stack OverflowEverything I Know About Accessibility I Learned from Stack Overflow
Everything I Know About Accessibility I Learned from Stack Overflow
 
Selfish Accessibility — WordCamp Europe 2017
Selfish Accessibility — WordCamp Europe 2017Selfish Accessibility — WordCamp Europe 2017
Selfish Accessibility — WordCamp Europe 2017
 
Selfish Accessibility: MinneWebCon 2017
Selfish Accessibility: MinneWebCon 2017Selfish Accessibility: MinneWebCon 2017
Selfish Accessibility: MinneWebCon 2017
 
Fringe Accessibility: London Web Standards
Fringe Accessibility: London Web StandardsFringe Accessibility: London Web Standards
Fringe Accessibility: London Web Standards
 
Selfish Accessibility: Government Digital Service
Selfish Accessibility: Government Digital ServiceSelfish Accessibility: Government Digital Service
Selfish Accessibility: Government Digital Service
 

Recently uploaded

test test test test testtest test testtest test testtest test testtest test ...
test test  test test testtest test testtest test testtest test testtest test ...test test  test test testtest test testtest test testtest test testtest test ...
test test test test testtest test testtest test testtest test testtest test ...
Arif0071
 
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
ufdana
 
History+of+E-commerce+Development+in+China-www.cfye-commerce.shop
History+of+E-commerce+Development+in+China-www.cfye-commerce.shopHistory+of+E-commerce+Development+in+China-www.cfye-commerce.shop
History+of+E-commerce+Development+in+China-www.cfye-commerce.shop
laozhuseo02
 
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
3ipehhoa
 
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
keoku
 
Internet-Security-Safeguarding-Your-Digital-World (1).pptx
Internet-Security-Safeguarding-Your-Digital-World (1).pptxInternet-Security-Safeguarding-Your-Digital-World (1).pptx
Internet-Security-Safeguarding-Your-Digital-World (1).pptx
VivekSinghShekhawat2
 
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
3ipehhoa
 
BASIC C++ lecture NOTE C++ lecture 3.pptx
BASIC C++ lecture NOTE C++ lecture 3.pptxBASIC C++ lecture NOTE C++ lecture 3.pptx
BASIC C++ lecture NOTE C++ lecture 3.pptx
natyesu
 
How to Use Contact Form 7 Like a Pro.pptx
How to Use Contact Form 7 Like a Pro.pptxHow to Use Contact Form 7 Like a Pro.pptx
How to Use Contact Form 7 Like a Pro.pptx
Gal Baras
 
The+Prospects+of+E-Commerce+in+China.pptx
The+Prospects+of+E-Commerce+in+China.pptxThe+Prospects+of+E-Commerce+in+China.pptx
The+Prospects+of+E-Commerce+in+China.pptx
laozhuseo02
 
Comptia N+ Standard Networking lesson guide
Comptia N+ Standard Networking lesson guideComptia N+ Standard Networking lesson guide
Comptia N+ Standard Networking lesson guide
GTProductions1
 
Multi-cluster Kubernetes Networking- Patterns, Projects and Guidelines
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesMulti-cluster Kubernetes Networking- Patterns, Projects and Guidelines
Multi-cluster Kubernetes Networking- Patterns, Projects and Guidelines
Sanjeev Rampal
 
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
APNIC
 
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdfJAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
Javier Lasa
 
guildmasters guide to ravnica Dungeons & Dragons 5...
guildmasters guide to ravnica Dungeons & Dragons 5...guildmasters guide to ravnica Dungeons & Dragons 5...
guildmasters guide to ravnica Dungeons & Dragons 5...
Rogerio Filho
 
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
3ipehhoa
 
This 7-second Brain Wave Ritual Attracts Money To You.!
This 7-second Brain Wave Ritual Attracts Money To You.!This 7-second Brain Wave Ritual Attracts Money To You.!
This 7-second Brain Wave Ritual Attracts Money To You.!
nirahealhty
 
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
Brad Spiegel Macon GA
 
1.Wireless Communication System_Wireless communication is a broad term that i...
1.Wireless Communication System_Wireless communication is a broad term that i...1.Wireless Communication System_Wireless communication is a broad term that i...
1.Wireless Communication System_Wireless communication is a broad term that i...
JeyaPerumal1
 
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
eutxy
 

Recently uploaded (20)

test test test test testtest test testtest test testtest test testtest test ...
test test  test test testtest test testtest test testtest test testtest test ...test test  test test testtest test testtest test testtest test testtest test ...
test test test test testtest test testtest test testtest test testtest test ...
 
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
一比一原版(CSU毕业证)加利福尼亚州立大学毕业证成绩单专业办理
 
History+of+E-commerce+Development+in+China-www.cfye-commerce.shop
History+of+E-commerce+Development+in+China-www.cfye-commerce.shopHistory+of+E-commerce+Development+in+China-www.cfye-commerce.shop
History+of+E-commerce+Development+in+China-www.cfye-commerce.shop
 
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
急速办(bedfordhire毕业证书)英国贝德福特大学毕业证成绩单原版一模一样
 
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
一比一原版(SLU毕业证)圣路易斯大学毕业证成绩单专业办理
 
Internet-Security-Safeguarding-Your-Digital-World (1).pptx
Internet-Security-Safeguarding-Your-Digital-World (1).pptxInternet-Security-Safeguarding-Your-Digital-World (1).pptx
Internet-Security-Safeguarding-Your-Digital-World (1).pptx
 
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
1比1复刻(bath毕业证书)英国巴斯大学毕业证学位证原版一模一样
 
BASIC C++ lecture NOTE C++ lecture 3.pptx
BASIC C++ lecture NOTE C++ lecture 3.pptxBASIC C++ lecture NOTE C++ lecture 3.pptx
BASIC C++ lecture NOTE C++ lecture 3.pptx
 
How to Use Contact Form 7 Like a Pro.pptx
How to Use Contact Form 7 Like a Pro.pptxHow to Use Contact Form 7 Like a Pro.pptx
How to Use Contact Form 7 Like a Pro.pptx
 
The+Prospects+of+E-Commerce+in+China.pptx
The+Prospects+of+E-Commerce+in+China.pptxThe+Prospects+of+E-Commerce+in+China.pptx
The+Prospects+of+E-Commerce+in+China.pptx
 
Comptia N+ Standard Networking lesson guide
Comptia N+ Standard Networking lesson guideComptia N+ Standard Networking lesson guide
Comptia N+ Standard Networking lesson guide
 
Multi-cluster Kubernetes Networking- Patterns, Projects and Guidelines
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesMulti-cluster Kubernetes Networking- Patterns, Projects and Guidelines
Multi-cluster Kubernetes Networking- Patterns, Projects and Guidelines
 
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024
 
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdfJAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
JAVIER LASA-EXPERIENCIA digital 1986-2024.pdf
 
guildmasters guide to ravnica Dungeons & Dragons 5...
guildmasters guide to ravnica Dungeons & Dragons 5...guildmasters guide to ravnica Dungeons & Dragons 5...
guildmasters guide to ravnica Dungeons & Dragons 5...
 
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
原版仿制(uob毕业证书)英国伯明翰大学毕业证本科学历证书原版一模一样
 
This 7-second Brain Wave Ritual Attracts Money To You.!
This 7-second Brain Wave Ritual Attracts Money To You.!This 7-second Brain Wave Ritual Attracts Money To You.!
This 7-second Brain Wave Ritual Attracts Money To You.!
 
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptx
 
1.Wireless Communication System_Wireless communication is a broad term that i...
1.Wireless Communication System_Wireless communication is a broad term that i...1.Wireless Communication System_Wireless communication is a broad term that i...
1.Wireless Communication System_Wireless communication is a broad term that i...
 
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
一比一原版(LBS毕业证)伦敦商学院毕业证成绩单专业办理
 

Inclusive Usability Testing — a11yTOCamp

  • 1. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for a11yTO Camp. Slides from this talk will be available at rosel.li/a11yTOCamp.
  • 2. • I’ve written some stuff, • Member of W3C, • Building for the web since 1993, • Learn more at AdrianRoselli.com, • Avoid on Twitter @aardrian. Great bedtime reading! About Adrian Roselli
  • 3. Overview • Concerns • Planning • Payment • Venue • Recruitment • Accommodation • Tech • Process • Privacy
  • 4. CONCERNS Photo by Save the Dream, CC BY 2.0
  • 6. Concerns • Accessibility remediation must be complete. • This is not accessibility testing.
  • 7. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism.
  • 8. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism. • Be clear on that with all stakeholders.
  • 9. PLANNING Photo by Save the Dream, CC BY 2.0Photo by benjaminlansky, CC BY 2.0
  • 10. Planning • Review your tests and format.
  • 11. Planning • Review your tests and format. • Are they structured? Informal? Remote?
  • 12. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning?
  • 13. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning? • Have you budgeted for paying participants?
  • 14. PAYMENT Photo by Mike Mozart, CC BY 2.0
  • 15. Payment • Expect to pay participants more than you usually do.
  • 16. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate:
  • 17. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost,
  • 18. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work,
  • 19. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed.
  • 20. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed. • Gift cards that can be accepted where they shop.
  • 21. VENUE Photo by Chris Waits, CC BY 2.0
  • 22. Venue • It must be accessible.
  • 23. Venue • It must be accessible. • Not just the building, but the entire route.
  • 24. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc.
  • 25. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door.
  • 26. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door. • Relief area for service animals.
  • 27. RECRUITMENT Photo by NASA Goddard Space Flight Center, CC BY 2.0
  • 28. Recruitment • Now you can find participants!
  • 29. Recruitment • Now you can find participants! • Community / support organizations:
  • 30. Recruitment • Now you can find participants! • Community / support organizations: • Demographics,
  • 31. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition,
  • 32. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships,
  • 33. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support.
  • 34. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support. • Let the organization recruit.
  • 35. ACCOMMODATION Photo by David Luders, CC BY 2.0
  • 36. Accommodation • Build extra time for every task.
  • 37. Accommodation • Build extra time for every task. • Allow them to be late.
  • 38. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables.
  • 39. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table.
  • 40. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc.
  • 41. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc. • A place to park scooters, chairs, etc.
  • 42. TECH Photo by City University Interaction Lab, CC BY 2.0
  • 43. Tech • Use the participant’s system (or community org system).
  • 44. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts.
  • 45. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration.
  • 46. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change.
  • 47. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change. • Return it to the way you found it when done.
  • 49. Process • Be prepared to read agreements, instructions, etc. aloud.
  • 50. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions.
  • 51. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it.
  • 52. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT.
  • 53. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault.
  • 54. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault. • Users may apologize for finding errors.
  • 56. Privacy • Some personal health information may be revealed.
  • 57. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential.
  • 58. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting.
  • 59. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting. • Coordinate with recruiting organization.
  • 61. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for a11yTO Camp. Slides from this talk will be available at rosel.li/a11yTOCamp.

Editor's Notes

  1. • Save the Dream and SASOL. • National Sport Day 2017 to promote education and inclusivity through sport. • High-profile Qatari athletes and footballers from Al Sadd Football Club.
  2. 1 of 9
  3. 1 of 9
  4. 1 of 9
  5. 1 of 9
  6. • Learning how to understand the signing of a floor plan in sign language • My teacher also forgets to give us the new reference point after each room • so I never know whether the kitchen is down the hall from the dining room or on the other side of the dining room. • It's rather confusing.
  7. 2 of 9
  8. 2 of 9
  9. 2 of 9
  10. 2 of 9
  11. • Gift cards can be most useful when they have cash value. • Avoid cards at venues that require travel, do not support disabilities, etc. • Get cards that are more useful than just a free coffee but take $20 to get to use. • Can be used as signature guides
  12. 3 of 9
  13. 3 of 9
  14. 3 of 9
  15. 3 of 9
  16. 3 of 9
  17. 3 of 9
  18. • A token effort is unacceptable • pay attention to whether or not it is truly accessible • Kutna Hora, Czech Republic
  19. 4 of 9
  20. 4 of 9
  21. 4 of 9
  22. 4 of 9
  23. 4 of 9
  24. • Blind Camp of Maryland Visits NASA Goddard • NASA's Goddard Space Flight Center in Greenbelt, Md. • hosted some 100 campers and volunteers from the Deaf-Blind Camp of Maryland. • Based in West River, Md., was established in 1998 • provides safe, fun, barrier-free week for people who have significant hearing and vision loss. • campers, aged 18 to 80, learned about space and NASA missions
  25. 5 of 9
  26. 5 of 9
  27. 5 of 9
  28. 5 of 9
  29. 5 of 9
  30. 5 of 9
  31. 5 of 9
  32. • May not anticipate some of the assistive tech that your users will bring. • A scooter and service dog combined will overwhelm even a spacious room.
  33. 6 of 9
  34. 6 of 9
  35. 6 of 9
  36. 6 of 9
  37. 6 of 9
  38. 6 of 9
  39. • This set-up may not work • For mobile testing that the user may hold device to ear
  40. 7 of 9
  41. 7 of 9
  42. 7 of 9
  43. 7 of 9
  44. 7 of 9
  45. Nuthin’
  46. 8 of 9
  47. 8 of 9
  48. 8 of 9
  49. 8 of 9
  50. 8 of 9
  51. 8 of 9
  52. Nuthin’
  53. 9 of 9
  54. 9 of 9
  55. 9 of 9
  56. 9 of 9