SlideShare a Scribd company logo
1 of 8
Are Users the Gold Standard
for Accessibility Evaluation?
7th April - W4A’14
Amaia Aizpurua1, Myriam Arrue Simon Harper2, Markel Vigo3
U. of the Basque Country University of Manchester
http://dx.doi.org/10.1145/2596695.2596705
1: @amaiaaizpurua
2: @sharpic
3: @markelvigo
Motivation
• User testing for accessibility evaluation
• Encouraged by the community
• No established procedures
– What?
– When?
– How?
27th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
In practice
• Evaluating web accessibility for blind users
– User testing method
• Effectiveness in identifying accessibility problems
[Mankoff et al. 2005]
– Accessibility guidelines
• Partial coverage of user problems
[Power et al. 2012]
37th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
Study results
• Accessibility: conformance vs. perceived
Website AA conformance level Perceived
47th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
Median Mode SD
6 7 1.95
6 6 1.42
2 1 1.62
6 6 1.95
1: very inaccessible
7: very accessible
Satisfied SC Non-satisfied SC
73% 27%
69% 31%
52% 48%
36% 64%
Why this mismatch?
• Guidelines vs. user problems
• Eliciting users’ problems
– Experience/report problems differently: web
expertise
– Interaction context, tasks type
• Identifying accessibility issues
– Combination of causes, contextual
information
– Under the influence of the evaluator effect
57th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
Discussion
• Inclusive participatory evaluation
– Following the considerations of co-operative
evaluation
– Evaluator and user evaluating a website
collaboratively
– Instead of interpreting data afterwards, work
on problems during the session
• Improve effectiveness
67th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
Conclusions
• User testing may not be the gold standard
for web accessibility evaluation
• Users are a gold mine
• Co-operative accessibility evaluation
• Bridge the gap?
77th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
Thank you!
87th April - W4A’14
Contact
amaia.aizpurua@ehu.es | @amaiaaizpurua
myriam.arrue@ehu.es
simon.harper@manchester.ac.uk | @sharpic
markel.vigo@manchester.ac.uk | @markelvigo

More Related Content

Viewers also liked

Biographical Prewrite & Outline
Biographical Prewrite & OutlineBiographical Prewrite & Outline
Biographical Prewrite & Outlineeardales
 
Macbeth Rough Draft 3
Macbeth Rough Draft 3Macbeth Rough Draft 3
Macbeth Rough Draft 3eardales
 
ファーエンドテクノロジーのサービスを支えるOSS
ファーエンドテクノロジーのサービスを支えるOSSファーエンドテクノロジーのサービスを支えるOSS
ファーエンドテクノロジーのサービスを支えるOSSMutsumi IWAISHI
 
MCTC A&PII Vessels
MCTC A&PII VesselsMCTC A&PII Vessels
MCTC A&PII Vesselsn k
 
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!アプリ開発検証はLXC+Ansibleで楽ちんにやろう!
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!Mutsumi IWAISHI
 
いろいろ引き出し作って見ました
いろいろ引き出し作って見ましたいろいろ引き出し作って見ました
いろいろ引き出し作って見ましたMutsumi IWAISHI
 
Frankenstein Outline
Frankenstein  OutlineFrankenstein  Outline
Frankenstein Outlineeardales
 
Harry Potter Rough Draft
Harry Potter Rough DraftHarry Potter Rough Draft
Harry Potter Rough Drafteardales
 
DNSって結局何?って人向けのRoute53の話など
DNSって結局何?って人向けのRoute53の話などDNSって結局何?って人向けのRoute53の話など
DNSって結局何?って人向けのRoute53の話などMutsumi IWAISHI
 

Viewers also liked (11)

Biographical Prewrite & Outline
Biographical Prewrite & OutlineBiographical Prewrite & Outline
Biographical Prewrite & Outline
 
何なのc?
何なのc?何なのc?
何なのc?
 
Macbeth Rough Draft 3
Macbeth Rough Draft 3Macbeth Rough Draft 3
Macbeth Rough Draft 3
 
Jaws ug shimane-1
Jaws ug shimane-1Jaws ug shimane-1
Jaws ug shimane-1
 
ファーエンドテクノロジーのサービスを支えるOSS
ファーエンドテクノロジーのサービスを支えるOSSファーエンドテクノロジーのサービスを支えるOSS
ファーエンドテクノロジーのサービスを支えるOSS
 
MCTC A&PII Vessels
MCTC A&PII VesselsMCTC A&PII Vessels
MCTC A&PII Vessels
 
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!アプリ開発検証はLXC+Ansibleで楽ちんにやろう!
アプリ開発検証はLXC+Ansibleで楽ちんにやろう!
 
いろいろ引き出し作って見ました
いろいろ引き出し作って見ましたいろいろ引き出し作って見ました
いろいろ引き出し作って見ました
 
Frankenstein Outline
Frankenstein  OutlineFrankenstein  Outline
Frankenstein Outline
 
Harry Potter Rough Draft
Harry Potter Rough DraftHarry Potter Rough Draft
Harry Potter Rough Draft
 
DNSって結局何?って人向けのRoute53の話など
DNSって結局何?って人向けのRoute53の話などDNSって結局何?って人向けのRoute53の話など
DNSって結局何?って人向けのRoute53の話など
 

Similar to Are Users the Gold Standard for Accessibility Evaluation?

Towards a Quality Framework for Online Educator Professional Development Acti...
Towards a Quality Framework for Online Educator Professional Development Acti...Towards a Quality Framework for Online Educator Professional Development Acti...
Towards a Quality Framework for Online Educator Professional Development Acti...Stefaan Vande Walle
 
MOOCs at UVa for eLearn October 2015
MOOCs at UVa for eLearn October 2015MOOCs at UVa for eLearn October 2015
MOOCs at UVa for eLearn October 2015Dr. Kristin Palmer
 
Comparing the Effectiveness of Electronic Diary and UX Curve Methods in Mul...
Comparing the Effectiveness of  Electronic Diary and UX Curve Methods  in Mul...Comparing the Effectiveness of  Electronic Diary and UX Curve Methods  in Mul...
Comparing the Effectiveness of Electronic Diary and UX Curve Methods in Mul...Farrukh Sahar
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Jon Rosewell
 
Rob howe - assessment strategies in a digital age
Rob howe   - assessment strategies in a digital ageRob howe   - assessment strategies in a digital age
Rob howe - assessment strategies in a digital ageRob Howe
 
User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...Andrew Preater
 
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...David Sloan
 
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...scotdigich
 
Rob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchAndrew Deacon
 
IWMW 2002: Designing for Usability
IWMW 2002: Designing for UsabilityIWMW 2002: Designing for Usability
IWMW 2002: Designing for UsabilityIWMW
 
Collecting meaningful feedback on Information literacy training: results of a...
Collecting meaningful feedback on Information literacy training: results of a...Collecting meaningful feedback on Information literacy training: results of a...
Collecting meaningful feedback on Information literacy training: results of a...IL Group (CILIP Information Literacy Group)
 
UX in 10 Minutes - Usability Testing - Presented at SEMPO
UX in 10 Minutes - Usability Testing - Presented at SEMPOUX in 10 Minutes - Usability Testing - Presented at SEMPO
UX in 10 Minutes - Usability Testing - Presented at SEMPOCarol Smith
 
Evidencing compliance of quality training and assessment (SNR 15) through e-l...
Evidencing compliance of quality training and assessment (SNR 15) through e-l...Evidencing compliance of quality training and assessment (SNR 15) through e-l...
Evidencing compliance of quality training and assessment (SNR 15) through e-l...Vanguard Visions
 
Privacy Concerns vs. User Behavior in Community Question Answering
Privacy Concerns vs. User Behavior in Community Question AnsweringPrivacy Concerns vs. User Behavior in Community Question Answering
Privacy Concerns vs. User Behavior in Community Question AnsweringNicolas Kourtellis
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerTao Zhang
 

Similar to Are Users the Gold Standard for Accessibility Evaluation? (20)

Towards a Quality Framework for Online Educator Professional Development Acti...
Towards a Quality Framework for Online Educator Professional Development Acti...Towards a Quality Framework for Online Educator Professional Development Acti...
Towards a Quality Framework for Online Educator Professional Development Acti...
 
Crowdsourcing Software Evaluation
Crowdsourcing Software EvaluationCrowdsourcing Software Evaluation
Crowdsourcing Software Evaluation
 
Adaptive software based feedback acquisition a personas-based design
Adaptive software based feedback acquisition a personas-based designAdaptive software based feedback acquisition a personas-based design
Adaptive software based feedback acquisition a personas-based design
 
MOOCs at UVa for eLearn October 2015
MOOCs at UVa for eLearn October 2015MOOCs at UVa for eLearn October 2015
MOOCs at UVa for eLearn October 2015
 
Comparing the Effectiveness of Electronic Diary and UX Curve Methods in Mul...
Comparing the Effectiveness of  Electronic Diary and UX Curve Methods  in Mul...Comparing the Effectiveness of  Electronic Diary and UX Curve Methods  in Mul...
Comparing the Effectiveness of Electronic Diary and UX Curve Methods in Mul...
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)
 
Rob howe - assessment strategies in a digital age
Rob howe   - assessment strategies in a digital ageRob howe   - assessment strategies in a digital age
Rob howe - assessment strategies in a digital age
 
User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...
 
Learning Analytics and MOOCs
Learning Analytics and MOOCsLearning Analytics and MOOCs
Learning Analytics and MOOCs
 
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...
A Challenge to Web Accessibility Metrics and Guidelines: Putting People and P...
 
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...
Paul Clough Sheffield iSchool Evaluating Info Searching in Digital Cultural H...
 
Rob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboardRob Howe - The honest journey to full e-submission and feedback using blackboard
Rob Howe - The honest journey to full e-submission and feedback using blackboard
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational research
 
IWMW 2002: Designing for Usability
IWMW 2002: Designing for UsabilityIWMW 2002: Designing for Usability
IWMW 2002: Designing for Usability
 
The design of adaptive acquisition of users feedback an empirical study (rcis...
The design of adaptive acquisition of users feedback an empirical study (rcis...The design of adaptive acquisition of users feedback an empirical study (rcis...
The design of adaptive acquisition of users feedback an empirical study (rcis...
 
Collecting meaningful feedback on Information literacy training: results of a...
Collecting meaningful feedback on Information literacy training: results of a...Collecting meaningful feedback on Information literacy training: results of a...
Collecting meaningful feedback on Information literacy training: results of a...
 
UX in 10 Minutes - Usability Testing - Presented at SEMPO
UX in 10 Minutes - Usability Testing - Presented at SEMPOUX in 10 Minutes - Usability Testing - Presented at SEMPO
UX in 10 Minutes - Usability Testing - Presented at SEMPO
 
Evidencing compliance of quality training and assessment (SNR 15) through e-l...
Evidencing compliance of quality training and assessment (SNR 15) through e-l...Evidencing compliance of quality training and assessment (SNR 15) through e-l...
Evidencing compliance of quality training and assessment (SNR 15) through e-l...
 
Privacy Concerns vs. User Behavior in Community Question Answering
Privacy Concerns vs. User Behavior in Community Question AnsweringPrivacy Concerns vs. User Behavior in Community Question Answering
Privacy Concerns vs. User Behavior in Community Question Answering
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian Primer
 

Recently uploaded

Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneLukeKholes
 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxsuhanimunjal27
 
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfChapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfParomita Roy
 
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...amitlee9823
 
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...home
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...kumaririma588
 
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Call Girls in Nagpur High Profile
 
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...Call Girls in Nagpur High Profile
 
Pastel Portfolio _ by Slidesgo.pptx. Xxx
Pastel Portfolio _ by Slidesgo.pptx. XxxPastel Portfolio _ by Slidesgo.pptx. Xxx
Pastel Portfolio _ by Slidesgo.pptx. XxxSegundoManuelFaichin1
 
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...Call Girls in Nagpur High Profile
 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxmirandajeremy200221
 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxjeswinjees
 
2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptxsuhanimunjal27
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)amitlee9823
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdftbatkhuu1
 
Government polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdGovernment polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdshivubhavv
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...SUHANI PANDEY
 
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...amitlee9823
 

Recently uploaded (20)

Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, Pune
 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptx
 
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfChapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
 
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
 
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
 
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
 
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
 
Pastel Portfolio _ by Slidesgo.pptx. Xxx
Pastel Portfolio _ by Slidesgo.pptx. XxxPastel Portfolio _ by Slidesgo.pptx. Xxx
Pastel Portfolio _ by Slidesgo.pptx. Xxx
 
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
 
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptx
 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptx
 
2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
 
young call girls in Pandav nagar 🔝 9953056974 🔝 Delhi escort Service
young call girls in Pandav nagar 🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Pandav nagar 🔝 9953056974 🔝 Delhi escort Service
young call girls in Pandav nagar 🔝 9953056974 🔝 Delhi escort Service
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdf
 
Government polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdGovernment polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcd
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
 
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...
Jigani Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangal...
 

Are Users the Gold Standard for Accessibility Evaluation?

  • 1. Are Users the Gold Standard for Accessibility Evaluation? 7th April - W4A’14 Amaia Aizpurua1, Myriam Arrue Simon Harper2, Markel Vigo3 U. of the Basque Country University of Manchester http://dx.doi.org/10.1145/2596695.2596705 1: @amaiaaizpurua 2: @sharpic 3: @markelvigo
  • 2. Motivation • User testing for accessibility evaluation • Encouraged by the community • No established procedures – What? – When? – How? 27th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
  • 3. In practice • Evaluating web accessibility for blind users – User testing method • Effectiveness in identifying accessibility problems [Mankoff et al. 2005] – Accessibility guidelines • Partial coverage of user problems [Power et al. 2012] 37th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
  • 4. Study results • Accessibility: conformance vs. perceived Website AA conformance level Perceived 47th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation? Median Mode SD 6 7 1.95 6 6 1.42 2 1 1.62 6 6 1.95 1: very inaccessible 7: very accessible Satisfied SC Non-satisfied SC 73% 27% 69% 31% 52% 48% 36% 64%
  • 5. Why this mismatch? • Guidelines vs. user problems • Eliciting users’ problems – Experience/report problems differently: web expertise – Interaction context, tasks type • Identifying accessibility issues – Combination of causes, contextual information – Under the influence of the evaluator effect 57th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
  • 6. Discussion • Inclusive participatory evaluation – Following the considerations of co-operative evaluation – Evaluator and user evaluating a website collaboratively – Instead of interpreting data afterwards, work on problems during the session • Improve effectiveness 67th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
  • 7. Conclusions • User testing may not be the gold standard for web accessibility evaluation • Users are a gold mine • Co-operative accessibility evaluation • Bridge the gap? 77th April - W4A’14 Are Users the Gold Standard for Accessibility Evaluation?
  • 8. Thank you! 87th April - W4A’14 Contact amaia.aizpurua@ehu.es | @amaiaaizpurua myriam.arrue@ehu.es simon.harper@manchester.ac.uk | @sharpic markel.vigo@manchester.ac.uk | @markelvigo