Accessibility innovation through gestural and sign-language interfaces

Jonathan Hassell
Jonathan HassellCEO at Hassell Inclusion
jonathanhassell@yahoo.co.uk
Accessibility innovation through gestural and sign-language interfaces
Prof Jonathan Hassell (@jonhassell)
Director, Hassell Inclusion
Visiting Professor, London Metropolitan University
CSUN, San Diego, USA 19th March 2013
1Accessibility
and innovation
jonathanhassell@yahoo.co.uk
Without these innovators
(and more)
the lives of disabled people
would be much impoverished
Jim Thatcher for the first
Screen Reader
Thanks to iheni.com
Ray Kurzweil for the first commercial
speech recognition (& much more)
Bill Kastner, WGBH and the BBC
for the first closed captioning
Gregg Vanderheiden for starting the
accessibility guidelines ball rolling
Tim Berners Lee for “the power of the web is
in its universality…”
(inspired by Mike Paciello)
The legislators behind
Section 508 (USA) and
Disability Discrimination Act Pt III (UK)
Rob Sinclair for making ATs
easier to create with MSAA and UIA
Maguire & SOCOG for giving the world
its first web accessibility test case
The WebAIM crew for getting the word out
and stoking the discussion
Julie Howell and the PAS/78 authors
for making accessibility more strategic
Shawn Lawton Henry for building a bridge
between accessibility & usability
Mick Curran & James Teh for making
screenreaders affordable with NVDA
Steve Jobs for
making
accessibility
built in as
standard in
Apple products
Jennison Asuncion for GAAD
jonathanhassell@yahoo.co.uk
And all those who
funded their work,
used what they created,
shared the news…
jonathanhassell@yahoo.co.uk
And …
jonathanhassell@yahoo.co.uk
As mobile technology enables
more people to be innovators
Why shouldn’t
your face be here…?
None of those guys were available… so you’ve got me: Jonathan
Hassell
• >13 years experience in accessibility and inclusion
• lead author of BS 8878 British Accessibility Standards
• former Head of Usability & Accessibility, BBC
• led work to embed accessibility across
BBC web, mobile and IPTV production teams
• won BIMA 2008 & Access-IT@Home awards
for the accessibility features of BBC iPlayer
• Product Manager of innovative products:
• won IMS Global Learning Impact Award 2010
for MyDisplay
• won ‘Best Usability & Accessibility’ BIMA 2006
for My Web, My Way
• 3 x Bafta-nominated for breakthrough rich-media
eLearning projects for disabled children
2What is innovation?
“Fresh thinking that creates value”
http://www.economist.com/specialreports/PrinterFriendly.cfm?story_id=9928154
“The process of translating an idea or
invention into a good or service that
creates value or for which customers
will pay.”
www.businessdictionary.com/definition/innovation.html#ixzz2iko2wNHH
Great innovations
come from…
User needs
Technology
possibilities
Sustainable
market/fundi
ng
Great
innovations
3“Where do you get your
ideas from…?”
jonathanhassell@yahoo.co.uk
How to source ideas…
From following
market trends
(e.g. everything
goes social…)
From listening
to users’
unmet needs
and finding
ways to meet
them
From
encouraging
your team to
come up with
ideas
From following
technology
possibilities
(Freeview =>
Youview)
jonathanhassell@yahoo.co.uk
How inclusion helps ideation…
From following
market trends
(e.g. everything
goes social…)
From listening
to users’
unmet needs
and finding
ways to meet
them
From
encouraging
your team to
come up with
ideas
From following
technology
possibilities
(Freeview =>
Youview)
jonathanhassell@yahoo.co.uk
The problem of fixation…
jonathanhassell@yahoo.co.uk
How people try to free themselves from it…
‘Draw an alien’ to free yourself from conventional thinking
jonathanhassell@yahoo.co.uk
Why not find a challenge closer to home?
Think about how a disabled person would use your product…
jonathanhassell@yahoo.co.uk
The beauty of constraints…
© 2011 Centre for Business Innovation Ltd
- 34 -
Centre for Business Innovation
“Connected Communities, helping you Do more with Less” Engineering Design Centre
The potential of inclusive design: OXO Good Grips
• Well-known pioneer of Inclusive Design in the
USA
• Sam Farber’s wife, a keen cook, suffered from
arthritis
“Why do ordinary kitchen tools hurt your
hands?”
• First 15 products launched in 1990
• Sales growth over 35% per year from 1991 to
2002
• The line has now grown to over 500 products
• Over 100 design awards received
Look where asking the right question can get you…
jonathanhassell@yahoo.co.uk
How focusing on users takes you beyond inclusion…
From following
market trends
(e.g. everything
goes social…)
From listening
to users’
unmet needs
and finding
ways to meet
them
From
encouraging
your team to
come up with
ideas
From following
technology
possibilities
(Freeview =>
Youview)
jonathanhassell@yahoo.co.uk
Audience research – focus groups, ethnographic studies etc.
Keep listening through iterative user-testing
Do initial
audience
research
User test to
get better
audience
research
Develop
minimal,
flexible
next version
If more
improvement
justified,
cycle…
Use a user-centred development process to help you
– BS 8878
How mainstream products have arisen from
innovative ‘beyond inclusion’ solutions
jonathanhassell@yahoo.co.uk
4Innovation through
Natural User Interfaces
Example 1: uKinect Sign Recognition
Speech recognition is cool
Speech translation is cooler
The Funding Vision
• Learners with disabilities may lack independence due to an
inability to communicate by speech or due to lack of motor
control
• If signs and gestures can be easily learned, recognized and
converted to digital data, a whole new world of opportunity
opens up.
TechDis, BIS, TSB SBRI ‘Making Waves’ competition
The ideal
The “breakthrough” inspiration
• http://www.fastcoexist.com/1680081/a-
device-to-translate-sign-language-into-
speech and http://www.uh.edu/news-
events/Fulbright/2012/may/0529MyVoice.ph
p
It takes time… – cf. Siri
Speech recognition was able to
understand digits in the 1950s…
Siri’s intelligence has been
worked on for at least 10 years
The problem
We had
6 months…
User-focused approach
User needs
Technology
possibilities
Sustainable
funding/ma
rket
Great
innovations
Our breakthrough
technology enabler 
The way ahead
The way ahead
Looked for
people who
could benefit
from each of
our (baby)
steps…
Why choose Makaton-users
as our target audience?
British Sign Language Makaton
Thousands of signs (> 21,000) Hundreds of signs
Individual sign vocab > 5,000 Individual sign vocab < 200
Long sequences of signs 1 or 2 sign sequences
Sign quality fairly uniform Sign quality very variable, plus
personal (idiosyncratic) signs
Many competing teams
innovating in this field
Very few competing teams
innovating in this field
User-Centred Approach
Engagement
through a
character and
humour…
Inspiration:
Talking Tom
Proof of concept solution
Watch the video at: http://vimeo.com/32022176
Phase Two
Users and contexts of use
Signing
e-Learning game
Users with comms difficulties
through LDs, Autism, stroke
Education Employment
Independent
Living
Supporters of these users:
colleagues, teachers, carers, parents
Product launching May-14
Accessibility innovation through gestural and sign-language interfaces
Hints of a new opportunity
“Boris was so engaging
that blind students were
also asking to use it to
learn to sign…”
Example 2: The Nepalese Necklace
A Movement Game for Blind and VI Children
The Nepalese Necklace Original concept
• The idea:
• using audio-games & Microsoft Kinect’s
gesture recognition to encourage blind and
partially-sighted children to engage more
readily with their mobility training
• The project:
• an inexpensive, 3 month Proof of Concept
to investigate the idea’s potential in a
concrete, testable way
The Nepalese Necklace UCD Approach
• Initial user-research
• found experts in the learning, and
representatives of the learners
• created a way of giving both an initial
idea of what we were talking about, to
get their attention and buy-in
• asked questions to “get into their world”
• then created what they needed/wanted
• Iterative user-testing
• we did this every couple of weeks
• there’s no substitute for it
The Nepalese Necklace Validation
• Did final research to prove value
• in all contexts of use
(in homes as well as as schools)
• over longer periods of testing, without
expert presence (over at least a week,
without you propping the PoC up)
• observed and interviewed users &
experts to understand how they
behave and feel about the PoC
• Got the results on video
• nothing else quite proves your case
Partner of the Year
Gamelab UK
If you
remember
one thing…
Listening to your diverse audiences needs…
identifies challenges…
but innovation often follows a challenge
So why shouldn’t
this be you?
• the full guide on how to transform your organisation
to achieve the consistent creation of web sites and
apps that are usable and accessible to all your
customers, at the most efficient cost
• with practical case-studies from leading
accessibility experts worldwide, including:
• Jennison Asuncion (Canada),
• Debra Ruh & Jeff Kline (USA),
• Andrew Arch (Australia)
• David Banes (Qatar)
• Axel Leblois (UN)
for information on the book,
free access to video case-
studies, and a chance of winning
the book for free
Click here for
chance to
win book
There’s more on accessibility
innovation in my book
Training &
support for
BS8878
Standards
Innovation
www.hassellinclusion.com
Strategy &
research
More Hassell Inclusion at CSUN-14:
Web Accessibility Myths for the mobile generation
• Do disabled people really
use ATs?
• Is the most important
accessibility issue for
images alt-text?
• Does inclusive design really
benefit everyone?
• Are the most important
people in accessibility
developers?
• challenging some of the
accepted views we hold that
may no longer be true…
More Hassell Inclusion at CSUN-14:
7 Signs of maturing in accessibility and inclusion
• The accessibility industry is
aging and growing…
• But is it maturing…?
• how do you measure
maturity in accessibility
- in organisations,
and as an industry?
• from Tim Cook’s latest
shareholder comments
to the IAAP – here are 7
signs that we’re maturing
as we grow…
Get in touch…
e: jonathan@hassellinclusion.com
t: @jonhassell
w: www.hassellinclusion.com
1 of 72

Recommended

uKinect: the Signed Internet - Gesture Control by
uKinect: the Signed Internet - Gesture ControluKinect: the Signed Internet - Gesture Control
uKinect: the Signed Internet - Gesture ControlJonathan Hassell
2.6K views25 slides
Accessibility as Innovation - giving your potential users the chance to inspi... by
Accessibility as Innovation - giving your potential users the chance to inspi...Accessibility as Innovation - giving your potential users the chance to inspi...
Accessibility as Innovation - giving your potential users the chance to inspi...Jonathan Hassell
1.6K views71 slides
eAccess-12 roundtable: Case Studies of Implementing BS 88878 by
eAccess-12 roundtable: Case Studies of Implementing BS 88878eAccess-12 roundtable: Case Studies of Implementing BS 88878
eAccess-12 roundtable: Case Studies of Implementing BS 88878Jonathan Hassell
1.8K views46 slides
7 Signs of Maturing in Accessibility and Inclusion by
7 Signs of Maturing in Accessibility and Inclusion7 Signs of Maturing in Accessibility and Inclusion
7 Signs of Maturing in Accessibility and InclusionJonathan Hassell
4.7K views101 slides
How BS8878 brings together usability & accessibility by
How BS8878 brings together usability & accessibilityHow BS8878 brings together usability & accessibility
How BS8878 brings together usability & accessibilityJonathan Hassell
1.6K views34 slides
Accessibility myths for a mobile generation by
Accessibility myths for a mobile generationAccessibility myths for a mobile generation
Accessibility myths for a mobile generationJonathan Hassell
6.9K views110 slides

More Related Content

What's hot

uKinect Gesture Recognition Games for Disabled People by
uKinect Gesture Recognition Games for Disabled PeopleuKinect Gesture Recognition Games for Disabled People
uKinect Gesture Recognition Games for Disabled PeopleJonathan Hassell
1K views13 slides
Case studies of implementing BS 8878 (CSUN 2012) by
Case studies of implementing BS 8878 (CSUN 2012)Case studies of implementing BS 8878 (CSUN 2012)
Case studies of implementing BS 8878 (CSUN 2012)Jonathan Hassell
2.5K views55 slides
2009: Maturing in accessibility - a brief BBC history by
2009: Maturing in accessibility - a brief BBC history2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC historyJonathan Hassell
787 views28 slides
Design for all vs. Design for me: the limits of Inclusive Design by
Design for all vs. Design for me: the limits of Inclusive DesignDesign for all vs. Design for me: the limits of Inclusive Design
Design for all vs. Design for me: the limits of Inclusive DesignJonathan Hassell
1.4K views37 slides
eAccessibility: Compliance towards Innovation by
eAccessibility: Compliance towards InnovationeAccessibility: Compliance towards Innovation
eAccessibility: Compliance towards InnovationJonathan Hassell
1.1K views30 slides
Checking Our Footing: 16 Modern Accessibility Myths Debunked by
Checking Our Footing: 16 Modern Accessibility Myths DebunkedChecking Our Footing: 16 Modern Accessibility Myths Debunked
Checking Our Footing: 16 Modern Accessibility Myths DebunkedJonathan Hassell
3.5K views83 slides

What's hot(20)

uKinect Gesture Recognition Games for Disabled People by Jonathan Hassell
uKinect Gesture Recognition Games for Disabled PeopleuKinect Gesture Recognition Games for Disabled People
uKinect Gesture Recognition Games for Disabled People
Jonathan Hassell1K views
Case studies of implementing BS 8878 (CSUN 2012) by Jonathan Hassell
Case studies of implementing BS 8878 (CSUN 2012)Case studies of implementing BS 8878 (CSUN 2012)
Case studies of implementing BS 8878 (CSUN 2012)
Jonathan Hassell2.5K views
2009: Maturing in accessibility - a brief BBC history by Jonathan Hassell
2009: Maturing in accessibility - a brief BBC history2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC history
Jonathan Hassell787 views
Design for all vs. Design for me: the limits of Inclusive Design by Jonathan Hassell
Design for all vs. Design for me: the limits of Inclusive DesignDesign for all vs. Design for me: the limits of Inclusive Design
Design for all vs. Design for me: the limits of Inclusive Design
Jonathan Hassell1.4K views
eAccessibility: Compliance towards Innovation by Jonathan Hassell
eAccessibility: Compliance towards InnovationeAccessibility: Compliance towards Innovation
eAccessibility: Compliance towards Innovation
Jonathan Hassell1.1K views
Checking Our Footing: 16 Modern Accessibility Myths Debunked by Jonathan Hassell
Checking Our Footing: 16 Modern Accessibility Myths DebunkedChecking Our Footing: 16 Modern Accessibility Myths Debunked
Checking Our Footing: 16 Modern Accessibility Myths Debunked
Jonathan Hassell3.5K views
Stop Trying to Avoid Losing and Start Winning: How BS 8878 reframes the Acces... by Jonathan Hassell
Stop Trying to Avoid Losing and Start Winning: How BS 8878 reframes the Acces...Stop Trying to Avoid Losing and Start Winning: How BS 8878 reframes the Acces...
Stop Trying to Avoid Losing and Start Winning: How BS 8878 reframes the Acces...
Jonathan Hassell3.2K views
BBC approach to accessibility & how BS8878 enables others to do the same by Jonathan Hassell
BBC approach to accessibility & how BS8878 enables others to do the sameBBC approach to accessibility & how BS8878 enables others to do the same
BBC approach to accessibility & how BS8878 enables others to do the same
Jonathan Hassell1.1K views
How can websites comply with accessibility legislation and win more users? by Jonathan Hassell
How can websites comply with accessibility legislation and win more users?How can websites comply with accessibility legislation and win more users?
How can websites comply with accessibility legislation and win more users?
Jonathan Hassell1.9K views
Policy Driven Adoption of Accessibility - CSUN 2013 by Jonathan Hassell
Policy Driven Adoption of Accessibility - CSUN 2013Policy Driven Adoption of Accessibility - CSUN 2013
Policy Driven Adoption of Accessibility - CSUN 2013
Jonathan Hassell2K views
2009: Social inclusion in a Digital Age by Jonathan Hassell
2009: Social inclusion in a Digital Age2009: Social inclusion in a Digital Age
2009: Social inclusion in a Digital Age
Jonathan Hassell1.2K views
2005: Accessibility: which site production standards and testing methods will... by Jonathan Hassell
2005: Accessibility: which site production standards and testing methods will...2005: Accessibility: which site production standards and testing methods will...
2005: Accessibility: which site production standards and testing methods will...
Jonathan Hassell724 views
How BS8878 relates to WCAG 2.0, PAS 78, Mandate 376 and UCD Standards by Jonathan Hassell
How BS8878 relates to WCAG 2.0, PAS 78, Mandate 376 and UCD StandardsHow BS8878 relates to WCAG 2.0, PAS 78, Mandate 376 and UCD Standards
How BS8878 relates to WCAG 2.0, PAS 78, Mandate 376 and UCD Standards
Jonathan Hassell13.7K views
Inclusive, immersive, imaginative and imperative by Christine Hemphill
Inclusive, immersive, imaginative and imperative Inclusive, immersive, imaginative and imperative
Inclusive, immersive, imaginative and imperative
Christine Hemphill156 views
Jisc edtech ideas challenges webinar 14 nov2018 by Paul Bailey
Jisc edtech ideas challenges   webinar 14 nov2018Jisc edtech ideas challenges   webinar 14 nov2018
Jisc edtech ideas challenges webinar 14 nov2018
Paul Bailey350 views
Tackling loneliness with technology by AbilityNet
Tackling loneliness with technologyTackling loneliness with technology
Tackling loneliness with technology
AbilityNet1K views
The Big Hack and Purple Pound - Scope by AbilityNet
The Big Hack and Purple Pound - ScopeThe Big Hack and Purple Pound - Scope
The Big Hack and Purple Pound - Scope
AbilityNet109 views
Inclusive design for connected and autonomous vehicles by Christine Hemphill
Inclusive design for connected and autonomous vehiclesInclusive design for connected and autonomous vehicles
Inclusive design for connected and autonomous vehicles
SEO through Accessibility- How designing accessible websites leads to automat... by Abhay Rautela
SEO through Accessibility- How designing accessible websites leads to automat...SEO through Accessibility- How designing accessible websites leads to automat...
SEO through Accessibility- How designing accessible websites leads to automat...
Abhay Rautela6.7K views

Viewers also liked

Nordic Independent Living Challenge by
Nordic Independent Living ChallengeNordic Independent Living Challenge
Nordic Independent Living ChallengeNordic Innovation
100.7K views26 slides
Technology for differently abled persons by
Technology for differently abled personsTechnology for differently abled persons
Technology for differently abled personsDeepa Ajithkumar
4.5K views100 slides
ppt presentation...Using technology of today to the classroom of today by
ppt presentation...Using technology of today to the classroom of todayppt presentation...Using technology of today to the classroom of today
ppt presentation...Using technology of today to the classroom of todayRowena Wheng Rosalejos
3.3K views13 slides
Welcome to BU by
Welcome to BUWelcome to BU
Welcome to BUbournemouthuniversity
255 views14 slides
FGV Graduate Management Specialization Course by
FGV Graduate Management Specialization CourseFGV Graduate Management Specialization Course
FGV Graduate Management Specialization CourseMarcio Koerich
327 views6 slides
Latest books of Prof. J.P.Verma on Research and Statistics by
Latest books of Prof. J.P.Verma on Research and StatisticsLatest books of Prof. J.P.Verma on Research and Statistics
Latest books of Prof. J.P.Verma on Research and StatisticsJai Verma
626 views6 slides

Viewers also liked(20)

Nordic Independent Living Challenge by Nordic Innovation
Nordic Independent Living ChallengeNordic Independent Living Challenge
Nordic Independent Living Challenge
Nordic Innovation100.7K views
Technology for differently abled persons by Deepa Ajithkumar
Technology for differently abled personsTechnology for differently abled persons
Technology for differently abled persons
Deepa Ajithkumar4.5K views
ppt presentation...Using technology of today to the classroom of today by Rowena Wheng Rosalejos
ppt presentation...Using technology of today to the classroom of todayppt presentation...Using technology of today to the classroom of today
ppt presentation...Using technology of today to the classroom of today
FGV Graduate Management Specialization Course by Marcio Koerich
FGV Graduate Management Specialization CourseFGV Graduate Management Specialization Course
FGV Graduate Management Specialization Course
Marcio Koerich327 views
Latest books of Prof. J.P.Verma on Research and Statistics by Jai Verma
Latest books of Prof. J.P.Verma on Research and StatisticsLatest books of Prof. J.P.Verma on Research and Statistics
Latest books of Prof. J.P.Verma on Research and Statistics
Jai Verma626 views
Rti implementation by mmcarl0928
Rti implementationRti implementation
Rti implementation
mmcarl0928346 views
Parent Toolkit-english by bsturgeon
Parent Toolkit-englishParent Toolkit-english
Parent Toolkit-english
bsturgeon686 views
Superstitions by ninesing
SuperstitionsSuperstitions
Superstitions
ninesing445 views
Senior Seminar Final Presentation Slide by ninesing
Senior Seminar Final Presentation SlideSenior Seminar Final Presentation Slide
Senior Seminar Final Presentation Slide
ninesing248 views
Society for software advancement and welfare samitti by PT Bipin Bhardwaj
Society for software advancement and welfare samittiSociety for software advancement and welfare samitti
Society for software advancement and welfare samitti
PT Bipin Bhardwaj667 views

Similar to Accessibility innovation through gestural and sign-language interfaces

Teaching with Technology by
Teaching with TechnologyTeaching with Technology
Teaching with TechnologyDavid Bond
234 views51 slides
Gfh 2011 presentation abrann by
Gfh 2011 presentation abrannGfh 2011 presentation abrann
Gfh 2011 presentation abrannabrann
205 views19 slides
Technology Innovations in Teaching and Learning by
Technology Innovations in Teaching and LearningTechnology Innovations in Teaching and Learning
Technology Innovations in Teaching and LearningCEMCA
7.8K views19 slides
Online Qual Research at Conecta by
Online Qual Research at ConectaOnline Qual Research at Conecta
Online Qual Research at Conectaconectarc
310 views15 slides
Dan Sutch UWE presentation by
Dan Sutch UWE presentationDan Sutch UWE presentation
Dan Sutch UWE presentationDannno
500 views40 slides
Our Digital Futures by
Our Digital FuturesOur Digital Futures
Our Digital FuturesLisa Harris
181 views27 slides

Similar to Accessibility innovation through gestural and sign-language interfaces(20)

Teaching with Technology by David Bond
Teaching with TechnologyTeaching with Technology
Teaching with Technology
David Bond234 views
Gfh 2011 presentation abrann by abrann
Gfh 2011 presentation abrannGfh 2011 presentation abrann
Gfh 2011 presentation abrann
abrann205 views
Technology Innovations in Teaching and Learning by CEMCA
Technology Innovations in Teaching and LearningTechnology Innovations in Teaching and Learning
Technology Innovations in Teaching and Learning
CEMCA7.8K views
Online Qual Research at Conecta by conectarc
Online Qual Research at ConectaOnline Qual Research at Conecta
Online Qual Research at Conecta
conectarc310 views
Dan Sutch UWE presentation by Dannno
Dan Sutch UWE presentationDan Sutch UWE presentation
Dan Sutch UWE presentation
Dannno500 views
Our Digital Futures by Lisa Harris
Our Digital FuturesOur Digital Futures
Our Digital Futures
Lisa Harris181 views
Lisa's research 10th oct 2012 by Lisa Harris
Lisa's research 10th oct 2012Lisa's research 10th oct 2012
Lisa's research 10th oct 2012
Lisa Harris381 views
Universal Usability Presentation by Lynn Marentette
Universal Usability PresentationUniversal Usability Presentation
Universal Usability Presentation
Lynn Marentette696 views
Product concept and design by EllaQuing
Product concept and designProduct concept and design
Product concept and design
EllaQuing93 views
Michael Edson @ Forum One: Strategy and Audience (long version) by Michael Edson
Michael Edson @ Forum One: Strategy and Audience (long version)Michael Edson @ Forum One: Strategy and Audience (long version)
Michael Edson @ Forum One: Strategy and Audience (long version)
Michael Edson1.3K views
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe... by Alton "Tony" Zanders
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
January15 2009 Pat Robinson Betterment by thmvmnt
January15 2009 Pat Robinson BettermentJanuary15 2009 Pat Robinson Betterment
January15 2009 Pat Robinson Betterment
thmvmnt443 views
Learning Analytics and Online Learning: New Oportunities? by Svet Ivantchev
Learning Analytics and Online Learning: New Oportunities?Learning Analytics and Online Learning: New Oportunities?
Learning Analytics and Online Learning: New Oportunities?
Svet Ivantchev1.1K views
Crowdsourcing based curation and user engagement in digital library design by Rose Holley
Crowdsourcing based curation and user engagement in digital library designCrowdsourcing based curation and user engagement in digital library design
Crowdsourcing based curation and user engagement in digital library design
Rose Holley463 views
Class number 1: Anyscreen Storytelling by brookeshepard
Class number 1: Anyscreen StorytellingClass number 1: Anyscreen Storytelling
Class number 1: Anyscreen Storytelling
brookeshepard186 views
What’s next for the Quiz and Question bank and for Moodle community collabora... by Tim Hunt
What’s next for the Quiz and Question bank and for Moodle community collabora...What’s next for the Quiz and Question bank and for Moodle community collabora...
What’s next for the Quiz and Question bank and for Moodle community collabora...
Tim Hunt177 views
Design and Creativity Day02 by R. Sosa
Design and Creativity Day02Design and Creativity Day02
Design and Creativity Day02
R. Sosa 831 views
From Digital Literacy to Digital Fluency by David Cain
From Digital Literacy to Digital FluencyFrom Digital Literacy to Digital Fluency
From Digital Literacy to Digital Fluency
David Cain784 views
Sustaining OER innovation by Jisc
Sustaining OER innovationSustaining OER innovation
Sustaining OER innovation
Jisc567 views
Stop Trying to Avoid Losing and Start Winning: How BS 8878 Reframes the Acces... by IWMW
Stop Trying to Avoid Losing and Start Winning: How BS 8878 Reframes the Acces...Stop Trying to Avoid Losing and Start Winning: How BS 8878 Reframes the Acces...
Stop Trying to Avoid Losing and Start Winning: How BS 8878 Reframes the Acces...
IWMW 1K views

More from Jonathan Hassell

The past, present and future of accessibility - niche to nice to normal by
The past, present and future of accessibility - niche to nice to normalThe past, present and future of accessibility - niche to nice to normal
The past, present and future of accessibility - niche to nice to normalJonathan Hassell
312 views34 slides
Back to the Future: Current and Future Trends for Accessibility by
Back to the Future: Current and Future Trends for AccessibilityBack to the Future: Current and Future Trends for Accessibility
Back to the Future: Current and Future Trends for AccessibilityJonathan Hassell
1K views37 slides
Providing better scaffolding - how BS8878 affects people designing inclusive ... by
Providing better scaffolding - how BS8878 affects people designing inclusive ...Providing better scaffolding - how BS8878 affects people designing inclusive ...
Providing better scaffolding - how BS8878 affects people designing inclusive ...Jonathan Hassell
916 views22 slides
2010: MyDisplay - Accessibility Preferences Aren't for Sissies by
2010: MyDisplay - Accessibility Preferences Aren't for Sissies2010: MyDisplay - Accessibility Preferences Aren't for Sissies
2010: MyDisplay - Accessibility Preferences Aren't for SissiesJonathan Hassell
2.3K views66 slides
2009: User experience in action by
2009: User experience in action2009: User experience in action
2009: User experience in actionJonathan Hassell
603 views37 slides
2007: Benjamin's House - Making Braille reading and writing fun for children by
2007: Benjamin's House - Making Braille reading and writing fun for children2007: Benjamin's House - Making Braille reading and writing fun for children
2007: Benjamin's House - Making Braille reading and writing fun for childrenJonathan Hassell
728 views15 slides

More from Jonathan Hassell(6)

The past, present and future of accessibility - niche to nice to normal by Jonathan Hassell
The past, present and future of accessibility - niche to nice to normalThe past, present and future of accessibility - niche to nice to normal
The past, present and future of accessibility - niche to nice to normal
Jonathan Hassell312 views
Back to the Future: Current and Future Trends for Accessibility by Jonathan Hassell
Back to the Future: Current and Future Trends for AccessibilityBack to the Future: Current and Future Trends for Accessibility
Back to the Future: Current and Future Trends for Accessibility
Jonathan Hassell1K views
Providing better scaffolding - how BS8878 affects people designing inclusive ... by Jonathan Hassell
Providing better scaffolding - how BS8878 affects people designing inclusive ...Providing better scaffolding - how BS8878 affects people designing inclusive ...
Providing better scaffolding - how BS8878 affects people designing inclusive ...
Jonathan Hassell916 views
2010: MyDisplay - Accessibility Preferences Aren't for Sissies by Jonathan Hassell
2010: MyDisplay - Accessibility Preferences Aren't for Sissies2010: MyDisplay - Accessibility Preferences Aren't for Sissies
2010: MyDisplay - Accessibility Preferences Aren't for Sissies
Jonathan Hassell2.3K views
2007: Benjamin's House - Making Braille reading and writing fun for children by Jonathan Hassell
2007: Benjamin's House - Making Braille reading and writing fun for children2007: Benjamin's House - Making Braille reading and writing fun for children
2007: Benjamin's House - Making Braille reading and writing fun for children
Jonathan Hassell728 views

Recently uploaded

Microsoft Power Platform.pptx by
Microsoft Power Platform.pptxMicrosoft Power Platform.pptx
Microsoft Power Platform.pptxUni Systems S.M.S.A.
53 views38 slides
PharoJS - Zürich Smalltalk Group Meetup November 2023 by
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023Noury Bouraqadi
127 views17 slides
Ransomware is Knocking your Door_Final.pdf by
Ransomware is Knocking your Door_Final.pdfRansomware is Knocking your Door_Final.pdf
Ransomware is Knocking your Door_Final.pdfSecurity Bootcamp
55 views46 slides
Melek BEN MAHMOUD.pdf by
Melek BEN MAHMOUD.pdfMelek BEN MAHMOUD.pdf
Melek BEN MAHMOUD.pdfMelekBenMahmoud
14 views1 slide
Transcript: The Details of Description Techniques tips and tangents on altern... by
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...BookNet Canada
136 views15 slides
Scaling Knowledge Graph Architectures with AI by
Scaling Knowledge Graph Architectures with AIScaling Knowledge Graph Architectures with AI
Scaling Knowledge Graph Architectures with AIEnterprise Knowledge
30 views15 slides

Recently uploaded(20)

PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi127 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada136 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10248 views
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf by Dr. Jimmy Schwarzkopf
STKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdfSTKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdf
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf
Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2217 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma39 views
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab19 views
Unit 1_Lecture 2_Physical Design of IoT.pdf by StephenTec
Unit 1_Lecture 2_Physical Design of IoT.pdfUnit 1_Lecture 2_Physical Design of IoT.pdf
Unit 1_Lecture 2_Physical Design of IoT.pdf
StephenTec12 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software263 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker37 views
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex22 views

Accessibility innovation through gestural and sign-language interfaces

  • 1. jonathanhassell@yahoo.co.uk Accessibility innovation through gestural and sign-language interfaces Prof Jonathan Hassell (@jonhassell) Director, Hassell Inclusion Visiting Professor, London Metropolitan University CSUN, San Diego, USA 19th March 2013
  • 3. jonathanhassell@yahoo.co.uk Without these innovators (and more) the lives of disabled people would be much impoverished
  • 4. Jim Thatcher for the first Screen Reader Thanks to iheni.com
  • 5. Ray Kurzweil for the first commercial speech recognition (& much more)
  • 6. Bill Kastner, WGBH and the BBC for the first closed captioning
  • 7. Gregg Vanderheiden for starting the accessibility guidelines ball rolling
  • 8. Tim Berners Lee for “the power of the web is in its universality…” (inspired by Mike Paciello)
  • 9. The legislators behind Section 508 (USA) and Disability Discrimination Act Pt III (UK)
  • 10. Rob Sinclair for making ATs easier to create with MSAA and UIA
  • 11. Maguire & SOCOG for giving the world its first web accessibility test case
  • 12. The WebAIM crew for getting the word out and stoking the discussion
  • 13. Julie Howell and the PAS/78 authors for making accessibility more strategic
  • 14. Shawn Lawton Henry for building a bridge between accessibility & usability
  • 15. Mick Curran & James Teh for making screenreaders affordable with NVDA
  • 16. Steve Jobs for making accessibility built in as standard in Apple products
  • 18. jonathanhassell@yahoo.co.uk And all those who funded their work, used what they created, shared the news…
  • 20. jonathanhassell@yahoo.co.uk As mobile technology enables more people to be innovators
  • 22. None of those guys were available… so you’ve got me: Jonathan Hassell • >13 years experience in accessibility and inclusion • lead author of BS 8878 British Accessibility Standards • former Head of Usability & Accessibility, BBC • led work to embed accessibility across BBC web, mobile and IPTV production teams • won BIMA 2008 & Access-IT@Home awards for the accessibility features of BBC iPlayer • Product Manager of innovative products: • won IMS Global Learning Impact Award 2010 for MyDisplay • won ‘Best Usability & Accessibility’ BIMA 2006 for My Web, My Way • 3 x Bafta-nominated for breakthrough rich-media eLearning projects for disabled children
  • 24. “Fresh thinking that creates value” http://www.economist.com/specialreports/PrinterFriendly.cfm?story_id=9928154
  • 25. “The process of translating an idea or invention into a good or service that creates value or for which customers will pay.” www.businessdictionary.com/definition/innovation.html#ixzz2iko2wNHH
  • 26. Great innovations come from… User needs Technology possibilities Sustainable market/fundi ng Great innovations
  • 27. 3“Where do you get your ideas from…?”
  • 28. jonathanhassell@yahoo.co.uk How to source ideas… From following market trends (e.g. everything goes social…) From listening to users’ unmet needs and finding ways to meet them From encouraging your team to come up with ideas From following technology possibilities (Freeview => Youview)
  • 29. jonathanhassell@yahoo.co.uk How inclusion helps ideation… From following market trends (e.g. everything goes social…) From listening to users’ unmet needs and finding ways to meet them From encouraging your team to come up with ideas From following technology possibilities (Freeview => Youview)
  • 31. jonathanhassell@yahoo.co.uk How people try to free themselves from it… ‘Draw an alien’ to free yourself from conventional thinking
  • 32. jonathanhassell@yahoo.co.uk Why not find a challenge closer to home? Think about how a disabled person would use your product…
  • 34. © 2011 Centre for Business Innovation Ltd - 34 - Centre for Business Innovation “Connected Communities, helping you Do more with Less” Engineering Design Centre The potential of inclusive design: OXO Good Grips • Well-known pioneer of Inclusive Design in the USA • Sam Farber’s wife, a keen cook, suffered from arthritis “Why do ordinary kitchen tools hurt your hands?” • First 15 products launched in 1990 • Sales growth over 35% per year from 1991 to 2002 • The line has now grown to over 500 products • Over 100 design awards received Look where asking the right question can get you…
  • 35. jonathanhassell@yahoo.co.uk How focusing on users takes you beyond inclusion… From following market trends (e.g. everything goes social…) From listening to users’ unmet needs and finding ways to meet them From encouraging your team to come up with ideas From following technology possibilities (Freeview => Youview)
  • 36. jonathanhassell@yahoo.co.uk Audience research – focus groups, ethnographic studies etc.
  • 37. Keep listening through iterative user-testing Do initial audience research User test to get better audience research Develop minimal, flexible next version If more improvement justified, cycle…
  • 38. Use a user-centred development process to help you – BS 8878
  • 39. How mainstream products have arisen from innovative ‘beyond inclusion’ solutions
  • 41. Example 1: uKinect Sign Recognition
  • 44. The Funding Vision • Learners with disabilities may lack independence due to an inability to communicate by speech or due to lack of motor control • If signs and gestures can be easily learned, recognized and converted to digital data, a whole new world of opportunity opens up. TechDis, BIS, TSB SBRI ‘Making Waves’ competition
  • 46. The “breakthrough” inspiration • http://www.fastcoexist.com/1680081/a- device-to-translate-sign-language-into- speech and http://www.uh.edu/news- events/Fulbright/2012/may/0529MyVoice.ph p
  • 47. It takes time… – cf. Siri Speech recognition was able to understand digits in the 1950s… Siri’s intelligence has been worked on for at least 10 years
  • 48. The problem We had 6 months…
  • 51. The way ahead Looked for people who could benefit from each of our (baby) steps…
  • 52. Why choose Makaton-users as our target audience? British Sign Language Makaton Thousands of signs (> 21,000) Hundreds of signs Individual sign vocab > 5,000 Individual sign vocab < 200 Long sequences of signs 1 or 2 sign sequences Sign quality fairly uniform Sign quality very variable, plus personal (idiosyncratic) signs Many competing teams innovating in this field Very few competing teams innovating in this field
  • 53. User-Centred Approach Engagement through a character and humour… Inspiration: Talking Tom
  • 54. Proof of concept solution Watch the video at: http://vimeo.com/32022176
  • 56. Users and contexts of use Signing e-Learning game Users with comms difficulties through LDs, Autism, stroke Education Employment Independent Living Supporters of these users: colleagues, teachers, carers, parents
  • 59. Hints of a new opportunity “Boris was so engaging that blind students were also asking to use it to learn to sign…”
  • 60. Example 2: The Nepalese Necklace A Movement Game for Blind and VI Children
  • 61. The Nepalese Necklace Original concept • The idea: • using audio-games & Microsoft Kinect’s gesture recognition to encourage blind and partially-sighted children to engage more readily with their mobility training • The project: • an inexpensive, 3 month Proof of Concept to investigate the idea’s potential in a concrete, testable way
  • 62. The Nepalese Necklace UCD Approach • Initial user-research • found experts in the learning, and representatives of the learners • created a way of giving both an initial idea of what we were talking about, to get their attention and buy-in • asked questions to “get into their world” • then created what they needed/wanted • Iterative user-testing • we did this every couple of weeks • there’s no substitute for it
  • 63. The Nepalese Necklace Validation • Did final research to prove value • in all contexts of use (in homes as well as as schools) • over longer periods of testing, without expert presence (over at least a week, without you propping the PoC up) • observed and interviewed users & experts to understand how they behave and feel about the PoC • Got the results on video • nothing else quite proves your case
  • 64. Partner of the Year Gamelab UK
  • 66. Listening to your diverse audiences needs… identifies challenges… but innovation often follows a challenge
  • 68. • the full guide on how to transform your organisation to achieve the consistent creation of web sites and apps that are usable and accessible to all your customers, at the most efficient cost • with practical case-studies from leading accessibility experts worldwide, including: • Jennison Asuncion (Canada), • Debra Ruh & Jeff Kline (USA), • Andrew Arch (Australia) • David Banes (Qatar) • Axel Leblois (UN) for information on the book, free access to video case- studies, and a chance of winning the book for free Click here for chance to win book There’s more on accessibility innovation in my book
  • 70. More Hassell Inclusion at CSUN-14: Web Accessibility Myths for the mobile generation • Do disabled people really use ATs? • Is the most important accessibility issue for images alt-text? • Does inclusive design really benefit everyone? • Are the most important people in accessibility developers? • challenging some of the accepted views we hold that may no longer be true…
  • 71. More Hassell Inclusion at CSUN-14: 7 Signs of maturing in accessibility and inclusion • The accessibility industry is aging and growing… • But is it maturing…? • how do you measure maturity in accessibility - in organisations, and as an industry? • from Tim Cook’s latest shareholder comments to the IAAP – here are 7 signs that we’re maturing as we grow…
  • 72. Get in touch… e: jonathan@hassellinclusion.com t: @jonhassell w: www.hassellinclusion.com

Editor's Notes

  1. Digital TV has brought many advances for disabled and elderly people in recent years… access services - subtitles, signing, and audio descriptionIt’s brought problems too…“what box do I need… and how expensive is it?”“how do I find the programmes with the access services I need?”especially if the electronic programme guide doesn’t include speech…
  2. Digital TV has brought many advances for disabled and elderly people in recent years… access services - subtitles, signing, and audio descriptionIt’s brought problems too…“what box do I need… and how expensive is it?”“how do I find the programmes with the access services I need?”especially if the electronic programme guide doesn’t include speech…
  3. Digital TV has brought many advances for disabled and elderly people in recent years… access services - subtitles, signing, and audio descriptionIt’s brought problems too…“what box do I need… and how expensive is it?”“how do I find the programmes with the access services I need?”especially if the electronic programme guide doesn’t include speech…
  4. And we found…
  5. Working with the students to work out what they’d like…
  6. Here’s a summary of what we were able to achieve in our Phase One.
  7. Here’s a summary of what we were able to achieve in our Phase One.
  8. 32 minutes to here
  9. 32 minutes to here