uKinect: the Signed Internet - Gesture Control

The Signed Internet – Gesture Control @jonhassell #eAccess12

Speech recognition is cool

Speech translation is cooler

The challenge we were set “Communication is a basic human right. Communication is the means through which we control our existence. It is the way we make friends and build relationships. It is the way we become independent and make choices. It is the way we learn” (BILD, 2007).• many scenarios exist where learners with disabilities lack independence due to an inability to communicate by speech or due to lack of motor control• communication may involve having to write down or manually input information into a device• may be manageable for communicating simple concrete things to people who are physically close• for more sophisticated communication it is slow, inadequate and ultimately disabling TechDis, BIS, TSB SBRI ‘Making Waves’ competition

Vision“If signs and gestures can beeasily learned, recognizedand converted to digital data,a whole new world ofopportunity opens up.”

The ideal

The “breakthrough” • http://www.fastcoexist.com/1680081/a-device- to-translate-sign-language-into-speech and http://www.uh.edu/news- events/Fulbright/2012/may/0529MyVoice.php

Some“breakthroughs” The progress in Aberdeen• The PSLT team apologised for not being able to make it today…• Check out: http://www.pslt.org/ for further details

It takes time… – cf. SiriSpeech recognition was able to The intelligence has been worked onunderstand digits in the 50s… for at least 10 years

The problem We had 6 months…

Our approach Great TechnologyUser needs innovations possibilities User-focused innovation

The way aheadFind a breakthroughtechnology enabler

The way ahead Find people who can benefit from each of your steps…

Our target audiencesYoung people who use Makaton signs to help them with their communication

Why choose Makaton?BSL MakatonThousands of signs (> 21,000) Hundreds of signsIndividual sign vocab (> 5,000) Individual sign vocab < 200Long sequences of signs 1 or 2 sign sequencesSign quality fairly uniform Sign quality very variable, plus personal (idiosyncratic) signsMany competing teams Very few competing teams

User-Centred Dev approach Engagement through a character and humour… Inspiration: Talking Tom

Proof of concept solutionPlay the video at: http://vimeo.com/32022176

Phase Two

Users and contexts of use Users with comms difficulties Supporters of these users: through LDs, Autism, colleagues, teachers, stroke carers, parents Signing e-Learning gameEducation Employment Independent Living

The potential of reverse inclusion: OXO Good Grips• Well-known pioneer of Inclusive Design in the USA• Sam Farber’s wife, a keen cook, suffered from arthritis “Why do ordinary kitchen tools hurt your hands?”• First 15 products launched in 1990• Sales growth over 35% per year from 1991 to 2002• The line has now grown to over 500 products• Over 100 design awards received Centre for Business Innovation “Connected Communities, helping you Do more with - 21 - Engineering Design Centre Less” © 2011 Centre for Business Innovation Ltd

Which brings us back to Siriagain… :-)

Find out more at:http://www.ukinect.co.uk

Innovation Training & support for BS8878 StandardsStrategy &research www.hassellinclusion.com

Contact use: jonathan@hassellinclusion.comt: @jonhassellw: www.hassellinclusion.comWith thanks to: TechDis, BISand the Technology Strategy Board

uKinect: the Signed Internet - Gesture Control

by Jonathan Hassell on Jul 06, 2012

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 7

Statistics

uKinect: the Signed Internet - Gesture Control Presentation Transcript

https://twimg0-a.akamaihd.net	4
http://lanyrd.com	2
https://si0.twimg.com	1