Your SlideShare is downloading. ×
The Signed Internet – Gesture Control       @jonhassell #eAccess12
Speech recognition is cool
The challenge we were set        “Communication is a basic human right.         Communication is the means through which w...
The ideal
The “breakthrough”        •   http://www.fastcoexist.com/1680081/a-device-            to-translate-sign-language-into-spee...
Some“breakthroughs”                                The progress in Aberdeen• The PSLT team apologised for not being able t...
It takes time… – cf. SiriSpeech recognition was able to       The intelligence has been worked onunderstand digits in the ...
The problem      We had      6 months…
Our approach                Great      TechnologyUser needs   innovations                           possibilities User-foc...
The way aheadFind a breakthroughtechnology enabler
The way ahead      Find people      who can      benefit from      each of your      steps…
Our target audiencesYoung people who use Makaton signs to help      them with their communication
Why choose Makaton?BSL                               MakatonThousands of signs (> 21,000)     Hundreds of signsIndividual ...
User-Centred Dev approach          Engagement          through a          character and          humour…          Inspirat...
Proof of concept solutionPlay the video at: http://vimeo.com/32022176
Phase Two
Users and contexts of use   Users with comms       difficulties                   Supporters of these users:  through LDs,...
The potential of reverse inclusion: OXO Good Grips• Well-known pioneer of Inclusive Design  in the USA• Sam Farber’s wife,...
Which brings us back to Siriagain… :-)
Find out more at:http://www.ukinect.co.uk
Innovation             Training &             support for             BS8878                           StandardsStrategy &...
Contact use: jonathan@hassellinclusion.comt: @jonhassellw: www.hassellinclusion.comWith thanks to: TechDis, BISand the Tec...
uKinect: the Signed Internet - Gesture Control
uKinect: the Signed Internet - Gesture Control
uKinect: the Signed Internet - Gesture Control
Upcoming SlideShare
Loading in...5
×

uKinect: the Signed Internet - Gesture Control

2,363

Published on

Presentation at eAccess-12 (#eAccess12) on uKinect and sign recognition systems by Prof Jonathan Hassell, co-lead of uKinect project (www.ukinect.co.uk)

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,363
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Here’s a summary of what we were able to achieve in our Phase One.
  • So that’s a summary of our Phase 2 application.Thanks for you attention.And do you have any questions?
  • Transcript of "uKinect: the Signed Internet - Gesture Control"

    1. 1. The Signed Internet – Gesture Control @jonhassell #eAccess12
    2. 2. Speech recognition is cool
    3. 3. Speech translation is cooler
    4. 4. The challenge we were set “Communication is a basic human right. Communication is the means through which we control our existence. It is the way we make friends and build relationships. It is the way we become independent and make choices. It is the way we learn” (BILD, 2007).• many scenarios exist where learners with disabilities lack independence due to an inability to communicate by speech or due to lack of motor control• communication may involve having to write down or manually input information into a device• may be manageable for communicating simple concrete things to people who are physically close• for more sophisticated communication it is slow, inadequate and ultimately disabling TechDis, BIS, TSB SBRI ‘Making Waves’ competition
    5. 5. Vision“If signs and gestures can beeasily learned, recognizedand converted to digital data,a whole new world ofopportunity opens up.”
    6. 6. The ideal
    7. 7. The “breakthrough” • http://www.fastcoexist.com/1680081/a-device- to-translate-sign-language-into-speech and http://www.uh.edu/news- events/Fulbright/2012/may/0529MyVoice.php
    8. 8. Some“breakthroughs” The progress in Aberdeen• The PSLT team apologised for not being able to make it today…• Check out: http://www.pslt.org/ for further details
    9. 9. It takes time… – cf. SiriSpeech recognition was able to The intelligence has been worked onunderstand digits in the 50s… for at least 10 years
    10. 10. The problem We had 6 months…
    11. 11. Our approach Great TechnologyUser needs innovations possibilities User-focused innovation
    12. 12. The way aheadFind a breakthroughtechnology enabler
    13. 13. The way ahead Find people who can benefit from each of your steps…
    14. 14. Our target audiencesYoung people who use Makaton signs to help them with their communication
    15. 15. Why choose Makaton?BSL MakatonThousands of signs (> 21,000) Hundreds of signsIndividual sign vocab (> 5,000) Individual sign vocab < 200Long sequences of signs 1 or 2 sign sequencesSign quality fairly uniform Sign quality very variable, plus personal (idiosyncratic) signsMany competing teams Very few competing teams
    16. 16. User-Centred Dev approach Engagement through a character and humour… Inspiration: Talking Tom
    17. 17. Proof of concept solutionPlay the video at: http://vimeo.com/32022176
    18. 18. Phase Two
    19. 19. Users and contexts of use Users with comms difficulties Supporters of these users: through LDs, Autism, colleagues, teachers, stroke carers, parents Signing e-Learning gameEducation Employment Independent Living
    20. 20. The potential of reverse inclusion: OXO Good Grips• Well-known pioneer of Inclusive Design in the USA• Sam Farber’s wife, a keen cook, suffered from arthritis “Why do ordinary kitchen tools hurt your hands?”• First 15 products launched in 1990• Sales growth over 35% per year from 1991 to 2002• The line has now grown to over 500 products• Over 100 design awards received Centre for Business Innovation “Connected Communities, helping you Do more with - 21 - Engineering Design Centre Less” © 2011 Centre for Business Innovation Ltd
    21. 21. Which brings us back to Siriagain… :-)
    22. 22. Find out more at:http://www.ukinect.co.uk
    23. 23. Innovation Training & support for BS8878 StandardsStrategy &research www.hassellinclusion.com
    24. 24. Contact use: jonathan@hassellinclusion.comt: @jonhassellw: www.hassellinclusion.comWith thanks to: TechDis, BISand the Technology Strategy Board

    ×