uKinect: the Signed Internet - Gesture Control


Published on

Presentation at eAccess-12 (#eAccess12) on uKinect and sign recognition systems by Prof Jonathan Hassell, co-lead of uKinect project (

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Here’s a summary of what we were able to achieve in our Phase One.
  • So that’s a summary of our Phase 2 application.Thanks for you attention.And do you have any questions?
  • uKinect: the Signed Internet - Gesture Control

    1. 1. The Signed Internet – Gesture Control @jonhassell #eAccess12
    2. 2. Speech recognition is cool
    3. 3. Speech translation is cooler
    4. 4. The challenge we were set “Communication is a basic human right. Communication is the means through which we control our existence. It is the way we make friends and build relationships. It is the way we become independent and make choices. It is the way we learn” (BILD, 2007).• many scenarios exist where learners with disabilities lack independence due to an inability to communicate by speech or due to lack of motor control• communication may involve having to write down or manually input information into a device• may be manageable for communicating simple concrete things to people who are physically close• for more sophisticated communication it is slow, inadequate and ultimately disabling TechDis, BIS, TSB SBRI ‘Making Waves’ competition
    5. 5. Vision“If signs and gestures can beeasily learned, recognizedand converted to digital data,a whole new world ofopportunity opens up.”
    6. 6. The ideal
    7. 7. The “breakthrough” • to-translate-sign-language-into-speech and events/Fulbright/2012/may/0529MyVoice.php
    8. 8. Some“breakthroughs” The progress in Aberdeen• The PSLT team apologised for not being able to make it today…• Check out: for further details
    9. 9. It takes time… – cf. SiriSpeech recognition was able to The intelligence has been worked onunderstand digits in the 50s… for at least 10 years
    10. 10. The problem We had 6 months…
    11. 11. Our approach Great TechnologyUser needs innovations possibilities User-focused innovation
    12. 12. The way aheadFind a breakthroughtechnology enabler
    13. 13. The way ahead Find people who can benefit from each of your steps…
    14. 14. Our target audiencesYoung people who use Makaton signs to help them with their communication
    15. 15. Why choose Makaton?BSL MakatonThousands of signs (> 21,000) Hundreds of signsIndividual sign vocab (> 5,000) Individual sign vocab < 200Long sequences of signs 1 or 2 sign sequencesSign quality fairly uniform Sign quality very variable, plus personal (idiosyncratic) signsMany competing teams Very few competing teams
    16. 16. User-Centred Dev approach Engagement through a character and humour… Inspiration: Talking Tom
    17. 17. Proof of concept solutionPlay the video at:
    18. 18. Phase Two
    19. 19. Users and contexts of use Users with comms difficulties Supporters of these users: through LDs, Autism, colleagues, teachers, stroke carers, parents Signing e-Learning gameEducation Employment Independent Living
    20. 20. The potential of reverse inclusion: OXO Good Grips• Well-known pioneer of Inclusive Design in the USA• Sam Farber’s wife, a keen cook, suffered from arthritis “Why do ordinary kitchen tools hurt your hands?”• First 15 products launched in 1990• Sales growth over 35% per year from 1991 to 2002• The line has now grown to over 500 products• Over 100 design awards received Centre for Business Innovation “Connected Communities, helping you Do more with - 21 - Engineering Design Centre Less” © 2011 Centre for Business Innovation Ltd
    21. 21. Which brings us back to Siriagain… :-)
    22. 22. Find out more at:
    23. 23. Innovation Training & support for BS8878 StandardsStrategy &research
    24. 24. Contact use: jonathan@hassellinclusion.comt: @jonhassellw: www.hassellinclusion.comWith thanks to: TechDis, BISand the Technology Strategy Board