Brainstorm Interactive is developing a gesture recognition and speech application for mobile devices using the Kinect camera. Their prototype allows users to hold spoken conversations over the phone through recognized sign language gestures. It uses Kinect's gesture recognition to enable speaking on the phone for those unable to articulate speech physically. The app will also include translating speech to gestures displayed on screen, allowing deaf-mute users to communicate, and may add language translation of gestures into different languages.

1. Brainstorm Interactive

2. Brainstorm Interactive What do you do

3. Brainstorm Interactive If…

4. Brainstorm Interactive You have to answer the phone call.

5. Brainstorm Interactive But…

6. Brainstorm Interactive But… You can’t speak.

7. Brainstorm Interactive We are currently developing a gesture recognition to speech application for mobile devices using the kinect camera . Our prototype allows users to hold a normal spoken conversation over a mobile telephone through the recognition of their gestures ( sign language ). Our prototype uses the amazing gesture recognition capabilities of the kinect camera to make speaking over a telephone a possibility for those lacking the physical capability to articulate speech.

8. Brainstorm Interactive The application will include a reversed form of translation turning speech recognition into gestures that can be viewed on a screen. This feature allows for those who are mute and deaf to utilize the application as well. Additional features currently being considered are language translation allowing for gestures to be translated into any language; effectively allowing those who have never been able to use a telephone through articulated speech previously, to do so in any language they choose.

9. Brainstorm Interactive