SlideShare a Scribd company logo
HANDTALK
PRESENTATION BY: GAURAV RAJESH (1017415)
JOSEPH EMMANUEL (1017417)
SHRUTHI S (1017430)
Abstract:
It is well-known that deaf and mute people find it very challenging to
interact with those who are different from them. HandTalk unleashes as
a novel technology that can aid those differently-able (deaf and mute)
who have difficulty in communicating with others. The existing gesture
recognition gloves might solve the problem but they are very expensive.
HandTalk comes into play at this point as a problem-solver; it is accurate
and inexpensive.
Introduction:
Of all the available Sign Languages, The American Sign Language (ASL) serves
as the major form of communicative method for the deaf and mute in most
communities.
By incorporating the ASL in a portable device, the gestures made by the user
can be recognized accurately by developing reliable software meant to serve
its purpose.
By ‘serve its purpose’, we mean that the software is capable of detecting the
gestures made by the user and mapping those recognized gestures into
appropriate alphabets/words and then ultimately converting those text into
speech.
Requirements
Hardware
◦ P5 virtual glove
◦ IR receiver
◦ Computer with minimum of 512 MB RAM and 100 MB Free HDD Space.
Software
◦ Text to speech synthesizer
◦ To convert gestures to text
UI
P5 Virtual Reality Glove
3D and virtual environments
proprietary bend sensor
Motivation
250-300 million peoples.
Indian situations.
Worldwide situations.
The Design:
We characterised four main modules that comprises the system.
1. The UI module deals with the P5 glove, its features and composition, and
its interaction with the system.
2. The Communication module accounts for the mode of communication
technology employed; which is Infrared that is bundled with the P5 glove.
3. The Processing module is the vital one where the major actions such as
the finger bend data being received constantly and interpreted with the
software, which looks into the gesture dictionary and once matched would
pop out the appropriate text data. The textual data that is given out is
further taken by a speech synthesizer which transforms into audio and
made available to the users.
4. The Output module does only have a very minor role when compared
with the other three; its main concern is the delivery of the output to the
user.
CONVERSION DELAY
TEXT PREVIEW AND
LOWER GESTURE PREVIEW
TIME
SWITCH FREE SUPPORT
FOR GESTURE DICTIONARY
EDITABLE GESTURE DATABASE
INSTANT SPEECH
SPEAK ANYTIME
The User Interface:
HandTalk uses component off-the-shelf (COTS) called P5 Virtual Reality Glove
which is mainly used for 3D gaming.
User-friendly interface that the deaf can use to interact with the software to
get what they want.
It is inexpensive, light-weight and portable which fits into every aspect of our
scheme.
The glove is built upon flex sensors, as its name indicates, the sensors are
flexible and it works on the unique property of its resistance being varied
depending upon the degree of the finger bends.
The glove is embedded with eight infrared transmission points which
constantly transfer data to the IR module which in turn is connected to the
computer through a USB port.
Problems with existing system
Meta Motion’s Data Glove Series and UC Berkeley’s Accelerating Glove
Sensing prototype
Expensive
Only gesture recognition.
Time delay problem.
Buffer problem
AND MORE…!
Future enhancements:
 Wired glove into Wireless glove.
 Bluetooth instead of Infrared.
 Mobile replaces laptop.
 Support for Natural Language Processing.
 Embedded Chip.
Literature survey
Isaac Garcia Incertis, Jaime Gomez Garcia-Bermejo, Eduardo Zalama Casanova, "Hand
Gesture Recognition for Deaf People Interfacing," icpr, vol. 2, pp.100-103, 18th
International Conference on Pattern Recognition (ICPR'06) Volume 2, 2006.
John Kangchun Perng, Brian Fisher, Seth Hollar, Kristofer S.J. Pister, "Acceleration Sensing
Glove," iswc, pp.178, Third International Symposium on Wearable Computers (ISWC'99),
1999
Ali Farhadi, David Forsyth, Ryan White, "Transfer Learning in Sign language," cvpr, pp.1-8,
2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007
Jiyong Ma, Wen Gao, Jiangqin Wu, Chunli Wang, "A Continuous Chinese Sign Language Recognition System," fg,
pp.428, Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), 2000
Sylvie C.W. Ong, Surendra Ranganath, "Automatic Sign Language Analysis: A Survey and the Future beyond
Lexical Meaning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 873-891,
June 2005, doi:10.1109/TPAMI.2005.112
”Experiments in Virtual Reality” by David Harrison and Mark Jaques.
Year of Publication: 1996, Publisher: Butterworth-Heinemann (Newton, USA)
”The Virtual Reality Homebrewer’s Handbook” by Robin Hollands, Sean Clark and Chris Hand
Year of Publication: 1996, Publisher: John Wiley & Sons, Inc. (New York, USA)
http://www.cwonline.com
”The American Sign Language Handshape Dictionary” by Richard A. Tennant and Marianne Gluszak Brown.
Year of Publication: 1998, Publisher: Gallaudet University Press
THANK YOU

More Related Content

What's hot

Smart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year reportSmart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year report
MUHAMMAD NOMAN KHAN
 
Electronic Hand Glove for Speed Impaired and Paralyzed Patients
Electronic Hand Glove for Speed Impaired and Paralyzed PatientsElectronic Hand Glove for Speed Impaired and Paralyzed Patients
Electronic Hand Glove for Speed Impaired and Paralyzed Patients
IEEEP Karachi
 
Deaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition SystemDeaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition System
Praveena T
 
Microcontroller Based Sign Language Glove
Microcontroller Based Sign Language GloveMicrocontroller Based Sign Language Glove
Microcontroller Based Sign Language Glove
ijsrd.com
 
Electronic hand glove for deaf and blindppt
Electronic hand glove for deaf and blindpptElectronic hand glove for deaf and blindppt
Electronic hand glove for deaf and blindppt
gtsooka
 
Conversion of sign language to speech using kinect
Conversion of sign language to speech using kinectConversion of sign language to speech using kinect
Conversion of sign language to speech using kinect
rajaganapathy28091100
 
Sign language recognition for deaf and dumb people
Sign language recognition for deaf and dumb peopleSign language recognition for deaf and dumb people
Sign language recognition for deaf and dumb people
eSAT Publishing House
 
Talking gloves
Talking glovesTalking gloves
Talking gloves
atulnitrkl
 
Mp r 3(final)
Mp r 3(final)Mp r 3(final)
Mp r 3(final)
asampalli vasavi
 
sign language recognition using HMM
sign language recognition using HMMsign language recognition using HMM
sign language recognition using HMM
veegrrl
 
Sign Language Translator
Sign Language TranslatorSign Language Translator
Sign Language Translator
Manjari Raj
 
Enable talk
Enable talkEnable talk
Enable talk
slmnsvn
 
IRJET- Smart Hand Gloves for Disable People
IRJET-  	  Smart Hand Gloves for Disable PeopleIRJET-  	  Smart Hand Gloves for Disable People
IRJET- Smart Hand Gloves for Disable People
IRJET Journal
 
TALK GLOVES.
TALK GLOVES.TALK GLOVES.
TALK GLOVES.
KANISHK
 
Sign language translator ieee power point
Sign language translator ieee power pointSign language translator ieee power point
Sign language translator ieee power point
Madhuri Yellapu
 
Enable talk
Enable talkEnable talk
Enable talk
slmnsvn
 
Enable talk project
Enable talk projectEnable talk project
Enable talk project
slmnsvn
 
Computer control using hand gestures
Computer control using hand gesturesComputer control using hand gestures
Computer control using hand gestures
RohithND
 
Microcontroll er based gesture vocalizer
Microcontroll er based gesture vocalizerMicrocontroll er based gesture vocalizer
Microcontroll er based gesture vocalizer
PRADEEP Cheekatla
 
Apr9600
Apr9600Apr9600
Apr9600
Hamed Raza
 

What's hot (20)

Smart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year reportSmart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year report
 
Electronic Hand Glove for Speed Impaired and Paralyzed Patients
Electronic Hand Glove for Speed Impaired and Paralyzed PatientsElectronic Hand Glove for Speed Impaired and Paralyzed Patients
Electronic Hand Glove for Speed Impaired and Paralyzed Patients
 
Deaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition SystemDeaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition System
 
Microcontroller Based Sign Language Glove
Microcontroller Based Sign Language GloveMicrocontroller Based Sign Language Glove
Microcontroller Based Sign Language Glove
 
Electronic hand glove for deaf and blindppt
Electronic hand glove for deaf and blindpptElectronic hand glove for deaf and blindppt
Electronic hand glove for deaf and blindppt
 
Conversion of sign language to speech using kinect
Conversion of sign language to speech using kinectConversion of sign language to speech using kinect
Conversion of sign language to speech using kinect
 
Sign language recognition for deaf and dumb people
Sign language recognition for deaf and dumb peopleSign language recognition for deaf and dumb people
Sign language recognition for deaf and dumb people
 
Talking gloves
Talking glovesTalking gloves
Talking gloves
 
Mp r 3(final)
Mp r 3(final)Mp r 3(final)
Mp r 3(final)
 
sign language recognition using HMM
sign language recognition using HMMsign language recognition using HMM
sign language recognition using HMM
 
Sign Language Translator
Sign Language TranslatorSign Language Translator
Sign Language Translator
 
Enable talk
Enable talkEnable talk
Enable talk
 
IRJET- Smart Hand Gloves for Disable People
IRJET-  	  Smart Hand Gloves for Disable PeopleIRJET-  	  Smart Hand Gloves for Disable People
IRJET- Smart Hand Gloves for Disable People
 
TALK GLOVES.
TALK GLOVES.TALK GLOVES.
TALK GLOVES.
 
Sign language translator ieee power point
Sign language translator ieee power pointSign language translator ieee power point
Sign language translator ieee power point
 
Enable talk
Enable talkEnable talk
Enable talk
 
Enable talk project
Enable talk projectEnable talk project
Enable talk project
 
Computer control using hand gestures
Computer control using hand gesturesComputer control using hand gestures
Computer control using hand gestures
 
Microcontroll er based gesture vocalizer
Microcontroll er based gesture vocalizerMicrocontroll er based gesture vocalizer
Microcontroll er based gesture vocalizer
 
Apr9600
Apr9600Apr9600
Apr9600
 

Viewers also liked

Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
PrachiWadekar
 
Smart glove
Smart gloveSmart glove
Smart glove
Sahil Rohilla
 
Dumb & Deaf School
Dumb & Deaf SchoolDumb & Deaf School
Dumb & Deaf School
Venkat Pola
 
Quick tutorial on IEEE 754 FLOATING POINT representation
Quick tutorial on IEEE 754 FLOATING POINT representationQuick tutorial on IEEE 754 FLOATING POINT representation
Quick tutorial on IEEE 754 FLOATING POINT representation
Ritu Ranjan Shrivastwa
 
GESTURE RECOGNITION TECHNOLOGY
GESTURE RECOGNITION TECHNOLOGYGESTURE RECOGNITION TECHNOLOGY
GESTURE RECOGNITION TECHNOLOGY
jinal thakrar
 
Deaf and dumb
Deaf and dumbDeaf and dumb
Deaf and dumb
Mariam Khalid
 
Sign Language in Communication
Sign Language in CommunicationSign Language in Communication
Sign Language in Communication
Meera Hapaliya
 
Deaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing PresentationDeaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing Presentation
ArtfulArtsyAmy
 
Gesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPTGesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPT
Suraj Rai
 
Hearing loss ppt final
Hearing loss ppt finalHearing loss ppt final
Hearing loss ppt final
Centennial College
 
Sign language recognizer
Sign language recognizerSign language recognizer
Sign language recognizer
Bikash Chandra Karmokar
 
What Is Sign Language
What Is Sign LanguageWhat Is Sign Language
What Is Sign Language
Arun Rao
 
Sign language ppt
Sign language pptSign language ppt
Sign language ppt
Amina Magaji
 

Viewers also liked (13)

Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
 
Smart glove
Smart gloveSmart glove
Smart glove
 
Dumb & Deaf School
Dumb & Deaf SchoolDumb & Deaf School
Dumb & Deaf School
 
Quick tutorial on IEEE 754 FLOATING POINT representation
Quick tutorial on IEEE 754 FLOATING POINT representationQuick tutorial on IEEE 754 FLOATING POINT representation
Quick tutorial on IEEE 754 FLOATING POINT representation
 
GESTURE RECOGNITION TECHNOLOGY
GESTURE RECOGNITION TECHNOLOGYGESTURE RECOGNITION TECHNOLOGY
GESTURE RECOGNITION TECHNOLOGY
 
Deaf and dumb
Deaf and dumbDeaf and dumb
Deaf and dumb
 
Sign Language in Communication
Sign Language in CommunicationSign Language in Communication
Sign Language in Communication
 
Deaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing PresentationDeaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing Presentation
 
Gesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPTGesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPT
 
Hearing loss ppt final
Hearing loss ppt finalHearing loss ppt final
Hearing loss ppt final
 
Sign language recognizer
Sign language recognizerSign language recognizer
Sign language recognizer
 
What Is Sign Language
What Is Sign LanguageWhat Is Sign Language
What Is Sign Language
 
Sign language ppt
Sign language pptSign language ppt
Sign language ppt
 

Similar to Project handtalk

Survey Paper on Raspberry pi based Assistive Device for Communication between...
Survey Paper on Raspberry pi based Assistive Device for Communication between...Survey Paper on Raspberry pi based Assistive Device for Communication between...
Survey Paper on Raspberry pi based Assistive Device for Communication between...
IRJET Journal
 
Hand Gesture Vocalizer
Hand Gesture VocalizerHand Gesture Vocalizer
Hand Gesture Vocalizer
ijtsrd
 
A Translation Device for the Vision Based Sign Language
A Translation Device for the Vision Based Sign LanguageA Translation Device for the Vision Based Sign Language
A Translation Device for the Vision Based Sign Language
ijsrd.com
 
Artificial Intelligence for Speech Recognition
Artificial Intelligence for Speech RecognitionArtificial Intelligence for Speech Recognition
Artificial Intelligence for Speech Recognition
RHIMRJ Journal
 
Two-Column Newsletter
Two-Column NewsletterTwo-Column Newsletter
Two-Column Newsletter
Jessica Zurawicz
 
Glove based wearable devices for sign language-GloSign
Glove based wearable devices for sign language-GloSignGlove based wearable devices for sign language-GloSign
Glove based wearable devices for sign language-GloSign
IAESIJAI
 
AlterEgo: A Personalized Wearable Silent Speech Interface
AlterEgo: A Personalized Wearable Silent Speech InterfaceAlterEgo: A Personalized Wearable Silent Speech Interface
AlterEgo: A Personalized Wearable Silent Speech Interface
eraser Juan José Calderón
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
bodapatigopi8531
 
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
Journal For Research
 
Gesture Vocalizer
Gesture VocalizerGesture Vocalizer
Gesture Vocalizer
IJMTST Journal
 
IRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart GloveIRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart Glove
IRJET Journal
 
Electronic Hand Glove Through Gestures For Verbally Challenged Persons
Electronic Hand Glove Through Gestures For Verbally Challenged PersonsElectronic Hand Glove Through Gestures For Verbally Challenged Persons
Electronic Hand Glove Through Gestures For Verbally Challenged Persons
IJERA Editor
 
183
183183
Review Paper on Two Way Communication System with Binary Code Medium for Peop...
Review Paper on Two Way Communication System with Binary Code Medium for Peop...Review Paper on Two Way Communication System with Binary Code Medium for Peop...
Review Paper on Two Way Communication System with Binary Code Medium for Peop...
IRJET Journal
 
gesture-recognition
gesture-recognitiongesture-recognition
gesture-recognition
Venkat RAGHAVENDRA REDDY
 
Procedia Computer Science 94 ( 2016 ) 295 – 301 Avail.docx
 Procedia Computer Science   94  ( 2016 )  295 – 301 Avail.docx Procedia Computer Science   94  ( 2016 )  295 – 301 Avail.docx
Procedia Computer Science 94 ( 2016 ) 295 – 301 Avail.docx
aryan532920
 
Finger reader
Finger readerFinger reader
Finger reader
yamini rayalu
 
Wireless and uninstrumented communication by gestures for deaf and mute based...
Wireless and uninstrumented communication by gestures for deaf and mute based...Wireless and uninstrumented communication by gestures for deaf and mute based...
Wireless and uninstrumented communication by gestures for deaf and mute based...
IOSR Journals
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language Translation
PARNIKA GUPTA
 
Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer Interfaces
Jeffrey Funk
 

Similar to Project handtalk (20)

Survey Paper on Raspberry pi based Assistive Device for Communication between...
Survey Paper on Raspberry pi based Assistive Device for Communication between...Survey Paper on Raspberry pi based Assistive Device for Communication between...
Survey Paper on Raspberry pi based Assistive Device for Communication between...
 
Hand Gesture Vocalizer
Hand Gesture VocalizerHand Gesture Vocalizer
Hand Gesture Vocalizer
 
A Translation Device for the Vision Based Sign Language
A Translation Device for the Vision Based Sign LanguageA Translation Device for the Vision Based Sign Language
A Translation Device for the Vision Based Sign Language
 
Artificial Intelligence for Speech Recognition
Artificial Intelligence for Speech RecognitionArtificial Intelligence for Speech Recognition
Artificial Intelligence for Speech Recognition
 
Two-Column Newsletter
Two-Column NewsletterTwo-Column Newsletter
Two-Column Newsletter
 
Glove based wearable devices for sign language-GloSign
Glove based wearable devices for sign language-GloSignGlove based wearable devices for sign language-GloSign
Glove based wearable devices for sign language-GloSign
 
AlterEgo: A Personalized Wearable Silent Speech Interface
AlterEgo: A Personalized Wearable Silent Speech InterfaceAlterEgo: A Personalized Wearable Silent Speech Interface
AlterEgo: A Personalized Wearable Silent Speech Interface
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
HCI BASED APPLICATION FOR PLAYING COMPUTER GAMES | J4RV4I1014
 
Gesture Vocalizer
Gesture VocalizerGesture Vocalizer
Gesture Vocalizer
 
IRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart GloveIRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart Glove
 
Electronic Hand Glove Through Gestures For Verbally Challenged Persons
Electronic Hand Glove Through Gestures For Verbally Challenged PersonsElectronic Hand Glove Through Gestures For Verbally Challenged Persons
Electronic Hand Glove Through Gestures For Verbally Challenged Persons
 
183
183183
183
 
Review Paper on Two Way Communication System with Binary Code Medium for Peop...
Review Paper on Two Way Communication System with Binary Code Medium for Peop...Review Paper on Two Way Communication System with Binary Code Medium for Peop...
Review Paper on Two Way Communication System with Binary Code Medium for Peop...
 
gesture-recognition
gesture-recognitiongesture-recognition
gesture-recognition
 
Procedia Computer Science 94 ( 2016 ) 295 – 301 Avail.docx
 Procedia Computer Science   94  ( 2016 )  295 – 301 Avail.docx Procedia Computer Science   94  ( 2016 )  295 – 301 Avail.docx
Procedia Computer Science 94 ( 2016 ) 295 – 301 Avail.docx
 
Finger reader
Finger readerFinger reader
Finger reader
 
Wireless and uninstrumented communication by gestures for deaf and mute based...
Wireless and uninstrumented communication by gestures for deaf and mute based...Wireless and uninstrumented communication by gestures for deaf and mute based...
Wireless and uninstrumented communication by gestures for deaf and mute based...
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language Translation
 
Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer Interfaces
 

Project handtalk

  • 1. HANDTALK PRESENTATION BY: GAURAV RAJESH (1017415) JOSEPH EMMANUEL (1017417) SHRUTHI S (1017430)
  • 2. Abstract: It is well-known that deaf and mute people find it very challenging to interact with those who are different from them. HandTalk unleashes as a novel technology that can aid those differently-able (deaf and mute) who have difficulty in communicating with others. The existing gesture recognition gloves might solve the problem but they are very expensive. HandTalk comes into play at this point as a problem-solver; it is accurate and inexpensive.
  • 3. Introduction: Of all the available Sign Languages, The American Sign Language (ASL) serves as the major form of communicative method for the deaf and mute in most communities. By incorporating the ASL in a portable device, the gestures made by the user can be recognized accurately by developing reliable software meant to serve its purpose. By ‘serve its purpose’, we mean that the software is capable of detecting the gestures made by the user and mapping those recognized gestures into appropriate alphabets/words and then ultimately converting those text into speech.
  • 4. Requirements Hardware ◦ P5 virtual glove ◦ IR receiver ◦ Computer with minimum of 512 MB RAM and 100 MB Free HDD Space. Software ◦ Text to speech synthesizer ◦ To convert gestures to text
  • 5. UI P5 Virtual Reality Glove 3D and virtual environments proprietary bend sensor
  • 6. Motivation 250-300 million peoples. Indian situations. Worldwide situations.
  • 7. The Design: We characterised four main modules that comprises the system. 1. The UI module deals with the P5 glove, its features and composition, and its interaction with the system. 2. The Communication module accounts for the mode of communication technology employed; which is Infrared that is bundled with the P5 glove. 3. The Processing module is the vital one where the major actions such as the finger bend data being received constantly and interpreted with the software, which looks into the gesture dictionary and once matched would pop out the appropriate text data. The textual data that is given out is further taken by a speech synthesizer which transforms into audio and made available to the users. 4. The Output module does only have a very minor role when compared with the other three; its main concern is the delivery of the output to the user.
  • 8.
  • 9. CONVERSION DELAY TEXT PREVIEW AND LOWER GESTURE PREVIEW TIME SWITCH FREE SUPPORT FOR GESTURE DICTIONARY EDITABLE GESTURE DATABASE INSTANT SPEECH SPEAK ANYTIME
  • 10. The User Interface: HandTalk uses component off-the-shelf (COTS) called P5 Virtual Reality Glove which is mainly used for 3D gaming. User-friendly interface that the deaf can use to interact with the software to get what they want. It is inexpensive, light-weight and portable which fits into every aspect of our scheme. The glove is built upon flex sensors, as its name indicates, the sensors are flexible and it works on the unique property of its resistance being varied depending upon the degree of the finger bends. The glove is embedded with eight infrared transmission points which constantly transfer data to the IR module which in turn is connected to the computer through a USB port.
  • 11.
  • 12. Problems with existing system Meta Motion’s Data Glove Series and UC Berkeley’s Accelerating Glove Sensing prototype Expensive Only gesture recognition. Time delay problem. Buffer problem
  • 13.
  • 14. AND MORE…! Future enhancements:  Wired glove into Wireless glove.  Bluetooth instead of Infrared.  Mobile replaces laptop.  Support for Natural Language Processing.  Embedded Chip.
  • 15.
  • 16.
  • 17. Literature survey Isaac Garcia Incertis, Jaime Gomez Garcia-Bermejo, Eduardo Zalama Casanova, "Hand Gesture Recognition for Deaf People Interfacing," icpr, vol. 2, pp.100-103, 18th International Conference on Pattern Recognition (ICPR'06) Volume 2, 2006. John Kangchun Perng, Brian Fisher, Seth Hollar, Kristofer S.J. Pister, "Acceleration Sensing Glove," iswc, pp.178, Third International Symposium on Wearable Computers (ISWC'99), 1999 Ali Farhadi, David Forsyth, Ryan White, "Transfer Learning in Sign language," cvpr, pp.1-8, 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007
  • 18. Jiyong Ma, Wen Gao, Jiangqin Wu, Chunli Wang, "A Continuous Chinese Sign Language Recognition System," fg, pp.428, Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), 2000 Sylvie C.W. Ong, Surendra Ranganath, "Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 873-891, June 2005, doi:10.1109/TPAMI.2005.112 ”Experiments in Virtual Reality” by David Harrison and Mark Jaques. Year of Publication: 1996, Publisher: Butterworth-Heinemann (Newton, USA) ”The Virtual Reality Homebrewer’s Handbook” by Robin Hollands, Sean Clark and Chris Hand Year of Publication: 1996, Publisher: John Wiley & Sons, Inc. (New York, USA) http://www.cwonline.com ”The American Sign Language Handshape Dictionary” by Richard A. Tennant and Marianne Gluszak Brown. Year of Publication: 1998, Publisher: Gallaudet University Press