SlideShare a Scribd company logo
Globallianz Solution 9021077617
Sign Language Glove with Voice (Hand Talk)
There are some people who don’t have the ability to speak or they lose it in an accident. They
find it difficult to express their thoughts or to convey their message to other people.
In this project we propose a Sign Language Glove which will assist those people who are
suffering for any kind of speech defect to communicate through gestures i.e. with the help of
single handed sign language the user will make gestures of alphabets. The glove will record all
the gestures made by the user and then it will translate these gestures into visual form as well as
in audio form.
This project uses PIC controller to control all the processes and flex sensors along with
accelerometer sensors will track the movement of fingers as well as entire palm. A LCD will be
used to display the user’s gesture and a speaker to translate the gesture into audio signal is
planned if possible for execution. This project can be further developed to recognize complex
like food, water, etc.
Globallianz Solution 9021077617
Abstract
Technology has always been of great help to the disabled and given them a helping hand
to allow them to live a normal and healthy life like others. we have come up with a novel idea of
a glove named Handtalk that will convert hand movements into text and allow the deaf to
express themselves better.
The Handtalk glove needs to be worn on the hand by the deaf or mute person and depending on
the variation of movement, the device will convert it intelligently into voice for the other person
to comprehend it easily.
The Handtalk glove senses the movements through the flex sensors pads which detect the
different patterns of motion and the way the finger curls. The device can sense carefully each
resistance and each movement made by the hand. Currently the device can convert only few
words, but depending on the success of this device few more additional words may be added
later onto this expressive system.
The Gestures can be converted to voice by using a APR 9600 Voice storage and retrival chip.
Prerecorded voices are stored into APR Memory and when corresponding gestures are received,
the appropriate voices are reproduced by the APR through the speaker.
Globallianz Solution 9021077617
Introduction
Sign language is the language used by deaf and mute people and it is a communication
skill that uses gestures instead of sound to convey meaning simultaneously combining hand
shapes, orientations and movement of the hands, arms or body and facial expressions to express
fluidly a speaker’s thoughts. Signs are used to communicate words and sentences to audience. A
gesture in a sign language is a particular movement of the hands with a specific shape made out
of them. A sign language usually provides sign for whole words. It can also provide sign for
letters to perform words that don’t have corresponding sign in that sign language. In this project
Flex Sensor Plays the major role, Flex sensors are sensors that change in resistance depending on
the amount of bend on the sensor.
In this project we propose a Sign Language Glove which will assist those people who are
suffering for any kind of speech defect to communicate through gestures i.e. with the help of
single handed sign language the user will make gestures of alphabets. The glove will record all
the gestures made by the user and then it will translate these gestures into visual form as well as
in audio form.
This project uses PIC microcontroller to control all the processes and flex sensors along with
accelerometer sensors will track the movement of fingers as well as entire palm. A LCD will be
used to display the users gesture and a speaker to translate the gesture into audio signal is
planned if possible for execution.
This project can be further developed to recognize complex like food, water, etc.
Globallianz Solution 9021077617
PROJECT HARDWARE SPECIFICATION
GENERAL SPECIFICATION
For the system to be implemented, requirement of following different modules were considered
as the individual blocks for operation.
1. Input sensors for Hand Gesture Recognition.
2. Signal Conditioning for Data Compatibility to next Stage.
3. Microcontroller for Data Process and Action.
4. Display Device for Data and Menu Display.
5. Voice IC for audio record.
6. Audio Amplifier for Boosting Audio Level.
7. Speaker for Audio Output.
PROJECT SYSTEM SPECIFICATION
SR.
NO.
TYPE OF
COMPONENT
SPECIFICATION
1. Glove Hand Glove
2. Microcontroller PIC 16F877A
3. Flex Sensors Spectra Symbol 4.5"
4. LCD HD44780
5. Voice IC APR 9600
6. Audio Amplifier LM 386
Globallianz Solution 9021077617
BLOCK DIAGRAM
7. Signal converter LM324
8. Speaker 12v
Globallianz Solution 9021077617
Flex Sensor
Input sensor that is flex sensor plays major role. As bending angle increases resistance of
flex sensor also increases. This change in resistance will be converted into voltage change by
connecting flex sensor to potential divider circuit.
Flex sensors are normally attached to the glove using needle and thread. They require a 5-
volt input to operate and it gives output between 0 and 5 V. As bending angle of sensor increases
resistance of flex sensor also increases. As the sensor varies the output voltage changes
accordingly. The diagram of flex sensor and its graph is as shown in figure below.
The resistance of flex sensor will only change in one direction. When sensor is in not
working i.e. unflexed at that time its resistance upto 10K and for flexed sensor it will increase
upto 30k-40k.
This change in resistance will be converted in to voltage change by connecting flex sensor
potential divider circuit. Voltage divider is used to determine the output voltage levels. Voltage
across two resistances connected in series i.e. .basically resistance to voltage converter. The
resistor and flex forms a voltage divider which divides the input voltage by a ratio determined by
the variable(R1) and fixed resistors(R2)
The Flex Sensor is a unique component that changes resistance when bent. An un flexed
sensor has a nominal resistance of 10,000 ohms (10 K). As the flex sensor is bent the resistance
gradually increases. When the sensor is bent at 90 degrees its resistance will range between 30-
40 K ohms. The flex sensor may be bent greater that 360 degrees depending upon the radius of
the curve. Its operating temperature is -45F to 125F.
Globallianz Solution 9021077617
The sensor measures 1/4 inch wide, 4 1/2 inches long and only .019 inches thick!
APR Voice Kit working:
The APR9600 device offers true single-chip voice recording, non-volatile storage, and
playback capability for 40 to 60 seconds. The device supports both random and sequential access
of multiple messages. Sample rates are user-selectable, allowing designers to customize their
design for unique quality and storage time needs. Integrated output amplifier, microphone
amplifier, and AGC circuits greatly simplify system design. the device is ideal for use in portable
voice recorders, toys, and many other consumer and industrial applications. APLUS integrated
achieves these high levels of storage capability by using its proprietary analog/multilevel storage
technology implemented in an advanced Flash non-volatile memory process, where each
memory cell can store 256 voltage levels. This technology enables the APR9600 device tom
reproduce voice signals in their natural form. It eliminates the need for encoding and
compression, which often introduce distortion.
Advantages
 It requires fewer components so its cost is low.
 Small in size: Due to small size we can place its hardware on our hand easily.
 Light weight.
 Flexible to users.
 It takes less power to operate system.
 Easy to operate: Anyone can operate it easily.
 Easy to define gestures: we can add or define our own gestures.
 Communication is possible in any language.
Globallianz Solution 9021077617
Application
Data gloves can only capture the shape of the hand and not the shape or motion of
other parts of the body e.g. arm, elbows, face etc. So only postures are taken and moving
gestures are ignored.
 Physically challenged persons
 Communication between the mute peoples and the normal peoples
 Conveying information related operations
 Medical application
 In public place for announcement
Globallianz Solution 9021077617
FUTURE WORK
The completion of this prototype suggests that sensor gloves can be used for partial
sign language recognition. More sensors can be employed to recognize full sign language. A
handy and portable hardware device with built-in translating system, speakers and group of body
sensors along with the pair of data gloves can be manufactured so that a deaf and dumb
person can communicate to any normal person anywhere.
 To reduce the size of unit we can use SMD.
 High quality sensor can use.
 The range can be increased.

More Related Content

What's hot

Wireless human health Monitor
Wireless human health MonitorWireless human health Monitor
Wireless human health Monitor
Amarendra K Yadav
 
Hand talk
Hand talkHand talk
Hand talk
rakesh kumar
 
Deaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition SystemDeaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition System
Praveena T
 
Talking gloves
Talking glovesTalking gloves
Talking glovesatulnitrkl
 
Smart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year reportSmart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year report
MUHAMMAD NOMAN KHAN
 
Hand gesture recognition
Hand gesture recognitionHand gesture recognition
Hand gesture recognition
Muhammed M. Mekki
 
Magic glove( sign to voice conversion)
Magic glove( sign to voice conversion)Magic glove( sign to voice conversion)
Magic glove( sign to voice conversion)Abhilasha Jain
 
Sensors On 3d Digitization
Sensors On 3d DigitizationSensors On 3d Digitization
Sensors On 3d DigitizationRajan Kumar
 
Automatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For PatientsAutomatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For Patients
Edgefxkits & Solutions
 
Real time gesture recognition
Real time gesture recognitionReal time gesture recognition
Real time gesture recognition
Jaison2636
 
Smart way communication with deaf and dump
Smart way communication with deaf and dumpSmart way communication with deaf and dump
Smart way communication with deaf and dump
JEFFERIN JOBU
 
Heart attack and alcohol detection sensor using internet of things
Heart attack and alcohol detection sensor using internet of thingsHeart attack and alcohol detection sensor using internet of things
Heart attack and alcohol detection sensor using internet of things
EditorIJAERD
 
Hand gesture based wheel chair for disable
Hand gesture based wheel chair for disableHand gesture based wheel chair for disable
Hand gesture based wheel chair for disablevedabobbala
 
HEART ATTACK DETECTION SYSTEM
HEART ATTACK DETECTION SYSTEMHEART ATTACK DETECTION SYSTEM
HEART ATTACK DETECTION SYSTEM
achuthanandanarmeta
 
GESTURE CONTROL ROBOT
GESTURE CONTROL ROBOTGESTURE CONTROL ROBOT
GESTURE CONTROL ROBOT
Satyam Kumar
 
Gesture controled robot
Gesture controled robotGesture controled robot
Gesture controled robot
Rinil N
 
Eye gaze communication
Eye gaze communicationEye gaze communication
Eye gaze communication
PRADEEP Cheekatla
 
VOICE OPERATED WHEELCHAIR
VOICE OPERATED WHEELCHAIRVOICE OPERATED WHEELCHAIR
VOICE OPERATED WHEELCHAIRMandar Jadhav
 
Touchless touchscreen technology
Touchless touchscreen technologyTouchless touchscreen technology
Touchless touchscreen technology
MATHEW JOSEPH
 
Touchscreen PPT
Touchscreen PPTTouchscreen PPT
Touchscreen PPT
76 Degree Creative
 

What's hot (20)

Wireless human health Monitor
Wireless human health MonitorWireless human health Monitor
Wireless human health Monitor
 
Hand talk
Hand talkHand talk
Hand talk
 
Deaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition SystemDeaf and Dump Gesture Recognition System
Deaf and Dump Gesture Recognition System
 
Talking gloves
Talking glovesTalking gloves
Talking gloves
 
Smart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year reportSmart glove hand gesture vocalizer final year report
Smart glove hand gesture vocalizer final year report
 
Hand gesture recognition
Hand gesture recognitionHand gesture recognition
Hand gesture recognition
 
Magic glove( sign to voice conversion)
Magic glove( sign to voice conversion)Magic glove( sign to voice conversion)
Magic glove( sign to voice conversion)
 
Sensors On 3d Digitization
Sensors On 3d DigitizationSensors On 3d Digitization
Sensors On 3d Digitization
 
Automatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For PatientsAutomatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For Patients
 
Real time gesture recognition
Real time gesture recognitionReal time gesture recognition
Real time gesture recognition
 
Smart way communication with deaf and dump
Smart way communication with deaf and dumpSmart way communication with deaf and dump
Smart way communication with deaf and dump
 
Heart attack and alcohol detection sensor using internet of things
Heart attack and alcohol detection sensor using internet of thingsHeart attack and alcohol detection sensor using internet of things
Heart attack and alcohol detection sensor using internet of things
 
Hand gesture based wheel chair for disable
Hand gesture based wheel chair for disableHand gesture based wheel chair for disable
Hand gesture based wheel chair for disable
 
HEART ATTACK DETECTION SYSTEM
HEART ATTACK DETECTION SYSTEMHEART ATTACK DETECTION SYSTEM
HEART ATTACK DETECTION SYSTEM
 
GESTURE CONTROL ROBOT
GESTURE CONTROL ROBOTGESTURE CONTROL ROBOT
GESTURE CONTROL ROBOT
 
Gesture controled robot
Gesture controled robotGesture controled robot
Gesture controled robot
 
Eye gaze communication
Eye gaze communicationEye gaze communication
Eye gaze communication
 
VOICE OPERATED WHEELCHAIR
VOICE OPERATED WHEELCHAIRVOICE OPERATED WHEELCHAIR
VOICE OPERATED WHEELCHAIR
 
Touchless touchscreen technology
Touchless touchscreen technologyTouchless touchscreen technology
Touchless touchscreen technology
 
Touchscreen PPT
Touchscreen PPTTouchscreen PPT
Touchscreen PPT
 

Viewers also liked

Sign language translator ieee power point
Sign language translator ieee power pointSign language translator ieee power point
Sign language translator ieee power pointMadhuri Yellapu
 
Deaf dumb
Deaf dumbDeaf dumb
Deaf dumbNic Kkr
 
Sign language recognizer
Sign language recognizerSign language recognizer
Sign language recognizer
Bikash Chandra Karmokar
 
Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
PrachiWadekar
 
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGE
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGEHandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGE
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGEASHOKKUMAR RAMAR
 
Gesture controlling of Robots
Gesture controlling of Robots Gesture controlling of Robots
Gesture controlling of Robots
Jibin Poulose
 
Smart glove
Smart gloveSmart glove
Smart glove
Sapna Patil
 
Hand gesture recognition system(FYP REPORT)
Hand gesture recognition system(FYP REPORT)Hand gesture recognition system(FYP REPORT)
Hand gesture recognition system(FYP REPORT)Afnan Rehman
 
Deaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing PresentationDeaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing PresentationArtfulArtsyAmy
 
Mems based hand gesture controlled robot
Mems based hand gesture controlled robotMems based hand gesture controlled robot
Mems based hand gesture controlled robot
Sriteja Rst
 
What Is Sign Language
What Is Sign LanguageWhat Is Sign Language
What Is Sign Language
Arun Rao
 
Gesture control robot using accelerometer ppt
Gesture control robot using accelerometer pptGesture control robot using accelerometer ppt
Gesture control robot using accelerometer ppt
Rajendra Prasad
 
The Speaking Glove
The Speaking GloveThe Speaking Glove
The Speaking Glove
Menaka Jayawardena
 
Deaf dumb school contai
Deaf dumb school  contaiDeaf dumb school  contai
Deaf dumb school contailionsleaders
 
Ppt final
Ppt finalPpt final
Ppt final
julietrincy
 

Viewers also liked (19)

Deaf and dumb
Deaf and dumbDeaf and dumb
Deaf and dumb
 
Sign language translator ieee power point
Sign language translator ieee power pointSign language translator ieee power point
Sign language translator ieee power point
 
Deaf dumb
Deaf dumbDeaf dumb
Deaf dumb
 
Sign language recognizer
Sign language recognizerSign language recognizer
Sign language recognizer
 
Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
 
Sign language ppt
Sign language pptSign language ppt
Sign language ppt
 
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGE
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGEHandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGE
HandTalk: Assistive Technology for the DUMB (AMERICAN SIGN LANGUAGE
 
Gesture controlling of Robots
Gesture controlling of Robots Gesture controlling of Robots
Gesture controlling of Robots
 
Apr9600
Apr9600Apr9600
Apr9600
 
Smart glove
Smart gloveSmart glove
Smart glove
 
Hand gesture recognition system(FYP REPORT)
Hand gesture recognition system(FYP REPORT)Hand gesture recognition system(FYP REPORT)
Hand gesture recognition system(FYP REPORT)
 
Deaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing PresentationDeaf And Hard Of Hearing Presentation
Deaf And Hard Of Hearing Presentation
 
Mems based hand gesture controlled robot
Mems based hand gesture controlled robotMems based hand gesture controlled robot
Mems based hand gesture controlled robot
 
What Is Sign Language
What Is Sign LanguageWhat Is Sign Language
What Is Sign Language
 
Gesture control robot using accelerometer ppt
Gesture control robot using accelerometer pptGesture control robot using accelerometer ppt
Gesture control robot using accelerometer ppt
 
Robotic hand
Robotic handRobotic hand
Robotic hand
 
The Speaking Glove
The Speaking GloveThe Speaking Glove
The Speaking Glove
 
Deaf dumb school contai
Deaf dumb school  contaiDeaf dumb school  contai
Deaf dumb school contai
 
Ppt final
Ppt finalPpt final
Ppt final
 

Similar to Hand talk (assistive technology for dumb)- Sign language glove with voice

PPT_1.pptx
PPT_1.pptxPPT_1.pptx
PPT_1.pptx
VishalLabde
 
Gesture Vocalizer
Gesture VocalizerGesture Vocalizer
Gesture Vocalizer
IJMTST Journal
 
SPEAKING SYSTEM FOR MUTE PEOPLES present.pptx
SPEAKING SYSTEM FOR  MUTE PEOPLES present.pptxSPEAKING SYSTEM FOR  MUTE PEOPLES present.pptx
SPEAKING SYSTEM FOR MUTE PEOPLES present.pptx
ShubhamSingh606946
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language Translation
PARNIKA GUPTA
 
Microcontroller Based Sign Language Glove
Microcontroller Based Sign Language GloveMicrocontroller Based Sign Language Glove
Microcontroller Based Sign Language Glove
ijsrd.com
 
Hand Gesture Vocalizer
Hand Gesture VocalizerHand Gesture Vocalizer
Hand Gesture Vocalizer
ijtsrd
 
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
Dr.SHANTHI K.G
 
IRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart GloveIRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart Glove
IRJET Journal
 
IRJET- Smart Speaking Glove for Speech Impaired People
IRJET- Smart Speaking Glove for Speech Impaired PeopleIRJET- Smart Speaking Glove for Speech Impaired People
IRJET- Smart Speaking Glove for Speech Impaired People
IRJET Journal
 
Enable talk
Enable talkEnable talk
Enable talk
Xavier Prathap
 
IRJET- Smart Hand Gloves for Disable People
IRJET-  	  Smart Hand Gloves for Disable PeopleIRJET-  	  Smart Hand Gloves for Disable People
IRJET- Smart Hand Gloves for Disable People
IRJET Journal
 
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
IRJET Journal
 
E0ad silent sound technology
E0ad silent  sound technologyE0ad silent  sound technology
E0ad silent sound technology
Madhuri Rudra
 
IRJET- IoT based Portable Hand Gesture Recognition System
IRJET-  	  IoT based Portable Hand Gesture Recognition SystemIRJET-  	  IoT based Portable Hand Gesture Recognition System
IRJET- IoT based Portable Hand Gesture Recognition System
IRJET Journal
 
hand-talk glove.pptx
hand-talk glove.pptxhand-talk glove.pptx
hand-talk glove.pptx
MuhammadZafran34
 
Front-end for invalid people
Front-end for invalid peopleFront-end for invalid people
Front-end for invalid people
capitan_jo
 
Advanced wheel chair vatsal shah
Advanced wheel chair   vatsal shah Advanced wheel chair   vatsal shah
Advanced wheel chair vatsal shah
Vatsal N Shah
 
Iaetsd gesture
Iaetsd gestureIaetsd gesture
Iaetsd gesture
Iaetsd Iaetsd
 

Similar to Hand talk (assistive technology for dumb)- Sign language glove with voice (20)

PPT_1.pptx
PPT_1.pptxPPT_1.pptx
PPT_1.pptx
 
Gesture Vocalizer
Gesture VocalizerGesture Vocalizer
Gesture Vocalizer
 
SPEAKING SYSTEM FOR MUTE PEOPLES present.pptx
SPEAKING SYSTEM FOR  MUTE PEOPLES present.pptxSPEAKING SYSTEM FOR  MUTE PEOPLES present.pptx
SPEAKING SYSTEM FOR MUTE PEOPLES present.pptx
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language Translation
 
conference1final
conference1finalconference1final
conference1final
 
Microcontroller Based Sign Language Glove
Microcontroller Based Sign Language GloveMicrocontroller Based Sign Language Glove
Microcontroller Based Sign Language Glove
 
Hand Gesture Vocalizer
Hand Gesture VocalizerHand Gesture Vocalizer
Hand Gesture Vocalizer
 
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
 
IRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart GloveIRJET - Sign to Speech Smart Glove
IRJET - Sign to Speech Smart Glove
 
IRJET- Smart Speaking Glove for Speech Impaired People
IRJET- Smart Speaking Glove for Speech Impaired PeopleIRJET- Smart Speaking Glove for Speech Impaired People
IRJET- Smart Speaking Glove for Speech Impaired People
 
Enable talk
Enable talkEnable talk
Enable talk
 
IRJET- Smart Hand Gloves for Disable People
IRJET-  	  Smart Hand Gloves for Disable PeopleIRJET-  	  Smart Hand Gloves for Disable People
IRJET- Smart Hand Gloves for Disable People
 
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
IRJET- Smart Gloves for Hand Gesture Recognition and Translation Into Text an...
 
E0ad silent sound technology
E0ad silent  sound technologyE0ad silent  sound technology
E0ad silent sound technology
 
IRJET- IoT based Portable Hand Gesture Recognition System
IRJET-  	  IoT based Portable Hand Gesture Recognition SystemIRJET-  	  IoT based Portable Hand Gesture Recognition System
IRJET- IoT based Portable Hand Gesture Recognition System
 
hand-talk glove.pptx
hand-talk glove.pptxhand-talk glove.pptx
hand-talk glove.pptx
 
Front-end for invalid people
Front-end for invalid peopleFront-end for invalid people
Front-end for invalid people
 
iot contest file
iot contest fileiot contest file
iot contest file
 
Advanced wheel chair vatsal shah
Advanced wheel chair   vatsal shah Advanced wheel chair   vatsal shah
Advanced wheel chair vatsal shah
 
Iaetsd gesture
Iaetsd gestureIaetsd gesture
Iaetsd gesture
 

Recently uploaded

Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
Recycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part IIIRecycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part III
Aditya Rajan Patra
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
SyedAbiiAzazi1
 
digital fundamental by Thomas L.floydl.pdf
digital fundamental by Thomas L.floydl.pdfdigital fundamental by Thomas L.floydl.pdf
digital fundamental by Thomas L.floydl.pdf
drwaing
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
manasideore6
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
SamSarthak3
 
Fundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptxFundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptx
manasideore6
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Soumen Santra
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
ssuser7dcef0
 
PPT on GRP pipes manufacturing and testing
PPT on GRP pipes manufacturing and testingPPT on GRP pipes manufacturing and testing
PPT on GRP pipes manufacturing and testing
anoopmanoharan2
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Understanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine LearningUnderstanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine Learning
SUTEJAS
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
Literature Review Basics and Understanding Reference Management.pptx
Literature Review Basics and Understanding Reference Management.pptxLiterature Review Basics and Understanding Reference Management.pptx
Literature Review Basics and Understanding Reference Management.pptx
Dr Ramhari Poudyal
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
Unbalanced Three Phase Systems and circuits.pptx
Unbalanced Three Phase Systems and circuits.pptxUnbalanced Three Phase Systems and circuits.pptx
Unbalanced Three Phase Systems and circuits.pptx
ChristineTorrepenida1
 
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsKuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
Victor Morales
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 

Recently uploaded (20)

Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
Recycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part IIIRecycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part III
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
 
digital fundamental by Thomas L.floydl.pdf
digital fundamental by Thomas L.floydl.pdfdigital fundamental by Thomas L.floydl.pdf
digital fundamental by Thomas L.floydl.pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
 
Fundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptxFundamentals of Induction Motor Drives.pptx
Fundamentals of Induction Motor Drives.pptx
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
 
PPT on GRP pipes manufacturing and testing
PPT on GRP pipes manufacturing and testingPPT on GRP pipes manufacturing and testing
PPT on GRP pipes manufacturing and testing
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Understanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine LearningUnderstanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine Learning
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
Literature Review Basics and Understanding Reference Management.pptx
Literature Review Basics and Understanding Reference Management.pptxLiterature Review Basics and Understanding Reference Management.pptx
Literature Review Basics and Understanding Reference Management.pptx
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
Unbalanced Three Phase Systems and circuits.pptx
Unbalanced Three Phase Systems and circuits.pptxUnbalanced Three Phase Systems and circuits.pptx
Unbalanced Three Phase Systems and circuits.pptx
 
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsKuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 

Hand talk (assistive technology for dumb)- Sign language glove with voice

  • 1. Globallianz Solution 9021077617 Sign Language Glove with Voice (Hand Talk) There are some people who don’t have the ability to speak or they lose it in an accident. They find it difficult to express their thoughts or to convey their message to other people. In this project we propose a Sign Language Glove which will assist those people who are suffering for any kind of speech defect to communicate through gestures i.e. with the help of single handed sign language the user will make gestures of alphabets. The glove will record all the gestures made by the user and then it will translate these gestures into visual form as well as in audio form. This project uses PIC controller to control all the processes and flex sensors along with accelerometer sensors will track the movement of fingers as well as entire palm. A LCD will be used to display the user’s gesture and a speaker to translate the gesture into audio signal is planned if possible for execution. This project can be further developed to recognize complex like food, water, etc.
  • 2. Globallianz Solution 9021077617 Abstract Technology has always been of great help to the disabled and given them a helping hand to allow them to live a normal and healthy life like others. we have come up with a novel idea of a glove named Handtalk that will convert hand movements into text and allow the deaf to express themselves better. The Handtalk glove needs to be worn on the hand by the deaf or mute person and depending on the variation of movement, the device will convert it intelligently into voice for the other person to comprehend it easily. The Handtalk glove senses the movements through the flex sensors pads which detect the different patterns of motion and the way the finger curls. The device can sense carefully each resistance and each movement made by the hand. Currently the device can convert only few words, but depending on the success of this device few more additional words may be added later onto this expressive system. The Gestures can be converted to voice by using a APR 9600 Voice storage and retrival chip. Prerecorded voices are stored into APR Memory and when corresponding gestures are received, the appropriate voices are reproduced by the APR through the speaker.
  • 3. Globallianz Solution 9021077617 Introduction Sign language is the language used by deaf and mute people and it is a communication skill that uses gestures instead of sound to convey meaning simultaneously combining hand shapes, orientations and movement of the hands, arms or body and facial expressions to express fluidly a speaker’s thoughts. Signs are used to communicate words and sentences to audience. A gesture in a sign language is a particular movement of the hands with a specific shape made out of them. A sign language usually provides sign for whole words. It can also provide sign for letters to perform words that don’t have corresponding sign in that sign language. In this project Flex Sensor Plays the major role, Flex sensors are sensors that change in resistance depending on the amount of bend on the sensor. In this project we propose a Sign Language Glove which will assist those people who are suffering for any kind of speech defect to communicate through gestures i.e. with the help of single handed sign language the user will make gestures of alphabets. The glove will record all the gestures made by the user and then it will translate these gestures into visual form as well as in audio form. This project uses PIC microcontroller to control all the processes and flex sensors along with accelerometer sensors will track the movement of fingers as well as entire palm. A LCD will be used to display the users gesture and a speaker to translate the gesture into audio signal is planned if possible for execution. This project can be further developed to recognize complex like food, water, etc.
  • 4. Globallianz Solution 9021077617 PROJECT HARDWARE SPECIFICATION GENERAL SPECIFICATION For the system to be implemented, requirement of following different modules were considered as the individual blocks for operation. 1. Input sensors for Hand Gesture Recognition. 2. Signal Conditioning for Data Compatibility to next Stage. 3. Microcontroller for Data Process and Action. 4. Display Device for Data and Menu Display. 5. Voice IC for audio record. 6. Audio Amplifier for Boosting Audio Level. 7. Speaker for Audio Output. PROJECT SYSTEM SPECIFICATION SR. NO. TYPE OF COMPONENT SPECIFICATION 1. Glove Hand Glove 2. Microcontroller PIC 16F877A 3. Flex Sensors Spectra Symbol 4.5" 4. LCD HD44780 5. Voice IC APR 9600 6. Audio Amplifier LM 386
  • 5. Globallianz Solution 9021077617 BLOCK DIAGRAM 7. Signal converter LM324 8. Speaker 12v
  • 6. Globallianz Solution 9021077617 Flex Sensor Input sensor that is flex sensor plays major role. As bending angle increases resistance of flex sensor also increases. This change in resistance will be converted into voltage change by connecting flex sensor to potential divider circuit. Flex sensors are normally attached to the glove using needle and thread. They require a 5- volt input to operate and it gives output between 0 and 5 V. As bending angle of sensor increases resistance of flex sensor also increases. As the sensor varies the output voltage changes accordingly. The diagram of flex sensor and its graph is as shown in figure below. The resistance of flex sensor will only change in one direction. When sensor is in not working i.e. unflexed at that time its resistance upto 10K and for flexed sensor it will increase upto 30k-40k. This change in resistance will be converted in to voltage change by connecting flex sensor potential divider circuit. Voltage divider is used to determine the output voltage levels. Voltage across two resistances connected in series i.e. .basically resistance to voltage converter. The resistor and flex forms a voltage divider which divides the input voltage by a ratio determined by the variable(R1) and fixed resistors(R2) The Flex Sensor is a unique component that changes resistance when bent. An un flexed sensor has a nominal resistance of 10,000 ohms (10 K). As the flex sensor is bent the resistance gradually increases. When the sensor is bent at 90 degrees its resistance will range between 30- 40 K ohms. The flex sensor may be bent greater that 360 degrees depending upon the radius of the curve. Its operating temperature is -45F to 125F.
  • 7. Globallianz Solution 9021077617 The sensor measures 1/4 inch wide, 4 1/2 inches long and only .019 inches thick! APR Voice Kit working: The APR9600 device offers true single-chip voice recording, non-volatile storage, and playback capability for 40 to 60 seconds. The device supports both random and sequential access of multiple messages. Sample rates are user-selectable, allowing designers to customize their design for unique quality and storage time needs. Integrated output amplifier, microphone amplifier, and AGC circuits greatly simplify system design. the device is ideal for use in portable voice recorders, toys, and many other consumer and industrial applications. APLUS integrated achieves these high levels of storage capability by using its proprietary analog/multilevel storage technology implemented in an advanced Flash non-volatile memory process, where each memory cell can store 256 voltage levels. This technology enables the APR9600 device tom reproduce voice signals in their natural form. It eliminates the need for encoding and compression, which often introduce distortion. Advantages  It requires fewer components so its cost is low.  Small in size: Due to small size we can place its hardware on our hand easily.  Light weight.  Flexible to users.  It takes less power to operate system.  Easy to operate: Anyone can operate it easily.  Easy to define gestures: we can add or define our own gestures.  Communication is possible in any language.
  • 8. Globallianz Solution 9021077617 Application Data gloves can only capture the shape of the hand and not the shape or motion of other parts of the body e.g. arm, elbows, face etc. So only postures are taken and moving gestures are ignored.  Physically challenged persons  Communication between the mute peoples and the normal peoples  Conveying information related operations  Medical application  In public place for announcement
  • 9. Globallianz Solution 9021077617 FUTURE WORK The completion of this prototype suggests that sensor gloves can be used for partial sign language recognition. More sensors can be employed to recognize full sign language. A handy and portable hardware device with built-in translating system, speakers and group of body sensors along with the pair of data gloves can be manufactured so that a deaf and dumb person can communicate to any normal person anywhere.  To reduce the size of unit we can use SMD.  High quality sensor can use.  The range can be increased.