This paper propose a methode design an electronic hand glove which would help the communication between deaf and blind. There are around 285millions of visually impaired people in the world and 900,000 of deaf and blind.
3. • Introduction
• Classification of hand gesture techniques
• Different types of hand gloves
• System design
• Advantage
• Conclusion and Future scope
• References
3
CONTENTS
4. • This paper proposes a method to design an
Electronic Hand Glove which would help the
communication between deaf and blind people .
• They use sign language to communicate, but its very
difficult to use and understand.
• This model use 26 gestures of hand to communicate
albhabets and 10 more gesture to communicate
numbers.
• This would help the deaf person to communicate
with others by typing text on LCD screen through
hand gestures.
• The text is converted in to speech and the blind
person could hear and communicate.
4
INTRODUCTION
5. Hand gestures are a great way of reinforcing
what you're saying, but caution…as they may
mean different things in different cultures.
• In this the glove based technique is used as
the hand gesture recognition technique.
5
HAND GESTURE
6. 6
CLASSIFICATION OF HAND GESTURE
TECHNIQUE
Hand gesture recognition technique
Glove based
technique
Vision based
technique
Hybrid
technique
7. • Glove based technique:- It use a glove with
different type of sensors like optical, electrical etc,
this sensor based glove collects the data according to
the hand and wrist movement and then this data is
analyzed.
• Vision based:-It use a camera to capture the hand
movement and then various image processing
techniques are employed and perform the particular
task.
• Hybrid technique:-It make the system more reliable
and accurate data from both the technique are
collected and analyzed.
7
CONT …..
8. 8
DIFFERENT TYPES OF HAND GLOVES
Sayre glove
Power glove
Pinch glove
5DT data glove
Light based sensor with flexible tube
with a light source at one end and
photocell at other.
Resistive sensor are used for the over
all flexion measurement of thumb
and finger
Has electrical contacts on the fingers
and the thumb
hand flexion is determined by the
fiber optic sensor
9. ARDUINO UNO
9
SYSTEM DESIGN
8bit code word
generated
Gesture recognized
Flex sensors
Tilt sensors
TTS256 IC(text to
speech converter)
LCD Screen
Text output
LM386
amplifier
Speaker Speech output
11. 11
SYSTEM DESIGN CONT…….
• Left section of the diagram represent the input part which
contain
flex sensor and tilt sensor.
• From input unit the hand gesture is captured as an input
data which is fed to the processor unit.
• Arduino Uno which consist of a microcontroller processes
the input data and generates an 8bit code word for the
particular input hand movement data.
• This code word is matched with the predefined alphabet or
number.
• If the hand gesture is valid then corresponding character is
given to the output unit and displayed on the LCD
screen(output which can be easily read by a deaf and
dumb).
12. • Another output from the processor goes to the text to
speech converter IC. Which convert the character into
speech.
• Speech is amplified by LM386 amplifier and fed to the
speaker.
• The speech output can easily heard by a blind person.
12
.
13. Flex sensor:- Five flex sensors are used , one on each finger and
thumb.
• It is a variable whose resistance changes on bend.
• Smaller the radius of bend ,higher the resistance it offers.
• While connecting it with the processor unit ,one end is given 5V
supply and another is grounded.
• Bend of the finger resistance of the flex sensor change
output voltage from the flex sensor change analog output
converted to digital by an ADC output range assigned logic
1 and logic 0.
13
CONT ….
14. Cont…
14
• TILT SENSOR:
ADXL335 ACCELEROMERTER IS USED AS A 3
AXIS TILT SENSOR .
IT MEASURE THE ACCELERATION IN 3
DIRECTIONS X,Y,Z.
IT GIVES THE AMOUNT OF TWIST OR TILT IN
HAND IN ANY OF THE 3AXES.THE OUTPUT
VALUE RANGE BETWEEN 1.5 TO 3.5V.
15. 15
This analog voltage is converted into logic 1 and logic
0 by the processor unit and 8bit code word is made by
combining 5 outputs from each flex sensor and 3
outputs from the tilt sensor placed on the wrist of the
hand.
Speech synthesis module:- It consist of text to speech
converter IC(TTS256) , speakjet , an amplifier
(LM386) , and a speaker
The TTS256 IC converts the ASCII character into
codes which are then fed to speakjet for
corresponding sound conversion.
This voice is amplified by LM386 amplifier and
finally we get the output through speaker.
20. • Low cost
• Easy to implement
• Useful for handling emergency conditioning
• It provide communication between deaf and blind.
20
ADVANTAGES
21. • A relaible and efficient system has been presented which
would help the communication between deaf and blind
easily.
• The system use 38 gestures(start , end ,alphabets and
numbers).
• The system can be accommodated more gestures in
future work.
21
CONCLUSION AND FUTURE
SCOPE
22. References
22
ZIMMERMAN, THOMAS G. "OPTICAL FLEX
SENSOR." U.S. PATEN.
STURMAN DAVID J , AND DAVID ZELTZER .”A
SURVEY OF GLOVE BASED INPUT” .COMPUTER
GRAPHICS AND APPLICATIONS, IEEE.