The objective of this project is to provide a sensorized glove for sign language recognition for the Deaf and Dump people so that they can communicate easily with the normal persons.
Sign language is the natural language of deaf people.
Although different in form, they serve the same function as spoken languages. To all over the world, it is not a universal language.
However most people do not understand the sign language, creating gap between people and the deaf and dumb, as well as difficulties in their daily life.
In our project what we have done is we have made, we are making a kit for deaf and dumb people so that they can communicate like the normal people .
Biology for Computer Engineers Course Handout.pptx
Smart way communication with deaf and dump
1. Smart way Communication with
Deaf and Dumb
PROJECTmember:
• ARUL SAGAYARAJ .L
(93610106007)
• JEFFERIN JOBU.J
(93610106019)
• NADAR SELVEN SINGARAYAR
(93610106032)
• ABDUL AZEEZ .M
(93610106300)
2. Objective
• The objective of this project is to provide a
sensorized glove for sign language recognition
for the Deaf and Dump people so that they can
communicate easily with the normal persons.
3. Abstract
• Sign language is the natural language of deaf people.
• Although different in form, they serve the same function as spoken
languages. To all over the world, it is not a universal language.
• However most people do not understand the sign language, creating
gap between people and the deaf and dumb, as well as difficulties in
their daily life.
• In our project what we have done is we have made, we are making a
kit for deaf and dumb people so that they can communicate like the
normal people .
4. Existing system
• In sign language recognition is existing system is based on video
and image processing .
• On the input side a color video camera is used. A processor with
an integrated image processing system allows the calculation of
the feature vectors at a processing rate of 13 frames per second.
• After capture image segmentation process occurs. Segmented
image compare with train images.
• Using this Sign recognition sign will find.
5. Proposed system
• The portable device is the transduction system and consists of a glove
comprising 5 flex sensors connected to a microcontroller through front-end
electronics.
• The sensors are positioned in the glove hence the finger joints are in the
middle of the sensitive area; this way the sensor covers the finger joint area
and follows its movement.
• Doing sign language our finger will bend, each bending of finger the sensor
send signal to our controller.
• Our controller match the sensor signals with train signals. Recorded audio
sound will playback for each sign.
• Opposite person easily communicate to deaf a keypad and display is used.
6. Disadvantages of existing system
• In camera based video processing need high memory to store the
videos in real time. Segmentation error will occur, Real time error
will occur in sign recognition, High complexity.
• In Accelerometer based system based on tilting xyz direction,
not bending of figure, it cannot achieve 100% accuracy and
utilization.
13. PIC16F877A PIC CONTROLLER
FEATURES
• 10-bit, up to 8-channel analog-to-digital converter (A/D)
• 256 x 8-bit internal ram
• 33 programmable i/o lines
• Two analog comparators
• one 16 bit timer/counter and two 8 bit timer/counter
• Low-power, high-speed Flash/EEPROM technology
• Fully static design
• Wide operating voltage range (2.0V to 5.5V)
• Commercial and Industrial temperature ranges
14. The AT89S52 is a low-power, high-performance CMOS 8-bit
microcomputer with 8K bytes of Flash programmable and erasable read
only memory (PEROM).
• Compatible with MCS-51™ Products.
• 8K Bytes of In-System Reprogrammable Flash Memory.
• Endurance: 10,000 Write/Erase Cycles.
• Fully Static Operation: 0 Hz to 24 MHz
• Three-level Program Memory Lock.
• 256 x 8-bit Internal RAM.
• 32 Programmable I/O Lines.
• Three 16-bit Timer/Counters.
• Eight Interrupt Sources.
• Programmable Serial Channel.
• Low-power Idle and Power-down Modes.
Features of AT89S52
15. Flex sensor
• A simple flex sensor 4.5" in length. As the sensor is flexed, the resistance
across the sensor increases.
Features
• Angle Displacement Measurement
• Bends and Flexes physically with motion device
Possible Uses
• Robotics
• Gaming (Virtual Motion)
• Medical Devices
• Computer Peripherals
• Musical Instruments
• Physical Therapy
• Simple Construction
• Low Profile
16. LCD Display
• LCD (Liquid Crystal Display) screen is an electronic display module and find a
wide range of applications.
• LCD display is very basic module and is very commonly used in various
devices and circuits. These modules are preferred over seven segments and
other multi segment LEDs.
• The reasons being: LCDs are economical easily programmable have no
limitation of displaying special & even custom characters (unlike in seven
segments),animations and many more..
• A lxm LCD means it can display l characters per line and there are m such lines.
In this LCD each character is displayed in 5x7 pixel matrix. This LCD has two
registers, namely, Command and Data.
17. Voice play back kit
• Up to 7 kinds of operation modes : MP3 mode, one on one key mode,
parallel mode, one record one play key mode , e-book mode, two-wire
serial mode and three-wire serial mode
• Support upload and download voice via USB.
• Support playback the high-quality voice downloaded from computer
• Can record up to 252 segment voice (including fixed voice).
• With power-down save data function
• Support key and MCU control.
18. Power supply
• This circuit is a small +5V power supply, which is useful when
experimenting with digital electronics, and easy to build.
• Small inexpensive wall transformers with variable output voltage are
available from any electronics shop and supermarket.
• Those transformers are easily available, but usually their voltage regulation
is very poor, which makes then not very usable for digital circuit
experimenter unless a better regulation can be achieved in some way.
• The following circuit is the answer to the problem.
• This circuit can give +5V output at about 150 mA current, but it can be
increased to 1 A when good cooling is added to 7805 regulator chip. The
circuit has over overload and terminal protection.
20. RESULT ANALYSIS
F1 (v) F2(v) F3(v) F4(v) F5(v) SYMBOL
1.6 1.6 1.3 1.2 1 A
1.4 1.8 1.8 1.6 1.4 B
1.6 1.8 1.7 1.6 1.4 C
1.4 1.8 1.4 1.3 1.2 D
1.4 1.7 1.4 1.3 1.1 E
• F1-F5- FIVE FINGER
• A-E- ALPHABETICAL
SYMBOL
TABLE : Analog voltage of each finger
24. Expected output
The Sensorized glove is worn by a deaf person, he will do a
sign language, For each sign the audio will playback and
character will display.
Opposite person have keypad, he type the character and we
will get visual format to answer or ask querries
25. Advantages
• Low cost
• Compact system
• Flexible to users
• It takes less power to operate system
26. Applications
1) The recognition of sign language.
2) The diagnostic measurement of the finger movement
at a distance and
3) The interaction with virtual reality.
27. Future scope
• Increasing the number of flex sensors delay can be reduced .
• By using advanced controller an processor the processing
speed can be used