This document describes a microcontroller-based gesture vocalizer system that facilitates communication for the deaf, dumb, and blind. It consists of: 1) A data glove with bend sensors to detect finger movements 2) An accelerometer-based tilt detector to sense hand tilting 3) A gesture detector module that analyzes the bend and tilt data and identifies gestures 4) A speech synthesizer and speaker controlled by the microcontroller to vocalize the recognized gestures 5) An LCD display to show the gesture text for the deaf. The system uses microcontrollers, sensors, and other circuits to recognize static finger gestures and hand tilts and convert them into synthesized speech or displayed text.

1. MICROCONTROLL
-ER BASED
GESTURE
VOCALIZER

3. A microprocessor
with inbuilt memory
and timers
Its a converter that measures a physical
quantity and converts it into a signal which
can be read by an observer or by an
instrument

4.  Large Scale Multi-Microcontroller based system being
designed to facilitate the communication among the deaf,
dumb and blind.

5. 1.DATA GLOVE
2.TILT DETECTOR
3.GESTURE DETECTOR
4.SPEECH SYNTHESIZER
5.LCD DISPLAY

6. BEND SENSOR
TILT SENSOR

7. Data glove has five bend sensors one for each finger
Detects the static movements of finger

9. Made by using IC-555 timer(In astable mode) along
with photo transistor
It has a square wave output
Frequency of this square wave varies with bending of
bend sensor

10. Accelerometer ADXL103, used as tilt detector which
detects tilting of hand
Has an analog output varying from 1.5 volts to 3.5
volts
The output of accelerometer is provided to tilt
detection module

11. To decrease the sensitivity of the system , output of
accelerometer is amplified using additional
circuitry

12. Checks the output of accelerometer.
sends the binary data against some meaningful
gesture to gesture detection module.
Gesture vocalizer system is a dual axis system which
can detect tilt of hand in two axes.
Pipelined structure of two ADC 0804 ICs are used to
digitize the outputs of two accelerometers.

13. Two ADCs have 8-bit output , common data bus
and control lines
Pipelining of ADCs is done by using chip select pin
At a given time only one ADC is active

14. The microcontroller receives the data from two ADCs
one by one and saves them
Now the microcontroller compares these values with
predefined values in its memory to represent it’s a
meaningful gesture or not
If it is a meaningful gesture, then microcontroller
sends the data to gesture detection module

15. Most Important and core part
Microcontroller controlled circuitry
Three ports are in use(two input and one
output)
• Port 0
• Port 1
• Port 2

16. • Port 0 (Input port)
Microcontroller checks the output of first bend sensor ,
calculates its pulse width, stores this output and moves on
The bends are quantized into ten levels and the finger
must be at any of these ten levels and the system knows
how much each finger is bent.
Now the system reads the movements of all the fingers as a
whole and moves on to next step , if the bend is a
meaningful one.

17. • Port 1
• Receives 8-bit data from tilt detector and if that is a
meaningful tilt, then the gesture as a whole
(bend+tilt) is considered as a meaningful one and
generates a 8-bit data
This 8-bit data can represent 256 (28 = 256) different
gestures

18. Consists of a microcontroller, a speech synthesizer ( IC
SP0256) and a speaker
The microcontroller receives the 8-bit data from
gesture detector and determines what gesture has
been made
The speech synthesizer IC SP0256 has some
allophones

19. Allophones-Sounds that are merely phonetic variants of
the same phoneme are allophones
Eg: ’s’ of sing and the ’r ’ of ring
Each allophone has a particular address location
The microcontroller’s 8-bit address corresponds to a
particular allophone and same can be heard on speaker

20. It is useful for the deaf
Voice is represented in text form

21. The 8-bit data given by gesture detection module
is given to LCD module.
The LCD display module checks each word and
compares it with previously stored values
Based on this comparison, the microcontroller
decides what must be displayed on LCD

22. Two Accelerometers

23. Designing of wireless transceiver system for "Microcontroller and
Sensors Based Gesture Vocalizer"

24. Perfection in monitoring and sensing of the
dynamic movements involved in "Microcontroller
and Sensors Based Gesture Vocalizer“

25. The Robot control system to regulate machine activity at
remote sensitive sites

26. Basis for communication for the disabled
Conveys sign language into voice for the blind and as text
for the deaf

27. India’s population 121 million , 2.1% of population is disabled
Blind - 15 million
Deaf – 10 million
Dumb – 2.7 million
Thus if proper light is thrown on R and D for this device , every
person with the above three disabilities can communicate easily
withanyone

28. THANK YOU