DESIGN OF LOW COST AND EFFICIENT SIGN LANGUAGE INTERPRETER FOR THE SPEECH AND...
Sign Language Translator
1. PROJECT PROPOSAL
ON
SIGN LANGUAGE TRANSLATOR
Submitted by
Christine Paul Divya Kashyap
(4NM09EC026) (4NM09EC032)
Manjari Raj Monica
(4NM09EC051) (4NM09EC055)
Under the guidance of
Mrs. Prabha Niranjan
Assistant Professor
Department of Electronics & Communication Engineering
N.M.A.M INSTITUTE OF TECHNOLOGY, NITTE
2. STUDENT PROJECT PROPOSAL
1. Name of college and place : N.M.A.M Institute of Technology, Nitte
2. Name of the SPP Co-ordinator : Radhakrishnan K.,Chairman-EXPRO,
N.M.A.M Institute of Technology, Nitte
sppnitte@gmail.com
Phone: 08258 281263
3. Project Title : SIGN LANGUAGE TRANSLATOR
4. Department : Electronics & Communication Engineering
5. Name of guide : Mrs. Prabha Niranjan, Assistant Professor,
Dept. of Electronics & Communication
Engineering
N.M.A.M Institute of Technology,
Nitte-574110, KarkalaTaluk
sppnitte@gmail.com
Phone:08258 281263
6. Names of team members :
Christine Paul 9742517926 chrispc91@gmail.com
Divya Kashyap 9035600654 divya19kashyap@gmail.com
Manjari Raj 9483457033 manjari.raj@hotmail.com
Monica 8867341292 monicabhartiya@yahoo.com
6a.Team Leader of the Project : Monica
Contact: 8867341292
monicabhartiya@yahoo.com
7. Date of commencement of the project : 24th
October 2012
8. Probable date of completion of the project : 15th
March 2013
9. Has a similar project been carried out at your college or in any other college/
institution : Yes
10. If this project is an improvement/extention of an earlier project, please give the
title of earlier project and the year in which it was carrid out. Specify
improvements/modifications clearly : Yes it is a modification/extension of
Sign Language Translation glove
designed in 2012. This glove is limited to interpret only the 26 alphabets in
American Sign Language (ASL). Our aim is to modify so as to interpret words
and sentences, thus making it more practical.
3. 11. Is similar device/machine (outcome of the project) commercially available? If
“yes”, what is the cost per unit? Please give details: N.A
12. Objectives of the project highlighting its importance
: Given in the synopsis
13. Methodology : Given in the synopsis
14. Expected Outcome of the project : Given in the synopsis
15. Application of the Project : Given in the synopsis
16. If the project is case study/survey project, variables to be studied, criteria for
sample selection and size of sample, etc., should be furnished. A specimen
questionnaire should be attached : NA
17. In case of fabrication of related project, an engineering drawing with
dimensions/detailed design calculations (approx.) of the machine/device should
be attached to the proposal : NA
18. Budget breakup details : Given in the budget
(Name &Signature of guide) (Signature of H.O.D) with seal
(Signature of the SPP co-ordinator) (Signature of Principal) with Seal
4. SIGN LANGUAGE TRANSLATOR
Introduction: Sign language is a language through which communication is possible
without the means of acoustic sounds. Instead, sign language relies on sign
patterns, i.e., body language, orientation and movements of the arm to facilitate
understanding between people. There are perhaps around two hundred sign
languages in use around the world today. It has been estimated that there are
between 0.9 and 14 million hearing impaired in India and perhaps "one of every five
people who are deaf in the world, lives in India", making it the country with the
largest number of Deaf, and perhaps also the largest number of sign language
users.
Keeping this in mind, we aim to build a sign language translator that uses a glove
fitted with sensors that can interpret the 26 English letters, words and sentences in
American Sign Language (ASL). The portable glove uses sensors and
accelerometers to gather data on each finger’s position and the hand’s motion. The
signed alphabet is then displayed on LCD as well as pronounced through the
speakers.
Objectives:
Selection of suitable flex sensors, contact sensors and accelerometers.
Converting sensed analog signals into digital signals using suitable ICs.
Interfacing sensors, accelerometers and radio transmitter with the
microcontroller at the detection unit.
Interfacing the base station microcontroller with the receiver, LCD and
speakers.
Methodology:
The glove uses flex sensors, contact sensors and accelerometers in three
dimensions to gather data on each finger’s position and the hand’s motion to
5. differentiate the letters. The output of sensors and accelerometer are given to the
detection unit placed on the arm.
The detection unit consists of ADC (analog to digital converter) to digitize the sensed
output which is then given to the AVR based microcontroller. The translation is
transmitted to the base station using a radio transmitter connected to the
microcontroller.
The receiver at the base station receives the data and transfers it to the base station
microcontroller interfaced with LCD and speakers to display as well as pronounce
the letter respectively. The use of radio transceiver makes the glove portable and
handy.
Block Diagram :
Flow Chart for the methodology
Glove : The glove is fitted with flex sensors, contact sensors and accelerometer.
Flex Sensors : The flex sensors are variable resistors used for sensing bending
of the finger with the change in resistance value.
Contact Sensors: Contacts between the fingers are sensed using contact
sensors.
Accelerometers: Accelerometers are used for movement and orientation
detection. Specific hand motions are the only way to detect the letters J and Z.
For letters such as G and Q, the only way to distinguish between them is their
orientation--while G has the palm facing sideways, Q has the palm facing
downwards.
6. Detection Unit: Comprises of two subunits namely microcontroller detection unit
and transceiver. Input from the sensors are fed to the microcontroller which in
turn is sent to the transceiver. Transceiver at the detection unit is used for
wireless transmission of signal.
Base station: The Base Station receives its input through a radio receiver and
outputs the results to an LCD screen and a speaker set. It consists of two main
parts: transceiver and base station microcontroller. The receiver receives the
letter signed by glove and sends the letter to the microcontroller on the base
station. The base station microcontroller stored with synthesized voice signals,
converts the text to speech as well as displays the letter on LCD.
Speaker: It pronounces the corresponding signed letter.
Expected Outcome of the project:
Glove that can sense movement of fingers and orientation of hand and hence can
display and pronounce the signed alphabets, words and sentences.
Application of the Project:
Sign language translator gives a very clear and easy way of communication
among hearing-impaired, inarticulate and physically sound people.
This technology can also play an important role in various defence and
security issues wherein people have to communicate through sign languages.
The overall architecture of this system is quite simple which makes it easy
accessible to all kinds of people whether they are from technical or non-
technical background.
7. PROPOSED BUDGET FOR THE PROJECT
This may not be the actual expenditure and may cross the estimated budget as
project is developed. The extra expenditure will be borne by the project associates.
Signature of the Project Leader Signature of the Project Investigator
SL.NO Materials and consumables
Cost
Rs. Ps.
1. Flex Sensors 2.2” ( 5 units ) 2200 00
2. Accelerometer and breakout board 3250 00
3. Analog to Digital converter (6 units) 350 00
4. Microcontroller(2 units) 5000 00
5. Transceiver( 2 units) 3500 00
6. Miscellaneous 3000 00
7. Project Report 500 00
TOTAL 17800 00