ABOUT SIGN LANGUAGE USING AI

1. 1
I am Soumyajit Saha
I am one of the collaborator of this
project.

2. Audio to Sign Language
Converter

3. What is Sign Language ?
3
Sign Language is a visual or manual form of conveying
thoughts or messages.
Visual representation
Generally used by specially abled people (deaf
community)
The form has its own grammar and lexicon

4. Sign Languages used all over the world
4
ASL
MSL
BSL
CSL
FSL
JSL
ASL
ISL
USL

5. ASL
American Sign Language is a
natural language which is used
by the communities in the
United Sates.
5
Widely used form of Sign Language
BSL
British Sign Language is a sign
language used by the deaf
community in United Kingdom.

6. Indian Sign Language
6
In the 2000s, the Indian Deaf community
advocated for an institute focused on ISL teaching
and research.
The 11th Five Year Plan (2007-2012) acknowledged
the needs of people with hearing disabilities had
been relatively neglected.
Establishment of Indian Sign Language Research
and Training Center (ISLRTC) in 4th Oct, 2011.

7. Over five per cent of the global population —432
million adults and 34 million children —have
disabling hearing loss
7

8. A picture worth
thousand words
8
Reports indicate that 1%of children are
born with hearing impairments. It means that
about 50 children with Hearing Impaired are
born in a district of 20 lakh population, and
about 60 children are born deaf everyday in
India.

9. I am Mukesh Show
I am one of the collaborator of this
project.
9

10. Desktop project
A Simple GUI that
can be used to train
people and create
awareness about
Indian Sign
Language.
10

11. Day Light
Themes
Dark Sapphire
11

12. 12

13. I am Abhijit Das
I am one of the collaborator of this
project.
13

14. Simplified conversion process
Audio Input
14
Split Words Fetch &
Display

15. Conversion Process
15
Audio
Initially, the input is
given using the
PyAudio module and
using the
SpeechRecognition
module it is further
processed.
Split Words
The entire sentence is
split into a list of
words.
Fetch & Display
Each alphabet of the
words are fetched and
displayed using the
Pillow module.

16. Working Model
16
PYAUDIO GOOGLE API
Collecting Text
Splitting Text into
List of Words
Fetch Sign Images
Algorithm to align the
words on to a Label
Frame
Internet
END

17. I am Priyangshu Datta
I am one of the collaborator of this
project.
17

18. Drawback & Limitation
18
Internet should be well configured
The translation is one way i.e., Audio to Sign
Microphone should be checked if properly
configured
Only display resolutions with 1920 × 1080 can use
this software. Although most the modern screens
are of this resolution only

19. Resources
19
Audio to Sign Language Translation for Deaf People by
#1 Ankita Harkude, #2 Sarika Namade, #3 Shefali Patil, #4
Anita Morey from Department of Information Technology,
Usha Mittal Institute of Technology, SNDT Women's
University
International Journal of Engineering and Innovative
Technology (IJEIT) Volume 9, Issue 10, April 2020
DOI:10.17605/OSF.IO/EZ6AG

20. Mobile App
Seamless conversations
using an android app
20

21. Credits
Soumyajit Saha Mukesh Show Priyangshu Datta Abhijit Das
Shri Niladri Das
(Academic in Charge)
Scientist-D NIELIT
Agartala
DCST 2018-21 DCST 2018-21 DCST 2018-21 DCST 2018-21
21
Shri Binoy Das
(Head of the Department)
Senior Technical Officer
NIELIT Agartala
Md. Reyad Hossain
(Project Supervisor)
Computer Science Faculty
NIELIT Agartala

22. Any questions?
22