This document proposes developing an Android application to help hearing impaired people in Bangladesh communicate via text and animation in Bangla sign language. [1] It aims to recognize Bangla speech and convert it to sign language displayed by a virtual agent, and include a sign language keyboard to convert signs to Bangla text. [2] The application could bridge communication between deaf and hearing communities and reduce the language barrier, helping deaf persons learn sign language. [3]

1. An Android Platform for Hearing Impaired People to
Communicate with General Persons Via Text and
Animation in Bangla.
Presented By:
Afif Bin Kamrul
Roll No.: 1404065
Supervised By
Shayla Sharmin
Assistant Professor
Department of CSE
CUET

2. 2 Department of CSE, CUET
Contents
 Introduction
 Motivation
 Objectives
 Benefits
 Related Works
 Deaf and Mute Community in Bangladesh
 Challenges
 Proposed Methodology
 Conclusion
 References

3. 3 Department of CSE, CUET
Introduction
Communication:
 Verbal action
 Facial Expression
 Body gesture and posture
(Sign Language)
Deaf and Mute People
Sign language

4. 4 Department of CSE, CUET
Contd.
Disable to Hear: 466 million
people
Suffering from variable degree of hearing
loss =13 million [1]
Suffering from severe hearing loss =3 million
[1]

5. 5 Department of CSE, CUET
Motivation
Difficult to Understand
Sign Language
Few works in Bangla
based on mobile platform

6. 6 Department of CSE, CUET
Contd.
Need Friendly Medium to
understand Sign and Natural
Language

7. 7 Department of CSE, CUET
Objectives
To Develop an Android App to Bridge the Gap
between General and Hearing Impaired People.
To Recognize Bangla Speech and Convert them to
Sign Language via Virtual Agent for Deaf People.
To Develop a Sign Language Keyboard that
Converts the Sign into Bangla Text.
ছাত্র (Student)
ছয় (Six)

8. 8 Department of CSE, CUET
Benefits of Establishing Digital Translator on Android
No human translator
needed.
Ensuring effective communication
between general and deaf people.

9. 9 Department of CSE, CUET
Contd.
1406.9 millions
2022
“www.statista.com”

10. 10 Department of CSE, CUET
Related Works
 [Sarkar et al., 2009]
 Worked on converting Bangla text to Bangla sign language.
 Due to matched input text, video clips are played.
 Desktop or laptop based application.
 [Shahriar et al., 2017]
 Used CMU Sphinx speech recognition to convert Bangla
speech to Bangla sign language.
 Data to train the acoustic model for Bangla are limited.
 Displays only still sign images.

11. 11 Department of CSE, CUET
Contd.
 [Gayyar et al., 2016]
 Worked on Arabic sign language keyboard.
 Developed application which conducts local database based on
signs’ Unicode.
 [Tanvir, 2018]
 Worked on a procedure of converting Bangla Text to Bangla
Sign Language.
 No medium for deaf people to communicate.

12. 12 Department of CSE, CUET
Deaf and Mute Community in Bangladesh
Govt. Dhaka Badhir High School, 174,
Shahid Syed Nazrul Islam Avenue,
Bijoy Nagar Road, Dhaka-1205
• Total 07 Schools
• Run by Govt. -> 01

13. 13 Department of CSE, CUET
Challenges
 To select a large scope of Bangla signs.
 Creating animation for selected Bangla root words.
 Creating database for storing the animated files for
corresponding Bangla words.
 Designing and applying signs for Bangla letters into the
keyboard buttons.

14. 14 Department of CSE, CUET
Outline of Methodology
Start
1. Speech recognition
2. Keyboard
Launch speech
recognition
Speech to sign language
conversion and showing
via virtual agent
End
Launch sign language
keyboard
Convert sign language to
Bangla text
1 2
Fig-01: Structural Representation of the Application

15. 15 Department of CSE, CUET
Outline of Methodology (Cont.)
Speaking
Bangla
Splitting
words from
sentence
(Tokenizing)
Splitting
suffixes,
inflections
etc.
Parts of speech
tagging
Fetching sign
from database
Sign language
output
Database of
animated
signs
Fig-02: Speech to Sign Language Conversion
ছাত্র (Student)

16. 16 Department of CSE, CUET
Outline of Methodology (Cont.)
Start
Image of sign
Match with corresponding
Bangla character
Show character
Build sentence
End
Fig-03: Sign Language Keyboard
Select sign
ছয় (Six)

17. 17 Department of CSE, CUET
Conclusion
 The system will be useful for deaf persons.
 The system will be useful for people who want to learn sign
language.
 It will reduce language barrier between deaf and hearing people.
 After implementing SMS service, effective communication can
happen between users located at a distant place.

18. 18 Department of CSE, CUET
References
[1] Deafness in Bangladesh Mohammad Alauddin FRCS; FCPS; DLO and Abul Hasnat Joarder, MBBS, FCPS D
ept. ofOto!aryngo!ogy, BSM Medical University, Shahbag, Dhaka, Bangladesh
[2] Ahmed Tanvir, “A Small Initiative to Convert Bangla Text to Bangla Sign Language”, American-Internationa
l University, Bangladesh. Available: https://www.academia.edu/30768422/A_Small_Initiative_to_Convert_Bangl
a_Text_to_Bangla_Sign_Language
[3] B. Sarkar, K. Datta, C. Datta, D. Sarkar, S. J. Dutta, I. D. Roy, A. Paul, J. U. Molla, and A. Paul, “A translator
for bangla text to sign language,” in 2009 Annual IEEE India Conference. IEEE, 2009, pp. 1–4.
[4] Mohammed Safayet Arefin, Lamia Alam, Shayla Sharmin, Mohammed Moshiul Hoque, “An Empirical Fram
ework for Parsing Bangia Assertive, Interrogative and Imperative Sentences”, 1st International Conference on
Computer & Information Engineering, 26-27 November, 2015 Organizer: Dept. of CSE, Rajshahi University
of Engineering & Technology, Rajshahi, Bangladesh.
[5] Rhythm Shahriar, A.G.M. Zaman, Tanvir Ahmed, Saqib Mahtab Khan, H.M. Maruf, “A Communication Platf
orm Between Bangla and Sign Language”, 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HT
C) 21 - 23 Dec 2017, Dhaka, Bangladesh.
[6] Kaidul Islam and Bishnu Sarker, “Designing A Press and Swipe Type Single Layered Bangla Soft Keyboard f
or Android Devices”, 16th Int'l Conf. Computer and Information Technology, 8-10 March 2014, Khulna, Bangla
desh.

19. 19 Department of CSE, CUET
References
[7] Mahmoud EI-Gayyar, Amira Ibrahim and Ahmed Sallam, “The ArSL Keyboard for Android”, 2015 IEEE Sev
enth International Conference on Intelligent Computing and Information Systems (ICICIS'15).
[8] Lance A. Allison, Mohammad Muztaba Fuad, “Inter-App Communication between Android Apps Developed
in App-Inventor and Android Studio”, 2016 IEEE/ACM International Conference on Mobile Software Engineerin
g and Systems.
[9] Md. Shahnur Azad Chowdhury, Nahid Mohammad Minhaz Uddin, Mohammad Imran, Mohammad Mahadi
Hassan and Md. Emdadul Haque, “Parts of Speech Tagging of Bangla Sentence”, Available: https://www.researc
hgate.net/publication/229038426_Parts_of_Speech_Tagging_of_Bangla_Sentence
[10] Sabir Ismail, M. Shahidur Rahman, Md. Abdullah Al Mumin, “Developing an Automated Bangla Parts of
Speech Tagged Dictionary”, 16th Int'l Conf. Computer and Information Technology, 8-10 March 2014, Khulna,
Bangladesh.
[11] Mohamed JEMNI, Oussama ELGHOUL, “Using ICT to teach sign language”, Eighth IEEE International Co
nference on Advanced Learning Technologies.

20. 20 Department of CSE, CUET