HearAct is a sign language interpreter for Pakistani Sign Language (PSL) that uses sensors to record hand orientation and gesture coordinates and passes that data to a recognition model to display the corresponding word or sentence. It aims to help the over 250,000 deaf or speech-impaired people in Pakistan communicate by reducing their dependency on others and enabling mobility through a portable, cost-effective solution. The project is supervised by Sir Abdul Basit and developed by team members Ayesha Dojky, Saif Rehman, Shehrbanu Karim, and Zahra Hussaini.

1. Ayesha Dojky
Saif Rehman
Shehrbanu Karim
Zahra Hussaini
HearAct
1

2. What is Hear Act?
● HearAct is a Sign Language Interpreter made for Pakistani SIgn Language(PSL).
● Hand orientation and gesture coordinates will be recorded by the sensor per frame.
● The data from the sensor will be passed on to our recognition model to display or play the
corresponding word/sentence.
212/18/2017

3. Problems
● 250000 people in Pakistan have impaired hearing/speech. (Census, 2015)
● The community feels isolated.
● Due to which, society remains unaware of their talent.
312/18/2017

4. Solution
● To create a system which can provide assistance to the mute people and help them
communicate with others.
412/18/2017

5. Work Flow
512/18/2017

6. Advantages
●Reduces dependency on others.
●Complete mobility and portability.
●Cost effective.
●Enables a mute person to stay connected to the society.
612/18/2017

7. About the Team
•Supervisor:
Sir Abdul Basit
•Team Members:
Ayesha Dojky
Saif Rehman
Shehrbanu Karim
Zahra Hussaini
712/18/2017

8. THANK YOU!
8