Hand Gesture Recognition Under The Supervision of Prof. Aliaa Abdel-Halim Abdel-Razik Youssif
Bringing them to us! Imagine your self a Deaf Person How would you express your feelings, thoughts and ideas. Will you be able to deliver them right and easily.
We need them ! As the handicap people representing a large scale of our community we should take steps to be able to communicate with them to share knowledge ,thoughts ,ideas and even feelings. So we want to create a communication mean that we can use to do so.
Team members Ahmed Abdel-Aziz El-Said El-Gazzar. Ahmed Osama Ahmed Fouad. Amr Muhammed Abou-Elgood. Karim Nabil Ibrahim. Muhammed Magdy Mekki. Sharif Ahmed Abdel-Sattar.
Project Idea Desktop application. Converting sign language into speech and convert text to sign language. Using intermediate phase (text).
Why?! Because we need Deaf Persons in our society . Also to remove all the communication barriers between us. For deaf people to be able to live a normal happy life.
Technical overview Tools • EmguCV It is the .NET OpenCV library • C# Speech Engine. the tool that we used to convert the text to Speech IDE • Microsoft Visual Studio . • Open CV on MVS.
Technical overview (cont’d) Previous work • Developing C# program that converts the text into speech and vice versa using C# speech Engine. • Searching about MATLAB & OPEN CV. • Self studying image processing & Machine Learning Development.
Technical overview (cont’d) Currant state • an application that converts from sign language to Text using Emgu CV.
Project ScenarioSign Speech Draw your Hand Sign
Project Scenario(cont’d)Use case: Sign Detection.Brief Description:The deaf person act the sign that represent a specific phrase or word.Initial Step-By-Step Description:Before this use case can be initiated, the Application already runningand the deaf person must be standing at appropriate distance from thecamera.1- The deaf person stands at appropriate distance from the camera.2- The application is set to sign detection mode.3- The system plays the speech representing the sign detected.
Project Scenario(cont’d)Use case: Sign Drawing.Brief Description:The normal person select the Phrase then the application draws thesign.Initial Step-By-Step Description:Before this use case can be initiated, the Application already running .1- The normal person select the Sign Text (Phrase) .2- The application convert the text into sign language.3- The system plays the sign video appropriate to the Selection detected.
Project Scenario Sign To Speech way .The form Divided in two Parts . Left Part use convex Hull algorithm to detect corner points and calculate them by K-curvature angle. Right Part use Polygon method and do the previous steps.
Project Scenario Text To Sign way . I n the second way You can choose the Phrase (Alphabets or Numbers or Phrases ) you need to translate it to sign and view its video .
Conclusion We Presented The Implementation of a System That aims to Translate sign language (Hand Gestures) into speech (Sound). In the future we aspire to Complete software application that will be available commercially to users that have a fast Mobile, a camera, and speakers and cover all words in Arabic sign language.