By
Manu . D 2nd ECE
Manu . K 2nd ECE
Introduction
 Normally Hand Gesture sign language is the tool which
is being used by the deaf and dumb to communicate.
 Hand Gesture Recognition will be useful in a
communication between dumb and deaf person and
normal person.
 This system works under Video Processing technology.
Present challenges for dumb and deaf people
 In our society we have people with disabilities.
 About 360 million people in the world are deaf and dumb
 Communications between deaf-mute and a normal person
have always been a challenging task.
 Sign language helps deaf and dumb people to communicate
with other people.
 But not all people understand sign language.
Tools used
 Camera (input device)
 Controller or PC with OpenCV interface (Processor)
 Mic and LCD Display (Output Device)
Deaf Sign Language
Basic Block Diagram of communication between
deaf and dumb person and normal person
Arduino or PC with
OpenCV interface
CameraInput Sign Processor
Output
Speaker
LCD DisplayLCD Display
ABCDA
B
C
Voice to
Text
converter
(BitVoicer)
DEAF and DUMB People
Normal People
Input Text
Mic
D
OpenCV
 OpenCV (Open Source Computer Vision) is a library of
programming functions mainly aimed at real-time computer vision.
 It can read and Write image and video.
 It can process image.
 It can detect Geometrical shapes.
 Gestures Recognize and more…
 It can support languages such as JAVA, PYTHON, C++.
Sample Working of OpenCV
Arduino and PC
 It interface camera and OpenCV Program in order to
recognize the gestures.
 In this system OpenCV is used to process the input
from the with the algorithm which we program in the
using c, c++, python.
 We write the Program in the way machine learning to
create a ability to recognize the gesture accurately.
 And the output will send to the output devices
Output
 Speaker
 We use normal speaker to deliver the output from the
processor as a voice output.
LCD Display
It is the visual output which display the output from the
processor
Normal Person to Dumb and Deaf
 The controller convert the speech signal into text. And
it can be done by BitVoicer and arduino .
 Finally it will send the output to the LCD Display.
 In this method the normal person need to give a input as a
voice to the mic. The mic will sense and convert it to
electrical pulse and that will send to the controller. And the
controller will convert it into text format.
 Finally it will display it
in the LCD display
Conclusion
 By using OpenCV we can achieve this with high
accuracy and fast as well it low cost ever now.
 Around the world 360 million people are dumb and
deaf around the world.
 We can give a easiest solution and every
needed person can use it.
Thank You

Hand Gesture Recognition system for deaf and dump people

  • 1.
    By Manu . D2nd ECE Manu . K 2nd ECE
  • 2.
    Introduction  Normally HandGesture sign language is the tool which is being used by the deaf and dumb to communicate.  Hand Gesture Recognition will be useful in a communication between dumb and deaf person and normal person.  This system works under Video Processing technology.
  • 3.
    Present challenges fordumb and deaf people  In our society we have people with disabilities.  About 360 million people in the world are deaf and dumb  Communications between deaf-mute and a normal person have always been a challenging task.  Sign language helps deaf and dumb people to communicate with other people.  But not all people understand sign language.
  • 4.
    Tools used  Camera(input device)  Controller or PC with OpenCV interface (Processor)  Mic and LCD Display (Output Device)
  • 5.
  • 6.
    Basic Block Diagramof communication between deaf and dumb person and normal person Arduino or PC with OpenCV interface CameraInput Sign Processor Output Speaker LCD DisplayLCD Display ABCDA B C Voice to Text converter (BitVoicer) DEAF and DUMB People Normal People Input Text Mic D
  • 7.
    OpenCV  OpenCV (OpenSource Computer Vision) is a library of programming functions mainly aimed at real-time computer vision.  It can read and Write image and video.  It can process image.  It can detect Geometrical shapes.  Gestures Recognize and more…  It can support languages such as JAVA, PYTHON, C++.
  • 8.
  • 9.
    Arduino and PC It interface camera and OpenCV Program in order to recognize the gestures.  In this system OpenCV is used to process the input from the with the algorithm which we program in the using c, c++, python.  We write the Program in the way machine learning to create a ability to recognize the gesture accurately.  And the output will send to the output devices
  • 10.
    Output  Speaker  Weuse normal speaker to deliver the output from the processor as a voice output. LCD Display It is the visual output which display the output from the processor
  • 11.
    Normal Person toDumb and Deaf  The controller convert the speech signal into text. And it can be done by BitVoicer and arduino .  Finally it will send the output to the LCD Display.  In this method the normal person need to give a input as a voice to the mic. The mic will sense and convert it to electrical pulse and that will send to the controller. And the controller will convert it into text format.  Finally it will display it in the LCD display
  • 12.
    Conclusion  By usingOpenCV we can achieve this with high accuracy and fast as well it low cost ever now.  Around the world 360 million people are dumb and deaf around the world.  We can give a easiest solution and every needed person can use it.
  • 13.