GESTURE 
RECOGNITION 
TECHNOLOGY 
Nagamani.gurram 
12761A0573
contents 
 Introduction 
 Gesture types 
 Image processing 
 Input devices 
 Challenges 
 Uses
Introduction 
 Gesture recognition is a topic in computer science and 
language technology with the goal of interpreting 
human gestures via mathematical algorithms. 
 Gestures can originate from any bodily motion or state 
but commonly originate from the face or hand. 
 Many approaches have been made using cameras 
and computer vision algorithms to interpret sign 
language
 In gesture recognition technology a camera reads the 
movements of the human body and communicates the 
data to a computer that uses the gestures as input to 
control devices or applications. 
 Gesture recognition can be conducted with techniques 
from computer vision and image processing.
Gesture types 
 In computer interfaces, two types of gestures are 
distinguished. 
 Offline gestures 
 Online gestures
Image processing 
 Image processing is any form of 
signal processing for which the 
input is an image. 
 Image processing usually refers to 
digital image processing, but 
optical and analog image 
processing also are possible.
Input devices 
 The ability to track a person's movements 
and determine what gestures they may 
be performing can be achieved through 
various tools. 
 Wired gloves 
 Depth aware cameras 
 Stereo cameras 
 Controller based gestures 
 Single camera
Technology Behind it.. 
Wired gloves 
 These can provide input to the 
computer about the position and 
notation of the hands using magnetic or 
inertial tracking devices. 
 This uses fiber optic cables running down 
the back of the hand. Light pulses are 
created and when the fingers are bent, 
and is registered giving an 
approximation of the hand pose.
Technology Behind it.. 
Depth aware cameras 
 Using specialized cameras such as 
structured light , one can generate a 
depth map of what is being seen through 
the camera. 
 These can be effective for detection of 
hand gestures due to their short range 
capabilities.
Depth aware camera
Technology Behind it.. 
Stereo cameras 
 It is a camera that has two lenses about 
the same distance apart as your eyes 
and take two pictures at a same time. 
 A 3D representation can be 
approximated by the output of the 
cameras.
Technology Behind it.. 
Controller based gestures 
 These controllers act as an extension of the body so that when 
gestures are performed ,some of their motion can be 
conveniently captured by software. 
 Mouse gestures are one example, where the motion of the 
mouse is correlated to a symbol being drawn by a persons hand.
s
Technology Behind it.. 
Single camera 
 A normal camera can be used for gesture recognition where the 
resources would not be convenient for other forms of image 
based recognition. 
 Earlier it was thought that single camera may not be effective as 
stereo or depth aware cameras .
Challenges 
 Accuracy 
 Background noise 
 Quality 
 Robust computer vision methods
Uses 
 Sign language recognition 
 For socially assistive robotics 
 Directional indication through pointing 
 Immersive game technology 
 Effective computing 
 Remote control
Gesture recognition technology

Gesture recognition technology

  • 1.
    GESTURE RECOGNITION TECHNOLOGY Nagamani.gurram 12761A0573
  • 2.
    contents  Introduction  Gesture types  Image processing  Input devices  Challenges  Uses
  • 3.
    Introduction  Gesturerecognition is a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms.  Gestures can originate from any bodily motion or state but commonly originate from the face or hand.  Many approaches have been made using cameras and computer vision algorithms to interpret sign language
  • 5.
     In gesturerecognition technology a camera reads the movements of the human body and communicates the data to a computer that uses the gestures as input to control devices or applications.  Gesture recognition can be conducted with techniques from computer vision and image processing.
  • 6.
    Gesture types In computer interfaces, two types of gestures are distinguished.  Offline gestures  Online gestures
  • 7.
    Image processing Image processing is any form of signal processing for which the input is an image.  Image processing usually refers to digital image processing, but optical and analog image processing also are possible.
  • 8.
    Input devices The ability to track a person's movements and determine what gestures they may be performing can be achieved through various tools.  Wired gloves  Depth aware cameras  Stereo cameras  Controller based gestures  Single camera
  • 9.
    Technology Behind it.. Wired gloves  These can provide input to the computer about the position and notation of the hands using magnetic or inertial tracking devices.  This uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, and is registered giving an approximation of the hand pose.
  • 10.
    Technology Behind it.. Depth aware cameras  Using specialized cameras such as structured light , one can generate a depth map of what is being seen through the camera.  These can be effective for detection of hand gestures due to their short range capabilities.
  • 11.
  • 12.
    Technology Behind it.. Stereo cameras  It is a camera that has two lenses about the same distance apart as your eyes and take two pictures at a same time.  A 3D representation can be approximated by the output of the cameras.
  • 13.
    Technology Behind it.. Controller based gestures  These controllers act as an extension of the body so that when gestures are performed ,some of their motion can be conveniently captured by software.  Mouse gestures are one example, where the motion of the mouse is correlated to a symbol being drawn by a persons hand.
  • 14.
  • 15.
    Technology Behind it.. Single camera  A normal camera can be used for gesture recognition where the resources would not be convenient for other forms of image based recognition.  Earlier it was thought that single camera may not be effective as stereo or depth aware cameras .
  • 18.
    Challenges  Accuracy  Background noise  Quality  Robust computer vision methods
  • 19.
    Uses  Signlanguage recognition  For socially assistive robotics  Directional indication through pointing  Immersive game technology  Effective computing  Remote control