The document discusses gesture recognition technology. It describes how cameras can read human body movements and communicate that data to computers to interpret gestures. Gestures can be used as inputs to control devices or applications. The document outlines different types of gestures, image processing techniques used, input devices like gloves and cameras, challenges, and potential uses like sign language recognition and immersive gaming.
3. Introduction
Gesture recognition is a topic in computer science and
language technology with the goal of interpreting
human gestures via mathematical algorithms.
Gestures can originate from any bodily motion or state
but commonly originate from the face or hand.
Many approaches have been made using cameras
and computer vision algorithms to interpret sign
language
4.
5. In gesture recognition technology a camera reads the
movements of the human body and communicates the
data to a computer that uses the gestures as input to
control devices or applications.
Gesture recognition can be conducted with techniques
from computer vision and image processing.
6. Gesture types
In computer interfaces, two types of gestures are
distinguished.
Offline gestures
Online gestures
7. Image processing
Image processing is any form of
signal processing for which the
input is an image.
Image processing usually refers to
digital image processing, but
optical and analog image
processing also are possible.
8. Input devices
The ability to track a person's movements
and determine what gestures they may
be performing can be achieved through
various tools.
Wired gloves
Depth aware cameras
Stereo cameras
Controller based gestures
Single camera
9. Technology Behind it..
Wired gloves
These can provide input to the
computer about the position and
notation of the hands using magnetic or
inertial tracking devices.
This uses fiber optic cables running down
the back of the hand. Light pulses are
created and when the fingers are bent,
and is registered giving an
approximation of the hand pose.
10. Technology Behind it..
Depth aware cameras
Using specialized cameras such as
structured light , one can generate a
depth map of what is being seen through
the camera.
These can be effective for detection of
hand gestures due to their short range
capabilities.
12. Technology Behind it..
Stereo cameras
It is a camera that has two lenses about
the same distance apart as your eyes
and take two pictures at a same time.
A 3D representation can be
approximated by the output of the
cameras.
13. Technology Behind it..
Controller based gestures
These controllers act as an extension of the body so that when
gestures are performed ,some of their motion can be
conveniently captured by software.
Mouse gestures are one example, where the motion of the
mouse is correlated to a symbol being drawn by a persons hand.
15. Technology Behind it..
Single camera
A normal camera can be used for gesture recognition where the
resources would not be convenient for other forms of image
based recognition.
Earlier it was thought that single camera may not be effective as
stereo or depth aware cameras .
