GESTURE RECOGNITION TECHNOLOGY

2. GESTURE
RECOGNITION
TECHNOLOGY

3. CONTENTS
• What are gestures and types of gestures.
• What is gesture recognition? And its example
• Basic working of gesture recognition system
• Hand gesture recognition
• Facial gesture recognition
• Sign language recognition
• Gesture sensing technology
• Technology behind it
• Algorithms
• Uses of gesture recognition
• Gesture recognition challenges

4. What are gestures?
• A gesture is a form of non-verbal
communication.
• Visible bodily actions communicate
particular messages.
• Gestures include movement of the
hands, face, or other parts of the body.

5. Types of gestures
• Iconic gestures
• Pointing gestures
• Metaphoric gestures
• Beat gestures

6. What is gesture recognition?

7. EXAMPLE
A smart TV
recognizing the
hand
movement to
control the
channels or to
select a option
from the menu.

8. Basic working of gesture
recognition technology
User interfaceUser interface
displaydisplay
Standard webStandard web
cameracamera
useruser
Updating
object
Image capture
Image input
Image input
Hand movement

9. Hand gesture recognition
Hand gesture recognition technology allows operations of complex
machines using only a series of fingers and hand movements ,
eliminating the need of physical contact between operator and machine

10. Facial gesture recognition
Facial Gesture Recognition
creates an effective non-contact
interface between user and their
machines
The goal of facial Gesture
Recognition is to make
machine effectively
understand human emotions.
Even most cameras detects your
smile to automatically click a
picture

11. Sign language recognition
Certain types of gesture recognition
software can transcribe the symbols
represented through sign language
into text
Effective sign language
recognition can help the deaf
people to communicate with
both other people as well as the
machine

12. Gesture sensing technology
Electric Field sensing technology
Proximity of a human body or
body part can be measured by
sensing electric fields .
These measurements can be
used to measure the distance
of a human hand or other
body part from an object; this
facilitates a vast range of
applications for a wide range
of industries.

13. Device sensing technology
Device-based techniques use a glove
or other position tracker, whose
movements send signals that the
system uses to identify the gesture.
The glove is equipped with a variety of
sensors to provide information about
hand position, orientation, and flex of
fingers.

14. Technology behind it...
Wired gloves
These can provide input to the
computer about the position and
rotation of the hands using magnetic
devices.
The first commercially available hand-
tracking glove-type device was the Data
Glove , a glove-type device which could
detect hand position, movement and
finger bending.
This uses fiber optic cables running down the
back of the hand. Light pulses are created and
when the fingers are bent, light leaks through
small cracks and the loss is registered, giving
an approximation of the hand pose.

15. Stereo cameras
A Stereo camera is a camera that has
two lenses about the same distance apart
as your eyes and takes two pictures at the
same time. This simulates the way we
actually see and therefore creates the 3D
effect when viewed.
Using two cameras whose relations
to one another are known, a 3D
representation can be
approximated by the output of the
cameras.

16. Depth-aware cameras
Using specialized cameras such
as structured light or time-of-
flight cameras, one can generate a
depth map of what is being seen
through the camera at a short
range, and use this data to
approximate a 3d representation
of what is being seen.
These can be effective for detection of
hand gestures due to their short range
capabilities.

18. Thermal cameras
An infrared camera is a device that detects
infrared radiation(temperature) from the
target object and converts it into an
electronic signal to generate a thermal
picture on a monitor or to make
temperature calculations on it.

20. Algorithms

21. 3-D model based
Skeletal based algorithm
Appearance based

22. Use of gesture recognition
technology
Just as speech recognition can transcribe
speech to text, certain types of gesture
recognition software can transcribe the
symbols represented through sign language
into text.
Sign language recognition

23. For systems where the act of finding or
acquiring a physical controller could require
too much time, gestures can be used as an
alternative control mechanism. Controlling
secondary devices in a car, or controlling a
television set are examples of such usage.
Through the use of gesture
recognition, remote control with the
wave of a hand of various devices is
possible.
Virtual controllers
Remote control

24. Machine wheel chairs are coming
with gesture based system. The
movement of the hand will act as
a controller of speed as well as
direction
In video game consoles such as
Microsoft X-box with kinect
sensors, often the user is the
controller and has to perform all
physical movements that they desire
the character in the game to do.
Aid to physically challenged
Immersive gaming technology

25. challenges
Different users make gestures differently,
causing difficulty in identifying motions
Many gesture recognition systems do not
read motions accurately or optimally due
to factors like insufficient background
light, high background noise etc
Lack of gesture language
Robustness

26. Made by:- JINaL
THaKRaR(57)