CSMSS
CHH.Shahu College of Engineering
Department of Electronics and Communication Engineering,
Aurangabad.
Seminar
On
HAND GESTURE BASED INTERACTIVE PHOTO SLIDER
Presented By Guided By
Sampada S Muley Prof. A.M Rawate
For the Degree of
Master of Engineering
(Electronics and Telecommunication Engineering)
Dr. BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY,
AURANGABAD (M.S.)
OVERVIEW
What is gesture?
Types
Objectives
Introduction
History
CSLand preprocessing
Stages of gesture
Block diagram
Advantages, Disadvantage
Conclusion
2
What is gesture????
 Gesture –any “moment’’.
 Gesture is a form of non-verbal communication in which
visible bodily actions communication particular message,
either in place or speech or together and in parallel words.
 Gestures can originate from any bodily motion or state but
commonly originate from the face or hand.
3
Types of gesture
Dynamic- This gesture change over a period of time .ex A
waving hand means “goodbye”.
Static- This gesture is in stable period of time. ex A stop hand.
Gesture to Gesture recognition
This involves:
1) A posture: A static configuration without the movement of
the body part.
2) A gesture: A dynamic movement of the body part.
4
Objective
 Provide the physically challenged users a better way to
interact with the computers.
 Provide a more natural Human Computer Interface.
 Helpful for handicap people.
 Interfacing user with software.
 Direction as well as count both will be responsible for the
hardware control.
5
Introduction
Two common technologies for hand gesture recognition
glove-based method
• Using special glove-based device to extract hand
posture
• Annoying
vision-based method
• 3D hand/arm modeling
• Appearance modeling
6
History
The hand gesture recognition is developed by many scienst in
different field.
Tin H -Hand tracking and recognize MAL (Myanmar
Alphabets Language)
William F -First Implementation of gesture recognition
and real time.
Manar M.- Developed ArSL(Arabic sign language)
7
CSL and Pre-processing
 CSL is the abbreviation for Chinese Sign Language.
 30 letters in CSL alphabet  Objects in recognition.
8
Pre-processing hand gesture recognition
 Detection of Hand Gesture Regions
 Aim to fix on the valid frames and locate the hand region from
the rest of the image.
 Low time consuming  fast processing rate  real time
speed
 Detect skin region from the rest of the image by using color.
 Each color has three components RGB.
9
Three Stages Of Hand gesture
10
Inputs Devices
The ability to track person’s movement and some variation
within tool and environment
Wired gloves-To detect the hand moments,postion n rotation
(5- 10 degree).
Depth aware camera-Useful to detect the hand in short range
(approximate a 3D representation ).
Single camera –Normal camera.
11
Block diagram
12
Gesture approaches and algorithm
Hand Gesture Technology
A Vision Based approaches: Instrumented Glove approaches
Colored Markers approaches
13
 Appearance-based models
 Skeletal-based algorithms
 3-D Model Based Approaches
14
15
30 different gestures, 120 samples/gesture
36*36 pixels
3600 training samples vs. d = 1296
Difficult to describe the data distribution
Reduce the dimensionality of hand gesture images
16
Based on the representation by skin pixels can be detected and
form a binary image sequence M’(x,y,t) – region mask
Another binary image sequence M’’(x,y,t) which reflects the
motion information is produced between every consecutive pair of
intensity images – motion mask
Transformed the detection results into gray-scale
images with 36*36 pixels.
Advantages
Able to understand people better.
Comm. Is able to carry out in an emergency.
Used for handicap people.
The system is connected in simple and active way.
Easy to used, no need to use special hardware.
System is fast, modular.
17
Disadvantages
High cost
Some assumption was made for the system like:-
o Input image include.
o Many hand can perform the device.
o Gesture are made with right hand only.
o The arm must be vertical.
o The palm is facing towards the camera.
18
conclusion
 The most important of this hand gesture based in input modes
is that using this method.
 The user can interact with the application from a distance
without using the keyboard or mouse
 And in future scope we can design a framework through a
application domain.
 Also the framework may be useful for controlling different
types of games which can be control by the hand gesture
recognition
19
THANK YOU
20

hand gesture based interactive photo silder

  • 1.
    CSMSS CHH.Shahu College ofEngineering Department of Electronics and Communication Engineering, Aurangabad. Seminar On HAND GESTURE BASED INTERACTIVE PHOTO SLIDER Presented By Guided By Sampada S Muley Prof. A.M Rawate For the Degree of Master of Engineering (Electronics and Telecommunication Engineering) Dr. BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY, AURANGABAD (M.S.)
  • 2.
    OVERVIEW What is gesture? Types Objectives Introduction History CSLandpreprocessing Stages of gesture Block diagram Advantages, Disadvantage Conclusion 2
  • 3.
    What is gesture???? Gesture –any “moment’’.  Gesture is a form of non-verbal communication in which visible bodily actions communication particular message, either in place or speech or together and in parallel words.  Gestures can originate from any bodily motion or state but commonly originate from the face or hand. 3
  • 4.
    Types of gesture Dynamic-This gesture change over a period of time .ex A waving hand means “goodbye”. Static- This gesture is in stable period of time. ex A stop hand. Gesture to Gesture recognition This involves: 1) A posture: A static configuration without the movement of the body part. 2) A gesture: A dynamic movement of the body part. 4
  • 5.
    Objective  Provide thephysically challenged users a better way to interact with the computers.  Provide a more natural Human Computer Interface.  Helpful for handicap people.  Interfacing user with software.  Direction as well as count both will be responsible for the hardware control. 5
  • 6.
    Introduction Two common technologiesfor hand gesture recognition glove-based method • Using special glove-based device to extract hand posture • Annoying vision-based method • 3D hand/arm modeling • Appearance modeling 6
  • 7.
    History The hand gesturerecognition is developed by many scienst in different field. Tin H -Hand tracking and recognize MAL (Myanmar Alphabets Language) William F -First Implementation of gesture recognition and real time. Manar M.- Developed ArSL(Arabic sign language) 7
  • 8.
    CSL and Pre-processing CSL is the abbreviation for Chinese Sign Language.  30 letters in CSL alphabet  Objects in recognition. 8
  • 9.
    Pre-processing hand gesturerecognition  Detection of Hand Gesture Regions  Aim to fix on the valid frames and locate the hand region from the rest of the image.  Low time consuming  fast processing rate  real time speed  Detect skin region from the rest of the image by using color.  Each color has three components RGB. 9
  • 10.
    Three Stages OfHand gesture 10
  • 11.
    Inputs Devices The abilityto track person’s movement and some variation within tool and environment Wired gloves-To detect the hand moments,postion n rotation (5- 10 degree). Depth aware camera-Useful to detect the hand in short range (approximate a 3D representation ). Single camera –Normal camera. 11
  • 12.
  • 13.
    Gesture approaches andalgorithm Hand Gesture Technology A Vision Based approaches: Instrumented Glove approaches Colored Markers approaches 13
  • 14.
     Appearance-based models Skeletal-based algorithms  3-D Model Based Approaches 14
  • 15.
    15 30 different gestures,120 samples/gesture 36*36 pixels 3600 training samples vs. d = 1296 Difficult to describe the data distribution Reduce the dimensionality of hand gesture images
  • 16.
    16 Based on therepresentation by skin pixels can be detected and form a binary image sequence M’(x,y,t) – region mask Another binary image sequence M’’(x,y,t) which reflects the motion information is produced between every consecutive pair of intensity images – motion mask Transformed the detection results into gray-scale images with 36*36 pixels.
  • 17.
    Advantages Able to understandpeople better. Comm. Is able to carry out in an emergency. Used for handicap people. The system is connected in simple and active way. Easy to used, no need to use special hardware. System is fast, modular. 17
  • 18.
    Disadvantages High cost Some assumptionwas made for the system like:- o Input image include. o Many hand can perform the device. o Gesture are made with right hand only. o The arm must be vertical. o The palm is facing towards the camera. 18
  • 19.
    conclusion  The mostimportant of this hand gesture based in input modes is that using this method.  The user can interact with the application from a distance without using the keyboard or mouse  And in future scope we can design a framework through a application domain.  Also the framework may be useful for controlling different types of games which can be control by the hand gesture recognition 19
  • 20.