Hand Gesture
Recognition
Emma Persky
storyteller, geek, believer, etc

Why Recognise
Gestures?

New Models of
Interaction

Accessibility!

Parameters of
Recognition

How Does it Work?
• Find the Hand (not my problem!)
• Find Interesting Regions on Hand
• Track Interesting Points
• Compare Hand Path / Relative Position

Interesting Points
• Edge Detection
• Corner Detection
• Regions of High Gradient of Change
• Brightness / Colour Histogram

Tracking Points
• Iterative Lucas - Kanade Method
• Pyramid Feature
• Outputs New Points and Probabilities

Tracking the Hand
• ‘Flock’ of points
• Cull outliers
• Median (x and y) of Points is Centre of
Hand

Recognising Gestures
• Relative Position of Hands from ‘Start’
• Trace Path of Hand Centre

Applications
• TV Control
• Ubiquitous Systems Control
• Games (Johnny Lee Eat Your Heart
Out)!

Demo!