This document summarizes a project on hand gesture recognition using a webcam. The project goals were to research hand gesture recognition techniques, algorithms, potential uses and issues, and develop a prototype gesture recognition system. The system used a webcam to capture images which were then processed and interpreted to recognize gestures. A 3D hand model was also developed and used for gesture modelling and recognition. In conclusion, the project researched hand gesture recognition and developed a prototype system using an optical glove and 3D hand model.

1. Hand Gesture RecognitionHand Gesture Recognition
Using a Web CamUsing a Web Cam
Chris GledhillChris Gledhill

2. Project DemoProject Demo
BackgroundBackground
Project goalsProject goals
Image CaptureImage Capture
Image ProcessingImage Processing
Image InterpretationImage Interpretation
Gesture RecognitionGesture Recognition
Gesture ModellingGesture Modelling
Project ConclusionsProject Conclusions

3. BackgroundBackground
Current user interfacesCurrent user interfaces
– Keyboards, Rodents, Joysticks, TabletsKeyboards, Rodents, Joysticks, Tablets
– 2D2D
– RangeRange
– Require physical contactRequire physical contact
Hand gesturesHand gestures
– 3D3D
– IntuitiveIntuitive
– Virtual RealityVirtual Reality

4. Background continued…Background continued…
Gesture recognitionGesture recognition
– Mechanical glove based approachMechanical glove based approach
– Optical approachOptical approach
Capture the imageCapture the image
Processing the imageProcessing the image
Interpreting the imageInterpreting the image
Gesture recognitionGesture recognition

5. Project GoalsProject Goals
Research hand gesture recognitionResearch hand gesture recognition
techniquestechniques
– AlgorithmsAlgorithms
– Present/future usesPresent/future uses
– IssuesIssues
Develop a prototype gesture recognitionDevelop a prototype gesture recognition
systemsystem
– Optical spotty glove locationOptical spotty glove location

6. Image CaptureImage Capture
Video Camera, Digital Camera, Web CamVideo Camera, Digital Camera, Web Cam
– ResolutionResolution
– Frame rateFrame rate
– ColourColour
Logitech QuickCam Pro 3000Logitech QuickCam Pro 3000
– 640x480640x480
– 30 fps30 fps
– 24bit colour24bit colour

7. Image Capture continued…Image Capture continued…
Logitech SDK/Video for Windows/DirectLogitech SDK/Video for Windows/Direct
Hardware/DirectXHardware/DirectX
DirectX SDKDirectX SDK
– CompatibilityCompatibility
– Windows componentWindows component
– Useful librariesUseful libraries

8. Image ProcessingImage Processing
Tidy up the imageTidy up the image
– Resize (640x480 => 70x70)Resize (640x480 => 70x70)
– Colour Reduction (16.7 million => 4)Colour Reduction (16.7 million => 4)
– Noise ReductionNoise Reduction
Locate spotsLocate spots
– Centre of massCentre of mass

9. Image InterpretationImage Interpretation
Rule based 2DRule based 2D

10. Gesture RecognitionGesture Recognition
3 gestures recognised3 gestures recognised
Palm down resting gesturePalm down resting gesture
2 click gestures2 click gestures

11. Gesture modellingGesture modelling
3D model based analysis3D model based analysis

12. Gesture modellingGesture modelling
3D Hand model developed in 3D Studio Max3D Hand model developed in 3D Studio Max

13. Gesture modelling continued…Gesture modelling continued…
Converted to .X file formatConverted to .X file format
Imported into application as Direct3D meshImported into application as Direct3D mesh
objectobject

14. Gesture modelling continued…Gesture modelling continued…
Rendered usingRendered using
Direct3DDirect3D

15. Project ConclusionProject Conclusion
Researched hand gesture recognitionResearched hand gesture recognition
techniquestechniques
– AlgorithmsAlgorithms
– Present/future usesPresent/future uses
– IssuesIssues
Developed a prototype gesture recognitionDeveloped a prototype gesture recognition
systemsystem
– Optical spotty glove locaterOptical spotty glove locater
– 3D Hand model3D Hand model

16. Project Demo SummaryProject Demo Summary
 BackgroundBackground
 Project goalsProject goals
 Image captureImage capture
 Image processingImage processing
 Image interpretingImage interpreting
 Gesture recognitionGesture recognition
 Gesture modellingGesture modelling
 Project conclusionsProject conclusions

17. Questions?Questions?