3. BackgroundBackground
Current user interfacesCurrent user interfaces
– Keyboards, Rodents, Joysticks, TabletsKeyboards, Rodents, Joysticks, Tablets
– 2D2D
– RangeRange
– Require physical contactRequire physical contact
Hand gesturesHand gestures
– 3D3D
– IntuitiveIntuitive
– Virtual RealityVirtual Reality
4. Background continued…Background continued…
Gesture recognitionGesture recognition
– Mechanical glove based approachMechanical glove based approach
– Optical approachOptical approach
Capture the imageCapture the image
Processing the imageProcessing the image
Interpreting the imageInterpreting the image
Gesture recognitionGesture recognition
5. Project GoalsProject Goals
Research hand gesture recognitionResearch hand gesture recognition
techniquestechniques
– AlgorithmsAlgorithms
– Present/future usesPresent/future uses
– IssuesIssues
Develop a prototype gesture recognitionDevelop a prototype gesture recognition
systemsystem
– Optical spotty glove locationOptical spotty glove location
6. Image CaptureImage Capture
Video Camera, Digital Camera, Web CamVideo Camera, Digital Camera, Web Cam
– ResolutionResolution
– Frame rateFrame rate
– ColourColour
Logitech QuickCam Pro 3000Logitech QuickCam Pro 3000
– 640x480640x480
– 30 fps30 fps
– 24bit colour24bit colour
7. Image Capture continued…Image Capture continued…
Logitech SDK/Video for Windows/DirectLogitech SDK/Video for Windows/Direct
Hardware/DirectXHardware/DirectX
DirectX SDKDirectX SDK
– CompatibilityCompatibility
– Windows componentWindows component
– Useful librariesUseful libraries
8. Image ProcessingImage Processing
Tidy up the imageTidy up the image
– Resize (640x480 => 70x70)Resize (640x480 => 70x70)
– Colour Reduction (16.7 million => 4)Colour Reduction (16.7 million => 4)
– Noise ReductionNoise Reduction
Locate spotsLocate spots
– Centre of massCentre of mass
13. Gesture modelling continued…Gesture modelling continued…
Converted to .X file formatConverted to .X file format
Imported into application as Direct3D meshImported into application as Direct3D mesh
objectobject
15. Project ConclusionProject Conclusion
Researched hand gesture recognitionResearched hand gesture recognition
techniquestechniques
– AlgorithmsAlgorithms
– Present/future usesPresent/future uses
– IssuesIssues
Developed a prototype gesture recognitionDeveloped a prototype gesture recognition
systemsystem
– Optical spotty glove locaterOptical spotty glove locater
– 3D Hand model3D Hand model