Downloaded 46 times
Uploaded byJia-Bin Huang
Static and Dynamic Hand Gesture Recognition
This document summarizes work on static and dynamic hand gesture recognition using a webcam. For static gesture recognition, a random forest classifier was used to recognize four hand poses from images. For dynamic gesture recognition, the goal was to track hand movements to control a mouse cursor. Key challenges addressed were skin detection using color spaces, fingertip detection using hand contour curvatures, and calculating hand center position for cursor control. The work provided skills in computer vision techniques like feature extraction and classification algorithms.
Static and Dynamic Hand Gesture Recognition
- 1. Static and DynamicHand Gesture Recognition Using a Webcam Kevin Han and Jia-Bin Huang Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign kyhan2@illinois.edu, jbhuang1@illinois.edu Motivation/Applications • Current human-computer interfaces not intuitive enough • Hand gestures more natural than mouse/keyboard • Human-robot interaction in future Unclicked Static Gesture Recognition Dynamic Gesture Recognition • Objective – recognize hand position and pose from webcam image • Cursor control • Four poses – fist, one, two, palm • Objective – extract mouse position and state (clicked, unclicked) from image • Based on object detection with a trained classifier (random forest classifier) • HOG descriptors performed poorly • HOG descriptor • Subproblems • Skin detection • YCrCb color space • Bayesian classifier with spatial priors • Fingertip detection • K-curvatures of hand contour • Hand center position (cursor position) • Centroid of hand bounding box Skills and Knowledge Gained • How to approach computer vision/classification problems • C++ and OpenCV • Classification algorithms • SVM, Random forest, Adaboost, Bayesian • Feature description • HOG descriptor • Image processing • Color spaces, morphological operations (dilation/erosion), contour detection, color histograms • Noise reduction References • Kalman filter Random forest image: http://www.iis.ee.ic.ac.uk/~tkkim/iccv09_tutorial.html Special thanks to my mentor, Jia-Bin Huang