SlideShare a Scribd company logo
1 of 5
Download to read offline
The International Journal Of Engineering And Science (IJES)
|| Volume || 4 || Issue || 6 || Pages || PP.42-46 || June - 2015 ||
ISSN (e): 2319 – 1813 ISSN (p): 2319 – 1805
www.theijes.com The IJES Page 42
Hand gesture recognition using support vector machine
Nagashree R N1
, Stafford Michahial1
, Aishwarya G N2
, Beebi Hajira Azeez2
,
Jayalakshmi M R2
, R Krupa Rani2
1
Asst. Professor, Dept of Telecommunication, GSSSIETW, Mysuru.
2
Student of 8th
sem, Dept of Telecommunication, GSSSIETW, Mysuru.
----------------------------------------------------------ABSTRACT-----------------------------------------------------------
The images contain measurement information of key interest for a variety of research and application areas. On
the other hand, computers have become an inseparable part of our society, influencing many aspects of our
daily lives in terms of communication and interaction. The main motive is to develop a system that can simplify
the way humans interact with Computers. The system is designed using Canny’s edge detection for edge
detection and Histogram of gradients for feature extraction and the Support Vector Machine (SVM) Classifier
which is widely used for classification and regression testing. SVM training algorithm builds a model that
predicts whether a new example falls into one category or other. And the classifier learns from the data points
in examples when they are classified belonging to their respective categories.
KEYWORDS – SVM, Canny’s Edge detection, Feature extraction, HOG.
---------------------------------------------------------------------------------------------------------------------------------------
Date of Submission: 20-May-2015 Date of Accepted: 08-June-2015
---------------------------------------------------------------------------------------------------------------------------------------
I. INTRODUCTION
With the continued growth of multimedia and communication systems, the instrumentation and
measurement fields have seen a steady increase in the focus on the image data. Digital image processing deals
with manipulation of digital images through a digital computer. It is a subfield of signals and systems but focus
particularly on images. DIP focuses on developing a computer system that is able to perform processing on an
image. The input of that system is a digital image and the system process that image using efficient algorithms,
and gives an image as an output [1].
A gesture is a form of non-verbal communication in which visible bodily actions communicate
particular messages, either in place of speech or together and in parallel with spoken words. Gestures can be
static (posture or certain pose) which require less computational complexity or dynamic (sequence of postures)
which are more complex but suitable for real time environments. Different methods have been proposed for
acquiring information necessary for recognition gestures system. Some methods used additional hardware
devices such as data glove devices and color markers to easily extract comprehensive description of gesture
features. Other methods based on the appearance of the hand using the skin color to segment the hand and
extract necessary features, these methods considered easy, natural and less cost comparing with methods
mentioned before. It includes movement of the hands, face, or other parts of the body. Gesture recognition can
be seen as a way for computers to begin to understand human body language, thus building a richer bridge
between machines and humans than primitive text user interfaces or even Graphical User Interfaces (GUIs),
which still limit the majority of input to keyboard and mouse [1]. It enables humans to interface with the
machine (HMI) and interact naturally without any mechanical devices. The main purpose of developing such a
system lies in the fact that gesture recognition has implemented in motion analysis to machine learning. It also
serves many applications from virtual reality to sign language recognition. A lot of research has been carried out
in last 2-3 decades on hand gesture recognition approach. These can be roughly divided into two categories,
namely, Glove Based Gesture Recognition and Vision Based Gesture Recognition. Glove based Hand Gesture
Recognition hinders the naturalness as cumbersome devices are required to wear. A Vision Based approach
uses features extracted from visual appearance of the input image model of the hand, comparing these modelled
features with features extracted from input camera(s) or video input [4]. Here we are emphasising on different
aspects of Hand Gesture Recognition with Support Vector Machine as a classifier.
Hand gesture recognition using support vector machine
www.theijes.com The IJES Page 43
II. OBJECTIVE
The SVM is a popular pattern recognition technique with supervised learning. Since it divides the
feature space for each class, the SVM can handle unknown data well, although it is not suited to grouping
sample data. Support Vector Machines (SVM) is a linear machine with some very good properties. The main
idea of a SVM in the context of pattern classification is to construct a hyper plane as the decision surface. The
hyper plane is constructed in such a way that the margin of separation between positive and negative examples
is maximized. The SVM uses a principled approach based on statistical learning theory know as structural risk
minimization, which minimizes an upper bound on the generalization error(i.e. a parameter estimation heuristic
that seeks parameter values that minimize the „risk‟ or „loss‟ that the model incurs on the training data).
III. DESIGN METHODOLOGY
The project involves the use of web camera which takes the input; it will also sense the depth of an
image. The Hand gesture classification is done in two phases. The first is the training phase where we train the
system with certain predefined symbols and we store them in the database of the system for further
classification. The second phase is the testing phase where the system is given the symbols and it compares it
with the symbols in the database and compares the most matched feature and gives the output.
Fig 1 Block Diagram
The processing involves acquiring the hand gesture using a web camera. In the per-processing stage a bounding
box is created to identify the hand for the separation of the foreground from the background. This is done by making use of
difference in consecutive frames. The acquired image is subjected to resizing in order to have faster computation. The edge
of the resized image is detected using Canny‟s edge detection. The extraction of the feature of the image is done using
Histogram of gradients (HOG). The extracted features are stored in database. SVM compares the image with the most
matched feature in the database and gives the output on the screen.
a) CANNY’S EDGE DETECTION
Edge detection is the name for a set of mathematical methods which aim at identifying points in a
digital image at which the image brightness changes sharply or more formally, has discontinuities. The point at
which image brightness changes sharply are typically organized into a set of curved line segments termed as
edges. The purpose of Edge detection in general is to significantly reduce the amount of data in an image, while
preserving the structural properties to be used for further image processing. Canny‟s Edge Detection one of the
edge detection method which was developed by John F Canny (JFC) in 1986. This method makes use
smoothing concept which is applied in the Gaussian operation, this makes error detection more effective. This
also improves the signal with respect to the noise ratio and this is established by non-maxima suppression
method as it results in one pixel wide ridges as the output. Another advantage is better detection of edges
especially in noise state. Even though it is quite old, it has become one of the standard edge detection methods
and it is still used in research. The algorithm runs in five different steps
Fig 2 Canny‟s Edge Detection Block Diagram
Hand gesture recognition using support vector machine
www.theijes.com The IJES Page 44
i) Smoothing: The image is then converted from RGB scale to Grey scale and is blurred in order to remove the
noise that is accompanied during the image acquisition. The noise is removed using the Gaussian filter by
specifying double threshold value.
ii) Finding gradients: The edges should be marked where the gradients of the image has large magnitudes.
iii) Non maximum suppression: Only local maxima should be marked as edges.
iv) Double thresholding: Potential edges are determined by thresholding.
v) Edge tracking by hysteresis: Final edges are determined by suppressing all edges that are not connected to a
very certain edge.
b) HISTOGRAM OF GRADIENTS
Feature extraction is a type of dimensionality reduction that efficiently represents interesting part of an
image as a compact feature vector. Detecting humans in images is a challenging task owing to their variable
appearance and the wide range of poses that they can adopt. The first need is a robust feature set that allows the
human form to be discriminated cleanly, even in cluttered backgrounds under difficult illumination. We study
the issue of feature sets for human detection, showing that locally normalized Histogram of Oriented Gradient
(HOG) descriptors provide excellent performance relative to other existing feature sets including wavelets. This
approach is useful when the image sizes are large and a reduced feature representation is required to quickly
complete tasks. This involves reducing the amount of resources required to describe a large set of data. HOG
features were introduced by Navneed Dalal and Bill Triggs who have developed and tested several variants of
HOG. HOG deals with moving body parts and are better compared to other feature extractors.
The HOG algorithm includes the following steps:
Fig 4 HOG Block Diagram
i) Gradient Computation: The most common method is to apply the 1D centred point discrete derivative mask
in both the horizontal and vertical directions. Specifically this method requires filtering the gray scale
image.
ii) Orientation Binning: This involves creating cell histograms. Each pixel within the cell casts a weighted vote
for an orientation based histogram channel based on the values found in the gradient computation.
iii) Descriptor Blocks: The gradient strengths must be locally normalized, which requires grouping the cells
together into larger, spatially connected blocks. Two main block geometrics exist: Rectangular HOG(R-
HOG) blocks, Circular HOG(C-HOG).
c) CLASSIFICATION USING SUPPORT VECTOR MACHINE
Classification is an ordered set of related categories used to group data according to its similarities. It
consists of codes and descriptors and allows survey responses to be put into meaningful categories in order to
produce useful data. It is a useful tool for developing statistical surveys. Classifier is an abstract metaclass
which describes (classifies) set of instances having common features. Support Vector Machine (SVM), is one of
the best machine learning algorithms, which was proposed in 1990‟s by Vapnik. SVM‟s are a set of related
supervised learning methods used for classification and regression. A supervised learning is the machine
learning task of inferring from supervised training data. A supervised learning algorithm analyzes the training
data and produces an inferred function which is called a classifier. SVM has high accuracy, nice theoretical
guarantees regarding over fitting, and with an appropriate kernel which can work well even when the data is not
linearly separable in the base feature space. The support vector network is a new learning machine for two
group classification problems. The machine conceptually implements the following idea: input vectors are non-
linearly mapped to a very high dimensional feature space. In this feature space a linear decision surface is
constructed. Special properties of decision surface ensures high generalisation ability of the learning machine.
The idea behind support vector was previously implemented for the restricted case where the training data can
be separated without errors.
Hand gesture recognition using support vector machine
www.theijes.com The IJES Page 45
Support vector machine constructs a hyperplane or set of hyperplanes in a high- or infinite-dimensional
space, which can be used for classification, regression, or other tasks. A hyperplane is a subspace of one
dimension less than its ambient space. A good separation is achieved by the hyperplane that has the largest
distance to the nearest training-data point of any class. It is explicitly told to find the best separating line. It
searches for the closest points which is called the "support vectors" (the name "support vector machine" is due
to the fact that points are like vectors and that the best line "depends on" or is "supported by" the closest points).
Once it has found the closest points, the SVM draws a line connecting them. It draws this connecting line by
doing vector subtraction (point A - point B). The support vector machine then declares the best separating line
to be the line that bisects -- and is perpendicular to -- the connecting line.
The support vector machine is better because when you get a new sample (new points), you will have
already made a line that keeps B and A as far away from each other as possible, and so it is less likely that one
will spill over across the line into the other's territory.
Fig 3 SVM classification.
DATASET FOR CLASSIFICATION
Fig 4 Dataset for classification
Hand gesture recognition using support vector machine
www.theijes.com The IJES Page 46
IV. EXPIRIMENTAL RESULT
The software analysis is carried out using MATLAB, that facilitates matrix manipulations, plotting
of functions and data, implementation of algorithms, creation of user interfaces, and interfacing with programs.
In this section, the performance of real time static hand gesture recognition system in complex background is
evaluated for each of the 20 hand gestures. And running input image is used for the performance evaluation.
The images were acquired in true colour using a webcam. The images in the testing phase are compared with
the database and the result is evaluated.
Fig 4 Gesture Recognised
V. CONCLUSION
Area of Hand gesture based computer human interaction is very vast. This project recognizes hand
gesture off-line so work can be done to do it for real time purpose. Hand recognition system can be useful in
many fields like robotics, computer human interaction and so make this offline system for real time will be
future work to do. Local contour sequence (LCS) is our prime feature in this project. LCS can be used with
other features so that it can be optimized to achieve higher recognition accuracy. Support Vector Machine can
be modified for reduction of complexity. Reduction of complexity leads us to a less computation time. Reduced
complexity provides us less computation time so we can make system to work real time. The applications of
hand gesture recognition is for non-verbal communication between human and computer, general fit person and
physically challenged people, 3D gaming, virtual reality etc.
The increase in applications, the gesture recognition system requires lots of research in different
directions. A large number of research works carried out during last twenty years have been reviewed. The
different sub-components, methodologies used for recognition of mainly hand gestures in those works have been
described. A brief comparison of backgrounds, segmentation techniques, features used and the recognition
methods have been done and presented. In today‟s digitized world, processing speeds have increased
dramatically, with computers being advanced to the levels where they can assist humans in complex tasks. Yet,
input technologies seem to cause a major bottleneck in performing some of the tasks, under-utilizing the
available resources and restricting the expressiveness of application use. Hand Gesture recognition comes to
rescue here. Computer Vision methods for hand gesture interfaces must surpass current performance in terms of
robustness and speed to achieve interactivity and usability. A review of vision-based hand gesture recognition
methods has been presented. Considering the relative infancy of research related to vision based gesture
recognition remarkable progress has been made. To continue this momentum it is clear that further research in
the areas of feature extraction, classification methods and gesture representation are required to realize the
ultimate goal of humans interfacing with machines on their own natural terms.
REFERENCES
[1] Aseema Sultana, T Rajapuspha , “A vision based Hand gesture recognition” in the proceeding of IJCSET(2012), Vol 3,No 7.
[2] S Nagarajan, T S Subashini, “Static Hand Gesture Recognition for Sign Language Alphabets using Edge Oriented Histogram”
in the proceeding of IJCA(2013), Vol 82, No 4.
[3] S. Naidoo, C.W. Omlin M. Glaser “Vision based Static Hand gesture recognition”, South Africa.
[4] S. Mohamed Mansoor Roomi, R. Jyothi Priya and H. Jayalakshmi “Hand Gesture Recognition for Human-Computer
Interaction”, in the proceedings of Journal Of Computer Science (2009).

More Related Content

What's hot

3.introduction onwards deepa
3.introduction onwards deepa3.introduction onwards deepa
3.introduction onwards deepa
Safalsha Babu
 

What's hot (20)

Fpga implementation of image segmentation by using edge detection based on so...
Fpga implementation of image segmentation by using edge detection based on so...Fpga implementation of image segmentation by using edge detection based on so...
Fpga implementation of image segmentation by using edge detection based on so...
 
IRJET- A Vision based Hand Gesture Recognition System using Convolutional...
IRJET-  	  A Vision based Hand Gesture Recognition System using Convolutional...IRJET-  	  A Vision based Hand Gesture Recognition System using Convolutional...
IRJET- A Vision based Hand Gesture Recognition System using Convolutional...
 
Image proccessing and its application
Image proccessing and its applicationImage proccessing and its application
Image proccessing and its application
 
B221223
B221223B221223
B221223
 
Image processing
Image processingImage processing
Image processing
 
Digital image processing
Digital image processingDigital image processing
Digital image processing
 
Presentation on deformable model for medical image segmentation
Presentation on deformable model for medical image segmentationPresentation on deformable model for medical image segmentation
Presentation on deformable model for medical image segmentation
 
M.sc.iii sem digital image processing unit v
M.sc.iii sem digital image processing unit vM.sc.iii sem digital image processing unit v
M.sc.iii sem digital image processing unit v
 
Review of Image Segmentation Techniques based on Region Merging Approach
Review of Image Segmentation Techniques based on Region Merging ApproachReview of Image Segmentation Techniques based on Region Merging Approach
Review of Image Segmentation Techniques based on Region Merging Approach
 
14 offline signature verification based on euclidean distance using support v...
14 offline signature verification based on euclidean distance using support v...14 offline signature verification based on euclidean distance using support v...
14 offline signature verification based on euclidean distance using support v...
 
01 introduction image processing analysis
01 introduction image processing analysis01 introduction image processing analysis
01 introduction image processing analysis
 
3.introduction onwards deepa
3.introduction onwards deepa3.introduction onwards deepa
3.introduction onwards deepa
 
A comparison of image segmentation techniques, otsu and watershed for x ray i...
A comparison of image segmentation techniques, otsu and watershed for x ray i...A comparison of image segmentation techniques, otsu and watershed for x ray i...
A comparison of image segmentation techniques, otsu and watershed for x ray i...
 
Object recognition
Object recognitionObject recognition
Object recognition
 
Image processing sw & hw
Image processing sw & hwImage processing sw & hw
Image processing sw & hw
 
From Image Processing To Computer Vision
From Image Processing To Computer VisionFrom Image Processing To Computer Vision
From Image Processing To Computer Vision
 
An efficient method for recognizing the low quality fingerprint verification ...
An efficient method for recognizing the low quality fingerprint verification ...An efficient method for recognizing the low quality fingerprint verification ...
An efficient method for recognizing the low quality fingerprint verification ...
 
Importance of Mean Shift in Remote Sensing Segmentation
Importance of Mean Shift in Remote Sensing SegmentationImportance of Mean Shift in Remote Sensing Segmentation
Importance of Mean Shift in Remote Sensing Segmentation
 
RECOGNITION OF RECAPTURED IMAGES USING PHYSICAL BASED FEATURES
RECOGNITION OF RECAPTURED IMAGES USING PHYSICAL BASED FEATURESRECOGNITION OF RECAPTURED IMAGES USING PHYSICAL BASED FEATURES
RECOGNITION OF RECAPTURED IMAGES USING PHYSICAL BASED FEATURES
 
Removing fence and recovering image details various techniques with performan...
Removing fence and recovering image details various techniques with performan...Removing fence and recovering image details various techniques with performan...
Removing fence and recovering image details various techniques with performan...
 

Viewers also liked

Justification for Oil Well Stimulation
Justification for Oil Well StimulationJustification for Oil Well Stimulation
Justification for Oil Well Stimulation
theijes
 
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
theijes
 
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
theijes
 
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
theijes
 
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using FeaMicro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
theijes
 
Feasibility of an eco – friendly disposal method for Iron ore tailings
Feasibility of an eco – friendly disposal method for Iron ore tailingsFeasibility of an eco – friendly disposal method for Iron ore tailings
Feasibility of an eco – friendly disposal method for Iron ore tailings
theijes
 

Viewers also liked (19)

Castellated beam optimization by using Finite Element Analysis: A Review.
Castellated beam optimization by using Finite Element Analysis: A Review.Castellated beam optimization by using Finite Element Analysis: A Review.
Castellated beam optimization by using Finite Element Analysis: A Review.
 
Performance evolution of a PMSG based WECS using maximum power point tracking...
Performance evolution of a PMSG based WECS using maximum power point tracking...Performance evolution of a PMSG based WECS using maximum power point tracking...
Performance evolution of a PMSG based WECS using maximum power point tracking...
 
The influence of organizational culture, ethical awareness and experience to ...
The influence of organizational culture, ethical awareness and experience to ...The influence of organizational culture, ethical awareness and experience to ...
The influence of organizational culture, ethical awareness and experience to ...
 
Acoustic Parameters of acetic acid in benzene at 3 MHz.
Acoustic Parameters of acetic acid in benzene at 3 MHz.Acoustic Parameters of acetic acid in benzene at 3 MHz.
Acoustic Parameters of acetic acid in benzene at 3 MHz.
 
Design and Analysis of Solar Powered RC Aircraft
Design and Analysis of Solar Powered RC AircraftDesign and Analysis of Solar Powered RC Aircraft
Design and Analysis of Solar Powered RC Aircraft
 
Tdtd-Edr: Time Orient Delay Tolerant Density Estimation Technique Based Data ...
Tdtd-Edr: Time Orient Delay Tolerant Density Estimation Technique Based Data ...Tdtd-Edr: Time Orient Delay Tolerant Density Estimation Technique Based Data ...
Tdtd-Edr: Time Orient Delay Tolerant Density Estimation Technique Based Data ...
 
Geophysical Investigation for Groundwater Potential in Rufus Giwa Polytechnic...
Geophysical Investigation for Groundwater Potential in Rufus Giwa Polytechnic...Geophysical Investigation for Groundwater Potential in Rufus Giwa Polytechnic...
Geophysical Investigation for Groundwater Potential in Rufus Giwa Polytechnic...
 
Enhancing the Performance of 75mw Steam Power Plant with Second Law Efficienc...
Enhancing the Performance of 75mw Steam Power Plant with Second Law Efficienc...Enhancing the Performance of 75mw Steam Power Plant with Second Law Efficienc...
Enhancing the Performance of 75mw Steam Power Plant with Second Law Efficienc...
 
Justification for Oil Well Stimulation
Justification for Oil Well StimulationJustification for Oil Well Stimulation
Justification for Oil Well Stimulation
 
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
Socio-cultural Study of the Unattended Urban Poor (Study of the Poor in the C...
 
Test Rig of Free End Torsion Effect on Linear Strain
Test Rig of Free End Torsion Effect on Linear StrainTest Rig of Free End Torsion Effect on Linear Strain
Test Rig of Free End Torsion Effect on Linear Strain
 
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
Underground Water Quantity and Quality Assessment in Next Decade in Bilaspur ...
 
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
An Evaluation of the Impact of Government Assisted Housing Programmes (GAHPs)...
 
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using FeaMicro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
Micro Mechanical Modeling of Fiber / Epoxy Unidirectional Laminates Using Fea
 
Solar Tracker Module with Automated Module Cleaning System
Solar Tracker Module with Automated Module Cleaning SystemSolar Tracker Module with Automated Module Cleaning System
Solar Tracker Module with Automated Module Cleaning System
 
Avaliability and Usage of Ict Resources for Chemistry Curriculum Delivery in ...
Avaliability and Usage of Ict Resources for Chemistry Curriculum Delivery in ...Avaliability and Usage of Ict Resources for Chemistry Curriculum Delivery in ...
Avaliability and Usage of Ict Resources for Chemistry Curriculum Delivery in ...
 
Study of the mechanical fracture behavior of rigid PVC pipes buried supply of...
Study of the mechanical fracture behavior of rigid PVC pipes buried supply of...Study of the mechanical fracture behavior of rigid PVC pipes buried supply of...
Study of the mechanical fracture behavior of rigid PVC pipes buried supply of...
 
Feasibility of an eco – friendly disposal method for Iron ore tailings
Feasibility of an eco – friendly disposal method for Iron ore tailingsFeasibility of an eco – friendly disposal method for Iron ore tailings
Feasibility of an eco – friendly disposal method for Iron ore tailings
 
Method Of Compensation Instability Of Frequency Modulators In The Absence Of ...
Method Of Compensation Instability Of Frequency Modulators In The Absence Of ...Method Of Compensation Instability Of Frequency Modulators In The Absence Of ...
Method Of Compensation Instability Of Frequency Modulators In The Absence Of ...
 

Similar to Hand gesture recognition using support vector machine

Similar to Hand gesture recognition using support vector machine (20)

IRJET- Survey Paper on Vision based Hand Gesture Recognition
IRJET- Survey Paper on Vision based Hand Gesture RecognitionIRJET- Survey Paper on Vision based Hand Gesture Recognition
IRJET- Survey Paper on Vision based Hand Gesture Recognition
 
Sign Language Identification based on Hand Gestures
Sign Language Identification based on Hand GesturesSign Language Identification based on Hand Gestures
Sign Language Identification based on Hand Gestures
 
Gesture Recognition System
Gesture Recognition SystemGesture Recognition System
Gesture Recognition System
 
Cc4301455457
Cc4301455457Cc4301455457
Cc4301455457
 
G0342039042
G0342039042G0342039042
G0342039042
 
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLESIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
 
IRJET- Convenience Improvement for Graphical Interface using Gesture Dete...
IRJET-  	  Convenience Improvement for Graphical Interface using Gesture Dete...IRJET-  	  Convenience Improvement for Graphical Interface using Gesture Dete...
IRJET- Convenience Improvement for Graphical Interface using Gesture Dete...
 
Hand gesture recognition using machine learning algorithms
Hand gesture recognition using machine learning algorithmsHand gesture recognition using machine learning algorithms
Hand gesture recognition using machine learning algorithms
 
MOUSE SIMULATION USING NON MAXIMUM SUPPRESSION
MOUSE SIMULATION USING NON MAXIMUM SUPPRESSIONMOUSE SIMULATION USING NON MAXIMUM SUPPRESSION
MOUSE SIMULATION USING NON MAXIMUM SUPPRESSION
 
Sign Language Recognition using Machine Learning
Sign Language Recognition using Machine LearningSign Language Recognition using Machine Learning
Sign Language Recognition using Machine Learning
 
Deep hypersphere embedding for real-time face recognition
Deep hypersphere embedding for real-time face recognitionDeep hypersphere embedding for real-time face recognition
Deep hypersphere embedding for real-time face recognition
 
Surveillance using Video Analytics
Surveillance using Video AnalyticsSurveillance using Video Analytics
Surveillance using Video Analytics
 
Sign Language Detection using Action Recognition
Sign Language Detection using Action RecognitionSign Language Detection using Action Recognition
Sign Language Detection using Action Recognition
 
IRJET- Sign Language Interpreter
IRJET- Sign Language InterpreterIRJET- Sign Language Interpreter
IRJET- Sign Language Interpreter
 
IRJET- Analysing Wound Area Measurement using Android App
IRJET- Analysing Wound Area Measurement using Android AppIRJET- Analysing Wound Area Measurement using Android App
IRJET- Analysing Wound Area Measurement using Android App
 
Detection of Virtual Passive Pointer
Detection of Virtual Passive PointerDetection of Virtual Passive Pointer
Detection of Virtual Passive Pointer
 
Inspection of Suspicious Human Activity in the Crowd Sourced Areas Captured i...
Inspection of Suspicious Human Activity in the Crowd Sourced Areas Captured i...Inspection of Suspicious Human Activity in the Crowd Sourced Areas Captured i...
Inspection of Suspicious Human Activity in the Crowd Sourced Areas Captured i...
 
A Gesture Based Digital Art with Colour Coherence Vector Algorithm
A Gesture Based Digital Art with Colour Coherence Vector AlgorithmA Gesture Based Digital Art with Colour Coherence Vector Algorithm
A Gesture Based Digital Art with Colour Coherence Vector Algorithm
 
PARALLEL GENERATION OF IMAGE LAYERS CONSTRUCTED BY EDGE DETECTION USING MESSA...
PARALLEL GENERATION OF IMAGE LAYERS CONSTRUCTED BY EDGE DETECTION USING MESSA...PARALLEL GENERATION OF IMAGE LAYERS CONSTRUCTED BY EDGE DETECTION USING MESSA...
PARALLEL GENERATION OF IMAGE LAYERS CONSTRUCTED BY EDGE DETECTION USING MESSA...
 
VIDEO BASED SIGN LANGUAGE RECOGNITION USING CNN-LSTM
VIDEO BASED SIGN LANGUAGE RECOGNITION USING CNN-LSTMVIDEO BASED SIGN LANGUAGE RECOGNITION USING CNN-LSTM
VIDEO BASED SIGN LANGUAGE RECOGNITION USING CNN-LSTM
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Hand gesture recognition using support vector machine

  • 1. The International Journal Of Engineering And Science (IJES) || Volume || 4 || Issue || 6 || Pages || PP.42-46 || June - 2015 || ISSN (e): 2319 – 1813 ISSN (p): 2319 – 1805 www.theijes.com The IJES Page 42 Hand gesture recognition using support vector machine Nagashree R N1 , Stafford Michahial1 , Aishwarya G N2 , Beebi Hajira Azeez2 , Jayalakshmi M R2 , R Krupa Rani2 1 Asst. Professor, Dept of Telecommunication, GSSSIETW, Mysuru. 2 Student of 8th sem, Dept of Telecommunication, GSSSIETW, Mysuru. ----------------------------------------------------------ABSTRACT----------------------------------------------------------- The images contain measurement information of key interest for a variety of research and application areas. On the other hand, computers have become an inseparable part of our society, influencing many aspects of our daily lives in terms of communication and interaction. The main motive is to develop a system that can simplify the way humans interact with Computers. The system is designed using Canny’s edge detection for edge detection and Histogram of gradients for feature extraction and the Support Vector Machine (SVM) Classifier which is widely used for classification and regression testing. SVM training algorithm builds a model that predicts whether a new example falls into one category or other. And the classifier learns from the data points in examples when they are classified belonging to their respective categories. KEYWORDS – SVM, Canny’s Edge detection, Feature extraction, HOG. --------------------------------------------------------------------------------------------------------------------------------------- Date of Submission: 20-May-2015 Date of Accepted: 08-June-2015 --------------------------------------------------------------------------------------------------------------------------------------- I. INTRODUCTION With the continued growth of multimedia and communication systems, the instrumentation and measurement fields have seen a steady increase in the focus on the image data. Digital image processing deals with manipulation of digital images through a digital computer. It is a subfield of signals and systems but focus particularly on images. DIP focuses on developing a computer system that is able to perform processing on an image. The input of that system is a digital image and the system process that image using efficient algorithms, and gives an image as an output [1]. A gesture is a form of non-verbal communication in which visible bodily actions communicate particular messages, either in place of speech or together and in parallel with spoken words. Gestures can be static (posture or certain pose) which require less computational complexity or dynamic (sequence of postures) which are more complex but suitable for real time environments. Different methods have been proposed for acquiring information necessary for recognition gestures system. Some methods used additional hardware devices such as data glove devices and color markers to easily extract comprehensive description of gesture features. Other methods based on the appearance of the hand using the skin color to segment the hand and extract necessary features, these methods considered easy, natural and less cost comparing with methods mentioned before. It includes movement of the hands, face, or other parts of the body. Gesture recognition can be seen as a way for computers to begin to understand human body language, thus building a richer bridge between machines and humans than primitive text user interfaces or even Graphical User Interfaces (GUIs), which still limit the majority of input to keyboard and mouse [1]. It enables humans to interface with the machine (HMI) and interact naturally without any mechanical devices. The main purpose of developing such a system lies in the fact that gesture recognition has implemented in motion analysis to machine learning. It also serves many applications from virtual reality to sign language recognition. A lot of research has been carried out in last 2-3 decades on hand gesture recognition approach. These can be roughly divided into two categories, namely, Glove Based Gesture Recognition and Vision Based Gesture Recognition. Glove based Hand Gesture Recognition hinders the naturalness as cumbersome devices are required to wear. A Vision Based approach uses features extracted from visual appearance of the input image model of the hand, comparing these modelled features with features extracted from input camera(s) or video input [4]. Here we are emphasising on different aspects of Hand Gesture Recognition with Support Vector Machine as a classifier.
  • 2. Hand gesture recognition using support vector machine www.theijes.com The IJES Page 43 II. OBJECTIVE The SVM is a popular pattern recognition technique with supervised learning. Since it divides the feature space for each class, the SVM can handle unknown data well, although it is not suited to grouping sample data. Support Vector Machines (SVM) is a linear machine with some very good properties. The main idea of a SVM in the context of pattern classification is to construct a hyper plane as the decision surface. The hyper plane is constructed in such a way that the margin of separation between positive and negative examples is maximized. The SVM uses a principled approach based on statistical learning theory know as structural risk minimization, which minimizes an upper bound on the generalization error(i.e. a parameter estimation heuristic that seeks parameter values that minimize the „risk‟ or „loss‟ that the model incurs on the training data). III. DESIGN METHODOLOGY The project involves the use of web camera which takes the input; it will also sense the depth of an image. The Hand gesture classification is done in two phases. The first is the training phase where we train the system with certain predefined symbols and we store them in the database of the system for further classification. The second phase is the testing phase where the system is given the symbols and it compares it with the symbols in the database and compares the most matched feature and gives the output. Fig 1 Block Diagram The processing involves acquiring the hand gesture using a web camera. In the per-processing stage a bounding box is created to identify the hand for the separation of the foreground from the background. This is done by making use of difference in consecutive frames. The acquired image is subjected to resizing in order to have faster computation. The edge of the resized image is detected using Canny‟s edge detection. The extraction of the feature of the image is done using Histogram of gradients (HOG). The extracted features are stored in database. SVM compares the image with the most matched feature in the database and gives the output on the screen. a) CANNY’S EDGE DETECTION Edge detection is the name for a set of mathematical methods which aim at identifying points in a digital image at which the image brightness changes sharply or more formally, has discontinuities. The point at which image brightness changes sharply are typically organized into a set of curved line segments termed as edges. The purpose of Edge detection in general is to significantly reduce the amount of data in an image, while preserving the structural properties to be used for further image processing. Canny‟s Edge Detection one of the edge detection method which was developed by John F Canny (JFC) in 1986. This method makes use smoothing concept which is applied in the Gaussian operation, this makes error detection more effective. This also improves the signal with respect to the noise ratio and this is established by non-maxima suppression method as it results in one pixel wide ridges as the output. Another advantage is better detection of edges especially in noise state. Even though it is quite old, it has become one of the standard edge detection methods and it is still used in research. The algorithm runs in five different steps Fig 2 Canny‟s Edge Detection Block Diagram
  • 3. Hand gesture recognition using support vector machine www.theijes.com The IJES Page 44 i) Smoothing: The image is then converted from RGB scale to Grey scale and is blurred in order to remove the noise that is accompanied during the image acquisition. The noise is removed using the Gaussian filter by specifying double threshold value. ii) Finding gradients: The edges should be marked where the gradients of the image has large magnitudes. iii) Non maximum suppression: Only local maxima should be marked as edges. iv) Double thresholding: Potential edges are determined by thresholding. v) Edge tracking by hysteresis: Final edges are determined by suppressing all edges that are not connected to a very certain edge. b) HISTOGRAM OF GRADIENTS Feature extraction is a type of dimensionality reduction that efficiently represents interesting part of an image as a compact feature vector. Detecting humans in images is a challenging task owing to their variable appearance and the wide range of poses that they can adopt. The first need is a robust feature set that allows the human form to be discriminated cleanly, even in cluttered backgrounds under difficult illumination. We study the issue of feature sets for human detection, showing that locally normalized Histogram of Oriented Gradient (HOG) descriptors provide excellent performance relative to other existing feature sets including wavelets. This approach is useful when the image sizes are large and a reduced feature representation is required to quickly complete tasks. This involves reducing the amount of resources required to describe a large set of data. HOG features were introduced by Navneed Dalal and Bill Triggs who have developed and tested several variants of HOG. HOG deals with moving body parts and are better compared to other feature extractors. The HOG algorithm includes the following steps: Fig 4 HOG Block Diagram i) Gradient Computation: The most common method is to apply the 1D centred point discrete derivative mask in both the horizontal and vertical directions. Specifically this method requires filtering the gray scale image. ii) Orientation Binning: This involves creating cell histograms. Each pixel within the cell casts a weighted vote for an orientation based histogram channel based on the values found in the gradient computation. iii) Descriptor Blocks: The gradient strengths must be locally normalized, which requires grouping the cells together into larger, spatially connected blocks. Two main block geometrics exist: Rectangular HOG(R- HOG) blocks, Circular HOG(C-HOG). c) CLASSIFICATION USING SUPPORT VECTOR MACHINE Classification is an ordered set of related categories used to group data according to its similarities. It consists of codes and descriptors and allows survey responses to be put into meaningful categories in order to produce useful data. It is a useful tool for developing statistical surveys. Classifier is an abstract metaclass which describes (classifies) set of instances having common features. Support Vector Machine (SVM), is one of the best machine learning algorithms, which was proposed in 1990‟s by Vapnik. SVM‟s are a set of related supervised learning methods used for classification and regression. A supervised learning is the machine learning task of inferring from supervised training data. A supervised learning algorithm analyzes the training data and produces an inferred function which is called a classifier. SVM has high accuracy, nice theoretical guarantees regarding over fitting, and with an appropriate kernel which can work well even when the data is not linearly separable in the base feature space. The support vector network is a new learning machine for two group classification problems. The machine conceptually implements the following idea: input vectors are non- linearly mapped to a very high dimensional feature space. In this feature space a linear decision surface is constructed. Special properties of decision surface ensures high generalisation ability of the learning machine. The idea behind support vector was previously implemented for the restricted case where the training data can be separated without errors.
  • 4. Hand gesture recognition using support vector machine www.theijes.com The IJES Page 45 Support vector machine constructs a hyperplane or set of hyperplanes in a high- or infinite-dimensional space, which can be used for classification, regression, or other tasks. A hyperplane is a subspace of one dimension less than its ambient space. A good separation is achieved by the hyperplane that has the largest distance to the nearest training-data point of any class. It is explicitly told to find the best separating line. It searches for the closest points which is called the "support vectors" (the name "support vector machine" is due to the fact that points are like vectors and that the best line "depends on" or is "supported by" the closest points). Once it has found the closest points, the SVM draws a line connecting them. It draws this connecting line by doing vector subtraction (point A - point B). The support vector machine then declares the best separating line to be the line that bisects -- and is perpendicular to -- the connecting line. The support vector machine is better because when you get a new sample (new points), you will have already made a line that keeps B and A as far away from each other as possible, and so it is less likely that one will spill over across the line into the other's territory. Fig 3 SVM classification. DATASET FOR CLASSIFICATION Fig 4 Dataset for classification
  • 5. Hand gesture recognition using support vector machine www.theijes.com The IJES Page 46 IV. EXPIRIMENTAL RESULT The software analysis is carried out using MATLAB, that facilitates matrix manipulations, plotting of functions and data, implementation of algorithms, creation of user interfaces, and interfacing with programs. In this section, the performance of real time static hand gesture recognition system in complex background is evaluated for each of the 20 hand gestures. And running input image is used for the performance evaluation. The images were acquired in true colour using a webcam. The images in the testing phase are compared with the database and the result is evaluated. Fig 4 Gesture Recognised V. CONCLUSION Area of Hand gesture based computer human interaction is very vast. This project recognizes hand gesture off-line so work can be done to do it for real time purpose. Hand recognition system can be useful in many fields like robotics, computer human interaction and so make this offline system for real time will be future work to do. Local contour sequence (LCS) is our prime feature in this project. LCS can be used with other features so that it can be optimized to achieve higher recognition accuracy. Support Vector Machine can be modified for reduction of complexity. Reduction of complexity leads us to a less computation time. Reduced complexity provides us less computation time so we can make system to work real time. The applications of hand gesture recognition is for non-verbal communication between human and computer, general fit person and physically challenged people, 3D gaming, virtual reality etc. The increase in applications, the gesture recognition system requires lots of research in different directions. A large number of research works carried out during last twenty years have been reviewed. The different sub-components, methodologies used for recognition of mainly hand gestures in those works have been described. A brief comparison of backgrounds, segmentation techniques, features used and the recognition methods have been done and presented. In today‟s digitized world, processing speeds have increased dramatically, with computers being advanced to the levels where they can assist humans in complex tasks. Yet, input technologies seem to cause a major bottleneck in performing some of the tasks, under-utilizing the available resources and restricting the expressiveness of application use. Hand Gesture recognition comes to rescue here. Computer Vision methods for hand gesture interfaces must surpass current performance in terms of robustness and speed to achieve interactivity and usability. A review of vision-based hand gesture recognition methods has been presented. Considering the relative infancy of research related to vision based gesture recognition remarkable progress has been made. To continue this momentum it is clear that further research in the areas of feature extraction, classification methods and gesture representation are required to realize the ultimate goal of humans interfacing with machines on their own natural terms. REFERENCES [1] Aseema Sultana, T Rajapuspha , “A vision based Hand gesture recognition” in the proceeding of IJCSET(2012), Vol 3,No 7. [2] S Nagarajan, T S Subashini, “Static Hand Gesture Recognition for Sign Language Alphabets using Edge Oriented Histogram” in the proceeding of IJCA(2013), Vol 82, No 4. [3] S. Naidoo, C.W. Omlin M. Glaser “Vision based Static Hand gesture recognition”, South Africa. [4] S. Mohamed Mansoor Roomi, R. Jyothi Priya and H. Jayalakshmi “Hand Gesture Recognition for Human-Computer Interaction”, in the proceedings of Journal Of Computer Science (2009).