This document provides a brief review of vision-based hand gesture recognition approaches. It discusses model-based approaches that use 3D hand models and appearance-based approaches that extract features directly from images without an explicit hand model. Model-based approaches attempt to match a 3D hand model to image data, while appearance-based approaches use classifiers on low-level features like color histograms or interest points. The document surveys recent works applying various features and machine learning methods for real-time hand gesture recognition.
This document discusses a hand gesture recognition system for underprivileged individuals. It begins by outlining the key steps in hand gesture recognition systems: image capture, pre-processing, segmentation, feature extraction and gesture recognition. It then goes into more detail on specific techniques for each step, such as thresholding and edge detection for segmentation. The document also covers applications like access control, sign language translation and future areas like biometric authentication. In conclusion, it proposes that hand gesture recognition can help disabled individuals communicate through accessible human-computer interaction.
Human Computer Interaction Based HEMD Using Hand GestureIJAEMSJORNAL
Hand gesture based Human-Computer-Interaction (HCI) is one of the most normal and spontaneous ways to communicate between people and apparatus to present a hand gesture recognition system with Webcam, Operates robustly in unrestrained environment and is insensible to hand variations and distortions. This classification consists of two major modules, that is, hand detection and gesture recognition. Diverse from conventional vision-based hand gesture recognition methods that use color-markers for hand detection, this system uses both the depth and color information from Webcam to detect the hand shape, which ensures the sturdiness in disorderly environments. Assurance its heftiness to input variations or the distortions caused by the low resolution of webcam, to apply a novel shape distance metric called Handle Earth Mover's Distance (HEMD) for hand gesture recognition. Consequently, in this paper concept operates accurately and efficiently. The intend of this paper is to expand robust and resourceful hand segmentation algorithm where three algorithms for hand segmentation using different color spaces with required thresholds have were utilized. Hand tracking and segmentation algorithm is found to be most resourceful to handle the challenge of apparition based organization such as skin dye detection. Noise may hold, for a moment, in the segmented image due to lively background. Tracking algorithm was developed and applied on the segmented hand contour for elimination of unnecessary background noise
The document discusses performance evaluation of neural network-based hand gesture recognition. It begins with an abstract describing the study, which tested a proposed algorithm on 100 sign images from American Sign Language (ASL). The algorithm improved true match rate from 77.7% to 84% while decreasing false match rate from 8.33% to 7.4%. The introduction provides background on pattern matching versus recognition algorithms. The rest of the document details hand gesture recognition approaches, importance of gestures for human-computer interaction, basic architecture of a gesture recognition system including data acquisition, modeling, and feature extraction stages, and challenges in hand gesture recognition.
A Fuzzy Watermarking Approach Based on Human Visual SystemCSCJournals
The implementation of our watermarking system is based on a hybrid system combining the human visual system (HVS) and the fuzzy inference system (FIS), which always passes through the transcription of human expertise in the form of fuzzy rules expressed in natural language, which allows our watermarking system remain understandable for non expert and become more friendly. The technique discussed in this paper is the use of an advanced approach to the technique of watermark that is the multi-watermark or the watermarking multiple of medical images in the frequency domain. In this approach, the emphasis will be on the safe side and the invisibility while maintaining robustness against a certain target range of attacks. Furthermore, this approach is based on an entirely blind technique which we will detail later.
A Pattern Classification Based approach for Blur Classificationijeei-iaes
Blur type identification is one of the most crucial step of image restoration. In case of blind restoration of such images, it is generally assumed that the blur type is known prior to restoration of such images. However, it is not practical in real applications. So, blur type identification is extremely desirable before application of blind restoration technique to restore a blurred image. An approach to categorize blur in three classes namely motion, defocus, and combined blur is presented in this paper. Curvelet transform based energy features are utilized as features of blur patterns and a neural network is designed for classification. The simulation results show preciseness of proposed approach.
Shadow Detection and Removal Techniques A Perspective Viewijtsrd
This document discusses techniques for shadow detection and removal in images. It provides an overview of various methods used, including those based on texture analysis, color information, Gaussian mixture models, and deterministic non-model based approaches. The document then reviews several published papers on different shadow detection and removal algorithms. These algorithms are compared based on advantages and disadvantages in terms of accuracy, computational efficiency, and applicability to different image types and conditions. The conclusion is that shadows remain a challenging problem for computer vision tasks and that the most suitable detection and removal technique depends on the specific image type and application.
Shadow Detection and Removal in Still Images by using Hue Properties of Color...ijsrd.com
This paper involves the review of the Shadow Detection and Removal in still images. No prior information has been used such as background images etc. for finding the shadows. It is a very challenging issue for the computer vision system that shadows effect the perception of artificial intelligence based machines in appropriately detecting the particular object as shadows also picked by them and detected as false positive objects. Also in surveillance, it affects the proper tracking of humans such as at airports. We proposed a method to remove shadows which eliminates the shadow much better than existed methods. RGB space has been used of the images and some morphological operations also applied to get better results.
This document discusses a hand gesture recognition system for underprivileged individuals. It begins by outlining the key steps in hand gesture recognition systems: image capture, pre-processing, segmentation, feature extraction and gesture recognition. It then goes into more detail on specific techniques for each step, such as thresholding and edge detection for segmentation. The document also covers applications like access control, sign language translation and future areas like biometric authentication. In conclusion, it proposes that hand gesture recognition can help disabled individuals communicate through accessible human-computer interaction.
Human Computer Interaction Based HEMD Using Hand GestureIJAEMSJORNAL
Hand gesture based Human-Computer-Interaction (HCI) is one of the most normal and spontaneous ways to communicate between people and apparatus to present a hand gesture recognition system with Webcam, Operates robustly in unrestrained environment and is insensible to hand variations and distortions. This classification consists of two major modules, that is, hand detection and gesture recognition. Diverse from conventional vision-based hand gesture recognition methods that use color-markers for hand detection, this system uses both the depth and color information from Webcam to detect the hand shape, which ensures the sturdiness in disorderly environments. Assurance its heftiness to input variations or the distortions caused by the low resolution of webcam, to apply a novel shape distance metric called Handle Earth Mover's Distance (HEMD) for hand gesture recognition. Consequently, in this paper concept operates accurately and efficiently. The intend of this paper is to expand robust and resourceful hand segmentation algorithm where three algorithms for hand segmentation using different color spaces with required thresholds have were utilized. Hand tracking and segmentation algorithm is found to be most resourceful to handle the challenge of apparition based organization such as skin dye detection. Noise may hold, for a moment, in the segmented image due to lively background. Tracking algorithm was developed and applied on the segmented hand contour for elimination of unnecessary background noise
The document discusses performance evaluation of neural network-based hand gesture recognition. It begins with an abstract describing the study, which tested a proposed algorithm on 100 sign images from American Sign Language (ASL). The algorithm improved true match rate from 77.7% to 84% while decreasing false match rate from 8.33% to 7.4%. The introduction provides background on pattern matching versus recognition algorithms. The rest of the document details hand gesture recognition approaches, importance of gestures for human-computer interaction, basic architecture of a gesture recognition system including data acquisition, modeling, and feature extraction stages, and challenges in hand gesture recognition.
A Fuzzy Watermarking Approach Based on Human Visual SystemCSCJournals
The implementation of our watermarking system is based on a hybrid system combining the human visual system (HVS) and the fuzzy inference system (FIS), which always passes through the transcription of human expertise in the form of fuzzy rules expressed in natural language, which allows our watermarking system remain understandable for non expert and become more friendly. The technique discussed in this paper is the use of an advanced approach to the technique of watermark that is the multi-watermark or the watermarking multiple of medical images in the frequency domain. In this approach, the emphasis will be on the safe side and the invisibility while maintaining robustness against a certain target range of attacks. Furthermore, this approach is based on an entirely blind technique which we will detail later.
A Pattern Classification Based approach for Blur Classificationijeei-iaes
Blur type identification is one of the most crucial step of image restoration. In case of blind restoration of such images, it is generally assumed that the blur type is known prior to restoration of such images. However, it is not practical in real applications. So, blur type identification is extremely desirable before application of blind restoration technique to restore a blurred image. An approach to categorize blur in three classes namely motion, defocus, and combined blur is presented in this paper. Curvelet transform based energy features are utilized as features of blur patterns and a neural network is designed for classification. The simulation results show preciseness of proposed approach.
Shadow Detection and Removal Techniques A Perspective Viewijtsrd
This document discusses techniques for shadow detection and removal in images. It provides an overview of various methods used, including those based on texture analysis, color information, Gaussian mixture models, and deterministic non-model based approaches. The document then reviews several published papers on different shadow detection and removal algorithms. These algorithms are compared based on advantages and disadvantages in terms of accuracy, computational efficiency, and applicability to different image types and conditions. The conclusion is that shadows remain a challenging problem for computer vision tasks and that the most suitable detection and removal technique depends on the specific image type and application.
Shadow Detection and Removal in Still Images by using Hue Properties of Color...ijsrd.com
This paper involves the review of the Shadow Detection and Removal in still images. No prior information has been used such as background images etc. for finding the shadows. It is a very challenging issue for the computer vision system that shadows effect the perception of artificial intelligence based machines in appropriately detecting the particular object as shadows also picked by them and detected as false positive objects. Also in surveillance, it affects the proper tracking of humans such as at airports. We proposed a method to remove shadows which eliminates the shadow much better than existed methods. RGB space has been used of the images and some morphological operations also applied to get better results.
There has been over the past few years, a very increased popularity for yoga. A lot of literatures have been published that claim yoga to be beneficial in improving the overall lifestyle and health especially in rehabilitation, mental health and more. Considering the fast-paced lives that individuals live, people usually prefer to exercise or work-out from the comfort of their homes and with that a need for an instructor arises. Hence why, we have developed a self-assisted system which can be used to detect and classify yoga asanas, which is discussed in-depth in this paper. Especially now when the pandemic has taken over the world, it is not feasible to attend physical classes or have an instructor over. Using the technology of Computer Vision, a computer-assisted system such as the one discussed, comes in very handy. The technologies such as ml5.js, PoseNet and Neural Networks are made use for the human pose estimation and classification. The proposed system uses the above-mentioned technologies to take in a real-time video input and analyze the pose of an individual, and classifies the poses into yoga asanas. It also displays the name of the yoga asana that is detected along with the confidence score.
Hand Gesture Recognition System for Human-Computer Interaction with Web-Camijsrd.com
This paper represents a comparative study of exiting hand gesture recognition systems and gives the new approach for the gesture recognition which is easy cheaper and alternative of input devices like mouse with static and dynamic hand gestures, for interactive computer applications. Despite the increase in the attention of such systems there are still certain limitations in literature. Most applications require different constraints like having distinct lightning conditions, usage of a specific camera, making the user wear a multi-coloured glove or need lots of training data. The use of hand gestures provides an attractive alternative to cumbersome interface devices for human-computer interaction (HCI). This interface is simple enough to be run using an ordinary webcam and requires little training.
Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...IJSRD
Person detection in a video surveillance system is major concern in real world. Several application likes abnormal event detection, congestion analysis, human gait characterization, fall detection, person identification, gender classification and for elderly people. In this algorithm, we use GMM method in background subtraction for multi person detection because of Gaussian Mixture Model (GMM) model is one such popular method this give a real time object detection. There is still not robustly but Multi person tracking with shadow removal fill this gap, in this work, HOG-LBP hybrid approach with GMM algorithm is presented for Multi person tracking with Shadow removal.
This document describes a study that used the curvelets transform method to identify abnormalities in MRI images. It begins with an abstract that outlines using curvelets to analyze different MRI image formats and calculate metrics like mean squared error and peak signal-to-noise ratio to evaluate image quality. The document then provides background on curvelets, wavelets, discrete wavelet transforms, and other digital image processing concepts. It describes applying curvelets and other methods to segment MRI images and identify abnormalities. The document presents results of applying curvelets versus other methods to several MRI images and concludes that curvelets provided more accurate and significant results for frequency and time representation with higher quality than older wavelet-based methods.
COMPRESSION BASED FACE RECOGNITION USING DWT AND SVMsipij
The biometric is used to identify a person effectively and employ in almost all applications of day to day
activities. In this paper, we propose compression based face recognition using Discrete Wavelet Transform
(DWT) and Support Vector Machine (SVM). The novel concept of converting many images of single person
into one image using averaging technique is introduced to reduce execution time and memory. The DWT is
applied on averaged face image to obtain approximation (LL) and detailed bands. The LL band coefficients
are given as input to SVM to obtain Support vectors (SV’s). The LL coefficients of DWT and SV’s are fused
based on arithmetic addition to extract final features. The Euclidean Distance (ED) is used to compare test
image features with database image features to compute performance parameters. It is observed that, the
proposed algorithm is better in terms of performance compared to existing algorithms.
ABSTRACT
The multimedia applications are rapidly increasing. It is essential to ensure the authenticity of multimedia
components. The image is one of the integrated components of the multimedia. In this paper ,we desing a
model based on customized filter mask to ensure the authenticity of image that means the image forgery
detection based on customized filter mask. We have satisfactory results for our dataset.
Literature Survey on Image Deblurring TechniquesEditor IJCATR
Image restoration and recognition has been of great importance nowadays. Face recognition becomes difficult when it comes
to blurred and poorly illuminated images and it is here face recognition and restoration come to picture. There have been many
methods that were proposed in this regard and in this paper we will examine different methods and technologies discussed so far. The
merits and demerits of different methods are discussed in this concern
A Deep Neural Framework for Continuous Sign Language Recognition by Iterative...ijtsrd
Sign Language SL is a medium of communication for physically disabled people. It is a gesture based language for communication of dumb and deaf people. These people communicate by using different actions of hands, where each different action means something. Sign language is the only way of conversation for deaf and dumb people. It is very difficult to understand this language for the common people. Hence sign language recognition has become an important task. There is a necessity for a translator to communicate with the world. Real time translator for sign language provides a medium to communicate with others. Previous methods employs sensor gloves, hat mounted cameras, armband etc. which has wearing difficulties and have noisy behaviour. To alleviate this problem, a real time gesture recognition system using Deep Learning DL is proposed. It enables to achieve improvements on the gesture recognition performance. Jeni Moni | Anju J Prakash ""A Deep Neural Framework for Continuous Sign Language Recognition by Iterative Training: Survey"" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-4 | Issue-2 , February 2020,
URL: https://www.ijtsrd.com/papers/ijtsrd30032.pdf
Paper Url : https://www.ijtsrd.com/engineering/computer-engineering/30032/a-deep-neural-framework-for-continuous-sign-language-recognition-by-iterative-training-survey/jeni-moni
Hand and wrist localization approach: sign language recognition Sana Fakhfakh
This document proposes a new method for hand detection and wrist localization to achieve automatic recognition of Arabic sign language gestures without clothing or background conditions. The method involves:
1) Using marker-controlled watershed segmentation to localize the hand region.
2) Rotating the hand region vertically, dividing it into sections, and detecting the wrist position as the first line with minimum white pixels in the hand region and maximum black pixels in the background region, focusing the search in the lower sections to avoid detecting fingers.
3) Extracting shape-based features like geometric moments and Zernike moments from the localized hand region to recognize Arabic digit sign gestures for sign language interaction.
Automatic Isolated word sign language recognitionSana Fakhfakh
This paper suggests a new system to help the
deaf and the hearing-impaired community improve their
connection with the hearing world and communicate
freely. The most important thing in this system is
how to help the users be free and finally have a more
natural way of communication. For this reason, we
present a new process based on two levels: a static-level
aiming to extract the most head/hands key points and
a dynamic-level with the objective of accumulating the
key-point trajectory matrix. Also our proposed approach
takes into account the signer-independence constraint.
A SIGNUM database is applied in the classification
stage and our system performances have improved with
a 94.3% recognition rate. Furthermore, a reduction
in time processing is obtained when the removing of
redundant frame step is applied. The obtained results
prove the superiority of our system compared to the
state-of- the-art methods in terms of recognition rate and
execution time.
WAVELET PACKET BASED IRIS TEXTURE ANALYSIS FOR PERSON AUTHENTICATIONsipij
There is considerable rise in the research of iris recognition system over a period of time. Most of the
researchers has been focused on the development of new iris pre-processing and recognition algorithms for
good quail iris images. In this paper, iris recognition system using Haar wavelet packet is presented.
Wavelet Packet Transform (WPT ) which is extension of discrete wavelet transform has multi-resolution
approach. In this iris information is encoded based on energy of wavelet packets.. Our proposed work
significantly decreases the error rate in recognition of noisy images. A comparison of this work with nonorthogonal Gabor wavelets method is done. Computational complexity of our work is also less as
compared to Gabor wavelets method.
A Review on Image Segmentation using Clustering and Swarm Optimization Techni...IJSRD
The process of dividing an image into multiple regions (set of pixels) is known as Image segmentation. It will make an image easy and smooth to evaluate. Image segmentation objective is to generate image more simple and meaningful. In this paper present a survey on image segmentation general segmentation techniques, clustering algorithms and optimization methods. Also a study of different research also been presented. The latest research in each of image segmentation methods is presented in this study. This paper presents the recent research in biologically inspired swarm optimization techniques, including ant colony optimization algorithm, particle swarm optimization algorithm, artificial bee colony algorithm and their hybridizations, which are applied in several fields.
The peer-reviewed International Journal of Engineering Inventions (IJEI) is started with a mission to encourage contribution to research in Science and Technology. Encourage and motivate researchers in challenging areas of Sciences and Technology.
Passive Image Forensic Method to Detect Resampling Forgery in Digital Imagesiosrjce
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
International Journal of Engineering and Science Invention (IJESI)inventionjournals
International Journal of Engineering and Science Invention (IJESI) is an international journal intended for professionals and researchers in all fields of computer science and electronics. IJESI publishes research articles and reviews within the whole field Engineering Science and Technology, new teaching methods, assessment, validation and the impact of new technologies and it will continue to provide information on the latest trends and developments in this ever-expanding subject. The publications of papers are selected through double peer reviewed to ensure originality, relevance, and readability. The articles published in our journal can be accessed online.
IJERA (International journal of Engineering Research and Applications) is International online, ... peer reviewed journal. For more detail or submit your article, please visit www.ijera.com
VIDEO SEGMENTATION FOR MOVING OBJECT DETECTION USING LOCAL CHANGE & ENTROPY B...csandit
Motion detection and object segmentation are an important research area of image-video
processing and computer vision. The technique and mathematical modeling used to detect and
segment region of interest (ROI) objects comprise the algorithmic modules of various high-level
techniques in video analysis, object extraction, classification, and recognition. The detection of
moving object is significant in many tasks, such as video surveillance & moving object tracking.
The design of a video surveillance system is directed on involuntary identification of events of
interest, especially on tracking and on classification of moving objects. An entropy based realtime
adaptive non-parametric window thresholding algorithm for change detection is
anticipated in this research. Based on the approximation of the value of scatter of sections of
change in a difference image, a threshold of every image block is calculated discriminatively
using entropy structure, and then the global threshold is attained by averaging all thresholds for
image blocks of the frame. The block threshold is calculated contrarily for regions of change
and background. Investigational results show the proposed thresholding algorithm
accomplishes well for change detection with high efficiency.
The document discusses improving the customer experience on a website. It identifies issues with the current site such as poor usability, unappealing design, and a lack of personalization. It proposes improvements like predictive search, removing distracting banners, and personalized content. It also discusses enabling an omni-channel experience by integrating different sales channels like web, mobile, and call centers to provide a seamless customer journey from discovery to after-sales. Previous work in areas like master data management that could help support these goals is also mentioned. The overall aim is to create a more customer-focused website to enhance the user experience.
This document discusses the relationship between gestures and diagrams in mathematical thinking and problem solving. It argues that gestures and diagrams are embodied acts that constitute new relationships between people and mathematics, rather than just representations of abstract concepts. The work of philosopher Gilles Châtelet is used to conceptualize gestures and diagrams as mutually dependent, with gestures giving rise to diagrams and diagrams enabling new gestures. Viewing gestures and diagrams this way provides a framework for understanding mathematical thinking and embodiment in a distributed, networked way rather than located within individuals.
World-Class Servitisation: Methods, Cases and PartnershipsTim McAloone
The document appears to be a presentation discussing product-service system (PSS) design and implementation. It notes that Denmark has a leading maritime industry and discusses how other industries can transition to servitization. The presentation outlines different factors to consider for PSS implementation, including when to transition, how to organize a company, and how to design and test business models for PSS. It also lists the various academic work and industry projects completed regarding PSS.
There has been over the past few years, a very increased popularity for yoga. A lot of literatures have been published that claim yoga to be beneficial in improving the overall lifestyle and health especially in rehabilitation, mental health and more. Considering the fast-paced lives that individuals live, people usually prefer to exercise or work-out from the comfort of their homes and with that a need for an instructor arises. Hence why, we have developed a self-assisted system which can be used to detect and classify yoga asanas, which is discussed in-depth in this paper. Especially now when the pandemic has taken over the world, it is not feasible to attend physical classes or have an instructor over. Using the technology of Computer Vision, a computer-assisted system such as the one discussed, comes in very handy. The technologies such as ml5.js, PoseNet and Neural Networks are made use for the human pose estimation and classification. The proposed system uses the above-mentioned technologies to take in a real-time video input and analyze the pose of an individual, and classifies the poses into yoga asanas. It also displays the name of the yoga asana that is detected along with the confidence score.
Hand Gesture Recognition System for Human-Computer Interaction with Web-Camijsrd.com
This paper represents a comparative study of exiting hand gesture recognition systems and gives the new approach for the gesture recognition which is easy cheaper and alternative of input devices like mouse with static and dynamic hand gestures, for interactive computer applications. Despite the increase in the attention of such systems there are still certain limitations in literature. Most applications require different constraints like having distinct lightning conditions, usage of a specific camera, making the user wear a multi-coloured glove or need lots of training data. The use of hand gestures provides an attractive alternative to cumbersome interface devices for human-computer interaction (HCI). This interface is simple enough to be run using an ordinary webcam and requires little training.
Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...IJSRD
Person detection in a video surveillance system is major concern in real world. Several application likes abnormal event detection, congestion analysis, human gait characterization, fall detection, person identification, gender classification and for elderly people. In this algorithm, we use GMM method in background subtraction for multi person detection because of Gaussian Mixture Model (GMM) model is one such popular method this give a real time object detection. There is still not robustly but Multi person tracking with shadow removal fill this gap, in this work, HOG-LBP hybrid approach with GMM algorithm is presented for Multi person tracking with Shadow removal.
This document describes a study that used the curvelets transform method to identify abnormalities in MRI images. It begins with an abstract that outlines using curvelets to analyze different MRI image formats and calculate metrics like mean squared error and peak signal-to-noise ratio to evaluate image quality. The document then provides background on curvelets, wavelets, discrete wavelet transforms, and other digital image processing concepts. It describes applying curvelets and other methods to segment MRI images and identify abnormalities. The document presents results of applying curvelets versus other methods to several MRI images and concludes that curvelets provided more accurate and significant results for frequency and time representation with higher quality than older wavelet-based methods.
COMPRESSION BASED FACE RECOGNITION USING DWT AND SVMsipij
The biometric is used to identify a person effectively and employ in almost all applications of day to day
activities. In this paper, we propose compression based face recognition using Discrete Wavelet Transform
(DWT) and Support Vector Machine (SVM). The novel concept of converting many images of single person
into one image using averaging technique is introduced to reduce execution time and memory. The DWT is
applied on averaged face image to obtain approximation (LL) and detailed bands. The LL band coefficients
are given as input to SVM to obtain Support vectors (SV’s). The LL coefficients of DWT and SV’s are fused
based on arithmetic addition to extract final features. The Euclidean Distance (ED) is used to compare test
image features with database image features to compute performance parameters. It is observed that, the
proposed algorithm is better in terms of performance compared to existing algorithms.
ABSTRACT
The multimedia applications are rapidly increasing. It is essential to ensure the authenticity of multimedia
components. The image is one of the integrated components of the multimedia. In this paper ,we desing a
model based on customized filter mask to ensure the authenticity of image that means the image forgery
detection based on customized filter mask. We have satisfactory results for our dataset.
Literature Survey on Image Deblurring TechniquesEditor IJCATR
Image restoration and recognition has been of great importance nowadays. Face recognition becomes difficult when it comes
to blurred and poorly illuminated images and it is here face recognition and restoration come to picture. There have been many
methods that were proposed in this regard and in this paper we will examine different methods and technologies discussed so far. The
merits and demerits of different methods are discussed in this concern
A Deep Neural Framework for Continuous Sign Language Recognition by Iterative...ijtsrd
Sign Language SL is a medium of communication for physically disabled people. It is a gesture based language for communication of dumb and deaf people. These people communicate by using different actions of hands, where each different action means something. Sign language is the only way of conversation for deaf and dumb people. It is very difficult to understand this language for the common people. Hence sign language recognition has become an important task. There is a necessity for a translator to communicate with the world. Real time translator for sign language provides a medium to communicate with others. Previous methods employs sensor gloves, hat mounted cameras, armband etc. which has wearing difficulties and have noisy behaviour. To alleviate this problem, a real time gesture recognition system using Deep Learning DL is proposed. It enables to achieve improvements on the gesture recognition performance. Jeni Moni | Anju J Prakash ""A Deep Neural Framework for Continuous Sign Language Recognition by Iterative Training: Survey"" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-4 | Issue-2 , February 2020,
URL: https://www.ijtsrd.com/papers/ijtsrd30032.pdf
Paper Url : https://www.ijtsrd.com/engineering/computer-engineering/30032/a-deep-neural-framework-for-continuous-sign-language-recognition-by-iterative-training-survey/jeni-moni
Hand and wrist localization approach: sign language recognition Sana Fakhfakh
This document proposes a new method for hand detection and wrist localization to achieve automatic recognition of Arabic sign language gestures without clothing or background conditions. The method involves:
1) Using marker-controlled watershed segmentation to localize the hand region.
2) Rotating the hand region vertically, dividing it into sections, and detecting the wrist position as the first line with minimum white pixels in the hand region and maximum black pixels in the background region, focusing the search in the lower sections to avoid detecting fingers.
3) Extracting shape-based features like geometric moments and Zernike moments from the localized hand region to recognize Arabic digit sign gestures for sign language interaction.
Automatic Isolated word sign language recognitionSana Fakhfakh
This paper suggests a new system to help the
deaf and the hearing-impaired community improve their
connection with the hearing world and communicate
freely. The most important thing in this system is
how to help the users be free and finally have a more
natural way of communication. For this reason, we
present a new process based on two levels: a static-level
aiming to extract the most head/hands key points and
a dynamic-level with the objective of accumulating the
key-point trajectory matrix. Also our proposed approach
takes into account the signer-independence constraint.
A SIGNUM database is applied in the classification
stage and our system performances have improved with
a 94.3% recognition rate. Furthermore, a reduction
in time processing is obtained when the removing of
redundant frame step is applied. The obtained results
prove the superiority of our system compared to the
state-of- the-art methods in terms of recognition rate and
execution time.
WAVELET PACKET BASED IRIS TEXTURE ANALYSIS FOR PERSON AUTHENTICATIONsipij
There is considerable rise in the research of iris recognition system over a period of time. Most of the
researchers has been focused on the development of new iris pre-processing and recognition algorithms for
good quail iris images. In this paper, iris recognition system using Haar wavelet packet is presented.
Wavelet Packet Transform (WPT ) which is extension of discrete wavelet transform has multi-resolution
approach. In this iris information is encoded based on energy of wavelet packets.. Our proposed work
significantly decreases the error rate in recognition of noisy images. A comparison of this work with nonorthogonal Gabor wavelets method is done. Computational complexity of our work is also less as
compared to Gabor wavelets method.
A Review on Image Segmentation using Clustering and Swarm Optimization Techni...IJSRD
The process of dividing an image into multiple regions (set of pixels) is known as Image segmentation. It will make an image easy and smooth to evaluate. Image segmentation objective is to generate image more simple and meaningful. In this paper present a survey on image segmentation general segmentation techniques, clustering algorithms and optimization methods. Also a study of different research also been presented. The latest research in each of image segmentation methods is presented in this study. This paper presents the recent research in biologically inspired swarm optimization techniques, including ant colony optimization algorithm, particle swarm optimization algorithm, artificial bee colony algorithm and their hybridizations, which are applied in several fields.
The peer-reviewed International Journal of Engineering Inventions (IJEI) is started with a mission to encourage contribution to research in Science and Technology. Encourage and motivate researchers in challenging areas of Sciences and Technology.
Passive Image Forensic Method to Detect Resampling Forgery in Digital Imagesiosrjce
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
International Journal of Engineering and Science Invention (IJESI)inventionjournals
International Journal of Engineering and Science Invention (IJESI) is an international journal intended for professionals and researchers in all fields of computer science and electronics. IJESI publishes research articles and reviews within the whole field Engineering Science and Technology, new teaching methods, assessment, validation and the impact of new technologies and it will continue to provide information on the latest trends and developments in this ever-expanding subject. The publications of papers are selected through double peer reviewed to ensure originality, relevance, and readability. The articles published in our journal can be accessed online.
IJERA (International journal of Engineering Research and Applications) is International online, ... peer reviewed journal. For more detail or submit your article, please visit www.ijera.com
VIDEO SEGMENTATION FOR MOVING OBJECT DETECTION USING LOCAL CHANGE & ENTROPY B...csandit
Motion detection and object segmentation are an important research area of image-video
processing and computer vision. The technique and mathematical modeling used to detect and
segment region of interest (ROI) objects comprise the algorithmic modules of various high-level
techniques in video analysis, object extraction, classification, and recognition. The detection of
moving object is significant in many tasks, such as video surveillance & moving object tracking.
The design of a video surveillance system is directed on involuntary identification of events of
interest, especially on tracking and on classification of moving objects. An entropy based realtime
adaptive non-parametric window thresholding algorithm for change detection is
anticipated in this research. Based on the approximation of the value of scatter of sections of
change in a difference image, a threshold of every image block is calculated discriminatively
using entropy structure, and then the global threshold is attained by averaging all thresholds for
image blocks of the frame. The block threshold is calculated contrarily for regions of change
and background. Investigational results show the proposed thresholding algorithm
accomplishes well for change detection with high efficiency.
The document discusses improving the customer experience on a website. It identifies issues with the current site such as poor usability, unappealing design, and a lack of personalization. It proposes improvements like predictive search, removing distracting banners, and personalized content. It also discusses enabling an omni-channel experience by integrating different sales channels like web, mobile, and call centers to provide a seamless customer journey from discovery to after-sales. Previous work in areas like master data management that could help support these goals is also mentioned. The overall aim is to create a more customer-focused website to enhance the user experience.
This document discusses the relationship between gestures and diagrams in mathematical thinking and problem solving. It argues that gestures and diagrams are embodied acts that constitute new relationships between people and mathematics, rather than just representations of abstract concepts. The work of philosopher Gilles Châtelet is used to conceptualize gestures and diagrams as mutually dependent, with gestures giving rise to diagrams and diagrams enabling new gestures. Viewing gestures and diagrams this way provides a framework for understanding mathematical thinking and embodiment in a distributed, networked way rather than located within individuals.
World-Class Servitisation: Methods, Cases and PartnershipsTim McAloone
The document appears to be a presentation discussing product-service system (PSS) design and implementation. It notes that Denmark has a leading maritime industry and discusses how other industries can transition to servitization. The presentation outlines different factors to consider for PSS implementation, including when to transition, how to organize a company, and how to design and test business models for PSS. It also lists the various academic work and industry projects completed regarding PSS.
Yuri van Geest is a speaker at Singularity University (NASA-Google) and Quantified Self Europe who is interested in topics like exponential growth, the law of accelerating returns, science fiction becoming reality, and emerging technologies converging biology and technology. Some technologies mentioned include Soylent food, Valkee light therapy, NovioSense glucose sensors, MC10 nano tattoos, and using gravity as a sensor. Contact information is provided at the end.
A short primer on experiment design. It's need more elaboration and a concise connection with the build - measure - learn loop. Read more in my blogpost: http://blog.firmhouse.com/a-short-primer-on-experiment-design-for-lean-startups
130607 yann-gael gueheneuc - ptidej tool suitePtidej Team
The Ptidej Tool Suite aims to analyze object-oriented programs to detect patterns at the code, design, and architecture levels in order to improve software quality, utilizing the Pattern and Abstract-level Description Language (PADL) meta-model to represent patterns and program structures for analysis by various PADL tools.
Enable U Mar 23 Bailetti Eco For Ec DevLisa Thompson
The document discusses Lead to Win, an initiative that uses a business ecosystem approach to create technology jobs in Canada's capital region. It operates through a three phase opportunity development process and provides founders with resources like mentors, financing assistance, and networking. The goal is for each startup that goes through the program to generate at least 6 new technology jobs over three years to build a healthy innovation ecosystem.
A Review Paper on Real-Time Hand Motion CaptureIRJET Journal
This document reviews various techniques for real-time hand motion capture. It discusses previous work that used particle swarm optimization and convolutional neural networks to estimate hand poses from RGB images or depth maps. More recent approaches use deep learning methods like generative adversarial networks to generate synthetic training data and improve generalization to real images. Current state-of-the-art methods leverage neural rendering and iterative model fitting to estimate 3D hand meshes and poses from single RGB images. These learning-based approaches achieve more accurate and robust real-time hand pose estimation compared to previous optimization-based methods.
Computer Based Human Gesture Recognition With Study Of AlgorithmsIOSR Journals
This document discusses computer-based human gesture recognition algorithms. It begins with an introduction to gesture recognition and its uses in human-computer interaction. It then describes two main approaches to gesture recognition: appearance-based and 3D model-based. For appearance-based recognition, it discusses active appearance models and histogram-of-motion words. For 3D model-based recognition, it discusses using 3D image data to achieve invariance to viewpoint. It also discusses representing gestures as sequences of motion primitives to achieve viewpoint independence. Finally, it discusses skeletal algorithms that represent body pose as joint configurations and angles.
Hand gesture recognition using support vector machinetheijes
1) The document describes a system for hand gesture recognition using support vector machines. It uses Canny's edge detection algorithm and histogram of gradients (HOG) for feature extraction from input images of hand gestures.
2) The system is trained using a dataset of predefined hand gestures. During testing, it compares the features extracted from new input images to those in the training dataset and classifies the gesture using an SVM classifier.
3) Experimental results found the system could accurately recognize 20 different static hand gestures in complex backgrounds. However, the authors note that future work could focus on real-time gesture recognition and reducing complexity for faster processing.
3D Human Hand Posture Reconstruction Using a Single 2D ImageWaqas Tariq
Passive sensing of the 3D geometric posture of the human hand has been studied extensively over the past decade. However, these research efforts have been hampered by the computational complexity caused by inverse kinematics and 3D reconstruction. In this paper, our objective focuses on 3D hand posture estimation based on a single 2D image with aim of robotic applications. We introduce the human hand model with 27 degrees of freedom (DOFs) and analyze some of its constraints to reduce the DOFs without any significant degradation of performance. A novel algorithm to estimate the 3D hand posture from eight 2D projected feature points is proposed. Experimental results using real images confirm that our algorithm gives good estimates of the 3D hand pose. Keywords: 3D hand posture estimation; Model-based approach; Gesture recognition; human- computer interface; machine vision.
This document summarizes a survey paper on hand gesture recognition using color hex matrices and hidden Markov models. It discusses limitations of current vision-based and data glove-based recognition methods and proposes a solution using a webcam to capture hand images, convert them to RGB matrices, and recognize gestures by comparing changes in the matrices over time using hidden Markov models. The method aims to provide low-cost real-time hand gesture recognition using commonly available hardware and software.
Hand gesture recognition using machine learning algorithmsCSITiaesprime
Gesture recognition is an emerging topic in today’s technologies. The main focus of this is to recognize the human gestures using mathematical algorithms for human computer interaction. Only a few modes of human-computer interaction exist, they are: through keyboard, mouse, touch screens etc. Each of these devices has their own limitations when it comes to adapting more versatile hardware in computers. Gesture recognition is one of the essential techniques to build user-friendly interfaces. Usually, gestures can be originated from any bodily motion or state, but commonly originate from the face or hand. Gesture recognition enables users to interact with the devices without physically touching them. This paper describes how hand gestures are trained to perform certain actions like switching pages, scrolling up or down in a page.
The document discusses gesture-based computing as an alternative to mouse input for human-computer interaction. It proposes a novel approach for implementing a real-time gesture recognition system capable of understanding commands based on analyzing the principal contour and fingertips of hand gestures. Vision-based gesture recognition techniques are discussed that do not require additional devices for users to interact with computers through natural hand motions.
The document describes a system for 3D modeling using hand gestures as input. It uses a vision-based tracking system to recognize hand gestures without any instruments attached to the hands. The system supports basic modeling tasks like selection, translation, rotation, and scaling of 3D objects using just five static hand gestures. Visual feedback is provided to help users perceive interactions. The goal is to provide an intuitive interface for 3D modeling that requires little or no training.
This document proposes an e-learning application called ELGR that uses gesture recognition to control a computer interface. Specifically, it aims to recognize finger movements and patterns to perform mouse operations like clicking, dragging, etc. The application would use color tracking rather than complex RGB-to-YCbCr conversion to identify gestures in real time. The document reviews literature on gesture recognition techniques, discusses relevant concepts in image processing and computer vision, and outlines the proposed seven-step algorithm for ELGR to provide a more natural user experience for e-learning.
Natural Hand Gestures Recognition System for Intelligent HCI: A SurveyEditor IJCATR
Gesture recognition is to recognizing meaningful expressions of motion by a human, involving the hands, arms, face, head,
and/or body. Hand Gestures have greater importance in designing an intelligent and efficient human–computer interface. The applications
of gesture recognition are manifold, ranging from sign language through medical rehabilitation to virtual reality. In this paper a survey on
various recent gesture recognition approaches is provided with particular emphasis on hand gestures. A review of static hand posture
methods are explained with different tools and algorithms applied on gesture recognition system, including connectionist models, hidden
Markov model, and fuzzy clustering. Challenges and future research directions are also highlighted.
Vision Based Gesture Recognition Using Neural Networks Approaches: A ReviewWaqas Tariq
The aim of gesture recognition researches is to create system that easily identifies gestures, and use them for device control, or convey in formations. In this paper we are discussing researches done in the area of hand gesture recognition based on Artificial Neural Networks approaches. Several hand gesture recognition researches that use Neural Networks are discussed in this paper, comparisons between these methods were presented, advantages and drawbacks of the discussed methods also included, and implementation tools for each method were presented as well.
Social Service Robot using Gesture recognition techniqueChristo Ananth
A robot is a machine that can automatically do a task or a series of tasks based on its programming and environment. They are artificially built machines or devices that can perform activities with utmost accuracy and precision minimizing time constraints. Service robots are technologically advanced machines deployed to service and maintain certain activities. Research findings convey the essential fact that serving robots are now being deployed worldwide. Social robotics is one such field that heavily involves an interaction between humans and an artificially built machine. These man-built machines interact with humans and can also understand social terms and words. Modernization has bought changes in design and mechanisms due to this ever-lasting growth in technology and innovation. Therefore, food industries are also dynamically adapting to the new changes in the field of automation to reduce human workload and increase the quality of service. Deployment of a robot in the food industries which help to aid deaf and mute people who face social constraints is an evergrowing challenge faced by engineers for the last few decades. Moreover, a contactless form of speedy service system which accomplishes its task with at most precision and reduced complexity is a feat yet to be perfected. Preservation of personal hygiene, a better quality of service, and reduced labour costs is achieved.
The document describes a gesture recognition system that uses computer vision techniques. It discusses different approaches to hand gesture recognition including vision-based, glove-based, and depth-based techniques. The proposed system uses computer vision and media pipe libraries to track hand landmarks and recognize gestures in real-time. It then uses those gestures to control functions like a virtual mouse, change volume, and zoom in/out. The system aims to provide natural human-computer interaction through contactless hand gesture recognition.
The document discusses visual interpretation of hand gestures for human-computer interaction. It proposes using pointing gestures with a depth camera to interact with large displays. The system tracks hand movements using RGB-D cameras and uses the hand position and orientation to control the movement and rotation of virtual objects in a display. It discusses approaches for modeling, recognizing, and analyzing hand gestures as well as applications of gesture-based interaction systems. The methodology presented uses color segmentation and centroid tracking of a user's hand to determine coordinates and control a virtual object similarly to a computer mouse.
HUMAN COMPUTER INTERACTION ALGORITHM BASED ON SCENE SITUATION AWARENESScsandit
Implicit interaction based on context information is widely used and studied in the virtual scene.In context based human computer interaction, the meaning of action A is well defined. For instance, the right wave is defined turning paper or PPT in context B, And it mean volume up in context C. However, Select object in a virtual scene with multiple objects, context information is not fit. In view of this situation, this paper proposes using the least squares fitting curve beam to
predict the user's trajectory, so as to determine what object the user’s wants to operate .And fitting the starting position of the straight line according to the change of the discrete table. And
using the bounding box size control the Z variable to move in an appropriate location. Experimental results show that the proposed in this paper based on bounding box size to control
the Z variables get a good effect; by fitting the trajectory of a human hand, to predict the object that the subjects would like to operate. The correct rate is 88.6%.
Human Computer Interaction Algorithm Based on Scene Situation Awareness cscpconf
- The document proposes an algorithm for human-computer interaction based on scene situation awareness. It uses least squares fitting to predict the trajectory of a user's hand movement and determine what object the user wants to interact with.
- The algorithm first segments the user's hand from images and extracts features. It then fits the trajectory of hand movements with a nonlinear curve to predict the interaction target. Bounding box size is used to control movement in the z-axis for object selection.
- An experiment using this algorithm achieved an 88.6% correct rate in predicting the object a user intended to interact with based on fitting their hand trajectory.
This document summarizes research on optimized fingerprint compression without loss of data. It discusses how fingerprint recognition works by extracting minutiae features from fingerprints. It then describes the proposed fingerprint recognition method using minutiae score matching (FRMSM), which uses block filtering for thinning fingerprints to preserve image quality while extracting minutiae. Experimental results showed the false matching ratio was better than existing algorithms. The document also provides background on biometric systems and fingerprint recognition. It reviews related work on fingerprint enhancement, orientation field estimation, and minutiae extraction. The proposed system describes a line extraction and graph matching approach for fingerprint matching with improved robustness. Modules for the system include authentication, image capturing, fingerprint matching, binarization, and
A hybrid learning scheme towards authenticating hand-geometry using multi-mo...IJECEIAES
Usage of hand geometry towards biometric-based authentication mechanism has been commercially practiced since last decade. However, there is a rising security problem being surfaced owing to the fluctuating features of hand-geometry during authentication mechanism. Review of existing research techniques exhibits the usage of singular features of hand-geometric along with sophisticated learning schemes where accuracy is accomplished at the higher cost of computational effort. Hence, the proposed study introduces a simplified analytical method which considers multi-modal features extracted from hand geometry which could further improve upon robust recognition system. For this purpose, the system considers implementing hybrid learning scheme using convolution neural network and Siamese algorithm where the former is used for feature extraction and latter is used for recognition of person on the basis of authenticated hand geometry. The main results show that proposed scheme offers 12.2% of improvement in accuracy compared to existing models exhibiting that with simpler amendment by inclusion of multi-modalities, accuracy can be significantly improve without computational burden.
Obstacle detection for autonomous systems using stereoscopic images and bacte...IJECEIAES
This paper presents a low cost strategy for real-time estimation of the position of ob- stacles in an unknown environment for autonomous robots. The strategy was intended for use in autonomous service robots, which navigate in unknown and dynamic indoor environments. In addition to human interaction, these environments are characterized by a design created for the human being, which is why our developments seek morphological and functional similarity equivalent to the human model. We use a pair of cameras on our robot to achieve a stereoscopic vision of the environment, and we analyze this information to determine the distance to obstacles using an algorithm that mimics bacterial behavior. The algorithm was evaluated on our robotic platform demonstrating high performance in the location of obstacles and real-time operation.
A Study on Sparse Representation and Optimal Algorithms in Intelligent Comput...MangaiK4
This document summarizes research on sparse representation techniques and optimal algorithms for computer vision tasks. It discusses how sparse representation can provide efficient encoding of images and signals. Two key computer vision problems discussed are face recognition and human pose estimation. The document proposes a model that uses sparse representation and parallel processing algorithms to recognize faces, estimate poses, and convert that information into voice signals to assist visually impaired users in understanding images.
A Study on Sparse Representation and Optimal Algorithms in Intelligent Comput...
Review by g siminon latest 2011
1. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
A Brief Review of Vision Based Hand Gesture Recognition
GEORGIANA SIMION (1), VASILE GUI (2), MARIUS OTEȘTEANU
Department of Communication
Politehnica University of Timișoara
Bd. Vasile Pârvan No.2, Timișoara
ROMANIA
georgiana.simion@etc.upt.ro, vasile.gui@etc.upt.ro, marius.otesteanu@etc.upt.ro
Abstract: - The evolution of user interfaces shapes the changes in Human-Computer Interaction (HCI). Direct
use of hand as an input device is an attractive method for providing natural HCI. The applications of gesture
recognition are manifold, ranging from sign language to medical rehabilitation to virtual reality. In this paper
we present a brief review of vision based hand gesture recognition.
Key-Words: - hand gestures, recognition, model based approach, view based approach, human computer
interaction, applications
1 Introduction there are non invasive and are based on the way
People perform various gestures in their human beings perceive information about their
daily lives. It is in our nature to use gestures in order surroundings. Although it is difficult to design a
to improve the communication between us. Try to vision based interface for generic usage, yet it is
imagine speaking with a person who makes no feasible to design such an interface for a controlled
gesture. It is very difficult to understand if your environment but has no lake of challenges including
message is clear for him or her, if he or she agrees accuracy, processing speed.
with your saying, in other words it is very hard to This paper is organized as follows: In section 2
guess what type of reaction your message produces. we provide a survey on vision based hand gesture
Between all kind of gestures that we perform, hand recognition. In section 3 we present various
gestures play an important role. Hand gestures can applications areas for gesture recognition and in
help us say more in less time. In these days, section 4 we give the conclusions.
computers have become an important part in our
lives, so why not use hand gesture in order to
communicate with them. 2 Problem Formulation
The direct use of the hand as an input device is The approaches to Vision based hand gesture
an attractive method for providing natural Human– recognition can be divided into two categories: 3 D
Computer Interaction. Two approaches are hand model based approaches and appearance based
commonly used to interpret gestures for Human approaches [1].
Computer Interaction.
Methods Which Use Data Gloves: Since 2.1 Model based approach
now, the only technology that satisfies the advanced Model based approaches attempt to infer the
requirements of hand-based input for HCI is glove- pose of the palm and the joint angles, this approach
based sensing This method employs sensors is ideal for realistic interactions in virtual
(mechanical or optical) attached to a glove that environments. By large, the approach consists of
transducers’ finger flexions into electrical signals searching for the kinematic parameters that brings
for determining the hand posture. Several the 2D projection of a 3D model of hand into
drawbacks make this technology not so popular: correspondence with an edge-based image of a
first of all interaction with the computer-controlled hand.
environment loses naturalness and easiness the user The model of the hand can be more or less
is forced to carry a load of cables which are elaborated.
connected to the computer and it also requires A 3D model with 27 degrees of freedom
calibration and setup procedures. (DOF) was introduced and, it has been used in many
Methods which are Vision Based: Computer
vision based techniques have the potential to
provide more natural and non-contact solutions,
ISBN: 978-1-61804-062-6 181
2. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
studies and it is shown in Fig. 1 a. between the profiles and edges extracted from the
images.
In [10] they have reformulated the problem
within a Bayesian (probabilistic) framework.
Bayesian approaches allow for the pooling of
multiple sources of information (e.g. system
dynamics, prior observations) to arrive at both an
optimal estimate of the parameters and a probability
distribution of the parameter space to guide future
search for parameters. On contrary to Kalman filter
approach, Bayesian approaches allow nonlinear
. system formulations and non- Gaussian (multi-
a) b) modal) uncertainty (e.g.caused by occlusions) at the
Fig.1. Skeletal hand model: (a) Hand expense of a closed-form solution of the uncertainty.
anatomy, (b) the kinematic model according to [7] In [12], a model-based visual hand posture
The CMC joints are assumed to be fixed, tracking algorithm is proposed to guide a dexterous
which quite unrealistically models the palm as a robot hand. The approach adopts a 3D model-based
rigid body. The fingers are modeled as planar serial framework with full-DOF kinematic and an
kinematic chains attached to the palm at anchor effective measurement method based on chamfer
points located at MCP joints. distance for both silhouette and edges. GA is
Over the years the kinematic model was integrated to traditional PF as a solution of high-
improved by adding extra twist motion to MCP dimensional and multi-modal tracking.
joints [2], [3] introducing one flexion/extension Experimental results show a significant
DOF to CMC joints [4] or using a spherical joint for improvement of tracking performance compared
TM [5] with traditional PF.
Rehg and Kanade [6] proposed one of the
earliest model based approaches to the problem of
bare hand tracking. They used a 3D model with 27
DOF for their system called DigitEyes.
Heap et al.[8] proposed a deformable 3D
hand model and modeled the entire surface of the
hand by a surface mash constructed via PCA from
training examples.
Fig.3. a) The 3D model presented in [12],b) The 3D
model presented in [13]
In [13] proposed a realistic 3D model of the hand.
This deformable model consists of a polygonal skin,
driven by an underlying skeleton. A new pose is
computed by linearly blending the motions that each
skin vertex would undergo when rigidly coupled to
a subset of the skeleton joints. The model is used in
a) b)
a particle filter framework. A novel algorithm which
Fig.2. a) Hand tracking using 3D Point Distribution
combines the SMD (Stochastic Meta-Descent)
Model from [8] and b) Quadrics-based hand model optimization with a particle filter to form ‘smart particles‘
from [9] is proposed. After propagating the particles, SMD is
Stenger et al. [9] used quadrics as shape performed and the resulting new particle set is included
primitives. The use of quadrics to build the 3D such that the original Bayesian distribution is not altered.
model yields a practical and elegant method for In [14,15] an approach to the recovery of
generating the contours of the model, which are then geometric and photometric pose parameters of a 3D
compared with the image data. The pose of the hand model with 28 DOF from monocular image
model is estimated with an Unscented Kalman filter sequences is presented.
(UKF), which minimizes the geometric error
ISBN: 978-1-61804-062-6 182
3. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
The 3D hand pose, the hand texture and the Another approach is to look for skin colored
illuminant are dynamically estimated through regions in the image. This is a very popular method
minimization of an objective function. Derived from [18], [19], [20], [21] but has some drawbacks. First,
an inverse problem formulation, the objective skin color detection is very sensitive to lighting
function enables explicit use of texture temporal conditions. While practicable and efficient methods
continuity and shading information, while handling exist for skin color detection under controlled (and
important self-occlusions and time-varying known) illumination, the problem of learning a
illumination. The minimization is done efficiently flexible skin model and adapting it over time is
using a quasi-Newton method, for which was challenging. Lindberg [16] used scale-space color
proposed a rigorous derivation of the objective features to recognize hand gestures. Multi scale
function gradient. features can be found in an image at different scales.
In [16] truncated quadrics are used to build Therefore, the hand can be described as one bigger
a 3D hand model where the DOF for each joint blob feature for the palm, having smaller blob
correspond to the DOF of a real hand. features representing the finger tips which are
Quadratic chamfer distance function is used to connected by some rigid features. Furthermore, it
compute the edge likelihood and the silhouette was proposed to perform the feature extraction
likelihood is performed by a Bayesian classifier and directly in the color space, as this allows the
online adaptation of skin color probabilities. Particle combination of probabilistic skin colors directly in
filtering is used to track the hand by predicting the the extraction phase. The advantage of directly
next state of 3D hand model. working on a color image lies in the better
The 3D hand models are articulated distinction of hand and background regions, but the
deformable objects with many degrees of freedom; a authors showed real time application only with no
very large image database is required to cover all other skin colored objects present in the scene.
the characteristic shapes under different views. Another approach is to use the eigenspace.
Another common problem with model based Given a set of images, eigenspace approaches
approaches is the problem of feature extraction and construct a small set of basis images that
lack of capability to deal with singularities that arise characterize the majority of the variation in the
from ambiguous views. training set and can be used to approximate any of
the training images. To reconstruct an image in the
2.2 Appearance based approaches training set, a linear combination of the basis
Appearance-based models are derived directly vectors (images) are taken, where the coefficients of
from the information contained in the images and the basis vectors are the result of projecting the
have traditionally been used for gesture recognition. image to be reconstructed on to the respective basis
No explicit model of the hand is needed; this means vectors. In [17] an approach for tracking hands by
no internal degrees of freedom to be specifically an eigenspace approach is presented. The authors
modeled. provide three major improvements to the original
When only the appearance of the hand in the eigenspace approach formulation, namely, a large
video frames is known, differentiating between invariance to occlusions, some invariance to
gestures is not as straight forward as with the model differences in background from the input images
based approach. The gesture recognition will and the training images, and the ability to handle
therefore typically involve some sort of statistical both small and large affine transformations (i.e.
classifier based on a set of features that represent the scale and rotation) of the input image with respect to
hand. In many gesture applications all that are the training images. The authors demonstrate their
required is a mapping between input video and approach with the ability to track four hand gestures
gesture. Therefore, many have argued that the full using 25 basis images.
reconstruction of the hand is not essential for In the last years is noticeable a new trend, more
gesture recognition. Instead many approaches have and more approaches use invariant local features
utilized the extraction of low-level image [24], [25], [26], [27], [28], [29], [30], [31].
measurements that are fairly robust to noise and can In [24], Adaboost learning algorithm with SIFT
be extracted quickly. Low-level features that have features is used. The Scale Invariant Feature
been proposed in the literature include: the centroid Transform (SIFT) introduced by Lowe [32] consists
of the hand region [16], principle axes defining an of a histogram representing gradient orientation and
elliptical bounding region of the hand, and the magnitude information within a small image patch.
optical flow/affine flow [17] of the hand region in a SIFT is a rotation and scale invariant feature and is
scene. robust to some variations of illuminations,
ISBN: 978-1-61804-062-6 183
4. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
viewpoints and noise. The accuracy of multi-class mixture of the part distributions. From all candidate
hand posture recognition is improved by the sharing compositions, relevant compositions must be
feature concept. However, different features such as selected. There are two types of relevant
contrast context histogram need to be studied and compositions: those compositions that occur
applied to accomplish hand posture recognition in frequently in all categories and also those which are
real time. specific for a category. The category posterior of
In [25] Bag-of-Words representation (BoW) compositions is learned in the training phase, and it
and SIFT features is used. In a typical BoW is a measure of relevance. The entropy of the
representation, “interesting” local patches are first category posterior helps to discriminate between
identified from an image, either by densely categories. A cost function is obtained by combining
sampling, or by an interest point detector. These the priors of the prototypes and the entropy. The
local patches, represented by vectors in a high process of recognition is based on bag of
dimensional space, are often referred to as the key composition method, where a discriminative
points. The bag-of-words methods main idea is to function is defined.
quantize each extracted key point into one of the In [28] Maximally Stable Extremal Region
visual words, and then represent each image by a (MSER) detector and color likelihood maps are used
histogram of visual words. A clustering algorithm is for hand tracking. Such a combination allows
generally used to generate the visual words performing repeated figure/ground segmentation in
dictionary. In [25] K-means algorithm has been used every frame in an efficient manner.
for clustering. A multi-class SVM was used to train The MSER detector is one of the best interest region
the classifier model. In the testing stage, the detectors in computer vision [35]. MSER detection
keypoints were extracted from every image captured is mostly applied to single gray scale images, but the
from the webcam and fed into the cluster model to method can be easily extended for analysis of color
map them with one (Bag-of-words) vector, which is images by defining a suitable ordering relationship
finally fed into the multi-class SVM training on the color pixels. In general the MSER detector
classifier model to recognize the hand gesture. finds bright connected regions which have
In [26] the ARPD descriptor (Appearance and consequently darker values along their boundaries.
Relative Position Descriptor) is proposed. This The set of MSERs is closed under continuous
descriptor includes color histogram, relative- geometric transformations and is invariant to affine
position information, and SURF [33]. The process intensity changes. Furthermore MSERs are detected
of constructing ARPD includes two steps: extracting at all scales. Therefore, due to these properties
SURF keypoints and color histogram from images, MSER detection is suited for segmentation
and computing relative-position information of purposes.
every keypoint within images, the relative-position In [29], [30], [31] Haar like features are used
information is also included as part of ARPD. The for the task of hand detection. Haar like features
ARPD was used in the BoW representation. focus more on the information within a certain area
The BoW was used to detect and recognize hand of the image rather than each single pixel. To
posture based on sliding-window framework. To improve classification accuracy and achieve
meet real-time request, several approaches were realtime performance, AdaBoost learning algorithm
proposed to speed up hand posture recognition that can adaptively select the best features in each
process. In tracking process, CAMESHIFT step and combine them into a strong classifier can
algorithm to track hand motion and a strategy based be used. The training algorithm based on AdaBoost
on histogram to reinitialize tracking process were learning algorithm takes a set of “positive” samples,
used. which contain the object of interest and a set of
In [27] compositional techniques are used for “negative” samples, i.e., images that do not contain
hand posture recognition. A hand posture objects of interest.
representation is based on compositions of parts: This invariant features allowed us to model the
descriptors are grouped according to the perceptual hand as collection of characteristic parts. Key points
laws of grouping [34] obtain a set of possible or characteristic regions are extracted. Using such
candidate compositions. These groups are a sparse features the hand gesture is decomposed in simpler
representation of the hand posture based on parts which are easier to recognize. This approach
overlapping subregions. has major advantages: even if some parts are
The detected part descriptors are represented as missing a gestures still can be recognized, so there
probability distributions over a codebook which is are robust to partials occlusions, changes in view
obtained in the learning phase. A composition is a point and considerable deformations. Bag of Words
ISBN: 978-1-61804-062-6 184
5. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
methods and compositional methods become more annotating and editing documents using pen-based
and more popular in hand gesture recognition. These gestures [41]. This year eyeSight introduced gesture
techniques have been studied in many diverse fields recognition Technology for Android Tablets and
such as linguistics, logic, and neuroscience, but Windows-based Portable Computers [50].
compositionality is especially evident in the syntax Sign Language: Sign language is an
and semantics of language where a limited number important case of communicative gestures. Since
of letter scan form a huge variety of words and sign languages are highly structural, they are very
sentences. In computer vision these techniques are suitable as testbeds for vision algorithms [42]. At
used in the context of a general problem: the same time, they can also be a good way to help
categorization. Using these techniques we address the disabled to interact with computers. Sign
also to the semantic gap that exists between the low language for the deaf (e.g. American Sign
level features and high level representations. The Language) is an example that has received
hand posture is no longer modeled as a whole. significant attention in the gesture literature [43, 44,
These characteristic regions are assembled to form 45 and 46].
compositions; these compositions at their turn can Vehicle interfaces: A number of hand
be group in compositions of compositions and so gesture recognition techniques for human vehicle
on. interface have been proposed time to time [47,48].
The primary motivation of research into the use of
3 Application Areas hand gestures for in-vehicle secondary controls is
There is a large variety of applications broadly based on the premise that taking the eyes
which involves hand gestures. Hand gestures can be off the road to operate conventional secondary
used to achieve natural human computer interaction controls can be reduced by using hand gestures.
for virtual environments, or there can be used to Healthcare: Wachs et al. [49] developed a
communicate with deaf and dumb. An important hand-gesture recognition system that enables
application area is that of vehicle interfaces. doctors to manipulate digital images during medical
In this section an overview of few procedures using hand gestures instead of touch
application areas is given. screens or computer keyboards. A sterile human-
Virtual Reality: Gestures for virtual and machine interface is of supreme importance because
augmented reality applications have experienced it is the means by which the surgeon controls
one of the greatest levels of uptake interactions [36] medical information, avoiding patient
or 2D displays that simulate 3D interactions [37]. contamination, the operating room and the other
Robotics and Telepresence: When robots surgeons. The gesture based system could replace
are moved out of factories and introduced into our touch screens now used in many hospital operating
daily lives they have to face many challenges such rooms which must be sealed to prevent
as cooperating with humans in complex and accumulation or spreading of contaminants and
uncertain environments or maintaining long-term requires smooth surfaces that must be thoroughly
human-robot relationships. Telepresence and cleaned after each procedure – but sometimes aren't.
telerobotic applications are typically situated within With infection rates at hospitals now at
the domain of space exploration and military-based unacceptably high rates, the hand gesture
research projects. recognition system offers a possible alternative.
The gestures used to interact with and control robots
are similar to fully-immersed virtual reality 4 Conclusion
interactions, however the worlds are often real, In this paper a review of vision based hand
presenting the operator with video feed from gesture recognition methods has been presented. In
cameras located on the robot [38]. Here, gestures the last years remarkable progress in the field of
can control a robots hand and arm movements to vision based hand gesture recognition has been
reach for and manipulate actual objects, as well its done. Further research in the areas of feature
movement through the world. extraction, classification methods and gesture
Hand gesture recognition for robotic control is representation are required to realize the ultimate
presented in [24, 39] goal of humans interfacing with machines on their
Desktop and Tablet PC Applications: In own natural terms.
desktop computing applications, gestures can It is obviously that the near future belongs
provide an alternative interaction to the mouse and to hand gesture recognition. Probably sooner that
keyboard [40]. Many gestures for desktop one may think the surrounding devices will be hand
computing tasks involve manipulating graphics, or gesture interfaced.
ISBN: 978-1-61804-062-6 185
6. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
ACKNOWLEDGMENT hierarchical Bayesian filter. IEEE Transactions
(1)
This paper was supported by the project on Pattern Analysis and Machine Intelligence
"Develop and support multidisciplinary postdoctoral (2006)
programs in primordial technical areas of national [11] Jinshi Cui, Zengqi Sun, Model-based visual
strategy of the research - development - innovation" hand posture tracking for guiding a dexterous
4D-POSTDOC, contract nr. POSDRU robotic hand, Optics Communications 235
/89/1.5/S/52603, project co-funded from European (2004) 311–318
Social Fund through Sectorial Operational Program [12] Bay M, Koller-Meier, Gool L.V., Smart
Human Resources 2007-2013. particle filtering for 3D hand tracking, in: Sixth
(2)
This work was supported by the national IEEE International Conference on Automatic
grant ID 931, contr. 651/19.01.2009. Face and Gesture Recognition, Los Alamitos,
CA, USA, 2004, pp 675
References: [13] Martin de La Gorce, Nikos Paragios, David J.
[1] H. Zhou, T.S. Huang, Tracking articulated Fleet, Model-Based Hand Tracking with
hand motion with Eigen dynamics analysis, In Texture, Shading and Self-occlusions, IEEE
Proc. Of International Conference on Conference on Computer Vision and Pattern
Computer Vision, Vol 2, 2003, pp. 1102-1109 Recognition, Alaska, 2008
[2] Bray M., Koller-Meier E., Gool L.V., Smart [14] Martin de La Gorce, David J. Fleet, and Nikos
particle filtering for 3D hand tracking. Sixth Paragios, Model-Based 3D Hand Pose
IEEE International Conference on Automatic Estimation from Monocular Video, IEEE
Face and Gesture Recognition (2004): 675 Transactions On Pattern Analysis And
[3] Bray M., Koller-Meier E., Muller P, Gool L.V., Machine Intelligence, 2011
Schraudolph N.N., 3D Hand tracking by rapid [15] Chutisant Kerdvibulvech, Hideo Saito, Model-
stochastic gradient descent using a skinning Based Hand Tracking by Chamfer Distance and
model.First European Conference on Visual Adaptive Color Learning Using Particle Filter
Media Production (2004): 297-302 EURASIP Journal on Image and Video
[4] Nirei K., Saito H., Mochimaru M., Ozawa S., Processing 2009
Human hand tracking from binocular image [16] New, J. R., Hasanbelliu, E. and Aguilar, M.
sequences. In 22th International Conference on Facilitating User Interaction with Complex
Industrial Electronics, Control, and Systems via Hand Gesture Recognition. In
Instrumentation Proc of Southeastern ACM Conf., Savannah
[5] Kuch J.J, Huang T.S , Human computer 2003
interaction via the human hand: a hand model,. [17] Yang M. H., Ahuja N., and Tabb M.,
Twenty-Eighty Asilomar Conference on Signal, “Extraction of 2-D Motion Trajectories and its
Systems, and Computers (1994): 1252– 56 Application to Hand Gesture Recognition,” in
[6] Rehg J., Kanade T., Visual tracking of high PAMI., 29(8) (2002) 1062–1074
DoF articulated structures: An application to [18] Mo Z., Lewis J.P., Neumann U., Smartcanvas:
human hand tracking. In European Conference a gesture-driven intelligent drawing desk
on Computer Vision and Image Understanding system, In 10th International Conference on
(1994): 35–46 Intelligent User Interfaces, ACM Press (2005):
[7] Ali Erol, George Bebis, Mircea Nicolescu, 239-43
Richard D. Boyle, Xander Twombly., Vision- [19] Martin J., Devin V. , Crowley J.L., Active hand
based hand pose estimation: A review. tracking, 3rd. International Conference on
Computer Vision and Image Understanding Face & Gesture Recognition, IEEE Computer
108 (2007), pp 52–73 Society (1998): 575
[8] Heap A. J., Hogg D. C., Towards 3-D hand [20] Kjeldsen R., Kender J., Toward the use of
tracking using a deformable model. In 2nd gesture in traditional user interfaces,
International Face and Gesture Recognition International Conference on Automatic Face
Conference (1996), pp 140–45 and Gesture Recognition (1996): 151–56
[9] Stenger B. , Mendonc P. R. S., Cipolla R., [21] O’Hagan R.G., Zelinsky A., . Rougeaux S.
Model-Based 3D Tracking of an Articulated Visual gesture interfaces for virtual
Hand." Proc. British Machine Vision environments, Interacting with Computers 14
Conference 1 (2001): 63-72 (2002): 231–50
[10] Stenger B., Thayananthan A., Torr P.H.S., [22] Lars Bretzner, Ivan Laptev and Tony
Cipolla R. Model-based hand tracking using a Lindeberg, Hand gesture recognition using
ISBN: 978-1-61804-062-6 186
7. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
multiscale color features, hieracrchichal models and Ecology, Psychology Press East Sussex,
and particle filtering, in Proceedings of Int. UK, 3rd edition 1996
Conf. on Automatic face and Gesture [35] K. Mikolajczyk, T. Tuytelaars, C. Schmid, A.
recognition, Washington D.C., May 2002 Zisserman, J. Matas, F. Schaffalitzky, T. Kadir,
[23] Black M., Jepson D, Eigen tracking: Robust and L. Van Gool, A comparison of affine
matching and tracking of articulated objects region detectors, International Journal of
using a view-based representation, In European Computer Vision, 65(1-2):43–72, 2005
Conference on Computer Vision, 1996. [36] Sharma, R., Huang, T. S., Pavovic, V. I., Zhao,
[24] C C Wang, K C Wang, Hand Posture Y., Lo, Z.,Chu, S., Schulten, K., Dalke, A.,
recognition using Adaboost with SIFT for Phillips, J., Zeller, M. & Humphrey, W.,
human robot interaction, Springer Berlin, ISSN Speech/Gesture Interface to a Visual
0170-8643, Volume 370, 2008 Computing Environment for Molecular
[25] Dardas, N.; Qing Chen; Georganas, N.D.; Biologists, In: Proc. of ICPR’96, Vol 2, pp
Petriu, E.M,. Hand gesture recognition using 964-968
Bag-of-features and multi-class Support Vector [37] Gandy, M., Starner, T., Auxier, J. & Ashbrook,
Machine, Haptic Audio-Visual Environments D. “The Gesture Pendant: A Self Illuminating,
and Games (HAVE),2010 Wearable, Infrared Computer Vision System
[26] Yuelong Chuang, Ling Chen, Gangqiang Zhao for Home Automation Control and Medical
and Gencai Chen, Hand Posture Recognition Monitoring”. Proc. of IEEE Int. Symposium on
and Tracking Based on Bag-of-Words for Wearable Computers. (2000), 87-94
Human Robot Interaction, IEEE International [38] Goza, S. M., Ambrose, R. O., Diftler, M. A. &
Conference on Robotics and Automation Spain, I. M, Telepresence Control of the
Shanghai International Conference Center May NASA/DARPA Robonaut on a Mobility
9-13, 2011, Shanghai, China Platform, In: Conference on Human Factors in
[27] Simion G., Gui V., OtesteanuM. "A Computing Systems. ACM Press, (2004) 623–
Compositional Tehnique for Hand Posture 629
Recognition : New Results." Wseas [39] Malima A, Ozgur E, Cetin M, A fast algorithm
Transactions on Communications 8 (8) (2009): for Vision based hand gesture recognition for
805-21 robot control, 14th IEEE conference on Signal
[28] Michael Donoser and Horst Bischof, Real Time Processing and Communications Applications,
Appearance Based Hand Tracking Pattern, April 2006
ICPR 2008 [40] Stotts D., Smith J, Gyllstrom M, K. Facespace:
[29] R. Lienhart and J. Maydt, An extended set of Endoand Exo-Spatial Hypermedia in the
Haar-like features for rapid object detection, in Transparent Video Facetop, In: Proc. of the
Proc. IEEE Int. Conf. Image Process., 2002 Fifteenth ACM Conf. on Hypertext &
vol. 1, pp. 900–903 Hypermedia. ACM Press, (2004) 48–57
[30] Andre L. C. Barczak, Farhad Dadgostar, Real- [41] Smith, G. M. & Schraefel. M. C., The Radial
time hand tracking using a set of co-operative Scroll Tool: Scrolling Support for Stylus-or
classifiers based on Haar-like features, Res. Touch-Based Document Navigation, In Proc.
Lett Inf. Math Sci., 2005, Vol. 7, pp 29-42 17th ACM Symposium on User Interface
[31] Qing Chen , N.D. Georganas, E.M Petriu, Software and Technology. ACM Press, (2004)
“Real-time Vision based Hand Gesture 53–56
Recognition Using Haar-like features IEEE [42] Valli C., Lucas C., Linguistics of American
Transactions on Instrumentation and Sign Language: An Introduction, Washington,
Measurement, 2007 D. C.: Gallaudet University Press, (2000)
[32] Lowe, David G., Object recognition from local [43] Martinez A., Wilbur, B., Shay R., Kak, A.
scale-invariant features, Proceedings of the “Purdue RVL-SLLL ASL Database for
International Conference on Computer Vision, Automatic Recognition of ASL, In IEEE Int.
1999,Vol 2, pp. 1150–1157 Conf. on Multimodal Interfaces, (2002) 167–
[33] H. Bay, A. Ess, T. Tuytelaars and L. Van Gool, 172
SURF: Speeded up robust features, in CVIU, [44] Starner, T., Weaver, J., Pentland, A. , Real-
2008, 110(3), pp. 346-359 Time American Sign Language Recognition
[34] Bruce V., Green P. R., Georgeson M. A., using Desk and Wearable Computer Based
Visual Perception: Physiology, Psychology, Video, PAMI, 20(12) (1998) 1371–1375
ISBN: 978-1-61804-062-6 187
8. Recent Researches in Circuits, Systems, Mechanics and Transportation Systems
[45] Vogler, C. & Metaxas, D. “A Framework for [48] Pickering, Carl A. Burnham, Keith J.
Recognizing the Simultaneous Aspects of Richardson, Michael J. Jaguar ,A research
American Sign Language” Comp. Vision and Study of Hand Gesture Recognition
Image Understanding, 81(3) (2001) 358–384 Technologies and Applications for Human
[46] Waldron, M. “Isolated ASL Sign Recognition Vehicle Interaction, 3rd Conference on
System for Deaf Persons”. IEEE Transactions Automotive Electronics, 2007
on Rehabilitation Engineering, 3(3) (1995) [49] Juan P. Wachs , Helman I. Stern, Yael Edan,
261–271 Michael Gillam, Jon Handler, Craig Feied,
[47] Dong Guo Yonghua, Vision-Based Hand Mark Smith, A Gesture-based Tool for Sterile
Gesture Recognition for Human-Vehicle Browsing of Radiology Images, Journal of the
Interaction, International Conference on American Medical Informatics Association,
Control, Automation and Computer Vision, 2008
1998 [50] http://www.eyesight-tech.com/news-and events
/#news
ISBN: 978-1-61804-062-6 188