FACE DETECTION
Pritam Banerjee
The University of Texas at Tyler
Department of Computer Science
Tyler, TX, 75799
pbanerjee@patriots.uttyler.edu
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
What is Face Detection ?
Face detection is to identify and detect all image
regions in an image which contain a face regardless
of its three-dimensional position, orientation, and
lighting conditions, and if there is a face present in
the image, return its location and extent of the face.
The process is complex and challenging because it
needs to detect faces which are non-rigid and have a
high degree of variability in size, shape, color, and
texture.
Face Detection
 What is face detection ?
 Why is face detection important
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Why is Face Detection Important ?
1) Face detection algorithms are used in a wide
range of applications, such as security control, video
retrieving, biometric signal processing which is often
mixed with face recognition, human computer
interface, face recognition and image database
management.
2) Modern digital cameras automatically focus on the
faces when those are detected. Some of the
cameras can also detect facial expressions such as
a smile and then automatically captures the
photograph without the actual need of a
Why is Face Detection Important ?
3) Face detection is getting immensely
important for marketers as well. A webcam can
be integrated into a television which can detect
the face of any person who walks by. Then the
system can calculate the race, gender, and an
approximate age of the person by analyzing the
person’s facial features. Once the information is
collected, a series of advertisements can be
played that is specific toward the detected race
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection techniques
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Classification of Face Detection Techniques
Image based techniques
1. Eigenface 1. Template Matching
2. Distribution based 2. Skin Color based detections
3. Support Vector Machines 3. Facial feature based detections
4. Bayes Decision Rule
Knowledge based techniques
Face detection techniques
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection techniques
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Image based techniques
Image-Based methods use training/learning methods
to make comparisons between face and non-face
images. For these methods, a large number of images
of faces and non-faces should be trained to increase
the accuracy of the system. Eigenface, Neural
Networks and Support Vector Machines are kinds of
methods that are used commonly in image based face
detection algorithms.
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based Face Detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Knowledge based techniques
Knowledge based techniques use information about
facial features, skin color or template matching.
Facial features include eyes, mouth, nose or other
facial features to detect the human faces. Skin color
is different from other colors, and its characteristics
do not change with respect to changes in pose and
occlusion. Because of this, skin color detection is
often the first step of a knowledge based face
detection algorithm.
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Comparison between Image based &
Knowledge based methods
Image Based Knowledge Based
Phases of the
systems
The system usually contains two
phases a. Training phase b.
Detection phase
The system usually contains two
phases a. Skin Detection b.Face
detection from the segmented skin
Desigining
Complexity
These systems are more complex as
this involved designing neural
networks to predict the face.
These systems are comparitively
simpler than Image based
techniques
Speed Computationally complex Usually faster than Image based
techniques.
Performance Performance Depends on the
training or learning images
Performance depends on the
criterion used to detect skin, face,
facial features etc
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Face Detection
 What is face detection ?
 Why is face detection important ?
 Classification of face detection
 Image based face detection
 Knowledge based face detection
 Comparison between Image based & Knowledge
based methods
 Open Issues
Open Issues
1. There can be insufficient luminance in the image i.e. the image might be too
dark. Skin color cannot be detected in these cases and hence most of the
algorithms fail. And there is not enough difference between the pixels
belonging to the facial region of the image and those belonging to non facial
region of the image.
2. Cases where the face is entirely covered with beard and the eyes are hidden
behind sunglasses have not yet been addressed. In that case neither the skin
detection will work nor will the facial feature detection work.
3. If the background is of skin color and there is a face in front of that where
there is hardly any difference between the skin color of the face and the
background there are no algorithm which can detect it. Though the facial
features might be detected but the exact face will be almost impossible to
detect.
4. Also if the face is rotated to such an extent that the nose cannot be spotted
anymore, then also it would be impossible to identify the facial region with
the existing systems.
Questions
Thank You

Face detection

  • 1.
    FACE DETECTION Pritam Banerjee TheUniversity of Texas at Tyler Department of Computer Science Tyler, TX, 75799 pbanerjee@patriots.uttyler.edu
  • 2.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 3.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 4.
    What is FaceDetection ? Face detection is to identify and detect all image regions in an image which contain a face regardless of its three-dimensional position, orientation, and lighting conditions, and if there is a face present in the image, return its location and extent of the face. The process is complex and challenging because it needs to detect faces which are non-rigid and have a high degree of variability in size, shape, color, and texture.
  • 5.
    Face Detection  Whatis face detection ?  Why is face detection important  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 6.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 7.
    Why is FaceDetection Important ? 1) Face detection algorithms are used in a wide range of applications, such as security control, video retrieving, biometric signal processing which is often mixed with face recognition, human computer interface, face recognition and image database management. 2) Modern digital cameras automatically focus on the faces when those are detected. Some of the cameras can also detect facial expressions such as a smile and then automatically captures the photograph without the actual need of a
  • 8.
    Why is FaceDetection Important ? 3) Face detection is getting immensely important for marketers as well. A webcam can be integrated into a television which can detect the face of any person who walks by. Then the system can calculate the race, gender, and an approximate age of the person by analyzing the person’s facial features. Once the information is collected, a series of advertisements can be played that is specific toward the detected race
  • 9.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 10.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection techniques  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 11.
    Classification of FaceDetection Techniques Image based techniques 1. Eigenface 1. Template Matching 2. Distribution based 2. Skin Color based detections 3. Support Vector Machines 3. Facial feature based detections 4. Bayes Decision Rule Knowledge based techniques Face detection techniques
  • 12.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection techniques  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 13.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 14.
    Image based techniques Image-Basedmethods use training/learning methods to make comparisons between face and non-face images. For these methods, a large number of images of faces and non-faces should be trained to increase the accuracy of the system. Eigenface, Neural Networks and Support Vector Machines are kinds of methods that are used commonly in image based face detection algorithms.
  • 15.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based Face Detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 16.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 17.
    Knowledge based techniques Knowledgebased techniques use information about facial features, skin color or template matching. Facial features include eyes, mouth, nose or other facial features to detect the human faces. Skin color is different from other colors, and its characteristics do not change with respect to changes in pose and occlusion. Because of this, skin color detection is often the first step of a knowledge based face detection algorithm.
  • 18.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 19.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 20.
    Comparison between Imagebased & Knowledge based methods Image Based Knowledge Based Phases of the systems The system usually contains two phases a. Training phase b. Detection phase The system usually contains two phases a. Skin Detection b.Face detection from the segmented skin Desigining Complexity These systems are more complex as this involved designing neural networks to predict the face. These systems are comparitively simpler than Image based techniques Speed Computationally complex Usually faster than Image based techniques. Performance Performance Depends on the training or learning images Performance depends on the criterion used to detect skin, face, facial features etc
  • 21.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 22.
    Face Detection  Whatis face detection ?  Why is face detection important ?  Classification of face detection  Image based face detection  Knowledge based face detection  Comparison between Image based & Knowledge based methods  Open Issues
  • 23.
    Open Issues 1. Therecan be insufficient luminance in the image i.e. the image might be too dark. Skin color cannot be detected in these cases and hence most of the algorithms fail. And there is not enough difference between the pixels belonging to the facial region of the image and those belonging to non facial region of the image. 2. Cases where the face is entirely covered with beard and the eyes are hidden behind sunglasses have not yet been addressed. In that case neither the skin detection will work nor will the facial feature detection work. 3. If the background is of skin color and there is a face in front of that where there is hardly any difference between the skin color of the face and the background there are no algorithm which can detect it. Though the facial features might be detected but the exact face will be almost impossible to detect. 4. Also if the face is rotated to such an extent that the nose cannot be spotted anymore, then also it would be impossible to identify the facial region with the existing systems.
  • 24.
  • 25.