SlideShare a Scribd company logo
BY:- 
Suraj Kumar(BT11CS008) 
Saroj Paswan(BT11CS005) 
FACE RECOGNITION 
USING FISHER FACE ANALYSIS(LDA)
TOPICS OF DISCUSSION 
 Face Recognition. 
 Linear Discriminant Analysis(LDA). 
 Class Separation using LDA. 
 Algorithm used in LDA approach. 
 Application of LDA. 
 Database used. 
 References.
FACE RECOGNITION 
Face recognition system is a computer application for 
automatically identify or verifying a person from a 
digital image or video frame. In this system 
automatically searching of faces from the face 
databases, typically resulting in a group of facial 
images ranked by computer evaluated similarity.
USE OF FACE RECOGNITION SYSTEM 
Face recognition system is typically used in security system 
and personal information access. 
 SECURITY 
 Airport, seaport, railway station etc. 
 Find Fugitive. 
 PERSONAL INFORMATION ACCESS 
 ATM. 
 Computer system.
FACE RECOGNITION ALGORITHM 
 Linear Discriminant Analysis(LDA). 
 Principle Component Analysis(PCA).
Linear Discriminant Analysis(LDA) 
Linear discriminant methods group images of the 
same classes and separates images of the different 
classes. To identify an input test image, the projected 
test image is compared to each projected training 
image, and the test image is identified as the closest 
training image.
To explain discriminant analysis, here we consider a classification 
involving two target categories and two predictor variables. 
The following figure shows a plot of the two categories with the 
two predictor’s orthogonal axes: 
Figure 1. Plot of two categories
The target variable may have two or more categories. 
Images are projected from two dimensional spaces to 
c dimensional space, where c is the number of classes 
of the images. To identify an input test image, the 
projected test image is compared to each projected 
Training image.
Class Separation Using LDA 
Linear discriminant analysis finds a linear 
transformation (discriminant function) of the two 
predictors, X and Y that yields a new set of 
transformed values that provides a more accurate 
discrimination than either predictor alone: 
Transformed Target = C1*X + C2*Y
The following figure shows the partitioning done using the 
transformation function: 
Figure 2. Partitioning done using the transformation function
Maximizing the between class scatter matrix, while 
minimizing the within-class scatter matrix, a transformation 
function is found that maximizes the ratio of between-class 
variance to within-class variance and find a good class 
separation as illustrated as follows: 
Figure 3. Class Separations in LDA
ALGORITHM USED IN LDA 
In Linear discriminant analysis we provide the following steps to 
discriminant the input images: 
STEP-1: 
We need a training set and at last one image in the test set. 
These examples should represent different frontal views of 
subjects with minor variations in view angle. They should 
also include different facial expressions, different lighting, 
background condition and only the face regions. It is 
assumed that all images are already normalized to m × n 
arrays.
b 
b 
 
 
  
 
 
 
 2 
 
1 
 
2 
 
  
 
 
N 
2 
 2 
a 
a 
a 
1 
2 
b 
N 
 
1 
 
2 
 
  
 
 
N 
 
c 
c 
c 
e 
e 
  
  
   
  
  
  
  2 
  
1 
  
 2 
  
  
  
  
 2 
N 
2 
 d 
d 
d 
1 
2 
e 
N 
  
1 
  
  2 
 
  
  
  
 N 
 
f 
f 
f 
representing faces
STEP-2: 
For each image and sub image, starting with the two 
dimensional m × n array of intensity values I(x, y), we 
construct the vector expansion Φ R m× n. This vector 
corresponds to the initial representation of the face. Thus 
the set of all faces in the feature space is treated as a high-dimensional 
vector space.
STEP-3: 
By defining all instances of the same person’s face as being in 
one class and the faces of different subjects as being in 
different classes for all subjects in the training set, we 
establish a framework for performing a cluster separation 
analysis in the feature space. we compute the within-class 
and between-class scatter matrices.
Now with-in class scatter matrix ‘Sw’ and the between class 
scatter matrix ‘Sb’ are defined as follows: 
푵풋 (휞풊 
Sw = Σ풄 Σ풋=ퟏ 풊=ퟏ 
풋 − 흁풋) (휞풊 
풋 − 흁풋)푻 ------ (1) 
푗, the 푖푡ℎ. samples of class j, 휇푗 is the mean of class j, c is the number 
Where , Γ푖 
of classes, 푁푗 is the number of samples in class j. 
풄 (흁풋 − 흁) (흁풋 − 흁)푻 ---------------- (2) 
Sb = Σ풋=ퟏ 
Where, μ represents the mean of all classes.
mean of class 
a b h 
a b h 
     
1 1 1 
  
1     2 2 2 
   
m where M 
  
  
      2 2 2 
 
, 8 
N N N 
M 
a b h 
Then subtract it from the training faces 
a m b m c m d m 
a m b m c m d m 
            
1 1 1 1 1 1 1 1 
        
  2 2    2 2        2 2   2 2 
 
 a b c d 
, , , , 
m m m m 
        
        
  a  m        N 2 N 2   b  m   c  m N 2 N 2 N 2 N 2   d  m 
N 2 N 
2 
 
e m f m 
e m f 
g m h m 
    
  
     
        
      
           
      
               
1 1 1 1 
2 2 
m g m h m 
e , 
f 
g h 
m m 
  
  e  m 
 N 2 N 
2 
 2 2 2 2 2 2 
1 1 1 1 
2 2 2 2 2 2 
, , m m 
f m g m h m 
N N N N N N
The subspace for LDA is spanned by a set of vectors w=[푎 푚, 푏푚, …, 
ℎ푚], Satisfying 
w = arg max = mod 
푤푇 푆푏 푤 
푤푇 푆푤 푤 
-----(3) 
The with-in class scatter matrix represents how face images are distributed 
closely with-in classes and between class scatter matrix describes how 
classes are separated from each other. When face images are projected into 
the discriminant vector w. 
Face images should be distributed closely with-in classes and should 
be separated between classes, as much as possible. In other words, these 
discriminant vectors minimize the denominator and maximize the 
numerator in equation (3).
The testing phase of LDA is as shown as in figure. 
Face Database Training Set 
Testing Set 
Projection of Test 
Image 
LDA(Feature 
Extraction) 
Feature Vector Feature Vector 
Classifier 
(Euclidean distance) 
Decision making
APPLICATION OF LDA 
Linear discriminant analysis techniques used in statistics, 
pattern recognition and machine learning to find a linear 
combination of features which characterized or separates 
two or more classes of objects. 
DATABASE USED 
ORL Database, All the files are in PGM format. The size of 
each image is 92×112 pixels. with 256 grey levels per 
pixel. 
Fig. 4. One of ORL face database with ten different expressions.
REFERENCES 
 [1] [Online]. Available: 
http://www.animetrics.com/technology/frapplications.html 
http://en.wikipedia.org/wiki/Facial_recognition_system 
http://vis-www.cs.umass.edu/~vidit/IndianFaceDatabase 
http://www.originlab.com 
 [2] B. J. Oh, Face Recognition using Radial Basis Function Network based on 
LDA. World Academy of Science, Engineering and Technology 7 2005 
 [3] R. Duda and P. Hart, Pattern Classification and Scene Analysis. 
 [4] R. Chellappa, C. Wilson, and S. Sirohey, Human and Machine Recognition 
of Faces: A Survey, Proc. IEEE, vol. 83, no. 5, pp. 705- 740, 1995. 
 [5] ORL face database: AT &T Laboratories, Cambridge,U.K..[Online]. 
Available: http://www. cam-orl.co.uk / facedatabse.html.
THANKS…

More Related Content

What's hot

Image feature extraction
Image feature extractionImage feature extraction
Image feature extraction
Rushin Shah
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
saba khan
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
nextlib
 
DBSCAN (2014_11_25 06_21_12 UTC)
DBSCAN (2014_11_25 06_21_12 UTC)DBSCAN (2014_11_25 06_21_12 UTC)
DBSCAN (2014_11_25 06_21_12 UTC)
Cory Cook
 

What's hot (20)

Face recognition using LDA
Face recognition using LDAFace recognition using LDA
Face recognition using LDA
 
Dimensionality Reduction
Dimensionality ReductionDimensionality Reduction
Dimensionality Reduction
 
Classification Based Machine Learning Algorithms
Classification Based Machine Learning AlgorithmsClassification Based Machine Learning Algorithms
Classification Based Machine Learning Algorithms
 
Dimensionality Reduction
Dimensionality ReductionDimensionality Reduction
Dimensionality Reduction
 
Machine Learning-Linear regression
Machine Learning-Linear regressionMachine Learning-Linear regression
Machine Learning-Linear regression
 
Fuzzy Clustering(C-means, K-means)
Fuzzy Clustering(C-means, K-means)Fuzzy Clustering(C-means, K-means)
Fuzzy Clustering(C-means, K-means)
 
Introduction to Linear Discriminant Analysis
Introduction to Linear Discriminant AnalysisIntroduction to Linear Discriminant Analysis
Introduction to Linear Discriminant Analysis
 
Image feature extraction
Image feature extractionImage feature extraction
Image feature extraction
 
Machine Learning With Logistic Regression
Machine Learning  With Logistic RegressionMachine Learning  With Logistic Regression
Machine Learning With Logistic Regression
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
 
Principal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT SlidesPrincipal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT Slides
 
Logistic regression in Machine Learning
Logistic regression in Machine LearningLogistic regression in Machine Learning
Logistic regression in Machine Learning
 
Lect5 principal component analysis
Lect5 principal component analysisLect5 principal component analysis
Lect5 principal component analysis
 
Linear discriminant analysis
Linear discriminant analysisLinear discriminant analysis
Linear discriminant analysis
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Ml3 logistic regression-and_classification_error_metrics
Ml3 logistic regression-and_classification_error_metricsMl3 logistic regression-and_classification_error_metrics
Ml3 logistic regression-and_classification_error_metrics
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
 
DBSCAN (2014_11_25 06_21_12 UTC)
DBSCAN (2014_11_25 06_21_12 UTC)DBSCAN (2014_11_25 06_21_12 UTC)
DBSCAN (2014_11_25 06_21_12 UTC)
 
Independent Component Analysis
Independent Component Analysis Independent Component Analysis
Independent Component Analysis
 
Unsupervised learning (clustering)
Unsupervised learning (clustering)Unsupervised learning (clustering)
Unsupervised learning (clustering)
 

Similar to Lda

EE660_Report_YaxinLiu_8448347171
EE660_Report_YaxinLiu_8448347171EE660_Report_YaxinLiu_8448347171
EE660_Report_YaxinLiu_8448347171
Yaxin Liu
 
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
ArchiLab 7
 
Lecture on linerar discriminatory analysis
Lecture on linerar discriminatory analysisLecture on linerar discriminatory analysis
Lecture on linerar discriminatory analysis
devcb13d
 

Similar to Lda (20)

Pattern Recognition - Designing a minimum distance class mean classifier
Pattern Recognition - Designing a minimum distance class mean classifierPattern Recognition - Designing a minimum distance class mean classifier
Pattern Recognition - Designing a minimum distance class mean classifier
 
Soạn thảo văn bản bằng LATEX
Soạn thảo văn bản bằng LATEXSoạn thảo văn bản bằng LATEX
Soạn thảo văn bản bằng LATEX
 
Comparison on PCA ICA and LDA in Face Recognition
Comparison on PCA ICA and LDA in Face RecognitionComparison on PCA ICA and LDA in Face Recognition
Comparison on PCA ICA and LDA in Face Recognition
 
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
 
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
The Positive Effects of Fuzzy C-Means Clustering on Supervised Learning Class...
 
Designing a Minimum Distance classifier to Class Mean Classifier
Designing a Minimum Distance classifier to Class Mean ClassifierDesigning a Minimum Distance classifier to Class Mean Classifier
Designing a Minimum Distance classifier to Class Mean Classifier
 
Human Face Detection Based on Combination of Logistic Regression, Distance of...
Human Face Detection Based on Combination of Logistic Regression, Distance of...Human Face Detection Based on Combination of Logistic Regression, Distance of...
Human Face Detection Based on Combination of Logistic Regression, Distance of...
 
G1804014348
G1804014348G1804014348
G1804014348
 
Km2417821785
Km2417821785Km2417821785
Km2417821785
 
Feature Selection
Feature Selection Feature Selection
Feature Selection
 
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
 
Introduction to Grad-CAM (complete version)
Introduction to Grad-CAM (complete version)Introduction to Grad-CAM (complete version)
Introduction to Grad-CAM (complete version)
 
Face Recognition using PCA-Principal Component Analysis using MATLAB
Face Recognition using PCA-Principal Component Analysis using MATLABFace Recognition using PCA-Principal Component Analysis using MATLAB
Face Recognition using PCA-Principal Component Analysis using MATLAB
 
A Fuzzy Interactive BI-objective Model for SVM to Identify the Best Compromis...
A Fuzzy Interactive BI-objective Model for SVM to Identify the Best Compromis...A Fuzzy Interactive BI-objective Model for SVM to Identify the Best Compromis...
A Fuzzy Interactive BI-objective Model for SVM to Identify the Best Compromis...
 
A FUZZY INTERACTIVE BI-OBJECTIVE MODEL FOR SVM TO IDENTIFY THE BEST COMPROMIS...
A FUZZY INTERACTIVE BI-OBJECTIVE MODEL FOR SVM TO IDENTIFY THE BEST COMPROMIS...A FUZZY INTERACTIVE BI-OBJECTIVE MODEL FOR SVM TO IDENTIFY THE BEST COMPROMIS...
A FUZZY INTERACTIVE BI-OBJECTIVE MODEL FOR SVM TO IDENTIFY THE BEST COMPROMIS...
 
A New Method Based on MDA to Enhance the Face Recognition Performance
A New Method Based on MDA to Enhance the Face Recognition PerformanceA New Method Based on MDA to Enhance the Face Recognition Performance
A New Method Based on MDA to Enhance the Face Recognition Performance
 
EE660_Report_YaxinLiu_8448347171
EE660_Report_YaxinLiu_8448347171EE660_Report_YaxinLiu_8448347171
EE660_Report_YaxinLiu_8448347171
 
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
 
Lecture on linerar discriminatory analysis
Lecture on linerar discriminatory analysisLecture on linerar discriminatory analysis
Lecture on linerar discriminatory analysis
 
MSE.pptx
MSE.pptxMSE.pptx
MSE.pptx
 

Recently uploaded

Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
Laundry management system project report.pdf
Laundry management system project report.pdfLaundry management system project report.pdf
Laundry management system project report.pdf
Kamal Acharya
 
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdfONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
Kamal Acharya
 
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical SolutionsRS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
Atif Razi
 

Recently uploaded (20)

HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
AI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdfAI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdf
 
Arduino based vehicle speed tracker project
Arduino based vehicle speed tracker projectArduino based vehicle speed tracker project
Arduino based vehicle speed tracker project
 
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationKIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
ENERGY STORAGE DEVICES INTRODUCTION UNIT-I
ENERGY STORAGE DEVICES  INTRODUCTION UNIT-IENERGY STORAGE DEVICES  INTRODUCTION UNIT-I
ENERGY STORAGE DEVICES INTRODUCTION UNIT-I
 
Construction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxConstruction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptx
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Laundry management system project report.pdf
Laundry management system project report.pdfLaundry management system project report.pdf
Laundry management system project report.pdf
 
Online resume builder management system project report.pdf
Online resume builder management system project report.pdfOnline resume builder management system project report.pdf
Online resume builder management system project report.pdf
 
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWINGBRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
 
2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge
 
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdfONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
 
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
 
Pharmacy management system project report..pdf
Pharmacy management system project report..pdfPharmacy management system project report..pdf
Pharmacy management system project report..pdf
 
Furniture showroom management system project.pdf
Furniture showroom management system project.pdfFurniture showroom management system project.pdf
Furniture showroom management system project.pdf
 
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data StreamKIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
 
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical SolutionsRS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
 

Lda

  • 1. BY:- Suraj Kumar(BT11CS008) Saroj Paswan(BT11CS005) FACE RECOGNITION USING FISHER FACE ANALYSIS(LDA)
  • 2. TOPICS OF DISCUSSION  Face Recognition.  Linear Discriminant Analysis(LDA).  Class Separation using LDA.  Algorithm used in LDA approach.  Application of LDA.  Database used.  References.
  • 3. FACE RECOGNITION Face recognition system is a computer application for automatically identify or verifying a person from a digital image or video frame. In this system automatically searching of faces from the face databases, typically resulting in a group of facial images ranked by computer evaluated similarity.
  • 4. USE OF FACE RECOGNITION SYSTEM Face recognition system is typically used in security system and personal information access.  SECURITY  Airport, seaport, railway station etc.  Find Fugitive.  PERSONAL INFORMATION ACCESS  ATM.  Computer system.
  • 5. FACE RECOGNITION ALGORITHM  Linear Discriminant Analysis(LDA).  Principle Component Analysis(PCA).
  • 6. Linear Discriminant Analysis(LDA) Linear discriminant methods group images of the same classes and separates images of the different classes. To identify an input test image, the projected test image is compared to each projected training image, and the test image is identified as the closest training image.
  • 7. To explain discriminant analysis, here we consider a classification involving two target categories and two predictor variables. The following figure shows a plot of the two categories with the two predictor’s orthogonal axes: Figure 1. Plot of two categories
  • 8. The target variable may have two or more categories. Images are projected from two dimensional spaces to c dimensional space, where c is the number of classes of the images. To identify an input test image, the projected test image is compared to each projected Training image.
  • 9. Class Separation Using LDA Linear discriminant analysis finds a linear transformation (discriminant function) of the two predictors, X and Y that yields a new set of transformed values that provides a more accurate discrimination than either predictor alone: Transformed Target = C1*X + C2*Y
  • 10. The following figure shows the partitioning done using the transformation function: Figure 2. Partitioning done using the transformation function
  • 11. Maximizing the between class scatter matrix, while minimizing the within-class scatter matrix, a transformation function is found that maximizes the ratio of between-class variance to within-class variance and find a good class separation as illustrated as follows: Figure 3. Class Separations in LDA
  • 12. ALGORITHM USED IN LDA In Linear discriminant analysis we provide the following steps to discriminant the input images: STEP-1: We need a training set and at last one image in the test set. These examples should represent different frontal views of subjects with minor variations in view angle. They should also include different facial expressions, different lighting, background condition and only the face regions. It is assumed that all images are already normalized to m × n arrays.
  • 13. b b         2  1  2      N 2  2 a a a 1 2 b N  1  2      N  c c c e e                2   1    2          2 N 2  d d d 1 2 e N   1     2         N  f f f representing faces
  • 14. STEP-2: For each image and sub image, starting with the two dimensional m × n array of intensity values I(x, y), we construct the vector expansion Φ R m× n. This vector corresponds to the initial representation of the face. Thus the set of all faces in the feature space is treated as a high-dimensional vector space.
  • 15. STEP-3: By defining all instances of the same person’s face as being in one class and the faces of different subjects as being in different classes for all subjects in the training set, we establish a framework for performing a cluster separation analysis in the feature space. we compute the within-class and between-class scatter matrices.
  • 16. Now with-in class scatter matrix ‘Sw’ and the between class scatter matrix ‘Sb’ are defined as follows: 푵풋 (휞풊 Sw = Σ풄 Σ풋=ퟏ 풊=ퟏ 풋 − 흁풋) (휞풊 풋 − 흁풋)푻 ------ (1) 푗, the 푖푡ℎ. samples of class j, 휇푗 is the mean of class j, c is the number Where , Γ푖 of classes, 푁푗 is the number of samples in class j. 풄 (흁풋 − 흁) (흁풋 − 흁)푻 ---------------- (2) Sb = Σ풋=ퟏ Where, μ represents the mean of all classes.
  • 17. mean of class a b h a b h      1 1 1   1     2 2 2    m where M           2 2 2  , 8 N N N M a b h Then subtract it from the training faces a m b m c m d m a m b m c m d m             1 1 1 1 1 1 1 1           2 2    2 2        2 2   2 2   a b c d , , , , m m m m                   a  m        N 2 N 2   b  m   c  m N 2 N 2 N 2 N 2   d  m N 2 N 2  e m f m e m f g m h m                                                          1 1 1 1 2 2 m g m h m e , f g h m m     e  m  N 2 N 2  2 2 2 2 2 2 1 1 1 1 2 2 2 2 2 2 , , m m f m g m h m N N N N N N
  • 18. The subspace for LDA is spanned by a set of vectors w=[푎 푚, 푏푚, …, ℎ푚], Satisfying w = arg max = mod 푤푇 푆푏 푤 푤푇 푆푤 푤 -----(3) The with-in class scatter matrix represents how face images are distributed closely with-in classes and between class scatter matrix describes how classes are separated from each other. When face images are projected into the discriminant vector w. Face images should be distributed closely with-in classes and should be separated between classes, as much as possible. In other words, these discriminant vectors minimize the denominator and maximize the numerator in equation (3).
  • 19. The testing phase of LDA is as shown as in figure. Face Database Training Set Testing Set Projection of Test Image LDA(Feature Extraction) Feature Vector Feature Vector Classifier (Euclidean distance) Decision making
  • 20. APPLICATION OF LDA Linear discriminant analysis techniques used in statistics, pattern recognition and machine learning to find a linear combination of features which characterized or separates two or more classes of objects. DATABASE USED ORL Database, All the files are in PGM format. The size of each image is 92×112 pixels. with 256 grey levels per pixel. Fig. 4. One of ORL face database with ten different expressions.
  • 21. REFERENCES  [1] [Online]. Available: http://www.animetrics.com/technology/frapplications.html http://en.wikipedia.org/wiki/Facial_recognition_system http://vis-www.cs.umass.edu/~vidit/IndianFaceDatabase http://www.originlab.com  [2] B. J. Oh, Face Recognition using Radial Basis Function Network based on LDA. World Academy of Science, Engineering and Technology 7 2005  [3] R. Duda and P. Hart, Pattern Classification and Scene Analysis.  [4] R. Chellappa, C. Wilson, and S. Sirohey, Human and Machine Recognition of Faces: A Survey, Proc. IEEE, vol. 83, no. 5, pp. 705- 740, 1995.  [5] ORL face database: AT &T Laboratories, Cambridge,U.K..[Online]. Available: http://www. cam-orl.co.uk / facedatabse.html.