SlideShare a Scribd company logo
RECOGNIZING FACIAL
EXPRESSIONS
THROUGH TRACKING
Salih Burak Gokturk
OVERVIEW
• PROBLEM DESCRIPTION
• TRAINING STAGE
• TESTING STAGE
• EXPERIMENTS
• CONCLUSION
Components of the recognition
system
Analysis
-Face Tracking
Intelligence
-Support Vector Machine
Classifier
Shape
Parameters
Training
with stereo
Data Classifier
Testing
with mono
New
Data
Output
PROBLEM
DESCRIPTION(Tracking )
?
PROBLEM DESCRIPTION
(Recognition)
X(t)
[ Rigid, Open Mouth, Smile]
?
[ Rigid, Open Mouth, Smile]
Training
Data Classifier Testing
New Data Output
OVERVIEW
• PROBLEM DESCRIPTION
• TRAINING STAGE
• TESTING STAGE
• EXPERIMENTS
• CONCLUSION
p - degrees of freedom
Stereo Tracking
Data Monocular Tracking
And Classification
Learn Shape
)
1
(
u
u
o X
X 
u
o
u
u
X
n
X
n
X 
 )
(
)
(




p
i
i
i
u
X
X
X
1
0

   
u
o
T
p X
X
X
X
X 
 
2
1

Support Vector Machines (SVM)
- Best discriminating hypersurface
between two class of objects
- Map the data to high dimension
using a map function 
- The hypersurface in the feature
space corresponds to a hyperplane
in the mapped space
Training
Data Classifier
Testing
(Classifier)
New Data Output
OVERVIEW
• PROBLEM DESCRIPTION
• TRAINING STAGE
• TESTING STAGE
• EXPERIMENTS
• CONCLUSION
LUKAS TOMASI KANADE OPTICAL
FLOW TRACKER EXTENDED TO 3D
X(t)
I(x(t)) I(t+1)
TIME t+1
?
X(t+1)   t
y
x I
v
u
I
I 











P
i
i
i X
X
X
1
0  )
,
,
( 
T
R
X






























d
dT
dR
d
v
dT
v
dR
v
d
u
dT
u
dR
u
v
u
J


 


 

  t
y
x I
d
dT
dR
J
I
I 












One to Many Application of
Support Vector Machines (SVM)
- One hypersurface per class is calculated
- A new data is tested for each hypersurface


k
z
z
k
i
e
e
i
P )
(
- A different probability is assigned to ith class
OVERVIEW
• PROBLEM DESCRIPTION
• TRAINING STAGE
• TESTING STAGE
• EXPERIMENTS
• CONCLUSION
-Training (Stereo) with 2 people, totally 240 frames
- Testing with 3 people
- 5 expressions: neutral, open mouth, close mouth,
smile, raise eyebrow
- velocity term is added to the shape vector:








3
n
n
n
new
n




- Two other classifiers were tested:
1 - Clustering 2 – N-Nearest Neighbor
MOVIE (1)
MOVIE (2)
Decision of the system
Input

Neutral Open
mouth
Close
mouth
Smile Raise
eyebrow
Neutral (44) 32 6 3 0 3
Open mouth (80) 0 76 4 0 0
Close Mouth (50) 0 1 49 0 0
Smile (87) 2 0 0 81 4
Raise Eyebrow (21) 3 0 0 0 18
Performance of the system for different
expressions
Table 1
Comparison Between Different Methods
SVM with
kernel
erbf
SVM with
kernel rbf
Clustering N-Nearest
with N=9
N-Nearest
with N=5
Same
person
176/182 170/182 161/182 173/182 173/182
Total 256/282 253/282 242/283 255/282 253/282
Table 2
-Training (Stereo) with 1 person, totally 130 frames
- Testing with 3 people
- 5 expressions: neutral, open mouth, close mouth,
smile, raise eyebrow
Comparison Between Different Methods with only one person training set
SVM with
kernel erbf
SVM with
kernel rbf
Clustering N-Nearest
with N=9
N-Nearest
with N=5
Same person 98/110 99/110 109/110 109/110 110/110
Total 216/282 207/282 233/282 231/282 229/282
Table 3
-Training (Stereo) with 2 people, totally 240 frames
- Testing with 3 people
- 3 emotional expressions: neutral, happy, surprise
- Transition between expressions are separated
Comparison Between Different Methods with three emotional expressions
SVM with
kernel erbf
SVM
with
kernel
rbf
Cluster
ing
N-
Nearest
with N=9
N-Nearest
with N=5
N-Nearest
with N=3
N-Nearest with
N=1
Same
person
164/165 165/165 152/165 163/165 164/165 164/165 164/165
Total 222/228 223/228 213/228 225/228 224/228 223/228 223/228
Table 4
Performance Comparison Between Previous Expression Recognition Work
Recognition
Rate
Pose
Change
Number of
Expressions
Test/Train
Subject
Number of
Data
Comments
Chen et.al,
ICME 2000
%89 Direct
camera
view
7 Different
subject
470
images
Problem with
different people
Wang et.al,
AFGR 1998
%96 Direct
camera
view
3 Different
subject
29 image
sequence
Sequence
classification
(easier)
Lien et.al,
AFGR 1998
%85-%93 ~10
degrees
rotation
4 Different
subject
~130
images
Only upper part
of the face is
classified
Hiroshi et.al,
ICPR 1996
%70 ~45-60
degrees
rotation
5 Same
subject
900
images
Permits for
rotations, but
rates are not as
good
Chang et.al,
IJCNN 1999
%92 Direct
camera
view
3 Different
subject
38 images Small test and
training set
Matsuno et.al,
ICCV 1995
%80 Direct
camera
view
4 Different
subject
45 images Small test and
training set
Hong et.al,
AFGR 1998
%65-%85 Direct
camera
view
7 Same and
different
subject
~250
images
%85 with known
person % 65 with
unknown person
Hong et.al,
AFGR 1998
%81-%97 Direct
camera
view
3 Same and
different
subject
~250
images
%97 with known
person % 81 with
unknown person
Sakaguchi
et.al, ICPR
1996
%84 Direct
camera
view
6 Same
subject
- The test and
training set not
mentioned
Our Work %91 ~70-80
degrees
rotation
5 Different
subject
282
images
Table 2
Our Work %98 ~70-80
degrees
3 Different
subject
228
images
Table 4 -
Emotional
OVERVIEW
• PROBLEM DESCRIPTION
• TRAINING STAGE
• TESTING STAGE
• EXPERIMENTS
• CONCLUSION
Future Work
Conclusions
- Breakthrough facial expression recognition rates .
- 3-D is the right way to go…
- Test with more subjects and expressions.
- further application to face recognition (?)

More Related Content

Similar to 09.ppt

analytical representation of data
 analytical representation of data analytical representation of data
analytical representation of data
Unsa Shakir
 
Abhik-Satish-dagstuhl
Abhik-Satish-dagstuhlAbhik-Satish-dagstuhl
Abhik-Satish-dagstuhl
Abhik Roychoudhury
 
Machine Learning Foundations
Machine Learning FoundationsMachine Learning Foundations
Machine Learning Foundations
Albert Y. C. Chen
 
Ee184405 statistika dan stokastik statistik deskriptif 2 numerik
Ee184405 statistika dan stokastik   statistik deskriptif 2 numerikEe184405 statistika dan stokastik   statistik deskriptif 2 numerik
Ee184405 statistika dan stokastik statistik deskriptif 2 numerik
yusufbf
 
Analysis of variance(menong)
Analysis of variance(menong)Analysis of variance(menong)
Analysis of variance(menong)
Maria Theresa
 
Face Identification for Humanoid Robot
Face Identification for Humanoid RobotFace Identification for Humanoid Robot
Face Identification for Humanoid Robotthomaswangxin
 
Yr7-Sequences.pptx
Yr7-Sequences.pptxYr7-Sequences.pptx
Yr7-Sequences.pptx
FrancaOkechukwu
 
G6 m5-b-lesson 7-t
G6 m5-b-lesson 7-tG6 m5-b-lesson 7-t
G6 m5-b-lesson 7-tmlabuski
 
Anova.ppt
Anova.pptAnova.ppt
Anova.ppt
satyamsk
 
Machine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
Machine learning by Dr. Vivek Vijay and Dr. Sandeep YadavMachine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
Machine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
Agile Testing Alliance
 
lecture 17
lecture 17lecture 17
lecture 17sajinsc
 
[Book Reading] 機械翻訳 - Section 5 No.2
[Book Reading] 機械翻訳 - Section 5 No.2[Book Reading] 機械翻訳 - Section 5 No.2
[Book Reading] 機械翻訳 - Section 5 No.2
NAIST Machine Translation Study Group
 
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved. .docx
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved.  .docx© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved.  .docx
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved. .docx
LynellBull52
 
Slides sentiment 2013 10-3
Slides sentiment 2013 10-3Slides sentiment 2013 10-3
Slides sentiment 2013 10-3Joachim De Beule
 
Computational Biology, Part 4 Protein Coding Regions
Computational Biology, Part 4 Protein Coding RegionsComputational Biology, Part 4 Protein Coding Regions
Computational Biology, Part 4 Protein Coding Regionsbutest
 
Frequency Distributions
Frequency DistributionsFrequency Distributions
Frequency Distributions
Kaori Kubo Germano, PhD
 
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์ เอื้อวัฒนามงคล
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์  เอื้อวัฒนามงคลMachine Learning: An introduction โดย รศ.ดร.สุรพงค์  เอื้อวัฒนามงคล
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์ เอื้อวัฒนามงคล
BAINIDA
 
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
University of Maribor
 

Similar to 09.ppt (20)

analytical representation of data
 analytical representation of data analytical representation of data
analytical representation of data
 
Abhik-Satish-dagstuhl
Abhik-Satish-dagstuhlAbhik-Satish-dagstuhl
Abhik-Satish-dagstuhl
 
Catapult DOE Case Study
Catapult DOE Case StudyCatapult DOE Case Study
Catapult DOE Case Study
 
Machine Learning Foundations
Machine Learning FoundationsMachine Learning Foundations
Machine Learning Foundations
 
Ee184405 statistika dan stokastik statistik deskriptif 2 numerik
Ee184405 statistika dan stokastik   statistik deskriptif 2 numerikEe184405 statistika dan stokastik   statistik deskriptif 2 numerik
Ee184405 statistika dan stokastik statistik deskriptif 2 numerik
 
Analysis of variance(menong)
Analysis of variance(menong)Analysis of variance(menong)
Analysis of variance(menong)
 
Face Identification for Humanoid Robot
Face Identification for Humanoid RobotFace Identification for Humanoid Robot
Face Identification for Humanoid Robot
 
Yr7-Sequences.pptx
Yr7-Sequences.pptxYr7-Sequences.pptx
Yr7-Sequences.pptx
 
G6 m5-b-lesson 7-t
G6 m5-b-lesson 7-tG6 m5-b-lesson 7-t
G6 m5-b-lesson 7-t
 
Anova.ppt
Anova.pptAnova.ppt
Anova.ppt
 
Machine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
Machine learning by Dr. Vivek Vijay and Dr. Sandeep YadavMachine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
Machine learning by Dr. Vivek Vijay and Dr. Sandeep Yadav
 
lecture 17
lecture 17lecture 17
lecture 17
 
[Book Reading] 機械翻訳 - Section 5 No.2
[Book Reading] 機械翻訳 - Section 5 No.2[Book Reading] 機械翻訳 - Section 5 No.2
[Book Reading] 機械翻訳 - Section 5 No.2
 
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved. .docx
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved.  .docx© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved.  .docx
© Charles T. Diebold, Ph.D., 9152013. All Rights Reserved. .docx
 
Slides sentiment 2013 10-3
Slides sentiment 2013 10-3Slides sentiment 2013 10-3
Slides sentiment 2013 10-3
 
Computational Biology, Part 4 Protein Coding Regions
Computational Biology, Part 4 Protein Coding RegionsComputational Biology, Part 4 Protein Coding Regions
Computational Biology, Part 4 Protein Coding Regions
 
Frequency Distributions
Frequency DistributionsFrequency Distributions
Frequency Distributions
 
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์ เอื้อวัฒนามงคล
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์  เอื้อวัฒนามงคลMachine Learning: An introduction โดย รศ.ดร.สุรพงค์  เอื้อวัฒนามงคล
Machine Learning: An introduction โดย รศ.ดร.สุรพงค์ เอื้อวัฒนามงคล
 
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
Solving 100-Digit Challenge with Score 100 by Extended Running Time and Paral...
 
evaluation and credibility-Part 1
evaluation and credibility-Part 1evaluation and credibility-Part 1
evaluation and credibility-Part 1
 

Recently uploaded

Chapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdfChapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdf
Kartik Tiwari
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Best Digital Marketing Institute In NOIDA
Best Digital Marketing Institute In NOIDABest Digital Marketing Institute In NOIDA
Best Digital Marketing Institute In NOIDA
deeptiverma2406
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
vaibhavrinwa19
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
goswamiyash170123
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBCSTRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
kimdan468
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
David Douglas School District
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 

Recently uploaded (20)

Chapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdfChapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdf
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Best Digital Marketing Institute In NOIDA
Best Digital Marketing Institute In NOIDABest Digital Marketing Institute In NOIDA
Best Digital Marketing Institute In NOIDA
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBCSTRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
STRAND 3 HYGIENIC PRACTICES.pptx GRADE 7 CBC
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 

09.ppt

  • 2. OVERVIEW • PROBLEM DESCRIPTION • TRAINING STAGE • TESTING STAGE • EXPERIMENTS • CONCLUSION
  • 3. Components of the recognition system Analysis -Face Tracking Intelligence -Support Vector Machine Classifier Shape Parameters Training with stereo Data Classifier Testing with mono New Data Output
  • 5. PROBLEM DESCRIPTION (Recognition) X(t) [ Rigid, Open Mouth, Smile] ? [ Rigid, Open Mouth, Smile] Training Data Classifier Testing New Data Output
  • 6. OVERVIEW • PROBLEM DESCRIPTION • TRAINING STAGE • TESTING STAGE • EXPERIMENTS • CONCLUSION
  • 7. p - degrees of freedom Stereo Tracking Data Monocular Tracking And Classification Learn Shape ) 1 ( u u o X X  u o u u X n X n X   ) ( ) (     p i i i u X X X 1 0      u o T p X X X X X    2 1 
  • 8. Support Vector Machines (SVM) - Best discriminating hypersurface between two class of objects - Map the data to high dimension using a map function  - The hypersurface in the feature space corresponds to a hyperplane in the mapped space Training Data Classifier Testing (Classifier) New Data Output
  • 9. OVERVIEW • PROBLEM DESCRIPTION • TRAINING STAGE • TESTING STAGE • EXPERIMENTS • CONCLUSION
  • 10. LUKAS TOMASI KANADE OPTICAL FLOW TRACKER EXTENDED TO 3D X(t) I(x(t)) I(t+1) TIME t+1 ? X(t+1)   t y x I v u I I             P i i i X X X 1 0  ) , , (  T R X                               d dT dR d v dT v dR v d u dT u dR u v u J            t y x I d dT dR J I I             
  • 11. One to Many Application of Support Vector Machines (SVM) - One hypersurface per class is calculated - A new data is tested for each hypersurface   k z z k i e e i P ) ( - A different probability is assigned to ith class
  • 12. OVERVIEW • PROBLEM DESCRIPTION • TRAINING STAGE • TESTING STAGE • EXPERIMENTS • CONCLUSION
  • 13. -Training (Stereo) with 2 people, totally 240 frames - Testing with 3 people - 5 expressions: neutral, open mouth, close mouth, smile, raise eyebrow - velocity term is added to the shape vector:         3 n n n new n     - Two other classifiers were tested: 1 - Clustering 2 – N-Nearest Neighbor
  • 16. Decision of the system Input  Neutral Open mouth Close mouth Smile Raise eyebrow Neutral (44) 32 6 3 0 3 Open mouth (80) 0 76 4 0 0 Close Mouth (50) 0 1 49 0 0 Smile (87) 2 0 0 81 4 Raise Eyebrow (21) 3 0 0 0 18 Performance of the system for different expressions Table 1
  • 17. Comparison Between Different Methods SVM with kernel erbf SVM with kernel rbf Clustering N-Nearest with N=9 N-Nearest with N=5 Same person 176/182 170/182 161/182 173/182 173/182 Total 256/282 253/282 242/283 255/282 253/282 Table 2
  • 18. -Training (Stereo) with 1 person, totally 130 frames - Testing with 3 people - 5 expressions: neutral, open mouth, close mouth, smile, raise eyebrow Comparison Between Different Methods with only one person training set SVM with kernel erbf SVM with kernel rbf Clustering N-Nearest with N=9 N-Nearest with N=5 Same person 98/110 99/110 109/110 109/110 110/110 Total 216/282 207/282 233/282 231/282 229/282 Table 3
  • 19. -Training (Stereo) with 2 people, totally 240 frames - Testing with 3 people - 3 emotional expressions: neutral, happy, surprise - Transition between expressions are separated Comparison Between Different Methods with three emotional expressions SVM with kernel erbf SVM with kernel rbf Cluster ing N- Nearest with N=9 N-Nearest with N=5 N-Nearest with N=3 N-Nearest with N=1 Same person 164/165 165/165 152/165 163/165 164/165 164/165 164/165 Total 222/228 223/228 213/228 225/228 224/228 223/228 223/228 Table 4
  • 20. Performance Comparison Between Previous Expression Recognition Work Recognition Rate Pose Change Number of Expressions Test/Train Subject Number of Data Comments Chen et.al, ICME 2000 %89 Direct camera view 7 Different subject 470 images Problem with different people Wang et.al, AFGR 1998 %96 Direct camera view 3 Different subject 29 image sequence Sequence classification (easier) Lien et.al, AFGR 1998 %85-%93 ~10 degrees rotation 4 Different subject ~130 images Only upper part of the face is classified Hiroshi et.al, ICPR 1996 %70 ~45-60 degrees rotation 5 Same subject 900 images Permits for rotations, but rates are not as good Chang et.al, IJCNN 1999 %92 Direct camera view 3 Different subject 38 images Small test and training set Matsuno et.al, ICCV 1995 %80 Direct camera view 4 Different subject 45 images Small test and training set Hong et.al, AFGR 1998 %65-%85 Direct camera view 7 Same and different subject ~250 images %85 with known person % 65 with unknown person Hong et.al, AFGR 1998 %81-%97 Direct camera view 3 Same and different subject ~250 images %97 with known person % 81 with unknown person Sakaguchi et.al, ICPR 1996 %84 Direct camera view 6 Same subject - The test and training set not mentioned Our Work %91 ~70-80 degrees rotation 5 Different subject 282 images Table 2 Our Work %98 ~70-80 degrees 3 Different subject 228 images Table 4 - Emotional
  • 21. OVERVIEW • PROBLEM DESCRIPTION • TRAINING STAGE • TESTING STAGE • EXPERIMENTS • CONCLUSION
  • 22. Future Work Conclusions - Breakthrough facial expression recognition rates . - 3-D is the right way to go… - Test with more subjects and expressions. - further application to face recognition (?)