This document proposes a method to analyze characters in films based on face recognition. It aims to identify specific actors and determine the time periods they appear throughout a movie in a more efficient manner than watching the full film. The proposed method involves using known images of actors to train a model for face detection and recognition software. It would detect faces in the input film, identify the actors, and visually present the recorded time points of their appearances. By detecting combinations of different actors, it could segment the film into different clips.

1. 基於臉部辨識的電影中⼈人物分析
Yu-Chen-Lin
Wang-Hsin-Shih

2. Outline
• Motivation
• Purpose
• Method
• Flow Chart
• Face Detection
• Face Recognition
• Experiment

3. Motivation
• 要找出特定演員在影⽚片中出現的時間往往曠⽇日
費時，需要看完整部影⽚片。︒
• 想要知道特定角⾊色在影⾯面中出現的時間和比重。︒
• 想看特定演員之間的對⼿手戲。︒

4. Methods
• 臉部辨識，從已知的演員清單中，取得演員的
照⽚片事先訓練好Model，再從input影⽚片中找出所
有演員出現的地⽅方。︒
• 將記錄出的時間點視覺畫呈現。︒
• 藉由偵測出不同演員的組合，將影⽚片區分出不
同的⽚片段。︒

5. Flow Chart
Input
Face Pre-
process
Feature
Extraction
Training
data
Face Pre-
process
Feature
Extraction
!
Classifier Output
Tag
Train
Test
Yes
No

6. Face Detection
• 偵測每個frame中是否找得到⼈人臉，並找出位置。︒
• Robust Real-Time Face Detection
(P Viola, MJ Jones - International journal of
computer vision, 2004 - Springer)
• Active Shape Models-Their Training and
Application
(TF Cootes, CJ Taylor, DH Cooper, J Graham -
1995)

8. Face Recognition
• Eigenfaces
“Application of the Karhunen-Loeve procedure for the
characterization of human faces”
• Fisherfaces
“Eigenfaces vs. Fisherfaces: Recognition Using Class
Specific Linear Projection”
• Local Binary Patterns Histograms
“Performance evaluation of texture measures with
classification based on Kullback discrimination of
distributions”

9. Experiment
• Face Recognition in Movie Trailers via Mean
Sequence Sparse Representation-based
Classification
(Enrique G. Ortiz, Alan Wright, and Mubarak Shah
CVPR 2013)
• Movie Trailer Face Dataset

11. Output
0
2
4
6
8
Time
0 17.5 35 52.5 70
演員A 演員B 演員C
演員D

12. Thank you
END