1. ICDP 2011
Latent Fingerprint Segmentation using
Ridge Template Correlation
Nathan Short, A. Lynn Abbott, Michael S. Hsiao,
Edward A. Fox
Virginia Tech
October 11th, 2011
2. Motivation
๏จ Large sample of good
quality features
๏ค Supervised acquisition of
sample fingerprint
๏จ Few good quality
features for matching
๏ค Low quality
๏ค Low fingerprint surface
area
Rolled/Plain Fingerprints Latent Fingerprints
1/29/2015
5. Motivation (cont.)
๏จ Automated Fingerprint Identification Systems
(AFIS)
๏ค Minutia based
๏ค Aimed towards Plain/Rolled fingerprint matching
๏ค Large sample size
๏จ Latent fingerprints continue to be encoded
manually
1/29/2015
6. Motivation (cont.)
๏จ Latent matching
๏ค Recent work has included additional features in
matching process [Jain and Feng]
๏ฎ minutiae, core points, ridge flow, local quality, ridge
wavelength, and others
๏ฎ matching results much improved over minutia-only based
methods
๏ค All features are extracted manually from latent prints
for matching
๏ฎ Quality is subjective
1/29/2015
8. Traditional Segmentation
๏จ Normalize Image
๏ค Min-max
๏ค Remove areas with low variance
๏จ Compute Gradient Image
๏ค Approximate first derivative of normalized image by convolving
with Sobel filter
๏จ Threshold based on average magnitude of gradient
within local blocks
1/29/2015
๐ป ๐ผ =
1
๐2
๐,๐ โ ๐ต
๐บ ๐ฅ ๐,๐
2
+ ๐บ ๐ฆ ๐,๐
2
๐ผ ๐ = 1 ๐๐ ๐ป ๐ผ โฅ ๐ก
0 ๐๐กโ๐๐๐ค๐๐ ๐
๐บ ๐ฅ = ๐ ๐ โ ๐ผ
๐บ ๐ฆ = ๐ ๐ฆ โ ๐ผ
๐ผ =
I โ min(๐ผ)
max ๐ผ โ min(๐ผ)
9. Traditional Segmentation
๏จ Problems
๏ค Assumes background only contains random noise
๏ฎ Foreground โ structure
๏ฎ Background โ no structure
๏ค Latent prints typically have structured
backgrounds
๏ฎ Resulting in many spurious minutiae when applying
traditional AFIS feature extraction methods
๏ฎ Also have similar structured background noise in the
fingerprint region itself
1/29/2015
10. Segmentation Method
1/29/2015
Input Fingerprint
Image
Input Fingerprint
Image
Normalize Image
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Generate ideal ridge
template
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Generate ideal ridge
template
Adjust template to
image mean and
variance
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Generate ideal ridge
template
Adjust template to
image mean and
variance
Take cross sectional
slice orthogonal to
ridge flow at anchor
point within
foreground region
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Cross-correlation of
cross sectional
region with ideal
template
Generate ideal ridge
template
Adjust template to
image mean and
variance
Take cross sectional
slice orthogonal to
ridge flow at anchor
point within
foreground region
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Cross-correlation of
cross sectional
region with ideal
template
Generate ideal ridge
template
Adjust template to
image mean and
variance
Threshold goodness
of fit score to
determine
foreground region
(quality levels) and
background region
Take cross sectional
slice orthogonal to
ridge flow at anchor
point within
foreground region
Find local ridge
frequency map
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Cross-correlation of
cross sectional
region with ideal
template
Generate ideal ridge
template
Adjust template to
image mean and
variance
Threshold goodness
of fit score to
determine
foreground region
(quality levels) and
background region
Segmented
Fingerprint Image
Take cross sectional
slice orthogonal to
ridge flow at anchor
point within
foreground region
Find local ridge
frequency map
Repeatforallblocksinfingerprintregion
Generate Ideal
Template
Input Fingerprint
Image
Normalize Image
Threshold
normalized
intensities to find
initial foreground
region
Cross-correlation of
cross sectional
region with ideal
template
Generate ideal ridge
template
Adjust template to
image mean and
variance
Threshold goodness
of fit score to
determine
foreground region
(quality levels) and
background region
Segmented
Fingerprint Image
Take cross sectional
slice orthogonal to
ridge flow at anchor
point within
foreground region
Find local ridge
frequency map
11. Ridge Template Generation
๏ค โIdealโ Ridge Template
๏ฎ Modeled by
๐๐ = sin 2๐๐๐๐ โ
๐
2
= โcos 2๐๐๐๐, , โ๐
๏ฎ Adjust normalized template to mean and variance of image by
๐๐ = ๐๐๐๐ โ ๐๐ + ๐๐๐๐, โ๐
๐ ๐13 = 3
Observed ๐ฅ-signature Ideal ๐ฅ-signature
1/29/2015
13. Segmentation Results (cont.)
Fingerprint Area
(% of total
Image)
False Negatives (% of true
minutiae labelled as
background)
NBIS 60.7 1.41
P1 60.7 0.29
P2 33.6 1.47
P3 45.2 0.69
1/29/2015
14. Line Detection
๏จ Latent fingerprint matching (Jain and Feng)
๏ค Ridge flow direction
๏ฎ Negative cost associated with ridge directions that do not match
๏ฎ lines which dominate the local ridge flow direction, decrease
match score
๏ฎ Detect lines and remove from directional flow computation
1/29/2015
15. Line Detection
๏ค Hough-based approach
๏ฎ A line passing through a point (๐ฅ, ๐ฆ), ๐ฆ = ๐๐ฅ + ๐ is represented in
Hough space as
๐ = ๐ฅ๐๐๐ (๐) + ๐ฆ๐ ๐๐(๐)
๏ฎ Collinear spatial points are represented by intersecting curves in
Hough space
๏ฎ Accumulator is used to find highest frequency parameters, (๐, ๐),
corresponding to points occurring in image
1/29/2015
17. Future Work
1/29/2015
๏จ Use classifier to determine
background/foreground and quality, instead of
threshold
๏จ Adjust template for ridge thickness
๏จ Performance results with refined directional
map
๏จ Detect and remove errors caused by text in
background
Accidental friction ridge skin impression left on a surface (crime scene)
Typically not visible, made visible by chemicals like powders ninhydrin then photographed or lifted with adhesive