Blink detection,

1. 1
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
BLINK DETECTION AND
TRACKING OF EYES FOR
EYE LOCALISATION
BY
LOPAMUDRA MOHAPATRA
(200199200)

2. 2
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
INTRODUCTION
 What is blink detection?
 What is eye tracking?
 What is localization of eye?

3. 3
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
WHY WE GO FOR EYE LOCALIZATION
• Face normalization
• Eye gaze based human computer interface.
• For reading detection.
• Security systems using the human iris for
identification.

4. 4
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
PROPOSED PROTOCOL
WHOLE METHOD
EYETRACKING
THRESHHOLDING
FRAMEDIFFERENCING
EYE LOCALIZATION

5. 5
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
THRESH HOLDING

6. 6
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
FRAME DIFFERENCING

7. 7
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
FRAME DIFFERENCING

8. 8
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
ALGORITHMS
Steps in the blink detection
(1) Obtain location of possible motion using
Frame differencing.
(2) Suitably thresh hold the motion regions and
obtain blobs using morphological operation and
connected components.

9. 9
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
ALGORITHM CONTD…...
(3) Remove unsuitable blobs that is either too big or
too small or have incorrect width to height ratios to
be considered as eyes.
(4) Repeat (1) to (3) until a suitable pair of blobs
are found and mark their positions.
(5) Compute optical flow field in the blob regions
(6)Mark dominant direction of motion of blobs.

10. 10
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
Algorithm contd…..
If the dominant motion is downward in a pair of
blobs
their positions are noted.These would represent eye
closure during a blink. If the motion is not downward
then steps (1) to (6) are repeated.
(7) Repeat steps (1) to (6).
(8)Discard blobs that are not suited near the location
of the blobs found with downward motion.

11. 11
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
Algorithm contd
(8) Compute optical flow to ascertain if the dominant
motion is upward with two ball remaining or repeat
from step (7).
(9) If the dominant motion is upward, then classify
the frame beginning from the frame where downward
motion was detected to the frame where upward
motion was detected as blink frames. If after
downward motion no upward motion is detected upto
3 frames it is considered as no blinks. Process of
blink detection is started from newframe.

12. 12
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
(10) The bounding boxes of the blobs where blink is
deemed to have occurred is taken as eye detection.
OPTICAL FLOW METHOD:
It allows for the differentiation between
vertical eyelid movements during blinks and
movement of eyeball and horizotal head movements.
EYE TRACKING :
After the location of eyes tracking is
done by using KLT tracker.

13. 13
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
EYETRACKING
In eye tracking mainly there are 20 feature points are
taken,which gives the more accuracy.
* These feature pts are taken from the eye area and
they are tracked in different places,and
reinitialization is done.

14. 14
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
Results of eye tracking
(a) eye region initialized (b) tracked eye regions to a
movement just before blink.

15. 15
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
COMPUTATION SPEEDUP
To speed up localization we need to speed up in
- Optical Flow
- Eye tracking.
EXPERIMENTAL RESULT :
(1) Optical flow: 10 sec
(2) Tracking of eyes : 10 sec
(3) reading image from disk: 13 sec

16. 16
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
CONCLUSION
In this paper we have proposed an accurate and fast
method for locating and tracking the eyes of a
computer user situated in front of the monitor. By
computing optical flow and using both the magnitude
and direction of the flow vectors, we can differentiate
blinking from the other motions. In this way our
study completed.

17. 17
Nationalinstituteofscience&technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE
LOCALIZATION
LOPAMUDRA
CS200199200
THANK YOU!!!