SlideShare a Scribd company logo
Signal Processing and Machine Learning
Approaches for Electrooculography
Signals
by
Dr. Anirban Dasgupta, PhD
Assistant Professor
Dept. of Electronics and Electrical Engineering
IIT Guwahati
Guest Lecture
On
Organized by
IEEE SPS Student Branch, IIT Kharagpur
As eye moves from center toward
periphery,
โ— retina approaches one
electrode
โ— cornea approaches the other
Change in dipole orientation
causes a change in the electric
potential field
Electrooculography (EOG): The Concept
Signal is a measure of potential
difference between the cornea
and retina
EOG is an inexpensive method
for recording of eye movements
The eye can be modeled as a
dipole with its positive pole at
the cornea and its negative pole
at the retina
Resulting electrical signal is
called the electrooculogram
Potential arises due to the
hyperpolarization and
depolarization of the neurons in
the retina.
Electrooculography (EOG): Recording Protocol
Vertical Paradigm
Six pairs of ocular muscles
control eye movements
Three paradigms of recording the
EOG
Horizontal Paradigm Hybrid Paradigm
Electrodes are located near the
canthus
Capturing the horizontal eyeball
movements
Most common paradigm
Electrodes are located above
eyebrow and bottom of eye
Capturing the vertical eyeball
and eyelid movements
Useful in blink analysis
Five electrodes are used
Capturing the vertical and
horizontal movements
Cross channel information is
useful
Only three electrodes required Only three electrodes required
Both paradigms combined
Several paradigms involving
random electrode positions
Electrooculography (EOG): Applications
Estimating Eye Gaze Angle Detecting Directional Eye Movements
Rehabilitation
Engineering
Diagnosis of
Ocular Diseases
Cognitive
Research
Applications
Compute Ocular Parameters
Affective
Computing
EOG-controlled
wheelchair1
โ— Nystagmus
โ— Vitamin A
Deficiency
โ— Degenerative
Myopia
โ— Retinal
Disorders
โ— Oguchi Disease
User Activity
Recognition
โ— Copying a text
โ— Reading a printed
paper
โ— Taking handwritten
notes
โ— Watching a
โ— video
โ— Browsing the Web Cognitive fatigue in drivers
โ— Fear
โ— Stress
โ— Anxiety
โ— Anger
โ— Depression
โ— Surprise
1
Barea et al. , โ€œSmart Wheelchairs and Brain-Computer Interfacesโ€, Mobile Assistive Technologies, 2018
Electrooculography (EOG): Signal Characteristics
Frequency range is 0.1 to 20 Hz
EOG amplitude lies between 100-3500 ฮผV
up to 16 ฮผV per degree of horizontal movement
up to 14 ฮผV per degree of vertical movement
EOG signal quality is affected by:
โ— metabolic changes in the eye
โ— nature of the sensors
Electrooculography (EOG): Sensors
Active Passive
Components
Dry Wet
Conducting Medium
1
Pic courtesy: Active Electrodes - Open BCI
Have a
compensation
circuitry along
with sensors1
No compensation
circuitry, just the
sensors
Sensors connect
directly with skin
Need a conducting
medium2
2
Pic courtesy: Compumedics, USA
Electrooculography (EOG): Challenges
Artifacts arise from muscle
potentials and small
electromagnetic disturbances due
to cables or surrounding power
line interference
EOG analysis is difficult when
the subject executes any head or
body part movement which leads
to non-stationarity of the signal
Sensor noise yields poor
signal-to-noise ratio (SNR) which
varies with the sensor quality
Signatures of eye movements are
difficult to preserve while
denoising EOG
Eye Movement: The Types
Eye Movements
Eyeball Movement
Fixations
Micro-sacc
ades
Ocular
Drifts
Ocular
microtremors
Smooth
pursuits
Saccades
Vergence
movements
Convergence Divergence
Rolling
Vestibulo-
ocular
movements
Eyelid Movement
Blinks
Prolonged
Eyelid
Closure
Electrooculography (EOG): Pipeline
Sensor
Signal
Conditioning
Band-pass
filtering
Amplification
ADC
Sampling
Rate
Bit-size
Transmission
UART
USB
I2C
SPI
Active/
Passive
Dry/ Wet
Trend Estimation
Linear
Spline
Adaptive
Empirical Mode
Decomposition
High-pass
filtering
Band-pass
filtering
Median filtering
Wavelet filtering
Amplitude
Thresholding
Velocity
Thresholding
Wavelet
Thresholding
Recursive State
Estimation
Time-series
Motifs
Blink Rate
Saccadic Ratio
Saccadic
Duration
Saccadic Peak
Velocity
EOG Signal
Acquisition
Baseline
Wander
Removal
Denoising
Eye
Movement
Classification
Parameter
Estimation
Electrooculography (EOG): Baseline Wander Removal
One of the major non-stationarities of the signal
Effect where the signal level moves up and down
rather than being straight
What is baseline wander?
What causes baseline wander?
Improper electrodes
Interfering background signals
Electrode polarization
EOG Signal Model
Electrooculography (EOG): Baseline Wander Removal
Empirical Mode
Decomposition (EMD)
High Pass Filtering
Methods
Windowed mean removal
Linear spline fit
Cubic spline fit
Method Time (ร—10
-3
s) p-value of ADF test
(ร—10
-3
)
Windowed mean
removal
1.2 2.92
Linear spline fit 4.1 1.34
Cubic spline fit 5.3 0.97
FIR high pass filter 4.3 2.11
EMD 6.8 0.91
Electrooculography (EOG): Denoising
Existing Methods
Batch-processing
Band-pass Filtering
EMD
Wavelet-based Denoising
Median Filtering
Recursive
Kalman Filter
Particle Filter
Electrooculography (EOG): Denoising
Anirban Dasgupta, and Aurobinda Routray, โ€œPiecewise empirical mode
Bayesian estimation-A new method to denoise electrooculograms.โ€, Biomedical
Signal Processing and Control, Elsevier, vol. 70, pp. 102-109, 2021.
Find breakdown
points
Divide the
signal into
sub-signals
Find intrinsic
modes of each
sub-signal
Remove lower
order intrinsic
modes as noise
Concatenate the
reconstructed
signal
Remove joining
artefacts
Noisy EOG signal
Denoised EOG signal
Electrooculography (EOG): Denoising
Method
CPU Time (ร—10
-3
s) GPU Time (ร—10
-3
s) SNR (ร—10
-3
) MSE (ร—10
-2
)
%
Preservation
of blinks
%
Preservation
of saccades
Band pass filter 0.8 0.036 27.8946 5.13 94.59 98.32
EMD 9.6 4.2 30.1247 6.17 93.88 98.47
Wavelet-denoising 11.3 0.512 29.1131 4.45 93.17 97.71
Median filter 0.4 0.019 25.8564 4.32 92.94 97.55
PEMBE
2.09ร—10
3 22.6 34.0661 9.98 94.12 99.08
Electrooculography (EOG): Classification
Classification Signal Processing
Amplitude and
velocity thresholding
Time-domain
matching
Wavelet-thresholding
Machine Learning
Shallow
Bayesian Learning
k-Nearest Neighbors
Decision Trees /
Random Forests
Deep
Convolutional
Neural Networks
Recurrent Neural
Networks
LSTM
GRU
Electrooculography (EOG): Movement Signatures
Electrooculography (EOG): Movement Signatures
Signal
processing
approaches
Machine
Learning
approaches
Conclusion
Discussed the nature, acquisition,
applications and research issues
in EOG signals
The main steps in EOG
processing include baseline
wander removal, denoising, and
movement classification
For denoising, signal processing
approaches are well-established
For classification, ML methods
are coming up which can
challenge signal processing
approaches
Electrooculography (EOG): The Concept
References
Anirban Dasgupta, and Aurobinda Routray, โ€œPiecewise empirical mode Bayesian estimation-A new method to
denoise electrooculograms.โ€, Biomedical Signal Processing and Control, Elsevier, vol. 70, pp. 102-109, 2021.
Suvodip Chakraborty, Anirban Dasgupta, and Aurobinda Routray, โ€œLocalization of Eye Saccadic Signatures in
Electrooculograms using Sparse Representations with Data driven Dictionariesโ€, Pattern Recognition Letters,
Elsevier, vol. 139, pp. 104-111, 2020.
Anirban Dasgupta, Suvodip Chakraborty, and Aurobinda Routray, โ€œA two-stage framework for denoising
electrooculography signalsโ€, Biomedical Signal Processing and Control, Elsevier, vol. 31, pp. 231-237, 2017.
Anwesha Sengupta, Anirban Dasgupta, Aritra Chaudhuri, Anjith George, Aurobinda Routray, and Rajlakshmi Guha,
โ€œA Multimodal System for Assessing Alertness Levels due to Cognitive Loadingโ€, IEEE in Transactions on Neural
Systems and Rehabilitation Engineering, vol. 25, no. 7, pp. 1037 - 1046, 2017.
Desmond, Paula A., and Gerald Matthews. โ€œImplications of task-induced fatigue effects for in-vehicle
countermeasures to driver fatigue.โ€ Accident Analysis & Prevention 29.4 (1997): 515-523.
Koล‚odziej, Marcin, et al. "Fatigue Detection Caused by Office Work With the Use of EOG Signal." IEEE Sensors
Journal 20.24 (2020): 15213-15223.
Webinar IIT Kharagpur SPS.pptx (1).pdf
Webinar IIT Kharagpur SPS.pptx (1).pdf

More Related Content

Similar to Webinar IIT Kharagpur SPS.pptx (1).pdf

Human Computer Interaction using Eye Gesture Recognition : ElectroOcculography
Human Computer Interaction using Eye Gesture Recognition : ElectroOcculographyHuman Computer Interaction using Eye Gesture Recognition : ElectroOcculography
Human Computer Interaction using Eye Gesture Recognition : ElectroOcculography
Athira Jay
ย 
Denoising Techniques for EEG Signals: A Review
Denoising Techniques for EEG Signals: A ReviewDenoising Techniques for EEG Signals: A Review
Denoising Techniques for EEG Signals: A Review
IRJET Journal
ย 
EEG guest lecture_iub_eee541
EEG guest lecture_iub_eee541EEG guest lecture_iub_eee541
EEG guest lecture_iub_eee541
Md Kafiul Islam
ย 
Ijmet 10 02_007
Ijmet 10 02_007Ijmet 10 02_007
Ijmet 10 02_007
IAEME Publication
ย 
Eeg
EegEeg
Eeg
DR RML DELHI
ย 
A project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinksA project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinks
pooja mote
ย 
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIEREEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
hiij
ย 
NEUROPHYSIOLOGY technique.pptx
NEUROPHYSIOLOGY technique.pptxNEUROPHYSIOLOGY technique.pptx
NEUROPHYSIOLOGY technique.pptx
Mr SACHIN
ย 
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
sipij
ย 
NeuralTechPPT.ppt
NeuralTechPPT.pptNeuralTechPPT.ppt
NeuralTechPPT.ppt
RuwanRanaweera7
ย 
Bionic Arm Using EMG Processing
Bionic Arm Using EMG ProcessingBionic Arm Using EMG Processing
Bionic Arm Using EMG Processing
biomedicz
ย 
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
IAEME Publication
ย 
Eeg seminar
Eeg seminarEeg seminar
Eeg seminar
DrRAVIKANTKUMAR
ย 
EMG electromayogram
EMG electromayogramEMG electromayogram
EMG electromayogram
ASHISH RAJ
ย 
Electro oculography, EOG -a detailed medical information| all about EOG
Electro oculography, EOG -a detailed medical information| all about EOG Electro oculography, EOG -a detailed medical information| all about EOG
Electro oculography, EOG -a detailed medical information| all about EOG
martinshaji
ย 
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
hiij
ย 
Design of Microsleep Alerting System of Pilot to Reduce Air Accidents
Design of Microsleep Alerting System of Pilot to Reduce Air AccidentsDesign of Microsleep Alerting System of Pilot to Reduce Air Accidents
Design of Microsleep Alerting System of Pilot to Reduce Air Accidents
Dr. Amarjeet Singh
ย 
Analysis of eeg for motor imagery
Analysis of eeg for motor imageryAnalysis of eeg for motor imagery
Analysis of eeg for motor imagery
ijbesjournal
ย 
Denoising of EEG Signals for Analysis of Brain Disorders: A Review
Denoising of EEG Signals for Analysis of Brain Disorders: A ReviewDenoising of EEG Signals for Analysis of Brain Disorders: A Review
Denoising of EEG Signals for Analysis of Brain Disorders: A Review
IRJET Journal
ย 
8060177.ppt
8060177.ppt8060177.ppt
8060177.ppt
rizkysam
ย 

Similar to Webinar IIT Kharagpur SPS.pptx (1).pdf (20)

Human Computer Interaction using Eye Gesture Recognition : ElectroOcculography
Human Computer Interaction using Eye Gesture Recognition : ElectroOcculographyHuman Computer Interaction using Eye Gesture Recognition : ElectroOcculography
Human Computer Interaction using Eye Gesture Recognition : ElectroOcculography
ย 
Denoising Techniques for EEG Signals: A Review
Denoising Techniques for EEG Signals: A ReviewDenoising Techniques for EEG Signals: A Review
Denoising Techniques for EEG Signals: A Review
ย 
EEG guest lecture_iub_eee541
EEG guest lecture_iub_eee541EEG guest lecture_iub_eee541
EEG guest lecture_iub_eee541
ย 
Ijmet 10 02_007
Ijmet 10 02_007Ijmet 10 02_007
Ijmet 10 02_007
ย 
Eeg
EegEeg
Eeg
ย 
A project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinksA project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinks
ย 
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIEREEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
EEG SIGNAL CLASSIFICATION USING LDA AND MLP CLASSIFIER
ย 
NEUROPHYSIOLOGY technique.pptx
NEUROPHYSIOLOGY technique.pptxNEUROPHYSIOLOGY technique.pptx
NEUROPHYSIOLOGY technique.pptx
ย 
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
SUITABLE MOTHER WAVELET SELECTION FOR EEG SIGNALS ANALYSIS: FREQUENCY BANDS D...
ย 
NeuralTechPPT.ppt
NeuralTechPPT.pptNeuralTechPPT.ppt
NeuralTechPPT.ppt
ย 
Bionic Arm Using EMG Processing
Bionic Arm Using EMG ProcessingBionic Arm Using EMG Processing
Bionic Arm Using EMG Processing
ย 
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
METHODS FOR IMPROVING THE CLASSIFICATION ACCURACY OF BIOMEDICAL SIGNALS BASED...
ย 
Eeg seminar
Eeg seminarEeg seminar
Eeg seminar
ย 
EMG electromayogram
EMG electromayogramEMG electromayogram
EMG electromayogram
ย 
Electro oculography, EOG -a detailed medical information| all about EOG
Electro oculography, EOG -a detailed medical information| all about EOG Electro oculography, EOG -a detailed medical information| all about EOG
Electro oculography, EOG -a detailed medical information| all about EOG
ย 
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
MHEALTH APPLICATIONS DEVELOPED BY THE MINISTRY OF HEALTH FOR PUBLIC USERS INK...
ย 
Design of Microsleep Alerting System of Pilot to Reduce Air Accidents
Design of Microsleep Alerting System of Pilot to Reduce Air AccidentsDesign of Microsleep Alerting System of Pilot to Reduce Air Accidents
Design of Microsleep Alerting System of Pilot to Reduce Air Accidents
ย 
Analysis of eeg for motor imagery
Analysis of eeg for motor imageryAnalysis of eeg for motor imagery
Analysis of eeg for motor imagery
ย 
Denoising of EEG Signals for Analysis of Brain Disorders: A Review
Denoising of EEG Signals for Analysis of Brain Disorders: A ReviewDenoising of EEG Signals for Analysis of Brain Disorders: A Review
Denoising of EEG Signals for Analysis of Brain Disorders: A Review
ย 
8060177.ppt
8060177.ppt8060177.ppt
8060177.ppt
ย 

Recently uploaded

Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
danielkiash986
ย 
How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17
Celine George
ย 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
TechSoup
ย 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
haiqairshad
ย 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
ย 
How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17
Celine George
ย 
Temple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation resultsTemple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation results
Krassimira Luka
ย 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
Mohammad Al-Dhahabi
ย 
A Free 200-Page eBook ~ Brain and Mind Exercise.pptx
A Free 200-Page eBook ~ Brain and Mind Exercise.pptxA Free 200-Page eBook ~ Brain and Mind Exercise.pptx
A Free 200-Page eBook ~ Brain and Mind Exercise.pptx
OH TEIK BIN
ย 
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumPhilippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
MJDuyan
ย 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
nitinpv4ai
ย 
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
EduSkills OECD
ย 
Juneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School DistrictJuneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School District
David Douglas School District
ย 
Bossa Nโ€™ Roll Records by Ismael Vazquez.
Bossa Nโ€™ Roll Records by Ismael Vazquez.Bossa Nโ€™ Roll Records by Ismael Vazquez.
Bossa Nโ€™ Roll Records by Ismael Vazquez.
IsmaelVazquez38
ย 
The basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptxThe basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptx
heathfieldcps1
ย 
Educational Technology in the Health Sciences
Educational Technology in the Health SciencesEducational Technology in the Health Sciences
Educational Technology in the Health Sciences
Iris Thiele Isip-Tan
ย 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
deepaannamalai16
ย 
CIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdfCIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdf
blueshagoo1
ย 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
iammrhaywood
ย 
How to Manage Reception Report in Odoo 17
How to Manage Reception Report in Odoo 17How to Manage Reception Report in Odoo 17
How to Manage Reception Report in Odoo 17
Celine George
ย 

Recently uploaded (20)

Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
ย 
How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17
ย 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
ย 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
ย 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
ย 
How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17
ย 
Temple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation resultsTemple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation results
ย 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
ย 
A Free 200-Page eBook ~ Brain and Mind Exercise.pptx
A Free 200-Page eBook ~ Brain and Mind Exercise.pptxA Free 200-Page eBook ~ Brain and Mind Exercise.pptx
A Free 200-Page eBook ~ Brain and Mind Exercise.pptx
ย 
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumPhilippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
ย 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
ย 
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
ย 
Juneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School DistrictJuneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School District
ย 
Bossa Nโ€™ Roll Records by Ismael Vazquez.
Bossa Nโ€™ Roll Records by Ismael Vazquez.Bossa Nโ€™ Roll Records by Ismael Vazquez.
Bossa Nโ€™ Roll Records by Ismael Vazquez.
ย 
The basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptxThe basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptx
ย 
Educational Technology in the Health Sciences
Educational Technology in the Health SciencesEducational Technology in the Health Sciences
Educational Technology in the Health Sciences
ย 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
ย 
CIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdfCIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdf
ย 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
ย 
How to Manage Reception Report in Odoo 17
How to Manage Reception Report in Odoo 17How to Manage Reception Report in Odoo 17
How to Manage Reception Report in Odoo 17
ย 

Webinar IIT Kharagpur SPS.pptx (1).pdf

  • 1. Signal Processing and Machine Learning Approaches for Electrooculography Signals by Dr. Anirban Dasgupta, PhD Assistant Professor Dept. of Electronics and Electrical Engineering IIT Guwahati Guest Lecture On Organized by IEEE SPS Student Branch, IIT Kharagpur
  • 2. As eye moves from center toward periphery, โ— retina approaches one electrode โ— cornea approaches the other Change in dipole orientation causes a change in the electric potential field Electrooculography (EOG): The Concept Signal is a measure of potential difference between the cornea and retina EOG is an inexpensive method for recording of eye movements The eye can be modeled as a dipole with its positive pole at the cornea and its negative pole at the retina Resulting electrical signal is called the electrooculogram Potential arises due to the hyperpolarization and depolarization of the neurons in the retina.
  • 3. Electrooculography (EOG): Recording Protocol Vertical Paradigm Six pairs of ocular muscles control eye movements Three paradigms of recording the EOG Horizontal Paradigm Hybrid Paradigm Electrodes are located near the canthus Capturing the horizontal eyeball movements Most common paradigm Electrodes are located above eyebrow and bottom of eye Capturing the vertical eyeball and eyelid movements Useful in blink analysis Five electrodes are used Capturing the vertical and horizontal movements Cross channel information is useful Only three electrodes required Only three electrodes required Both paradigms combined Several paradigms involving random electrode positions
  • 4. Electrooculography (EOG): Applications Estimating Eye Gaze Angle Detecting Directional Eye Movements Rehabilitation Engineering Diagnosis of Ocular Diseases Cognitive Research Applications Compute Ocular Parameters Affective Computing EOG-controlled wheelchair1 โ— Nystagmus โ— Vitamin A Deficiency โ— Degenerative Myopia โ— Retinal Disorders โ— Oguchi Disease User Activity Recognition โ— Copying a text โ— Reading a printed paper โ— Taking handwritten notes โ— Watching a โ— video โ— Browsing the Web Cognitive fatigue in drivers โ— Fear โ— Stress โ— Anxiety โ— Anger โ— Depression โ— Surprise 1 Barea et al. , โ€œSmart Wheelchairs and Brain-Computer Interfacesโ€, Mobile Assistive Technologies, 2018
  • 5. Electrooculography (EOG): Signal Characteristics Frequency range is 0.1 to 20 Hz EOG amplitude lies between 100-3500 ฮผV up to 16 ฮผV per degree of horizontal movement up to 14 ฮผV per degree of vertical movement EOG signal quality is affected by: โ— metabolic changes in the eye โ— nature of the sensors
  • 6. Electrooculography (EOG): Sensors Active Passive Components Dry Wet Conducting Medium 1 Pic courtesy: Active Electrodes - Open BCI Have a compensation circuitry along with sensors1 No compensation circuitry, just the sensors Sensors connect directly with skin Need a conducting medium2 2 Pic courtesy: Compumedics, USA
  • 7. Electrooculography (EOG): Challenges Artifacts arise from muscle potentials and small electromagnetic disturbances due to cables or surrounding power line interference EOG analysis is difficult when the subject executes any head or body part movement which leads to non-stationarity of the signal Sensor noise yields poor signal-to-noise ratio (SNR) which varies with the sensor quality Signatures of eye movements are difficult to preserve while denoising EOG
  • 8. Eye Movement: The Types Eye Movements Eyeball Movement Fixations Micro-sacc ades Ocular Drifts Ocular microtremors Smooth pursuits Saccades Vergence movements Convergence Divergence Rolling Vestibulo- ocular movements Eyelid Movement Blinks Prolonged Eyelid Closure
  • 9. Electrooculography (EOG): Pipeline Sensor Signal Conditioning Band-pass filtering Amplification ADC Sampling Rate Bit-size Transmission UART USB I2C SPI Active/ Passive Dry/ Wet Trend Estimation Linear Spline Adaptive Empirical Mode Decomposition High-pass filtering Band-pass filtering Median filtering Wavelet filtering Amplitude Thresholding Velocity Thresholding Wavelet Thresholding Recursive State Estimation Time-series Motifs Blink Rate Saccadic Ratio Saccadic Duration Saccadic Peak Velocity EOG Signal Acquisition Baseline Wander Removal Denoising Eye Movement Classification Parameter Estimation
  • 10. Electrooculography (EOG): Baseline Wander Removal One of the major non-stationarities of the signal Effect where the signal level moves up and down rather than being straight What is baseline wander? What causes baseline wander? Improper electrodes Interfering background signals Electrode polarization EOG Signal Model
  • 11. Electrooculography (EOG): Baseline Wander Removal Empirical Mode Decomposition (EMD) High Pass Filtering Methods Windowed mean removal Linear spline fit Cubic spline fit Method Time (ร—10 -3 s) p-value of ADF test (ร—10 -3 ) Windowed mean removal 1.2 2.92 Linear spline fit 4.1 1.34 Cubic spline fit 5.3 0.97 FIR high pass filter 4.3 2.11 EMD 6.8 0.91
  • 12. Electrooculography (EOG): Denoising Existing Methods Batch-processing Band-pass Filtering EMD Wavelet-based Denoising Median Filtering Recursive Kalman Filter Particle Filter
  • 13. Electrooculography (EOG): Denoising Anirban Dasgupta, and Aurobinda Routray, โ€œPiecewise empirical mode Bayesian estimation-A new method to denoise electrooculograms.โ€, Biomedical Signal Processing and Control, Elsevier, vol. 70, pp. 102-109, 2021. Find breakdown points Divide the signal into sub-signals Find intrinsic modes of each sub-signal Remove lower order intrinsic modes as noise Concatenate the reconstructed signal Remove joining artefacts Noisy EOG signal Denoised EOG signal
  • 14. Electrooculography (EOG): Denoising Method CPU Time (ร—10 -3 s) GPU Time (ร—10 -3 s) SNR (ร—10 -3 ) MSE (ร—10 -2 ) % Preservation of blinks % Preservation of saccades Band pass filter 0.8 0.036 27.8946 5.13 94.59 98.32 EMD 9.6 4.2 30.1247 6.17 93.88 98.47 Wavelet-denoising 11.3 0.512 29.1131 4.45 93.17 97.71 Median filter 0.4 0.019 25.8564 4.32 92.94 97.55 PEMBE 2.09ร—10 3 22.6 34.0661 9.98 94.12 99.08
  • 15. Electrooculography (EOG): Classification Classification Signal Processing Amplitude and velocity thresholding Time-domain matching Wavelet-thresholding Machine Learning Shallow Bayesian Learning k-Nearest Neighbors Decision Trees / Random Forests Deep Convolutional Neural Networks Recurrent Neural Networks LSTM GRU
  • 17. Electrooculography (EOG): Movement Signatures Signal processing approaches Machine Learning approaches
  • 18. Conclusion Discussed the nature, acquisition, applications and research issues in EOG signals The main steps in EOG processing include baseline wander removal, denoising, and movement classification For denoising, signal processing approaches are well-established For classification, ML methods are coming up which can challenge signal processing approaches
  • 19. Electrooculography (EOG): The Concept References Anirban Dasgupta, and Aurobinda Routray, โ€œPiecewise empirical mode Bayesian estimation-A new method to denoise electrooculograms.โ€, Biomedical Signal Processing and Control, Elsevier, vol. 70, pp. 102-109, 2021. Suvodip Chakraborty, Anirban Dasgupta, and Aurobinda Routray, โ€œLocalization of Eye Saccadic Signatures in Electrooculograms using Sparse Representations with Data driven Dictionariesโ€, Pattern Recognition Letters, Elsevier, vol. 139, pp. 104-111, 2020. Anirban Dasgupta, Suvodip Chakraborty, and Aurobinda Routray, โ€œA two-stage framework for denoising electrooculography signalsโ€, Biomedical Signal Processing and Control, Elsevier, vol. 31, pp. 231-237, 2017. Anwesha Sengupta, Anirban Dasgupta, Aritra Chaudhuri, Anjith George, Aurobinda Routray, and Rajlakshmi Guha, โ€œA Multimodal System for Assessing Alertness Levels due to Cognitive Loadingโ€, IEEE in Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 7, pp. 1037 - 1046, 2017. Desmond, Paula A., and Gerald Matthews. โ€œImplications of task-induced fatigue effects for in-vehicle countermeasures to driver fatigue.โ€ Accident Analysis & Prevention 29.4 (1997): 515-523. Koล‚odziej, Marcin, et al. "Fatigue Detection Caused by Office Work With the Use of EOG Signal." IEEE Sensors Journal 20.24 (2020): 15213-15223.