SlideShare a Scribd company logo
Eye Tracking for Predicting
ADHD
Gavindya Jayawardena
PhD Student
Neuro Information Retrieval and Data Science Lab
Department of Computer Science
Old Dominion University
@Gavindya2, @WebSciDL
Eye Tracker use in Computer Science Research Work
Overview
● Eye Tracking
● Eye Movements
● Eye Tracker Demonstration
● Research Work
○ Predicting ADHD using Eye Gaze Metrics
○ Results
○ Publications
● WEKA Demonstration
2Eye Tracker use in Computer Science Research Work
About Me
● 1st Year PhD Student @ODU
● GPA - 4.0/4.0
● Joined ODU Spring 2019
● Dominion Scholar
● Research Assistant @ODUCS @WSDL
● http://www.cs.odu.edu/~gavindya
3Eye Tracker use in Computer Science Research Work
● BSc Degree @UOM, Sri Lanka
● GPA - 3.85/4.20
● Originally from Sri Lanka
My Research Area
● Research in Eye tracking for
targeted population
- Current work: Predicting ADHD
using Eye Tracking
4Eye Tracker use in Computer Science Research Work
What is Eye Tracking?
● Measuring the gaze point (where one is
looking)
5Eye Tracker use in Computer Science Research Work
Source- https://help.tobii.com/hc/en-us/articles/115003295025
-Eye-tracking-in-gaming-how-does-it-work-
● Measuring the motion of an eye
Source - Eye-Tracking-Krankenkassen-Vergleich-Google-
Search-Heat-Map.jpg
Human Eye
6Eye Tracker use in Computer Science Research Work
Basic Elements of Eye Movement
7Eye Tracker use in Computer Science Research Work
• Fixations
• High acuity vision
• Eye is stable in regard to the object of interest
• Saccades
• No vision
• Move eyes between eye fixations very rapidly
• Smooth pursuits
• Eyes follow an object
Why is Eye Tracking Important?
● We move eyes to bring a particular portion of the visible field of view into high
resolution
● We divert our attention to that point so that we can concentrate
● Eye movements follow along the path of attention
8Eye Tracker use in Computer Science Research Work
Eye Trackers
● A device for measuring eye positions and eye movement.
9Eye Tracker use in Computer Science Research Work
Tobii 4C
90 Hz
$169.00
PupilLabs
200 Hz
$2740.00
Gazepoint
150 Hz
$1,995.00
Eye Tracking Applications
10Eye Tracker use in Computer Science Research Work
Gaming
Eye Tracking Applications
11Eye Tracker use in Computer Science Research Work
Market ResearchUsability Research
Source - https://imotions.com/blog/top-8-applications-eye-tracking-research/
Eye Tracking Applications
12Eye Tracker use in Computer Science Research Work
Medical Research
Source - https://www.tobiipro.com/imagevault/publishedmedia/t2pps4lriuxsx2jv8sn2/TobiiPro-Spectrum-FoU-banners_BiometricEEG-3_1.jpg
Demo of Eye Trackers
13
Eye Tracker use in Computer Science Research Work
Tobii 4C Eye Tracker
● Used for - Gaming
● Sampling Rate - 90 Hz
● Price - $169 in Amazon
14Eye Tracker use in Computer Science Research Work
PupilLabs Core Eye Tracker
● Used for - Research
● Sampling Rate
○ World camera: 120 Hz
○ Eye cameras: 200 Hz
● Price - $2740
15Eye Tracker use in Computer Science Research Work
Source - https://pupil-labs.com/products/core/configure/
What Do We Do @NIRDS Lab?
● What do we have?
○ Eye Trackers
○ Wearable EEG Caps
○ Empatica E4
● What do we really do?
○ Study Eye Tracking Data of ADHD and Non-ADHD adults
○ Study EEG Signals of Autistic and healthy kids
● What kind of Research?
○ Predict a diagnosis of ADHD using Eye Tracking Data
○ Analyze relationship of brain activities and ASD using EEG
16Eye Tracker use in Computer Science Research Work
Emotiv EEG Empatica E4
Predicting ADHD using Eye Gaze Metrics Indexing
Working Memory Capacity
In Collaboration with Dr. Anne Michalek from the
Department of Communication Disorders & Special
Education, Old Dominion University
17
Eye Tracker use in Computer Science Research Work
Eye Tracking Research
Attention-Deficit/Hyperactivity Disorder (ADHD)
● Three distinct behavioral symptoms
○ Difficulty in paying attention
○ Difficulty in controlling impulsive behaviours
○ Being overactive
● Researchers have recognized that ADHD persists through adulthood, with an
estimation of 10.2% in 2016 in the U.S.
18Eye Tracker use in Computer Science Research Work
Eye Tracker Specification
● Tobii Pro X2-60 computer
screen-based eye tracker
● Tobii Studio analysis software
● Sampling rate - 60 Hz
(approximately once every 16.23
milliseconds)
● Each participant was calibrated
using Tobii's standard calibration
methods
19Eye Tracker use in Computer Science Research Work
Tobii X2-60 Eye Tracker
Tobii Studio analysis software
Participants
● Adult participants:
○ 7 participants diagnosed with ADHD by medical practitioners and confirmed through verified
documentation (6 F, 1 M)
○ 7 participants without a diagnosis (4 F, 3 M)
● All of the participants fulfilled the following inclusion criteria:
○ Between 18 and 65 years of age
○ Spoke English as their first language
○ No vision impairments
○ No history of psychotic symptoms
○ No documented learning / reading disabilities
20Eye Tracker use in Computer Science Research Work
The Experiment
● Purpose
○ To differentiate between ADHD and Non-ADHD
● Hypothesis
○ There is a significant difference in attention level between ADHD and
Non-ADHD subjects
● Measured Using
○ Working Memory Capacity (WMC)
21Eye Tracker use in Computer Science Research Work
Working Memory Capacity (WMC)
22Eye Tracker use in Computer Science Research Work
● Hold and manipulate information
simultaneously
● Greater WMC ⇒
■ More attention
■ Less distraction
ADHD and WMC
● Researchers have shown that adults with ADHD have reduced WMC
compared to their peers.
● Differences in WMC is because of differences in attention control
● Differences in WMC affects performance during cognitively demanding tasks
○ Example - In Education
■ Kids, young adults, and adults suffer because of the bad grades
■ Can we use Eye Tracking to identify people in classroom setting?
23Eye Tracker use in Computer Science Research Work
Paul is afraid of heights and refuses to fly on a plane. ? R
Whenever I drink the newspaper, I always get depressed. ? M
How do we measure WMC?
Reading Span (RSPAN) task
● Read a sentence and tell whether it makes sense (yes/no)
● Remember the letter at the end of the sentence
● Recall all the letters they can remember from sentences
● Based on the performance of RSPAN task, the WMC score is calculated for each
participant
24Eye Tracker use in Computer Science Research Work
Research Interests
★ Using RSPAN task as the context of study,
Identify ADHD and Non-ADHD
1. Using WMC scores
No significant difference seen in WMC scores of ADHD and Non-ADHD
2. Using Machine Learning on Eye Tracking Data
We created 3 Feature sets which includes saccades and fixations
25Eye Tracker use in Computer Science Research Work
Comparison of Eye Fixations for ADHD and Non-
ADHD Participant
26Eye Tracker use in Computer Science Predicting ADHD using Eye Gaze Metrics
Screen Capture of Tobii Studio Analysis Software during WMC Task as Generated during the Replay
Mode
ADHD Participant Non-ADHD Participant
Research Interests (contd…)
3. Using Eye Tracking data within Areas Of Interest (AOIs) based on sentences
○ We created a Feature set which includes saccades and fixations within the AOIs
of all the sentences
○ Areas Of Interest (AOIs):
■ AOI 1 - Stimulus (the whole sentence)
■ AOI 2 - Critical word (critical word when determining the coherency of the sentence)
■ AOI 3 - Determiner (the decision point with the letter to be remembered)
27Eye Tracker use in Computer Science Research Work
Machine Learning and Features
● Machine learning (ML) = Development of computer programs that can
access data and learn patterns or classifications without explicitly
programming
● ML need a dataset which consist of different feature values
● Feature = An attribute being observed
○ Fixation Duration = 100 milliseconds
○ Saccade Duration = 10 milliseconds
● Feature set = A set of all the attributes that you're interested in
○ Eg: Fixation Duration & Saccade Duration
28Eye Tracker use in Computer Science Research Work
Eye Gaze Metrics Feature Set
Fixation features
● Number of fixations
● Fixation Duration (ms)
● Average Fixation duration (ms)
● Pupil diameter of left eye (mm)
● Pupil diameter of right eye (mm)
29Eye Tracker use in Computer Science Research Work
Normal Pupils vs. Dilated Pupils
Source - https://www.allaboutvision.com/en-in/conditions/dilated-pupils/
Eye Gaze Metrics Feature Set
Saccade features
● Saccade Duration
● Saccade Amplitude
● Saccade Peak velocities
30Eye Tracker use in Computer Science Research Work
Sample Eye Gaze Metrics Feature Set
31Eye Tracker use in Computer Science Research Work
Part of Fixation Feature Set
What do we use for Machine Learning?
32Eye Tracker use in Computer Science Research Work
Evaluation of Results
● We chose standard information retrieval evaluation measures
○ Precision
○ Recall
○ Accuracy
33Eye Tracker use in Computer Science Research Work
Results (I)
Classify ADHD and Non-ADHD subjects using Machine Learning on Eye
Tracking data
34Eye Tracker use in Computer Science Research Work
Feature Set Accuracy
Fixation Features 78.48%
Saccade Features 91.14%
Both Fixation and Saccade Features 91.11%
Results (II)
Classify ADHD and Non-ADHD subjects using Machine Learning on Eye
Tracking data within Areas Of Interest (AOIs) based on sentences
35Eye Tracker use in Computer Science Research Work
Feature Set Accuracy
Sentence-based Feature set 86.20%
Publications
● 1 Book Chapter
○ Anne M. P. Michalek, *Gavindya Jayawardena, and Sampath Jayarathna. "Predicting ADHD Using Eye Gaze
Metrics Indexing Working Memory Capacity", Computational Models for Biomedical Reasoning and Problem
Solving, IGI Global, pp. 66-88. 2019
● 1 Conference Paper
○ *Gavindya Jayawardena, Anne M. P. Michalek, and Sampath Jayarathna. "Eye Tracking Area of Interest in the
Context of Working Memory Capacity Tasks", In Proceedings of the 2014 IEEE 20th International Conference
on Information Reuse and Integration (IEEE IRI 2019) (In Press)
● 1 Tech report
○ Eye Gaze Metrics and Analysis of AOI for Indexing Working Memory towards Predicting ADHD -
https://arxiv.org/abs/1906.07183
● 1 Blog Post
○ Use of Cognitive Memory to Improve the Accessibility of Digital Collections - https://ws-
dl.blogspot.com/2019/06/2019-06-19-use-of-cognitive-memory-to.html
36Eye Tracker use in Computer Science Research Work
WEKA
● Is a collection of machine learning
algorithms for data mining tasks
● Contains tools for data classification
● Facilitates to visualize how different
algorithms perform for the same data set
37Eye Tracker use in Computer Science Research Work
Demo of Weka Knowledge Flow
38Eye Tracker use in Computer Science Research Work
Questions?
39Eye Tracker use in Computer Science Research Work
Gavindya Jayawardena
Twitter Handle - @Gavindya2
Email - hjaya001@odu.edu
Thank You!
40Eye Tracker use in Computer Science Research Work

More Related Content

Similar to Eye Tracking for Predicting ADHD

Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...
Jaey Jeong
 
TrackLab: a solution for indoor and outdoor tracking and movement analysis
TrackLab: a solution for indoor and outdoor tracking and movement analysisTrackLab: a solution for indoor and outdoor tracking and movement analysis
TrackLab: a solution for indoor and outdoor tracking and movement analysis
AALForum
 
Designing a Successful Eye-Tracking Study UPA 2008
Designing a Successful Eye-Tracking Study UPA 2008Designing a Successful Eye-Tracking Study UPA 2008
Designing a Successful Eye-Tracking Study UPA 2008
Andrew Schall
 
MGaze: Multi-Gaze Interactions
MGaze: Multi-Gaze InteractionsMGaze: Multi-Gaze Interactions
MGaze: Multi-Gaze Interactions
Rajith Bhanuka Mahanama
 
Personal Presentation
Personal PresentationPersonal Presentation
Personal Presentation
Antonio Di Maio
 
Pivotal Tracker - Research Findings
Pivotal Tracker - Research FindingsPivotal Tracker - Research Findings
Pivotal Tracker - Research Findings
Paulina Galindo
 
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
Yuji Oyamada
 
An eye gaze detection using low resolution web camera in desktop environment
An eye gaze detection using low resolution web camera in desktop environmentAn eye gaze detection using low resolution web camera in desktop environment
An eye gaze detection using low resolution web camera in desktop environment
eSAT Journals
 
CX Survival Guide for 2019
CX Survival Guide for 2019CX Survival Guide for 2019
CX Survival Guide for 2019
UserTesting
 
Go-Lab: What is Happening in my ILS
Go-Lab: What is Happening in my ILSGo-Lab: What is Happening in my ILS
Go-Lab: What is Happening in my ILS
Go-Lab Initiative
 
Knowit seminarium 0131 Lars Irenius
Knowit seminarium 0131 Lars IreniusKnowit seminarium 0131 Lars Irenius
Knowit seminarium 0131 Lars Irenius
Knowit_TM
 
Appearance based gaze estimation using deep features and random forest regres...
Appearance based gaze estimation using deep features and random forest regres...Appearance based gaze estimation using deep features and random forest regres...
Appearance based gaze estimation using deep features and random forest regres...
Jaey Jeong
 
employee job satisfaction project
employee job satisfaction projectemployee job satisfaction project
employee job satisfaction project
vtstechvpm
 
A Survey on Software Release Planning Models - Slides for the Presentation @ ...
A Survey on Software Release Planning Models - Slides for the Presentation @ ...A Survey on Software Release Planning Models - Slides for the Presentation @ ...
A Survey on Software Release Planning Models - Slides for the Presentation @ ...
Supersede
 
Reading Group 2014
Reading Group 2014Reading Group 2014
Reading Group 2014
Emir Muñoz
 
Medical Applications of Virtual Reality - Alex Wendland
Medical Applications of Virtual Reality - Alex WendlandMedical Applications of Virtual Reality - Alex Wendland
Medical Applications of Virtual Reality - Alex Wendland
WithTheBest
 
Neural networks for semantic gaze analysis in xr settings
Neural networks for semantic gaze analysis in xr settingsNeural networks for semantic gaze analysis in xr settings
Neural networks for semantic gaze analysis in xr settings
Jaey Jeong
 
iSee - An App for Visually Impaired using Artificial Intelligence
iSee - An App for Visually Impaired using Artificial IntelligenceiSee - An App for Visually Impaired using Artificial Intelligence
iSee - An App for Visually Impaired using Artificial Intelligence
Jerin Abraham
 
5 Practical Steps to a Successful Deep Learning Research
5 Practical Steps to a Successful  Deep Learning Research5 Practical Steps to a Successful  Deep Learning Research
5 Practical Steps to a Successful Deep Learning Research
Brodmann17
 
Eye Tracking the User Experience of Mobile: What You Need To Know
Eye Tracking the User Experience of Mobile: What You Need To KnowEye Tracking the User Experience of Mobile: What You Need To Know
Eye Tracking the User Experience of Mobile: What You Need To Know
UXPA DC
 

Similar to Eye Tracking for Predicting ADHD (20)

Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...
 
TrackLab: a solution for indoor and outdoor tracking and movement analysis
TrackLab: a solution for indoor and outdoor tracking and movement analysisTrackLab: a solution for indoor and outdoor tracking and movement analysis
TrackLab: a solution for indoor and outdoor tracking and movement analysis
 
Designing a Successful Eye-Tracking Study UPA 2008
Designing a Successful Eye-Tracking Study UPA 2008Designing a Successful Eye-Tracking Study UPA 2008
Designing a Successful Eye-Tracking Study UPA 2008
 
MGaze: Multi-Gaze Interactions
MGaze: Multi-Gaze InteractionsMGaze: Multi-Gaze Interactions
MGaze: Multi-Gaze Interactions
 
Personal Presentation
Personal PresentationPersonal Presentation
Personal Presentation
 
Pivotal Tracker - Research Findings
Pivotal Tracker - Research FindingsPivotal Tracker - Research Findings
Pivotal Tracker - Research Findings
 
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
Vision Based Analysis on Trajectories of Notes Representing Ideas Toward Work...
 
An eye gaze detection using low resolution web camera in desktop environment
An eye gaze detection using low resolution web camera in desktop environmentAn eye gaze detection using low resolution web camera in desktop environment
An eye gaze detection using low resolution web camera in desktop environment
 
CX Survival Guide for 2019
CX Survival Guide for 2019CX Survival Guide for 2019
CX Survival Guide for 2019
 
Go-Lab: What is Happening in my ILS
Go-Lab: What is Happening in my ILSGo-Lab: What is Happening in my ILS
Go-Lab: What is Happening in my ILS
 
Knowit seminarium 0131 Lars Irenius
Knowit seminarium 0131 Lars IreniusKnowit seminarium 0131 Lars Irenius
Knowit seminarium 0131 Lars Irenius
 
Appearance based gaze estimation using deep features and random forest regres...
Appearance based gaze estimation using deep features and random forest regres...Appearance based gaze estimation using deep features and random forest regres...
Appearance based gaze estimation using deep features and random forest regres...
 
employee job satisfaction project
employee job satisfaction projectemployee job satisfaction project
employee job satisfaction project
 
A Survey on Software Release Planning Models - Slides for the Presentation @ ...
A Survey on Software Release Planning Models - Slides for the Presentation @ ...A Survey on Software Release Planning Models - Slides for the Presentation @ ...
A Survey on Software Release Planning Models - Slides for the Presentation @ ...
 
Reading Group 2014
Reading Group 2014Reading Group 2014
Reading Group 2014
 
Medical Applications of Virtual Reality - Alex Wendland
Medical Applications of Virtual Reality - Alex WendlandMedical Applications of Virtual Reality - Alex Wendland
Medical Applications of Virtual Reality - Alex Wendland
 
Neural networks for semantic gaze analysis in xr settings
Neural networks for semantic gaze analysis in xr settingsNeural networks for semantic gaze analysis in xr settings
Neural networks for semantic gaze analysis in xr settings
 
iSee - An App for Visually Impaired using Artificial Intelligence
iSee - An App for Visually Impaired using Artificial IntelligenceiSee - An App for Visually Impaired using Artificial Intelligence
iSee - An App for Visually Impaired using Artificial Intelligence
 
5 Practical Steps to a Successful Deep Learning Research
5 Practical Steps to a Successful  Deep Learning Research5 Practical Steps to a Successful  Deep Learning Research
5 Practical Steps to a Successful Deep Learning Research
 
Eye Tracking the User Experience of Mobile: What You Need To Know
Eye Tracking the User Experience of Mobile: What You Need To KnowEye Tracking the User Experience of Mobile: What You Need To Know
Eye Tracking the User Experience of Mobile: What You Need To Know
 

Recently uploaded

Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Muhammad Ali
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
SynapseIndia
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
Priyanka Aash
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
Yevgen Sysoyev
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsScaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Mydbops
 
How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
SynapseIndia
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSECHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
kumarjarun2010
 
Pigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending PlantPigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending Plant
LINUS PROJECTS (INDIA)
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
Ivanti
 
The Role of Technology in Payroll Statutory Compliance (1).pdf
The Role of Technology in Payroll Statutory Compliance (1).pdfThe Role of Technology in Payroll Statutory Compliance (1).pdf
The Role of Technology in Payroll Statutory Compliance (1).pdf
paysquare consultancy
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
ishalveerrandhawa1
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
Shiv Technolabs
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
bhumivarma35300
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
aslasdfmkhan4750
 

Recently uploaded (20)

Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsScaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
 
How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSECHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
CHAPTER-8 COMPONENTS OF COMPUTER SYSTEM CLASS 9 CBSE
 
Pigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending PlantPigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending Plant
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
 
The Role of Technology in Payroll Statutory Compliance (1).pdf
The Role of Technology in Payroll Statutory Compliance (1).pdfThe Role of Technology in Payroll Statutory Compliance (1).pdf
The Role of Technology in Payroll Statutory Compliance (1).pdf
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
 

Eye Tracking for Predicting ADHD

  • 1. Eye Tracking for Predicting ADHD Gavindya Jayawardena PhD Student Neuro Information Retrieval and Data Science Lab Department of Computer Science Old Dominion University @Gavindya2, @WebSciDL Eye Tracker use in Computer Science Research Work
  • 2. Overview ● Eye Tracking ● Eye Movements ● Eye Tracker Demonstration ● Research Work ○ Predicting ADHD using Eye Gaze Metrics ○ Results ○ Publications ● WEKA Demonstration 2Eye Tracker use in Computer Science Research Work
  • 3. About Me ● 1st Year PhD Student @ODU ● GPA - 4.0/4.0 ● Joined ODU Spring 2019 ● Dominion Scholar ● Research Assistant @ODUCS @WSDL ● http://www.cs.odu.edu/~gavindya 3Eye Tracker use in Computer Science Research Work ● BSc Degree @UOM, Sri Lanka ● GPA - 3.85/4.20 ● Originally from Sri Lanka
  • 4. My Research Area ● Research in Eye tracking for targeted population - Current work: Predicting ADHD using Eye Tracking 4Eye Tracker use in Computer Science Research Work
  • 5. What is Eye Tracking? ● Measuring the gaze point (where one is looking) 5Eye Tracker use in Computer Science Research Work Source- https://help.tobii.com/hc/en-us/articles/115003295025 -Eye-tracking-in-gaming-how-does-it-work- ● Measuring the motion of an eye Source - Eye-Tracking-Krankenkassen-Vergleich-Google- Search-Heat-Map.jpg
  • 6. Human Eye 6Eye Tracker use in Computer Science Research Work
  • 7. Basic Elements of Eye Movement 7Eye Tracker use in Computer Science Research Work • Fixations • High acuity vision • Eye is stable in regard to the object of interest • Saccades • No vision • Move eyes between eye fixations very rapidly • Smooth pursuits • Eyes follow an object
  • 8. Why is Eye Tracking Important? ● We move eyes to bring a particular portion of the visible field of view into high resolution ● We divert our attention to that point so that we can concentrate ● Eye movements follow along the path of attention 8Eye Tracker use in Computer Science Research Work
  • 9. Eye Trackers ● A device for measuring eye positions and eye movement. 9Eye Tracker use in Computer Science Research Work Tobii 4C 90 Hz $169.00 PupilLabs 200 Hz $2740.00 Gazepoint 150 Hz $1,995.00
  • 10. Eye Tracking Applications 10Eye Tracker use in Computer Science Research Work Gaming
  • 11. Eye Tracking Applications 11Eye Tracker use in Computer Science Research Work Market ResearchUsability Research Source - https://imotions.com/blog/top-8-applications-eye-tracking-research/
  • 12. Eye Tracking Applications 12Eye Tracker use in Computer Science Research Work Medical Research Source - https://www.tobiipro.com/imagevault/publishedmedia/t2pps4lriuxsx2jv8sn2/TobiiPro-Spectrum-FoU-banners_BiometricEEG-3_1.jpg
  • 13. Demo of Eye Trackers 13 Eye Tracker use in Computer Science Research Work
  • 14. Tobii 4C Eye Tracker ● Used for - Gaming ● Sampling Rate - 90 Hz ● Price - $169 in Amazon 14Eye Tracker use in Computer Science Research Work
  • 15. PupilLabs Core Eye Tracker ● Used for - Research ● Sampling Rate ○ World camera: 120 Hz ○ Eye cameras: 200 Hz ● Price - $2740 15Eye Tracker use in Computer Science Research Work Source - https://pupil-labs.com/products/core/configure/
  • 16. What Do We Do @NIRDS Lab? ● What do we have? ○ Eye Trackers ○ Wearable EEG Caps ○ Empatica E4 ● What do we really do? ○ Study Eye Tracking Data of ADHD and Non-ADHD adults ○ Study EEG Signals of Autistic and healthy kids ● What kind of Research? ○ Predict a diagnosis of ADHD using Eye Tracking Data ○ Analyze relationship of brain activities and ASD using EEG 16Eye Tracker use in Computer Science Research Work Emotiv EEG Empatica E4
  • 17. Predicting ADHD using Eye Gaze Metrics Indexing Working Memory Capacity In Collaboration with Dr. Anne Michalek from the Department of Communication Disorders & Special Education, Old Dominion University 17 Eye Tracker use in Computer Science Research Work Eye Tracking Research
  • 18. Attention-Deficit/Hyperactivity Disorder (ADHD) ● Three distinct behavioral symptoms ○ Difficulty in paying attention ○ Difficulty in controlling impulsive behaviours ○ Being overactive ● Researchers have recognized that ADHD persists through adulthood, with an estimation of 10.2% in 2016 in the U.S. 18Eye Tracker use in Computer Science Research Work
  • 19. Eye Tracker Specification ● Tobii Pro X2-60 computer screen-based eye tracker ● Tobii Studio analysis software ● Sampling rate - 60 Hz (approximately once every 16.23 milliseconds) ● Each participant was calibrated using Tobii's standard calibration methods 19Eye Tracker use in Computer Science Research Work Tobii X2-60 Eye Tracker Tobii Studio analysis software
  • 20. Participants ● Adult participants: ○ 7 participants diagnosed with ADHD by medical practitioners and confirmed through verified documentation (6 F, 1 M) ○ 7 participants without a diagnosis (4 F, 3 M) ● All of the participants fulfilled the following inclusion criteria: ○ Between 18 and 65 years of age ○ Spoke English as their first language ○ No vision impairments ○ No history of psychotic symptoms ○ No documented learning / reading disabilities 20Eye Tracker use in Computer Science Research Work
  • 21. The Experiment ● Purpose ○ To differentiate between ADHD and Non-ADHD ● Hypothesis ○ There is a significant difference in attention level between ADHD and Non-ADHD subjects ● Measured Using ○ Working Memory Capacity (WMC) 21Eye Tracker use in Computer Science Research Work
  • 22. Working Memory Capacity (WMC) 22Eye Tracker use in Computer Science Research Work ● Hold and manipulate information simultaneously ● Greater WMC ⇒ ■ More attention ■ Less distraction
  • 23. ADHD and WMC ● Researchers have shown that adults with ADHD have reduced WMC compared to their peers. ● Differences in WMC is because of differences in attention control ● Differences in WMC affects performance during cognitively demanding tasks ○ Example - In Education ■ Kids, young adults, and adults suffer because of the bad grades ■ Can we use Eye Tracking to identify people in classroom setting? 23Eye Tracker use in Computer Science Research Work
  • 24. Paul is afraid of heights and refuses to fly on a plane. ? R Whenever I drink the newspaper, I always get depressed. ? M How do we measure WMC? Reading Span (RSPAN) task ● Read a sentence and tell whether it makes sense (yes/no) ● Remember the letter at the end of the sentence ● Recall all the letters they can remember from sentences ● Based on the performance of RSPAN task, the WMC score is calculated for each participant 24Eye Tracker use in Computer Science Research Work
  • 25. Research Interests ★ Using RSPAN task as the context of study, Identify ADHD and Non-ADHD 1. Using WMC scores No significant difference seen in WMC scores of ADHD and Non-ADHD 2. Using Machine Learning on Eye Tracking Data We created 3 Feature sets which includes saccades and fixations 25Eye Tracker use in Computer Science Research Work
  • 26. Comparison of Eye Fixations for ADHD and Non- ADHD Participant 26Eye Tracker use in Computer Science Predicting ADHD using Eye Gaze Metrics Screen Capture of Tobii Studio Analysis Software during WMC Task as Generated during the Replay Mode ADHD Participant Non-ADHD Participant
  • 27. Research Interests (contd…) 3. Using Eye Tracking data within Areas Of Interest (AOIs) based on sentences ○ We created a Feature set which includes saccades and fixations within the AOIs of all the sentences ○ Areas Of Interest (AOIs): ■ AOI 1 - Stimulus (the whole sentence) ■ AOI 2 - Critical word (critical word when determining the coherency of the sentence) ■ AOI 3 - Determiner (the decision point with the letter to be remembered) 27Eye Tracker use in Computer Science Research Work
  • 28. Machine Learning and Features ● Machine learning (ML) = Development of computer programs that can access data and learn patterns or classifications without explicitly programming ● ML need a dataset which consist of different feature values ● Feature = An attribute being observed ○ Fixation Duration = 100 milliseconds ○ Saccade Duration = 10 milliseconds ● Feature set = A set of all the attributes that you're interested in ○ Eg: Fixation Duration & Saccade Duration 28Eye Tracker use in Computer Science Research Work
  • 29. Eye Gaze Metrics Feature Set Fixation features ● Number of fixations ● Fixation Duration (ms) ● Average Fixation duration (ms) ● Pupil diameter of left eye (mm) ● Pupil diameter of right eye (mm) 29Eye Tracker use in Computer Science Research Work Normal Pupils vs. Dilated Pupils Source - https://www.allaboutvision.com/en-in/conditions/dilated-pupils/
  • 30. Eye Gaze Metrics Feature Set Saccade features ● Saccade Duration ● Saccade Amplitude ● Saccade Peak velocities 30Eye Tracker use in Computer Science Research Work
  • 31. Sample Eye Gaze Metrics Feature Set 31Eye Tracker use in Computer Science Research Work Part of Fixation Feature Set
  • 32. What do we use for Machine Learning? 32Eye Tracker use in Computer Science Research Work
  • 33. Evaluation of Results ● We chose standard information retrieval evaluation measures ○ Precision ○ Recall ○ Accuracy 33Eye Tracker use in Computer Science Research Work
  • 34. Results (I) Classify ADHD and Non-ADHD subjects using Machine Learning on Eye Tracking data 34Eye Tracker use in Computer Science Research Work Feature Set Accuracy Fixation Features 78.48% Saccade Features 91.14% Both Fixation and Saccade Features 91.11%
  • 35. Results (II) Classify ADHD and Non-ADHD subjects using Machine Learning on Eye Tracking data within Areas Of Interest (AOIs) based on sentences 35Eye Tracker use in Computer Science Research Work Feature Set Accuracy Sentence-based Feature set 86.20%
  • 36. Publications ● 1 Book Chapter ○ Anne M. P. Michalek, *Gavindya Jayawardena, and Sampath Jayarathna. "Predicting ADHD Using Eye Gaze Metrics Indexing Working Memory Capacity", Computational Models for Biomedical Reasoning and Problem Solving, IGI Global, pp. 66-88. 2019 ● 1 Conference Paper ○ *Gavindya Jayawardena, Anne M. P. Michalek, and Sampath Jayarathna. "Eye Tracking Area of Interest in the Context of Working Memory Capacity Tasks", In Proceedings of the 2014 IEEE 20th International Conference on Information Reuse and Integration (IEEE IRI 2019) (In Press) ● 1 Tech report ○ Eye Gaze Metrics and Analysis of AOI for Indexing Working Memory towards Predicting ADHD - https://arxiv.org/abs/1906.07183 ● 1 Blog Post ○ Use of Cognitive Memory to Improve the Accessibility of Digital Collections - https://ws- dl.blogspot.com/2019/06/2019-06-19-use-of-cognitive-memory-to.html 36Eye Tracker use in Computer Science Research Work
  • 37. WEKA ● Is a collection of machine learning algorithms for data mining tasks ● Contains tools for data classification ● Facilitates to visualize how different algorithms perform for the same data set 37Eye Tracker use in Computer Science Research Work
  • 38. Demo of Weka Knowledge Flow 38Eye Tracker use in Computer Science Research Work
  • 39. Questions? 39Eye Tracker use in Computer Science Research Work Gavindya Jayawardena Twitter Handle - @Gavindya2 Email - hjaya001@odu.edu
  • 40. Thank You! 40Eye Tracker use in Computer Science Research Work

Editor's Notes

  1. Twitter handle
  2. Put GPA I am originally from SL I am a Dominion Scholar
  3. A picture of myself with Pupil Labs!
  4. Show a eye tracker . A real one! So we use it
  5. Use a physical object for the rotations
  6. Copy paste from Dr.Sampath’s Slide
  7. While talking - drop something and explain attention
  8. Add multiple images - instead of words For all! Animated GIF for may be gaming - eye tracking in gaming - Dr.Sampaths slide
  9. Add multiple images - instead of words For all! Animated GIF for may be gaming - eye tracking in gaming - Dr.Sampaths slide
  10. Add multiple images - instead of words For all! Animated GIF for may be gaming - eye tracking in gaming - Dr.Sampaths slide
  11. How to Calibrate? Game
  12. WM allows for the manipulation of stored information, whereas short-term memory only refers to the short-term storage of information.
  13. we can apply the same to see how much of a WMC you have right now by RSpan task or other types of tasks available to calculate the WMC score. Score = the number of letters accurately recalled / the total number of possible letters recalled in order
  14. ADHD - Non ADHD -- USING ML
  15. ML need features ex
  16. You are listening to my talk → We can get number of fixations Duration of fixations Pupil Dilate more -> more info Excited / Paying Attention -> dilate-> extract info
  17. Sccd is a jump It has a curve→ height is the amplitude - → Highest speed of saccade is the pv
  18. Use Anaconda - The open-source Anaconda Distribution is the easiest way to perform Python/R data science and machine learning Quickly download 1,500+ Python/R data science packages Its Free Separate or with Anaconda Pandas Dataframes (table) -- a data structure → efficient data retrieval (without loops) Pandas developed on top of numpy
  19. Precision - measures the correctly predicted number of labels out of all predicted data instances. Recall - measures the correctly predicted number of labels out of all labeled data instances for a specific a category label Accuracy - indicates the percentage of correctly classified instances
  20. Put up a ONE table