Presented at 12th International Conference on Health Informatics (HEALTHINF 2019) http://www.insticc.org/Primoris/Resources/PaperPdf.ashx?idPaper=74026 Authors: Romuald Carette, Mahmoud Elbattah, Federica Cilia, Gilles Dequen, Jean-Luc Guérin Université de Picardie Jules Verne, France mahmoud.elbattah@u-picardie.fr

1. 12th International Conference on Health Informatics (HEALTHINF 2019)
Learning to Predict Autism Spectrum Disorder Based
on the Visual Patterns of Eye-Tracking Scanpaths
Romuald Carette, Mahmoud Elbattah, Federica Cilia,
Gilles Dequen, Jean-Luc Guérin
Université de Picardie Jules Verne, France
mahmoud.elbattah@u-picardie.fr
https://mahmoud-elbattah.github.io/ML4Autism/
https://www.researchgate.net/publication/331784416_Learning_to_Predict_Autism_Spectrum_Disorder_based_on_the_Visual_Patterns_of_Eye-
tracking_Scanpaths

2. 12th International Conference on Health Informatics (HEALTHINF 2019)
Background:AutismSpectrumDisorder
• Autism Spectrum Disorder (ASD) is a pervasive developmental disorder
characterised by a set of impairments including social communication
problems. 1
• ASD has been considered to affect about 1% of the world’s population (US
Dep. of Health, 2018). 2
• The hallmark of autism is an impairment of the ability to make and maintain
eye contact. 3
2
1 L. Wing, and J. Gould, “Severe Impairments of Social Interaction and Associated Abnormalities in Children: Epidemiology and
Classification”. Journal of Autism and Developmental Disorders, 9(1), pp.11-29, 1979.
2 U.S. Department of Health & Human Services. Data and statistics | autism spectrum disorder (asd) | ncbddd | cdc, 2018.
URL: https://www.cdc.gov/ncbddd/autism/data.html.
3 Coonrod, E. E. and Stone, W. L. (2004). Early concerns of parents of children with autistic and nonautistic disorders. Infants
& Young Children, 17(3), 258–268.

3. 12th International Conference on Health Informatics (HEALTHINF 2019)
Background:Eye-TrackingTechnology
3
Image Source: https://imotions.com/blog/eye-tracking/
J.H. Goldberg, and J.I. Helfman, “Visual scanpath representation”, In Proceedings of the 2010 Symposium on Eye-Tracking
Research & Applications, ACM, 2010, pp. 203-210.
Gaze Scan-path

4. 12th International Conference on Health Informatics (HEALTHINF 2019)
KeyIdea:
Learningthe VisualPatternsofEye-TrackingScanpaths
4

5. 12th International Conference on Health Informatics (HEALTHINF 2019)
Data Description
• 59 participants.
• Avg age ≈7.88 years old.
• 547 images: 328 (Non-ASD), 219 (ASD)
• Image dimensions: 640x480
• Dataset available on Figshare
5
ASD Non-ASD

6. 12th International Conference on Health Informatics (HEALTHINF 2019)
Image Augmentation
• Augmentation was applied to produce variations of images based on a
random set of transformations (e.g. rotation, shearing).
• The augmented dataset contained more than 3K samples.
• Implemented using Keras.
6https://github.com/Mahmoud-Elbattah/Predicting_ASD

7. 12th International Conference on Health Informatics (HEALTHINF 2019)
Results:BinaryClassifierAccuracy(10-foldCross-Validation)
7https://github.com/Mahmoud-Elbattah/Predicting_ASD

8. 12th International Conference on Health Informatics (HEALTHINF 2019)
Results:Multi-LabelClassifierAccuracy(10-foldCross-Validation)
8https://github.com/Mahmoud-Elbattah/Predicting_ASD

9. 12th International Conference on Health Informatics (HEALTHINF 2019)
Demo Application:
https://goo.gl/i4N7Zj
9

10. 12th International Conference on Health Informatics (HEALTHINF 2019)
THANK YOU!
mahmoud.elbattah@u-picardie.fr
Find the original publication on:
• https://www.researchgate.net/publication/331784416_Learning_to_Predict_Autism_Spectrum_Disorder_b
ased_on_the_Visual_Patterns_of_Eye-tracking_Scanpaths
• http://www.insticc.org/Primoris/Resources/PaperPdf.ashx?idPaper=74026
Dataset available on Figshare:
• https://figshare.com/articles/Visualization_of_Eye-
Tracking_Scanpaths_in_Autism_Spectrum_Disorder_Image_Dataset/7073087
Project Website:
• https://mahmoud-elbattah.github.io/ML4Autism/
• https://www.researchgate.net/project/Predicting-Autism-Spectrum-Disorder-Using-Machine-Learning-and-
Eye-Tracking