Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

DBI World Conference 2019 - Eye gaze technology: more than meets the eye!


Published on

DBI World Conference 2019
Technology stream: Concurrent session 10B
Presenter: Wendy L. Buckley
Topic: Eye gaze technology: more than meets the eye!

Published in: Healthcare
  • Be the first to comment

  • Be the first to like this

DBI World Conference 2019 - Eye gaze technology: more than meets the eye!

  1. 1. 1 Eye Gaze Technology: More Than Meets the Eye! Wendy L. Buckley, M.Ed., Ed.S 17th Deafblind International World Conference Gold Coast, Australia
  2. 2. 2 Eye Gaze Tracker
  3. 3. 3 3 Eye tracker device: operates computer mouse functions Detects and follows eye movements Light emitting diodes illuminate the eyes Reflections off corneal surface System tracks eye movements Calculations estimate position of eye and point of gaze (x,y coordinates) Monocular or binocular Eye Gaze Technology
  4. 4. 4 4 Computer Screen: Adjustable height Articulating arm or stand Adjustable height table Computer location Background clutter Room lighting Windows/light sources Distraction free APH Tri-fold Board User Positioning
  5. 5. 5 5
  6. 6. 6
  7. 7. 7 7 Visual skills Fixation Recognition Preferences Choosing Applications for Training & Analysis
  8. 8. 8 What Can We Learn? Eye Gaze Technology for Children with Deafblindness
  9. 9. 9 9 Can the user attend to screen? Initiate interaction? Sustain attention? What colors result in the most attention? Does the user attend to images with more or less detail? Moving shapes vs. moving characters Does the user track equally in all directions? Questions
  10. 10. 10 10 Can the user sustain attention on a single object for short periods? Does the user demonstrate a preference for certain images or patterns? Does the user demonstrate awareness of features of an image? Does the user demonstrate understanding of cause & effect? Questions
  11. 11. 11 11 Can the user communicate a preference? Can the user sustain concentration for a longer period? Can the user look at and explore the entire screen? Can the user explore the screen to interact with objects? Does the user demonstrate emerging awareness of control by looking? Questions
  12. 12. 12 12 Online subscription: Insight Desktop Software: Attention and Looking Exploring and Learning Choosing and Playing Analytics: Eye Gaze Software
  13. 13. 13 13 Online subscription Intelligent analytics Provides objective and detailed measurement and analysis of early vision and cognition behaviors using eye gaze technology. Insight
  14. 14. 14 14 Insight Early Vision Early Cognition
  15. 15. 15 15 Activities with small incremental steps Gradual increase in complexity Progression Road Map
  16. 16. 16 16 Age 18 CVI phase 1 Non-ambulatory Uses a switch Student: J
  17. 17. 17 17 Learning Goal: Visual Attention Learning to attend to different visual stimuli and engage with the screen Game Play: Experiential An experiential activity with no interaction required! Levels represent a general progression of visual complexity Level: 1 – Petals Attend to very high contrast patterns of bold black and white lines and shapes. Student: J Initial session
  18. 18. 18 18 Visual Attention Activity Video: moving pattern with musical tune
  19. 19. 19 19 Initial Session: Overall Performance 17% Visual Attention: J demonstrated poor visual attention skills in this activity. (17%) Attention: J attended to the screen briefly. (1%) Reaction: J reacted to most images after a short delay. (62%) Quality: When attending J's attention was sustained. (98%) Consistency: J's behavior was consistent throughout the activity. (94%)
  20. 20. 20 20 Learning Goal: Visual Attention Game Play: Experiential Level: 2 – Petals Attend to very high contrast patterns of bold black and single colors lines and shapes. End of Year 1
  21. 21. 21 21 One Year Later: Performance Scores 50-80% Visual Attention: Jared demonstrated some visual attention skills in this activity. (52%) Attention: Jared attended to the screen for some of the time. (43%) Reaction: Jared reacted to most images quickly. (81%) Quality: When attending Jared's attention was sustained. (95%) Consistency: Jared's behavior was consistent throughout the activity. (72%)
  22. 22. 22 22 End of Year Two Learning Goal: Visual Attention Game Play: Experiential Level: 3 – Cubes Attend to detailed patterns of multi- colored, textured, and 3D images
  23. 23. 23 23
  24. 24. 24 24 Transition time for activities Attends to color; possible preference for green Extended periods of absence: regression with recovery to previous point Time available for instruction (sandwich transitions) Visual fatigue Overwhelmed by combined visual/auditory stimuli Outcomes: What Have We Learned?
  25. 25. 25 25 Student: B
  26. 26. 26 26 Age 3 Medically complex Limited muscle control CVI early phase 1 Early Vision activities Student: B
  27. 27. 27 27  Black & white patterns: 4 to 23%  Black & single color patterns: 45 to 98%  Multi-colored patterns: 22 to 85% Performance Scores
  28. 28. 28 28 Increased visual attention Moving to "noticing" activities End of Eight Months
  29. 29. 29 29 End of Eight Months Learning Goal: Noticing Images Learning to direct visual attention to specific images Game Play: Look at an image to make it "pop." Eight images in each activity. Level: 1 – Balloons (Color) Notice large images in the center of the screen.
  30. 30. 30 30 Noticing Images Activity
  31. 31. 31 31 Preference for color over black & white Prefers colors green and neon pink Left field weakness Learning to exert minimal movement to reposition visual focus Strong response to visual activities Fatigue factors Outcomes: What Have We Learned?
  32. 32. 32 32 Age 10 CVI phase 2 Physical limitations Student: E
  33. 33. 33 33 Activity: Control and Predict
  34. 34. 34 34 Activity: Control and Predict
  35. 35. 35 35 Incremental steps Demonstrating preferences Uses vision to communicate preferences Cause & effect Outcomes: What Have We Learned?
  36. 36. 36 36 Activity Example: Simple Linear Tracking
  37. 37. 37 37 Activity Example: Simple Linear Tracking
  38. 38. 38 38 Video: Simple Linear Tracking Video does not have audio
  39. 39. 39 39 Tracking: Analytics Visual line trace
  40. 40. 40 40 Tracking: Analytics Visual heat map
  41. 41. 41 41 Using vision to experience, interact, create Cause & effect using eye control Visual attention with fixation on a single image Initial skills for dwell selection Early cursor control Purposeful cursor movement Application of Eye Gaze
  42. 42. 42 42 Color preferences Placement of materials Patterns of behavior Visual skills Communication skills Simple vs. complex images Time “available” for instruction What Can We Learn?
  43. 43. 43 43 Inclusive Technology Guidebooks: Eye Gaze in the Classroom Attention and Looking Exploring and Playing Choosing and Telling How to Use myGaze® with HelpKidzLearn Resources
  44. 44. 44 44 Unlocking Abilities Guides  An Introduction to Eye Gaze Devices  Assessment and Setup for Eye Gaze Device Use  Keys to Developing Eye Gaze Skills  Software for Developing Eye Gaze Skills  Eye Gaze Monitoring Sheets Resources