SlideShare a Scribd company logo
EYE-BASED HEAD GESTURES FOR
   INTERACTION IN THE CAR
         Diako Mardanbegi
        Dan Witzner Hansen
         IT University of Copenhagen
More Functionality + Less Complexity
New interaction methods

Speech            Gestures
More safety
HEAD GESTURE
EYE TRACKING
Multi-purpose device
Vestibulo-Ocular Reflex
Vestibulo-Ocular Reflex
Interaction with the
  road way objects
Interaction with the
objects inside the car


   Head gesture         C
                                        B



  Fixating on the
 windscreen target
                                             A



                     Looking at the object
Application Scenarios
Application Scenarios
Head-Up Displays
          +
Eye-Based Head gesture
Continuous head movements
•Adjusting the sound level
•Adjusting the air conditioning temperature
•Opening and closing the window
Continuous head movements
•Continuously zoom or scrolling the map
•Adjusting the side-view mirrors
THANKS


Download the open-source mobile gaze tracker
               Haytham
                  From
               Eye.itu.dk

More Related Content

Viewers also liked (8)

Sné S
Sné SSné S
Sné S
 
Wrrgg
WrrggWrrgg
Wrrgg
 
การพัฒนาเทคโนโลยีสื่อสาร
การพัฒนาเทคโนโลยีสื่อสารการพัฒนาเทคโนโลยีสื่อสาร
การพัฒนาเทคโนโลยีสื่อสาร
 
Dfefg
DfefgDfefg
Dfefg
 
My personal history
My personal historyMy personal history
My personal history
 
Service Excellence - Beyond ITIL
Service Excellence - Beyond ITILService Excellence - Beyond ITIL
Service Excellence - Beyond ITIL
 
Eye-based head gestures
Eye-based head gesturesEye-based head gestures
Eye-based head gestures
 
Real-time parallax error compensation in head-mounted eye trackers
Real-time parallax error compensation in head-mounted eye trackersReal-time parallax error compensation in head-mounted eye trackers
Real-time parallax error compensation in head-mounted eye trackers
 

Recently uploaded

The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Accounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdfAccounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdf
YibeltalNibretu
 

Recently uploaded (20)

Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
Salient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptxSalient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptx
 
B.ed spl. HI pdusu exam paper-2023-24.pdf
B.ed spl. HI pdusu exam paper-2023-24.pdfB.ed spl. HI pdusu exam paper-2023-24.pdf
B.ed spl. HI pdusu exam paper-2023-24.pdf
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.pptBasic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdfINU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
 
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptxSolid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Accounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdfAccounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdf
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Benefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational ResourcesBenefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational Resources
 
Basic Civil Engineering Notes of Chapter-6, Topic- Ecosystem, Biodiversity G...
Basic Civil Engineering Notes of Chapter-6,  Topic- Ecosystem, Biodiversity G...Basic Civil Engineering Notes of Chapter-6,  Topic- Ecosystem, Biodiversity G...
Basic Civil Engineering Notes of Chapter-6, Topic- Ecosystem, Biodiversity G...
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxMatatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
 

AutoNUI2012

Editor's Notes

  1. My name is diako mardanbegi,\nI am a phd student at itu working on developing and imroving the head-mounted eyr trackers.\n
  2. Car user interfaces have become more complex with much new functionalities. \ndriver's focus on driving, still hase the highest priority And our main concern is to make the tasks that are not related to controlling the vehicle as minimally distracting as possible.\nSo we need to make the interaction methods more simple and intuitive. \n\n\n\n
  3. New interaction techniques like speech and gesture recognition seem to be intuitive way for interaction as they can use the natural human communication skills\n\n1-There have been some studies that report that voice-activated interfaces impose inappropriately high cognitive loads and can negatively affect driving performance. And the main reason is that we are still far from achieving high-performance automatic speech recognition (ASR) systems. \n2-There are also some tasks like controlling radio volume, opening the window just slightly, continuously zoom or scrolling the map which are not intuitive operations to perform solely via speech-based interaction. \n3-Speech input cannot also be used when the environment is too noisy. \n\n\n\n
  4. Interaction by head gestures involves less driver's cognitive load. \n
  5. many methods for head gesture recognition have been used that They are mostly concentrated on only detecting head shakes and nods.\n\nhead gesture recognition just like speech ecog. often require a short explicit command like pushing a button before they can be used.\n \nmost of them are video based\n
  6. On the other hand, video based eye trackers have been used in cars for different proposes and they usually require another camera system. \n\nEye trackers are used as a fatigue monitoring device to improve driving safety. \nEye and the visual behaviors measured by an eye tracker provide significant information about driver's attention.\nThe texture of the iris is known to be a powerful biometric for human identification\n\n\n\n
  7. In this paper we suggest to use a method called eye based head gestures for interaction with the user interfaces. This method allows us to use driver's visual attention and head gesture together for interaction\n
  8. Eye based head gesture is a method for mesuring the head movements through eye movements. \n
  9. When our gaze point is fixed... Figure...\nThis method allows for measuring a wide range of head movements even though the movements are very small \n
  10. So the idea is ...,figure\nSo a simple head gesture may have different interpretation depends on which object you are looking at.\n \n
  11. \n\n
  12. But can we use this method for interction inside the car\n\n we minimize the time that the gaze is away from the roadway by transferring the fixed-gaze target from a point on the object to a specified point on the windscreen. \n\nfor short gestures no need for target\nmeaningful gesture\ngazing on the target can be easily detected\n
  13. flipping the rear-view mirror down or up or accepting the incoming phone calls or in general any kind of yes/no decision when a system initiated questions or option dialogs\n
  14. As an intuitive shortcut function, enabling the user to control the music player and to skip between individual cd-tracks or radio stations. \n
  15. This method has a hight,, potential to be used for interaction with HUD\nenabling the driver to do selecting and for switching between different submenus \n
  16. Continuous vertical movements of the head can be useful for changing the volume, adjusting the air conditioning temperature, opening and closing the window, and continuously zoom or scrolling the map. In these examples, visual or auditory feedback through HUD or speakers can help the driver to perform the task more efficiently. \n
  17. The visual feedback can be a highlight color or even displaying the image of the object. For example, when the driver wants to adjust the side-view mirrors, he/she looks at the mirror and then the eye tracker recognize the mirror as the attended object and then the system shows the real-time image of the mirror in the head-up display. Now, the driver can see the mirror image in front of the windscreen and therefore can easily adjust the mirror by the head movements. \n
  18. \n\n