SlideShare a Scribd company logo
Measuring Perceptible
Affordances with Eye Tracking:
An iGoogle Case Study
                                                             Jacques Chueke
                                                        London, UK, May 2011

                                                             George Buchanan
                                                                (1st Supervisor)
                                                Lecturer, Centre for HCI Design

                                                              Stephanie Wilson
                                                               (2nd Supervisor)
                                                Lecturer, Centre for HCI Design




Master in Design, PUC-Rio, RJ, Brazil
PhD Researcher at the Centre for HCI Design
School of Informatics, City University London                                1
New Modes of Interaction




 Microsoft Surface, 2007                                                      Xbox 360 (Kinect) Dashboard, 2011




                                                                  Tobii LeNovo, Jun 2011




   CES 2009: Hitachi's Gesture Remote Control TV Prototype   Front-facing webcam to track head movements for
                                                                                           cursor control, 2011
                                                                                                                  2
It’s not supposed to be like this…




                                 Gmail Motion, April 2011

                                                            3
Problem Statement
• Traditional control modes of interaction (e.g. Mouse and
  Keyboard) are being substituted by NUI (physical
  interactions, e.g. touch, voice, gestures, eye gaze).

• Emerging Post-WIMP command vocabularies.

• Hybrid solutions of control modes (interactions) x visual
  solutions (interfaces).

• The ‘hidden gestures’ issue.

• The ‘invisible’ control issue or ‘hidden interactions’.



                                                              4
Problem Statement
• What am I supposed to do? And if I did, what’s going to happen?




                                                         Carroll, Lewis (2009). Alice's Adventures in
                                                         Wonderland and Through the Looking-
                                                         Glass.

                                                                                          5
The Hidden Interactions issue
• The new Windows 8 with similar features as used in Windows Phone and Xbox 360 Dashboard.




                                                                                      6
The Hidden Interactions issue
• iPad and hidden interaction/gestures issue and some interface solutions.




                                                                             7

More Related Content

Viewers also liked

Eye tracking
Eye trackingEye tracking
Eye tracking
Jordi Aymar Bru
 
Hawk-Eye
Hawk-EyeHawk-Eye
Hawk-Eye
Khyati Rajput
 
Tobii Eye Tracking
Tobii Eye TrackingTobii Eye Tracking
Tobii Eye Tracking
Acuity ETS Limited
 
(eye gaze)
(eye gaze)(eye gaze)
(eye gaze)
PRADEEP Cheekatla
 
Hawk eye technology
Hawk   eye   technologyHawk   eye   technology
Hawk eye technology
PRADEEP Cheekatla
 
Hawk_s_Eye
Hawk_s_EyeHawk_s_Eye
Hawk_s_Eye
vivek bhusa
 
Hawk eye technology By RKO
Hawk eye technology By RKOHawk eye technology By RKO
Hawk eye technology By RKO
Rahul Prajapat
 
Hawk eye 1st-presentation
Hawk eye 1st-presentationHawk eye 1st-presentation
Hawk eye 1st-presentation
Bruno Borras
 
A project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinksA project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinks
pooja mote
 
Hawk eye technology by Mohit Agarwal
Hawk eye technology by Mohit AgarwalHawk eye technology by Mohit Agarwal
Hawk eye technology by Mohit Agarwal
Mohit Agarwal
 
Hawk Eye Technology ppt
Hawk Eye Technology pptHawk Eye Technology ppt
Hawk Eye Technology ppt
sravya raju
 
Eye Movement based Human Computer Interaction Technique
Eye Movement based Human Computer Interaction TechniqueEye Movement based Human Computer Interaction Technique
Eye Movement based Human Computer Interaction Technique
Jobin George
 
Hawk eye technology
Hawk eye technologyHawk eye technology
Hawk eye technology
N.CH Karthik
 

Viewers also liked (13)

Eye tracking
Eye trackingEye tracking
Eye tracking
 
Hawk-Eye
Hawk-EyeHawk-Eye
Hawk-Eye
 
Tobii Eye Tracking
Tobii Eye TrackingTobii Eye Tracking
Tobii Eye Tracking
 
(eye gaze)
(eye gaze)(eye gaze)
(eye gaze)
 
Hawk eye technology
Hawk   eye   technologyHawk   eye   technology
Hawk eye technology
 
Hawk_s_Eye
Hawk_s_EyeHawk_s_Eye
Hawk_s_Eye
 
Hawk eye technology By RKO
Hawk eye technology By RKOHawk eye technology By RKO
Hawk eye technology By RKO
 
Hawk eye 1st-presentation
Hawk eye 1st-presentationHawk eye 1st-presentation
Hawk eye 1st-presentation
 
A project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinksA project on wheelchair motion control using eye gaze and blinks
A project on wheelchair motion control using eye gaze and blinks
 
Hawk eye technology by Mohit Agarwal
Hawk eye technology by Mohit AgarwalHawk eye technology by Mohit Agarwal
Hawk eye technology by Mohit Agarwal
 
Hawk Eye Technology ppt
Hawk Eye Technology pptHawk Eye Technology ppt
Hawk Eye Technology ppt
 
Eye Movement based Human Computer Interaction Technique
Eye Movement based Human Computer Interaction TechniqueEye Movement based Human Computer Interaction Technique
Eye Movement based Human Computer Interaction Technique
 
Hawk eye technology
Hawk eye technologyHawk eye technology
Hawk eye technology
 

Similar to JChueke HCID Open Day_apr2012_pt01

New Context Conference: Intro to Lean UX
New Context Conference: Intro to Lean UXNew Context Conference: Intro to Lean UX
New Context Conference: Intro to Lean UX
Janice Fraser
 
Lecture 1: Bodily Interaction Autumn2011
Lecture 1: Bodily Interaction Autumn2011Lecture 1: Bodily Interaction Autumn2011
Lecture 1: Bodily Interaction Autumn2011
Ferhat Şen
 
Improving access to mobile technologies using tactile feedback
Improving access to mobile technologies using tactile feedback Improving access to mobile technologies using tactile feedback
Improving access to mobile technologies using tactile feedback
University of Maryland Baltimore County - Department of Information Systems
 
Praesentation dubai 2011
Praesentation dubai 2011Praesentation dubai 2011
Praesentation dubai 2011
Marcus Birkenkrahe
 
Presentation dubai 2011
Presentation dubai 2011Presentation dubai 2011
Presentation dubai 2011
Berlin School of Economics and Law
 
Bodily Interaction Lecture 1 Slides
Bodily Interaction Lecture 1 SlidesBodily Interaction Lecture 1 Slides
Bodily Interaction Lecture 1 Slides
Ferhat Şen
 
Rossett fallinloveagain w isd
Rossett fallinloveagain w isdRossett fallinloveagain w isd
Rossett fallinloveagain w isd
Allison Rossett
 
Alvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leaderAlvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leader
School of Creative Media, City University, Hong KOng
 
Kinetic Brainstorming Workshop Seattle Hive 2011
Kinetic Brainstorming Workshop Seattle Hive 2011Kinetic Brainstorming Workshop Seattle Hive 2011
Kinetic Brainstorming Workshop Seattle Hive 2011
Prarthana Johnson
 
Agile Business Analysis - The Key to Effective Requirements on Agile Projects
Agile Business Analysis - The Key to Effective Requirements on Agile ProjectsAgile Business Analysis - The Key to Effective Requirements on Agile Projects
Agile Business Analysis - The Key to Effective Requirements on Agile Projects
Lilian De Munno
 
The New Era of (Non-) Discoverability
The New Era of (Non-) DiscoverabilityThe New Era of (Non-) Discoverability
The New Era of (Non-) Discoverability
Dan Saffer
 
UiGathering Talk - Visual Design Opening Speech / by David Chen
UiGathering Talk - Visual Design Opening Speech / by David ChenUiGathering Talk - Visual Design Opening Speech / by David Chen
UiGathering Talk - Visual Design Opening Speech / by David Chen
UXTW(Taiwan User Experience Professional Association)
 
hcid2011 - Gesture Based Interfaces: Jacques chueke (HCID, City University L...
hcid2011 -  Gesture Based Interfaces: Jacques chueke (HCID, City University L...hcid2011 -  Gesture Based Interfaces: Jacques chueke (HCID, City University L...
hcid2011 - Gesture Based Interfaces: Jacques chueke (HCID, City University L...
City University London
 
ITP / SED Day 6
ITP / SED Day 6ITP / SED Day 6
ITP / SED Day 6
Sami Niemelä
 
ITP / SED Day 2
ITP / SED Day 2ITP / SED Day 2
ITP / SED Day 2
Sami Niemelä
 
Animation in user interfaces
Animation in user interfacesAnimation in user interfaces
Animation in user interfaces
Matthias Schreck
 
426 Lecture 9: Research Directions in AR
426 Lecture 9: Research Directions in AR426 Lecture 9: Research Directions in AR
426 Lecture 9: Research Directions in AR
Mark Billinghurst
 
(2012) Evolution of the Human Biometric Sensor Interaction model
(2012) Evolution of the Human Biometric Sensor Interaction model(2012) Evolution of the Human Biometric Sensor Interaction model
(2012) Evolution of the Human Biometric Sensor Interaction model
International Center for Biometric Research
 
Lean UX framework
Lean UX frameworkLean UX framework
Lean UX framework
Startup Monthly
 
Lu xi deck
Lu xi deckLu xi deck
Lu xi deck
jeronimo415
 

Similar to JChueke HCID Open Day_apr2012_pt01 (20)

New Context Conference: Intro to Lean UX
New Context Conference: Intro to Lean UXNew Context Conference: Intro to Lean UX
New Context Conference: Intro to Lean UX
 
Lecture 1: Bodily Interaction Autumn2011
Lecture 1: Bodily Interaction Autumn2011Lecture 1: Bodily Interaction Autumn2011
Lecture 1: Bodily Interaction Autumn2011
 
Improving access to mobile technologies using tactile feedback
Improving access to mobile technologies using tactile feedback Improving access to mobile technologies using tactile feedback
Improving access to mobile technologies using tactile feedback
 
Praesentation dubai 2011
Praesentation dubai 2011Praesentation dubai 2011
Praesentation dubai 2011
 
Presentation dubai 2011
Presentation dubai 2011Presentation dubai 2011
Presentation dubai 2011
 
Bodily Interaction Lecture 1 Slides
Bodily Interaction Lecture 1 SlidesBodily Interaction Lecture 1 Slides
Bodily Interaction Lecture 1 Slides
 
Rossett fallinloveagain w isd
Rossett fallinloveagain w isdRossett fallinloveagain w isd
Rossett fallinloveagain w isd
 
Alvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leaderAlvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leader
 
Kinetic Brainstorming Workshop Seattle Hive 2011
Kinetic Brainstorming Workshop Seattle Hive 2011Kinetic Brainstorming Workshop Seattle Hive 2011
Kinetic Brainstorming Workshop Seattle Hive 2011
 
Agile Business Analysis - The Key to Effective Requirements on Agile Projects
Agile Business Analysis - The Key to Effective Requirements on Agile ProjectsAgile Business Analysis - The Key to Effective Requirements on Agile Projects
Agile Business Analysis - The Key to Effective Requirements on Agile Projects
 
The New Era of (Non-) Discoverability
The New Era of (Non-) DiscoverabilityThe New Era of (Non-) Discoverability
The New Era of (Non-) Discoverability
 
UiGathering Talk - Visual Design Opening Speech / by David Chen
UiGathering Talk - Visual Design Opening Speech / by David ChenUiGathering Talk - Visual Design Opening Speech / by David Chen
UiGathering Talk - Visual Design Opening Speech / by David Chen
 
hcid2011 - Gesture Based Interfaces: Jacques chueke (HCID, City University L...
hcid2011 -  Gesture Based Interfaces: Jacques chueke (HCID, City University L...hcid2011 -  Gesture Based Interfaces: Jacques chueke (HCID, City University L...
hcid2011 - Gesture Based Interfaces: Jacques chueke (HCID, City University L...
 
ITP / SED Day 6
ITP / SED Day 6ITP / SED Day 6
ITP / SED Day 6
 
ITP / SED Day 2
ITP / SED Day 2ITP / SED Day 2
ITP / SED Day 2
 
Animation in user interfaces
Animation in user interfacesAnimation in user interfaces
Animation in user interfaces
 
426 Lecture 9: Research Directions in AR
426 Lecture 9: Research Directions in AR426 Lecture 9: Research Directions in AR
426 Lecture 9: Research Directions in AR
 
(2012) Evolution of the Human Biometric Sensor Interaction model
(2012) Evolution of the Human Biometric Sensor Interaction model(2012) Evolution of the Human Biometric Sensor Interaction model
(2012) Evolution of the Human Biometric Sensor Interaction model
 
Lean UX framework
Lean UX frameworkLean UX framework
Lean UX framework
 
Lu xi deck
Lu xi deckLu xi deck
Lu xi deck
 

Recently uploaded

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
jpupo2018
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 

Recently uploaded (20)

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 

JChueke HCID Open Day_apr2012_pt01

  • 1. Measuring Perceptible Affordances with Eye Tracking: An iGoogle Case Study Jacques Chueke London, UK, May 2011 George Buchanan (1st Supervisor) Lecturer, Centre for HCI Design Stephanie Wilson (2nd Supervisor) Lecturer, Centre for HCI Design Master in Design, PUC-Rio, RJ, Brazil PhD Researcher at the Centre for HCI Design School of Informatics, City University London 1
  • 2. New Modes of Interaction Microsoft Surface, 2007 Xbox 360 (Kinect) Dashboard, 2011 Tobii LeNovo, Jun 2011 CES 2009: Hitachi's Gesture Remote Control TV Prototype Front-facing webcam to track head movements for cursor control, 2011 2
  • 3. It’s not supposed to be like this… Gmail Motion, April 2011 3
  • 4. Problem Statement • Traditional control modes of interaction (e.g. Mouse and Keyboard) are being substituted by NUI (physical interactions, e.g. touch, voice, gestures, eye gaze). • Emerging Post-WIMP command vocabularies. • Hybrid solutions of control modes (interactions) x visual solutions (interfaces). • The ‘hidden gestures’ issue. • The ‘invisible’ control issue or ‘hidden interactions’. 4
  • 5. Problem Statement • What am I supposed to do? And if I did, what’s going to happen? Carroll, Lewis (2009). Alice's Adventures in Wonderland and Through the Looking- Glass. 5
  • 6. The Hidden Interactions issue • The new Windows 8 with similar features as used in Windows Phone and Xbox 360 Dashboard. 6
  • 7. The Hidden Interactions issue • iPad and hidden interaction/gestures issue and some interface solutions. 7

Editor's Notes

  1. The introduction of novel hardware for computing and gaming during the last decade is changing the way we control everyday devices. It provides NUI control methods, such as haptic (e.g. iPhone, iPad, MS Surface), gesture-based and voice (e.g. Nintendo Wii, Microsoft Xbox 360 console gaming with Kinect sensor) and eye tracking interactions (e. g. Tobii P-10).One specific impact this has had is on the user’s control of such devices. New ways to control – new gestures vocabularies (example kinect and iPad) - New command vocabularies have emerged and users do not know how to access or activate them.New visual metaphors (metro dashboard)How do people make sense?How do people learn?How to design better pas to improve ux and learning?How to teach at first and when one becomes and expert he/she may hide pa----------------Regarding new gestures vocabularies, what you gonna see is not what I mean…