SlideShare a Scribd company logo
HUMAN COMPUTER
    INTERACTION
    SUBJECT CODE : DCM 214




                                 Prepared by : NURAINI MOHD GHANI
                                    p            R
1
                     Chapter 2
          HUMAN CAPABILITIES :
        INPUT OUTPUT SYSTEMS
KEY POINT
 Human have processing constraints
               p         g
 Motor limitations, e.g. Fitts’ law for pointing




                                                          Prepare by : NURAI MOHD GHANI
 Visual range for motion, shape, colour, detail and
 their consequences for design decisions




                                                                ed
 Visual attention models
 Alternative sensory channels
 Alt     ti            h      l




                                                                           INI     H
                                                      2
HUMAN CONSTRAINTS
What do we know about human capabilities that could or
should constrain interface design?




                                                                     Prepare by : NURAI MOHD GH
   Limits on perceptual capability – e.g. contrast, resolution
              p    p        p       y    g         ,




                                                                           ed
   Limits on motor capability – e.g. reach, speed, precision
   Limits on attention capacity
   Limits on memory




                                                                                      INI
   Rates of learning and forgetting
   Causes of error
   Mental
   M t l models & biases
              d l    bi




                                                                                              HANI
   Individual differences (the average size fits few people)
   Variable state (e.g. stress, fatigue)
   Special needs & age …                                         3
HUMAN CONSTRAINTS
Model Human Processor
(MHP)




                               Prepare by : NURAI MOHD GH
*One way to subdivide
         y




                                     ed
the main constraints
*Perceptual, Motor and
Cognitive sub-systems
           sub systems




                                                INI
characterised by:
– Storage capacity U
– Decay time D




                                                        HANI
– Processor cycle time T
*We will focus today on
the perceptual and         4
motor processes
MOTOR CONSTRAINTS

Example: Fi ’ law (1954)
E    l Fitts’ l




                               Prepare by : NURAINI MOHD GHANI
                                     ed         I         H
                           5
MOTOR CONSTRAINTS
  Example: Fitts’ law (1954)
      p               (    )




                                                              Prepare by : NURAI MOHD GH
                                                                    ed
  Justification?




                                                                               INI
       #By “analogy” to Shannon information
capacity = bandwidthxlog2((signal+noise)/noise)




                                                                                       HANI
       #If move fraction 1-r to target each timestep,
  then reach target when rnD = W/2; so n is
  proportional to log22D/W
                                                          6
       # Empirically find good fit with log2(D/W + 0.5)
MOTOR CONSTRAINTS
 Example: Fitts’ law (1954)
     p               (    )




                                                      Prepared by : NURAI MOHD GH
                                                            e
 Application?




                                                                        INI
     *Time will increase with distance – can we
 keep everything close?




                                                                                HANI
     *Time will decrease with width – can we
 make width infinite?
                                                  7
Prepared by : NURAINI MOHD GHANI
                                      e           I         H
                                                                   8
PERCEPTION
             What can we see?
PERCEPTION
 Some consequences of what we can see:
            q
     #Motion – will be visible (and distracting)




                                                           Prepare by : NURAI MOHD GH
 anywhere in visual field
     # Colour – main advantage is “pop-out”:




                                                                 ed
But many disadvantages:
     # Sh
       Shape iimportant i t t recognition: SO
                   t t in text         iti




                                                                            INI
 ALL CAPS BAD
     # Limits on resolution – recommend




                                                                                    HANI
 minimum font size; ideally individual can adjust
     # High resolution only in tiny area of fixation
                                                       9
EYE TRACKING
 Fixation pattern is a g
          p            good indicator of attention




                                                      Prepare by : NURAI MOHD GHANI
     #Where do people look, how often, for how
           long, in what order?




                                                            ed
     #Recent technology is making this a
           standard tool for HCI




                                                                       INI
     #Also used as input device.




                                                                               H
                                                     10
PERCEPTION

 Importance of eye movements




                                     Prepare by : NURAI MOHD GH
  Must shift the tiny high
resolution area around




                                           ed
Constantly

  Movements called saccades




                                                      INI
occur > 2 per second all day Long

 How does visual system decide
where to move next?




                                                              HANI
  Models of attention
e.g. Itti et.al. 1998
                                    11
ATTENTION
  Simple statistical model of saliency Rosenholtz et al (2005)

*Provides definition of ‘clutter’: size of




                                                                  Prepare by : NURAI MOHD GH
local covariance ellipsoid




                                                                        ed
* To measure:
* Compute local feature covariance at
multiple scales
* Take maximum across scales




                                                                                   INI
* Average for different features
* Pool over space
*P d
  Produces good correlation with human
               d       l ti   ith h




                                                                                           HANI
estimates of clutter
* Can also use to determine what
feature added where would best draw                              12
attention
ATTENTION
#So what went wrong here?
#Task: find current population of U.S.
    k fi d              l i     f S




                                                       Prepared by : NURAINI MOHD GH
                                                             e           I         HANI
86% of users failed…
http://www.useit.com/alertbox/fancy-formatting.html   13
PERCEPTUAL CONSTRAINTS
  Bottom up visual processing sets some constraints on
  optimal layouts, but must also consider top down
     ti l l    t b t      t l        id t d
  issues:




                                                            Prepare by : NURAI MOHD GH
#Cultural and l
#C lt    l d learned f t
                       d factors – f ili it
                                   familiarity




                                                                  ed
#Underlying domain knowledge of user
# Need to reflect logical structure, e.g., placement and
  grouping




                                                                             INI
according to function, sequence, frequency of use
# Dependence on task to be carried out, e.g. getting an
  overview




                                                                                     HANI
vs. seeking specific information
# Note that layout and visualisation are already widely
  explored fields with conclusions that carry over to
           fields,                                         14
  HCI
ALTERNATIVE SENSORY CHANNELS
Different sensors provide parallel channel capacity
Sound:




                                                                 Prepare by : NURAI MOHD GH
#Not so easy to localise but can detect from any direction
            y                                   y




                                                                       ed
# Grabs attention – warning mechanisms
# Good signal of causal relation – use as confirmatory
   feedback




                                                                                  INI
# Monitoring state, ‘background information’
# Disk, printer noise etc.
# Example of user improvisation in use of ‘data’
                                            data




                                                                                          HANI
# Interface sound design is typically arbitrary and synthetic

Touch
To ch and haptics:                                              15
# Exploit our natural ability to ‘handle’ objects
THANK YOU
SEE YOU NEXT CLASS




                      Prepare by : NURAI MOHD GH
                            ed
       AND




                                       INI
DON T
DON’T FORGET TO




                                               HANI
  FINISH YOUR
  HOMEWORK
                     16

More Related Content

What's hot

User cognitive aspects for HCI
User cognitive aspects for HCIUser cognitive aspects for HCI
User cognitive aspects for HCI
HafizMImran1
 
Evaluation techniques in HCI
Evaluation techniques in HCIEvaluation techniques in HCI
Evaluation techniques in HCI
sawsan slii
 
HCI 3e - Ch 7: Design rules
HCI 3e - Ch 7:  Design rulesHCI 3e - Ch 7:  Design rules
HCI 3e - Ch 7: Design rules
Alan Dix
 
Human Computer Interaction Notes 176.pdf
Human Computer Interaction Notes 176.pdfHuman Computer Interaction Notes 176.pdf
Human Computer Interaction Notes 176.pdf
vijaykumarK44
 
HCI 3e - Ch 4 (extra):
HCI 3e - Ch 4 (extra):HCI 3e - Ch 4 (extra):
HCI 3e - Ch 4 (extra):
Alan Dix
 
Interaction design beyond human computer interaction
Interaction design beyond human computer interactionInteraction design beyond human computer interaction
Interaction design beyond human computer interaction
Kenny Nguyen
 
A completed modeling of local binary pattern operator
A completed modeling of local binary pattern operatorA completed modeling of local binary pattern operator
A completed modeling of local binary pattern operatorWin Yu
 
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
Jia-Bin Huang
 
HCI Presentation
HCI PresentationHCI Presentation
HCI Presentation
Abdul Rasheed Memon
 
Machine Learning (ML) in Wireless Sensor Networks (WSNs)
Machine Learning (ML) in Wireless Sensor Networks (WSNs)Machine Learning (ML) in Wireless Sensor Networks (WSNs)
Machine Learning (ML) in Wireless Sensor Networks (WSNs)
mabualsh
 
HCI 3e - Ch 18: Modelling rich interaction
HCI 3e - Ch 18:  Modelling rich interactionHCI 3e - Ch 18:  Modelling rich interaction
HCI 3e - Ch 18: Modelling rich interaction
Alan Dix
 
Dynamic source routing
Dynamic source routingDynamic source routing
Dynamic source routingAshraf Uddin
 
Artificial Intelligence Chapter two agents
Artificial Intelligence Chapter two agentsArtificial Intelligence Chapter two agents
Artificial Intelligence Chapter two agentsEhsan Nowrouzi
 
Multimodal Interaction
Multimodal InteractionMultimodal Interaction
Multimodal Interaction
Maleeha Khawar Hashmie
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI) Human Computer Interaction (HCI)
Human Computer Interaction (HCI)
Sachith Perera
 
Principles Of Good Screen Design
Principles Of Good Screen DesignPrinciples Of Good Screen Design
Principles Of Good Screen Design
guest7af47
 
HCI - Chapter 6
HCI - Chapter 6HCI - Chapter 6
HCI - Chapter 6
Alan Dix
 
Cognitive architecture
Cognitive architectureCognitive architecture
Cognitive architectureHasam Panezai
 
Cognition in HCI
Cognition in HCICognition in HCI
Cognition in HCI
Um e Farwa
 

What's hot (20)

User cognitive aspects for HCI
User cognitive aspects for HCIUser cognitive aspects for HCI
User cognitive aspects for HCI
 
Evaluation techniques in HCI
Evaluation techniques in HCIEvaluation techniques in HCI
Evaluation techniques in HCI
 
HCI 3e - Ch 7: Design rules
HCI 3e - Ch 7:  Design rulesHCI 3e - Ch 7:  Design rules
HCI 3e - Ch 7: Design rules
 
Human Computer Interaction Notes 176.pdf
Human Computer Interaction Notes 176.pdfHuman Computer Interaction Notes 176.pdf
Human Computer Interaction Notes 176.pdf
 
HCI 3e - Ch 4 (extra):
HCI 3e - Ch 4 (extra):HCI 3e - Ch 4 (extra):
HCI 3e - Ch 4 (extra):
 
Interaction design beyond human computer interaction
Interaction design beyond human computer interactionInteraction design beyond human computer interaction
Interaction design beyond human computer interaction
 
A completed modeling of local binary pattern operator
A completed modeling of local binary pattern operatorA completed modeling of local binary pattern operator
A completed modeling of local binary pattern operator
 
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
Saliency Detection via Divergence Analysis: A Unified Perspective ICPR 2012
 
HCI Presentation
HCI PresentationHCI Presentation
HCI Presentation
 
Machine Learning (ML) in Wireless Sensor Networks (WSNs)
Machine Learning (ML) in Wireless Sensor Networks (WSNs)Machine Learning (ML) in Wireless Sensor Networks (WSNs)
Machine Learning (ML) in Wireless Sensor Networks (WSNs)
 
HCI 3e - Ch 18: Modelling rich interaction
HCI 3e - Ch 18:  Modelling rich interactionHCI 3e - Ch 18:  Modelling rich interaction
HCI 3e - Ch 18: Modelling rich interaction
 
Dynamic source routing
Dynamic source routingDynamic source routing
Dynamic source routing
 
Artificial Intelligence Chapter two agents
Artificial Intelligence Chapter two agentsArtificial Intelligence Chapter two agents
Artificial Intelligence Chapter two agents
 
Multimodal Interaction
Multimodal InteractionMultimodal Interaction
Multimodal Interaction
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI) Human Computer Interaction (HCI)
Human Computer Interaction (HCI)
 
Principles Of Good Screen Design
Principles Of Good Screen DesignPrinciples Of Good Screen Design
Principles Of Good Screen Design
 
HCI - Chapter 6
HCI - Chapter 6HCI - Chapter 6
HCI - Chapter 6
 
E3 chap-08
E3 chap-08E3 chap-08
E3 chap-08
 
Cognitive architecture
Cognitive architectureCognitive architecture
Cognitive architecture
 
Cognition in HCI
Cognition in HCICognition in HCI
Cognition in HCI
 

Viewers also liked

Slaidi premium medical_decembris
Slaidi premium medical_decembrisSlaidi premium medical_decembris
Slaidi premium medical_decembrisPremiumMedical
 
Premium Medical_marts
Premium Medical_martsPremium Medical_marts
Premium Medical_marts
PremiumMedical
 
3 ca - homer
3   ca - homer3   ca - homer
3 ca - homer
rhettteacher
 
Arthur Erkrasharj
Arthur ErkrasharjArthur Erkrasharj
Arthur Erkrasharj67gayane
 
Delitti esemplari 2013
Delitti esemplari 2013Delitti esemplari 2013
Delitti esemplari 2013
Patrizia Ercole
 
Men & women’s ministry Spiritual Assessment
Men & women’s ministry Spiritual Assessment Men & women’s ministry Spiritual Assessment
Men & women’s ministry Spiritual Assessment
Phoebeluz Santos
 
Industrial and Logistics Market Report 2012
Industrial and Logistics Market Report 2012Industrial and Logistics Market Report 2012
Industrial and Logistics Market Report 2012
Ellwanger & Geiger Privatbankiers
 
Slaidi premium medical_ru_janvaris
Slaidi premium medical_ru_janvarisSlaidi premium medical_ru_janvaris
Slaidi premium medical_ru_janvarisPremiumMedical
 
Hawkins kaiser module_4
Hawkins kaiser module_4Hawkins kaiser module_4
Hawkins kaiser module_4InnovateLTC
 
DCTS Brochure
DCTS BrochureDCTS Brochure
DCTS Brochure
Ana-Maria Popa
 
Premium medical junijs
Premium medical junijsPremium medical junijs
Premium medical junijsPremiumMedical
 
Kisamyakayin hashvetvutyun
Kisamyakayin hashvetvutyunKisamyakayin hashvetvutyun
Kisamyakayin hashvetvutyun67gayane
 
File Processing - Batch Process Execution
File Processing - Batch Process ExecutionFile Processing - Batch Process Execution
File Processing - Batch Process Execution
Abimael Desales López
 
KU7 | Kuvareportaasi | Susanne Sandberg
KU7 | Kuvareportaasi | Susanne SandbergKU7 | Kuvareportaasi | Susanne Sandberg
KU7 | Kuvareportaasi | Susanne Sandberg
Pohjois-Tapiolan lukio
 
Photography Research
Photography ResearchPhotography Research
Photography ResearchPaige Harper
 
Slaidi premium medical_ru_decembris
Slaidi premium medical_ru_decembrisSlaidi premium medical_ru_decembris
Slaidi premium medical_ru_decembrisPremiumMedical
 
Chapter 1 principle and guidlines
Chapter 1   principle and guidlinesChapter 1   principle and guidlines
Chapter 1 principle and guidlines
Nuraini Mohd Ghani
 
Premium medical oktobris
Premium medical oktobrisPremium medical oktobris
Premium medical oktobrisPremiumMedical
 
DOCENTES SEDE TUCUNARE
DOCENTES SEDE TUCUNAREDOCENTES SEDE TUCUNARE
DOCENTES SEDE TUCUNARE
projavier
 

Viewers also liked (20)

Slaidi premium medical_decembris
Slaidi premium medical_decembrisSlaidi premium medical_decembris
Slaidi premium medical_decembris
 
Premium Medical_marts
Premium Medical_martsPremium Medical_marts
Premium Medical_marts
 
3 ca - homer
3   ca - homer3   ca - homer
3 ca - homer
 
Arthur Erkrasharj
Arthur ErkrasharjArthur Erkrasharj
Arthur Erkrasharj
 
Delitti esemplari 2013
Delitti esemplari 2013Delitti esemplari 2013
Delitti esemplari 2013
 
Men & women’s ministry Spiritual Assessment
Men & women’s ministry Spiritual Assessment Men & women’s ministry Spiritual Assessment
Men & women’s ministry Spiritual Assessment
 
Industrial and Logistics Market Report 2012
Industrial and Logistics Market Report 2012Industrial and Logistics Market Report 2012
Industrial and Logistics Market Report 2012
 
Slaidi premium medical_ru_janvaris
Slaidi premium medical_ru_janvarisSlaidi premium medical_ru_janvaris
Slaidi premium medical_ru_janvaris
 
Hawkins kaiser module_4
Hawkins kaiser module_4Hawkins kaiser module_4
Hawkins kaiser module_4
 
DCTS Brochure
DCTS BrochureDCTS Brochure
DCTS Brochure
 
Premium medical junijs
Premium medical junijsPremium medical junijs
Premium medical junijs
 
Kisamyakayin hashvetvutyun
Kisamyakayin hashvetvutyunKisamyakayin hashvetvutyun
Kisamyakayin hashvetvutyun
 
File Processing - Batch Process Execution
File Processing - Batch Process ExecutionFile Processing - Batch Process Execution
File Processing - Batch Process Execution
 
KU7 | Kuvareportaasi | Susanne Sandberg
KU7 | Kuvareportaasi | Susanne SandbergKU7 | Kuvareportaasi | Susanne Sandberg
KU7 | Kuvareportaasi | Susanne Sandberg
 
Photography Research
Photography ResearchPhotography Research
Photography Research
 
Slaidi premium medical_ru_decembris
Slaidi premium medical_ru_decembrisSlaidi premium medical_ru_decembris
Slaidi premium medical_ru_decembris
 
Gallery
GalleryGallery
Gallery
 
Chapter 1 principle and guidlines
Chapter 1   principle and guidlinesChapter 1   principle and guidlines
Chapter 1 principle and guidlines
 
Premium medical oktobris
Premium medical oktobrisPremium medical oktobris
Premium medical oktobris
 
DOCENTES SEDE TUCUNARE
DOCENTES SEDE TUCUNAREDOCENTES SEDE TUCUNARE
DOCENTES SEDE TUCUNARE
 

More from Nuraini Mohd Ghani

Chapter 4 - Human Capabilities : Conceptual Models
Chapter 4 - Human Capabilities : Conceptual ModelsChapter 4 - Human Capabilities : Conceptual Models
Chapter 4 - Human Capabilities : Conceptual Models
Nuraini Mohd Ghani
 
VISUAL REALITY [Chapter 3 - transforming shapes]
VISUAL REALITY [Chapter 3 - transforming shapes]VISUAL REALITY [Chapter 3 - transforming shapes]
VISUAL REALITY [Chapter 3 - transforming shapes]Nuraini Mohd Ghani
 
FUNDAMENTAL OF GRAPHIC DESIGN - assignment I
FUNDAMENTAL OF GRAPHIC DESIGN - assignment IFUNDAMENTAL OF GRAPHIC DESIGN - assignment I
FUNDAMENTAL OF GRAPHIC DESIGN - assignment I
Nuraini Mohd Ghani
 
VISUAL REALITY AND VRML - Assignment Presentation
VISUAL REALITY AND VRML - Assignment PresentationVISUAL REALITY AND VRML - Assignment Presentation
VISUAL REALITY AND VRML - Assignment Presentation
Nuraini Mohd Ghani
 
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
Nuraini Mohd Ghani
 
Chapter 1 - INTRODUCTION TO VRML
Chapter 1 - INTRODUCTION TO VRMLChapter 1 - INTRODUCTION TO VRML
Chapter 1 - INTRODUCTION TO VRML
Nuraini Mohd Ghani
 
Human computer interaction - assignment presentation
Human computer interaction  - assignment presentationHuman computer interaction  - assignment presentation
Human computer interaction - assignment presentation
Nuraini Mohd Ghani
 
Chapter 3 memory and learning
Chapter 3   memory and learningChapter 3   memory and learning
Chapter 3 memory and learning
Nuraini Mohd Ghani
 
E headline2010 - Presentation Seminar
E headline2010 - Presentation SeminarE headline2010 - Presentation Seminar
E headline2010 - Presentation SeminarNuraini Mohd Ghani
 
Critique 1
Critique 1Critique 1
Critique 1
Nuraini Mohd Ghani
 
Nuraini mohd ghani 1071120119
Nuraini mohd ghani   1071120119Nuraini mohd ghani   1071120119
Nuraini mohd ghani 1071120119
Nuraini Mohd Ghani
 

More from Nuraini Mohd Ghani (12)

Chapter 4 - Human Capabilities : Conceptual Models
Chapter 4 - Human Capabilities : Conceptual ModelsChapter 4 - Human Capabilities : Conceptual Models
Chapter 4 - Human Capabilities : Conceptual Models
 
VISUAL REALITY [Chapter 3 - transforming shapes]
VISUAL REALITY [Chapter 3 - transforming shapes]VISUAL REALITY [Chapter 3 - transforming shapes]
VISUAL REALITY [Chapter 3 - transforming shapes]
 
FUNDAMENTAL OF GRAPHIC DESIGN - assignment I
FUNDAMENTAL OF GRAPHIC DESIGN - assignment IFUNDAMENTAL OF GRAPHIC DESIGN - assignment I
FUNDAMENTAL OF GRAPHIC DESIGN - assignment I
 
VISUAL REALITY AND VRML - Assignment Presentation
VISUAL REALITY AND VRML - Assignment PresentationVISUAL REALITY AND VRML - Assignment Presentation
VISUAL REALITY AND VRML - Assignment Presentation
 
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
VISUAL REALITY AND VRML [Chapter 2 - BUILDING PRIMITIVE SHAPES]
 
Chapter 1 - INTRODUCTION TO VRML
Chapter 1 - INTRODUCTION TO VRMLChapter 1 - INTRODUCTION TO VRML
Chapter 1 - INTRODUCTION TO VRML
 
Human computer interaction - assignment presentation
Human computer interaction  - assignment presentationHuman computer interaction  - assignment presentation
Human computer interaction - assignment presentation
 
Chapter 3 memory and learning
Chapter 3   memory and learningChapter 3   memory and learning
Chapter 3 memory and learning
 
E headline2010 - Presentation Seminar
E headline2010 - Presentation SeminarE headline2010 - Presentation Seminar
E headline2010 - Presentation Seminar
 
Critique 1
Critique 1Critique 1
Critique 1
 
Presentation Slide
Presentation SlidePresentation Slide
Presentation Slide
 
Nuraini mohd ghani 1071120119
Nuraini mohd ghani   1071120119Nuraini mohd ghani   1071120119
Nuraini mohd ghani 1071120119
 

Recently uploaded

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 

Recently uploaded (20)

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 

Chapter 2 human capabilities, input output systems

  • 1. HUMAN COMPUTER INTERACTION SUBJECT CODE : DCM 214 Prepared by : NURAINI MOHD GHANI p R 1 Chapter 2 HUMAN CAPABILITIES : INPUT OUTPUT SYSTEMS
  • 2. KEY POINT Human have processing constraints p g Motor limitations, e.g. Fitts’ law for pointing Prepare by : NURAI MOHD GHANI Visual range for motion, shape, colour, detail and their consequences for design decisions ed Visual attention models Alternative sensory channels Alt ti h l INI H 2
  • 3. HUMAN CONSTRAINTS What do we know about human capabilities that could or should constrain interface design? Prepare by : NURAI MOHD GH Limits on perceptual capability – e.g. contrast, resolution p p p y g , ed Limits on motor capability – e.g. reach, speed, precision Limits on attention capacity Limits on memory INI Rates of learning and forgetting Causes of error Mental M t l models & biases d l bi HANI Individual differences (the average size fits few people) Variable state (e.g. stress, fatigue) Special needs & age … 3
  • 4. HUMAN CONSTRAINTS Model Human Processor (MHP) Prepare by : NURAI MOHD GH *One way to subdivide y ed the main constraints *Perceptual, Motor and Cognitive sub-systems sub systems INI characterised by: – Storage capacity U – Decay time D HANI – Processor cycle time T *We will focus today on the perceptual and 4 motor processes
  • 5. MOTOR CONSTRAINTS Example: Fi ’ law (1954) E l Fitts’ l Prepare by : NURAINI MOHD GHANI ed I H 5
  • 6. MOTOR CONSTRAINTS Example: Fitts’ law (1954) p ( ) Prepare by : NURAI MOHD GH ed Justification? INI #By “analogy” to Shannon information capacity = bandwidthxlog2((signal+noise)/noise) HANI #If move fraction 1-r to target each timestep, then reach target when rnD = W/2; so n is proportional to log22D/W 6 # Empirically find good fit with log2(D/W + 0.5)
  • 7. MOTOR CONSTRAINTS Example: Fitts’ law (1954) p ( ) Prepared by : NURAI MOHD GH e Application? INI *Time will increase with distance – can we keep everything close? HANI *Time will decrease with width – can we make width infinite? 7
  • 8. Prepared by : NURAINI MOHD GHANI e I H 8 PERCEPTION What can we see?
  • 9. PERCEPTION Some consequences of what we can see: q #Motion – will be visible (and distracting) Prepare by : NURAI MOHD GH anywhere in visual field # Colour – main advantage is “pop-out”: ed But many disadvantages: # Sh Shape iimportant i t t recognition: SO t t in text iti INI ALL CAPS BAD # Limits on resolution – recommend HANI minimum font size; ideally individual can adjust # High resolution only in tiny area of fixation 9
  • 10. EYE TRACKING Fixation pattern is a g p good indicator of attention Prepare by : NURAI MOHD GHANI #Where do people look, how often, for how long, in what order? ed #Recent technology is making this a standard tool for HCI INI #Also used as input device. H 10
  • 11. PERCEPTION Importance of eye movements Prepare by : NURAI MOHD GH Must shift the tiny high resolution area around ed Constantly Movements called saccades INI occur > 2 per second all day Long How does visual system decide where to move next? HANI Models of attention e.g. Itti et.al. 1998 11
  • 12. ATTENTION Simple statistical model of saliency Rosenholtz et al (2005) *Provides definition of ‘clutter’: size of Prepare by : NURAI MOHD GH local covariance ellipsoid ed * To measure: * Compute local feature covariance at multiple scales * Take maximum across scales INI * Average for different features * Pool over space *P d Produces good correlation with human d l ti ith h HANI estimates of clutter * Can also use to determine what feature added where would best draw 12 attention
  • 13. ATTENTION #So what went wrong here? #Task: find current population of U.S. k fi d l i f S Prepared by : NURAINI MOHD GH e I HANI 86% of users failed… http://www.useit.com/alertbox/fancy-formatting.html 13
  • 14. PERCEPTUAL CONSTRAINTS Bottom up visual processing sets some constraints on optimal layouts, but must also consider top down ti l l t b t t l id t d issues: Prepare by : NURAI MOHD GH #Cultural and l #C lt l d learned f t d factors – f ili it familiarity ed #Underlying domain knowledge of user # Need to reflect logical structure, e.g., placement and grouping INI according to function, sequence, frequency of use # Dependence on task to be carried out, e.g. getting an overview HANI vs. seeking specific information # Note that layout and visualisation are already widely explored fields with conclusions that carry over to fields, 14 HCI
  • 15. ALTERNATIVE SENSORY CHANNELS Different sensors provide parallel channel capacity Sound: Prepare by : NURAI MOHD GH #Not so easy to localise but can detect from any direction y y ed # Grabs attention – warning mechanisms # Good signal of causal relation – use as confirmatory feedback INI # Monitoring state, ‘background information’ # Disk, printer noise etc. # Example of user improvisation in use of ‘data’ data HANI # Interface sound design is typically arbitrary and synthetic Touch To ch and haptics: 15 # Exploit our natural ability to ‘handle’ objects
  • 16. THANK YOU SEE YOU NEXT CLASS Prepare by : NURAI MOHD GH ed AND INI DON T DON’T FORGET TO HANI FINISH YOUR HOMEWORK 16