SlideShare a Scribd company logo
Computational
Rationality as a
Theory of Interaction
Antti Oulasvirta, Jussi Jokinen, Andrew Howes
Computational Rationality as a Theory of Interaction
Interactive behavior
is highly adaptive
Computational Rationality as a Theory of Interaction
Interaction
emerges
Actions
Thoughts
Beliefs
Goals
Capabilities
Design
Computational Rationality as a Theory of Interaction
Credit: Alex Jung / Aalto University
RL agents adapt via interaction
But AI research
has no interest
in explaining
human
adaptation
Agents try to
learn sequential
action policies
that maximize
rewards
Computational Rationality as a Theory of Interaction
Example: Adaptation in typing
Jokinen et al. CHI’21
Write fast w/out error
Adapts when error
occurs Turn on autocorrection
No human data
needed for
training
Computational Rationality as a Theory of Interaction
Increasing interest in HCI
Text entry Multitasking Decision-making
Theoretical
commitments?
Core modeling
ideas?
Computational Rationality as a Theory of Interaction
Combines RL with cognitive
architectures
Lewis et a al. 2014; Gershman et al. 2015;
Lieder & Griffiths 2019
Computational
Rationality
Cognitive
architectures
Agents act via
their bounded
cognition
Reinforcement
learning
Bounded
optimality
Interaction
emerges as
adaptation within
internal and
external bounds
Computational Rationality as a Theory of Interaction
Cognitive Architectures Computational Rationality
An information processor An agent
Manually specified rule set Policy obtained via optimization
Bounded by cognition Bounded by cognition
Program POMDP
Comparison with cognitive
architecture models
Computational Rationality as a Theory of Interaction
Theoretical commitments in HCI
1. Agent faces a stochastic
sequential decision problem
2. Agent acts in the world via
its internal environment
3. Bounds exist on information
processing in the internal
environment
4. Agent is boundedly optimal
Computational Rationality as a Theory of Interaction
Agent structure point-of-view
Standard RL
Computational rationality
Computational Rationality as a Theory of Interaction
Policy estimation view
Lewis & Howes 2019
Subjective utility payoff
surface
Boundedly optimal
policy
Standard RL Computational rationality
Behaviors admitted by
the internal
environment
Behaviors admitted by
the external
environment
Behaviors admitted by
the external
environment
Computational Rationality as a Theory of Interaction
Modeling in practice
External environment
Agent
Eye mov commands
Finger mov commands
Bounded
vision
Reward
function
Max speed
and
min errors
Finger and
eye positions
Motor
system
Perception
Internal
environment
Eye mov
Finger mov
Generates
moment-by-
moment traces,
from which
summary
statistics can be
computed
Computational Rationality as a Theory of Interaction
Comparison with human data
Jokinen et al. CHI’21
Human data Model predictions
The goal in CR is
to accurately
predict human
behavior
Computational Rationality as a Theory of Interaction
Significant progress last 5 years
147 papers found
87 peer-reviewed
20 models of HCI tasks
15 used a rigorous method
to find an optimal policy
Six interactive tasks
• Pointing
• Menu selection
• Driving
• Typing
• Multitasking
• Decision-making
Computational Rationality as a Theory of Interaction
Opportunity: Explain behavior
[Kangasrääsiö et al. CHI’17, Cognitive Science 2019]
Inverse modeling with likelihood-free inference Bayesian methods
Examples in the paper
Computational Rationality as a Theory of Interaction
Opportunity: Design interventions
Examples in the paper
Computational Rationality as a Theory of Interaction
AI
HCI’s interest is distinct
HCI
Supporting user-
centered design
and engineering
Cognitive
science
Human
intelligence
General
intelligence
Computational Rationality as a Theory of Interaction
Agenda: From micro- to macro-HCI
Motivational dynamics
Human learning
Situations
Social interaction
Computational
Rationality as a
Theory of Interaction
Antti Oulasvirta, Jussi Jokinen, Andrew Howes

More Related Content

Similar to "Computational rationality as a theory of interaction" - CHI'22 paper

The role of expectations in human computer interactions by emanuel baisire
The role of expectations in human computer interactions by emanuel baisireThe role of expectations in human computer interactions by emanuel baisire
The role of expectations in human computer interactions by emanuel baisire
Emanuel Baisire
 
-- The Cognitive Engine - 10RULE WHITE PAPER
-- The Cognitive Engine - 10RULE WHITE PAPER-- The Cognitive Engine - 10RULE WHITE PAPER
-- The Cognitive Engine - 10RULE WHITE PAPERGary Morais
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
aagamshah0812
 
ICT Colloquium Presentation
ICT Colloquium PresentationICT Colloquium Presentation
ICT Colloquium Presentation
Rijk Mercuur
 
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
IOSR Journals
 
Intention recognition for dynamic role exchange in haptic
Intention recognition for dynamic role exchange in hapticIntention recognition for dynamic role exchange in haptic
Intention recognition for dynamic role exchange in haptic
أحلام انصارى
 
Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationAmjad Adib
 
Beyond-Accuracy Perspectives: Explainability and Fairness
Beyond-Accuracy Perspectives: Explainability and FairnessBeyond-Accuracy Perspectives: Explainability and Fairness
Beyond-Accuracy Perspectives: Explainability and Fairness
Erasmo Purificato
 
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Marc Van den Broeck
 
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
cscpconf
 
Useful interactions
Useful interactionsUseful interactions
Useful interactions
Raymond Monaco
 
PhD Thesis Proposal - Design of Persuasive Apps Based on Self-Determination ...
PhD Thesis Proposal  - Design of Persuasive Apps Based on Self-Determination ...PhD Thesis Proposal  - Design of Persuasive Apps Based on Self-Determination ...
PhD Thesis Proposal - Design of Persuasive Apps Based on Self-Determination ...
Gabriela Villalobos-Zúñiga
 
Эриберто Кваджавитль "Адаптивное обучение с подкреплением для интерактивных ...
Эриберто Кваджавитль  "Адаптивное обучение с подкреплением для интерактивных ...Эриберто Кваджавитль  "Адаптивное обучение с подкреплением для интерактивных ...
Эриберто Кваджавитль "Адаптивное обучение с подкреплением для интерактивных ...
AINL Conferences
 
Ai2020 ai and or final
Ai2020 ai and or finalAi2020 ai and or final
Ai2020 ai and or final
Richard Vidgen
 
How a behavioral scientist can work productively with an HCI researcher?
How a behavioral scientist can work productively with an HCI researcher?How a behavioral scientist can work productively with an HCI researcher?
How a behavioral scientist can work productively with an HCI researcher?
Designing Health Lab, Arizona State University
 
Automatic Persona Generation: Introduction & Current Challenges
Automatic Persona Generation: Introduction & Current ChallengesAutomatic Persona Generation: Introduction & Current Challenges
Automatic Persona Generation: Introduction & Current Challenges
Joni Salminen
 
AI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of RecruitmentAI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of Recruitment
karan651042
 
AI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of RecruitmentAI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of Recruitment
karan651042
 
Invited Lecture on Interactive Information Retrieval
Invited Lecture on Interactive Information RetrievalInvited Lecture on Interactive Information Retrieval
Invited Lecture on Interactive Information Retrieval
DavidMaxwell77
 
Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"
Aalto University
 

Similar to "Computational rationality as a theory of interaction" - CHI'22 paper (20)

The role of expectations in human computer interactions by emanuel baisire
The role of expectations in human computer interactions by emanuel baisireThe role of expectations in human computer interactions by emanuel baisire
The role of expectations in human computer interactions by emanuel baisire
 
-- The Cognitive Engine - 10RULE WHITE PAPER
-- The Cognitive Engine - 10RULE WHITE PAPER-- The Cognitive Engine - 10RULE WHITE PAPER
-- The Cognitive Engine - 10RULE WHITE PAPER
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
ICT Colloquium Presentation
ICT Colloquium PresentationICT Colloquium Presentation
ICT Colloquium Presentation
 
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
How Cognitive Science Has Influenced the Applied Science of HCI “The evolutio...
 
Intention recognition for dynamic role exchange in haptic
Intention recognition for dynamic role exchange in hapticIntention recognition for dynamic role exchange in haptic
Intention recognition for dynamic role exchange in haptic
 
Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to Implementation
 
Beyond-Accuracy Perspectives: Explainability and Fairness
Beyond-Accuracy Perspectives: Explainability and FairnessBeyond-Accuracy Perspectives: Explainability and Fairness
Beyond-Accuracy Perspectives: Explainability and Fairness
 
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
 
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
CRESUS: A TOOL TO SUPPORT COLLABORATIVE REQUIREMENTS ELICITATION THROUGH ENHA...
 
Useful interactions
Useful interactionsUseful interactions
Useful interactions
 
PhD Thesis Proposal - Design of Persuasive Apps Based on Self-Determination ...
PhD Thesis Proposal  - Design of Persuasive Apps Based on Self-Determination ...PhD Thesis Proposal  - Design of Persuasive Apps Based on Self-Determination ...
PhD Thesis Proposal - Design of Persuasive Apps Based on Self-Determination ...
 
Эриберто Кваджавитль "Адаптивное обучение с подкреплением для интерактивных ...
Эриберто Кваджавитль  "Адаптивное обучение с подкреплением для интерактивных ...Эриберто Кваджавитль  "Адаптивное обучение с подкреплением для интерактивных ...
Эриберто Кваджавитль "Адаптивное обучение с подкреплением для интерактивных ...
 
Ai2020 ai and or final
Ai2020 ai and or finalAi2020 ai and or final
Ai2020 ai and or final
 
How a behavioral scientist can work productively with an HCI researcher?
How a behavioral scientist can work productively with an HCI researcher?How a behavioral scientist can work productively with an HCI researcher?
How a behavioral scientist can work productively with an HCI researcher?
 
Automatic Persona Generation: Introduction & Current Challenges
Automatic Persona Generation: Introduction & Current ChallengesAutomatic Persona Generation: Introduction & Current Challenges
Automatic Persona Generation: Introduction & Current Challenges
 
AI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of RecruitmentAI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of Recruitment
 
AI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of RecruitmentAI and Human Synergy in the World of Recruitment
AI and Human Synergy in the World of Recruitment
 
Invited Lecture on Interactive Information Retrieval
Invited Lecture on Interactive Information RetrievalInvited Lecture on Interactive Information Retrieval
Invited Lecture on Interactive Information Retrieval
 
Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"
 

More from Aalto University

Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
Observations on typing from 136 million keystrokes - Presentation by Antti Ou...Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
Aalto University
 
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Aalto University
 
"Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI..."Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI...
Aalto University
 
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
Aalto University
 
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti OulasvirtaComputational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Aalto University
 
HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides] HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides]
Aalto University
 
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Aalto University
 
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Aalto University
 
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Aalto University
 
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Aalto University
 
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Aalto University
 
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Aalto University
 
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
Aalto University
 
Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)
Aalto University
 
Improving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen DevicesImproving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen Devices
Aalto University
 
Studying interaction with 3D mobile maps
Studying interaction with 3D mobile mapsStudying interaction with 3D mobile maps
Studying interaction with 3D mobile maps
Aalto University
 

More from Aalto University (16)

Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
Observations on typing from 136 million keystrokes - Presentation by Antti Ou...Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
Observations on typing from 136 million keystrokes - Presentation by Antti Ou...
 
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
 
"Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI..."Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI...
 
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
 
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti OulasvirtaComputational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
 
HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides] HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides]
 
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
 
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
 
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
 
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
 
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
 
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
 
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
 
Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)
 
Improving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen DevicesImproving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen Devices
 
Studying interaction with 3D mobile maps
Studying interaction with 3D mobile mapsStudying interaction with 3D mobile maps
Studying interaction with 3D mobile maps
 

Recently uploaded

Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
muralinath2
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
AlaminAfendy1
 
general properties of oerganologametal.ppt
general properties of oerganologametal.pptgeneral properties of oerganologametal.ppt
general properties of oerganologametal.ppt
IqrimaNabilatulhusni
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
IshaGoswami9
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
University of Maribor
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
moosaasad1975
 
S.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary levelS.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary level
ronaldlakony0
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
RenuJangid3
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
Richard Gill
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Erdal Coalmaker
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Sérgio Sacani
 
GBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram StainingGBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram Staining
Areesha Ahmad
 
role of pramana in research.pptx in science
role of pramana in research.pptx in sciencerole of pramana in research.pptx in science
role of pramana in research.pptx in science
sonaliswain16
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
frank0071
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
University of Rennes, INSA Rennes, Inria/IRISA, CNRS
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
ChetanK57
 

Recently uploaded (20)

Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
 
general properties of oerganologametal.ppt
general properties of oerganologametal.pptgeneral properties of oerganologametal.ppt
general properties of oerganologametal.ppt
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
 
S.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary levelS.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary level
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
 
GBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram StainingGBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram Staining
 
role of pramana in research.pptx in science
role of pramana in research.pptx in sciencerole of pramana in research.pptx in science
role of pramana in research.pptx in science
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
 

"Computational rationality as a theory of interaction" - CHI'22 paper

  • 1. Computational Rationality as a Theory of Interaction Antti Oulasvirta, Jussi Jokinen, Andrew Howes
  • 2. Computational Rationality as a Theory of Interaction Interactive behavior is highly adaptive
  • 3. Computational Rationality as a Theory of Interaction Interaction emerges Actions Thoughts Beliefs Goals Capabilities Design
  • 4. Computational Rationality as a Theory of Interaction Credit: Alex Jung / Aalto University RL agents adapt via interaction But AI research has no interest in explaining human adaptation Agents try to learn sequential action policies that maximize rewards
  • 5. Computational Rationality as a Theory of Interaction Example: Adaptation in typing Jokinen et al. CHI’21 Write fast w/out error Adapts when error occurs Turn on autocorrection No human data needed for training
  • 6. Computational Rationality as a Theory of Interaction Increasing interest in HCI Text entry Multitasking Decision-making Theoretical commitments? Core modeling ideas?
  • 7. Computational Rationality as a Theory of Interaction Combines RL with cognitive architectures Lewis et a al. 2014; Gershman et al. 2015; Lieder & Griffiths 2019 Computational Rationality Cognitive architectures Agents act via their bounded cognition Reinforcement learning Bounded optimality Interaction emerges as adaptation within internal and external bounds
  • 8. Computational Rationality as a Theory of Interaction Cognitive Architectures Computational Rationality An information processor An agent Manually specified rule set Policy obtained via optimization Bounded by cognition Bounded by cognition Program POMDP Comparison with cognitive architecture models
  • 9. Computational Rationality as a Theory of Interaction Theoretical commitments in HCI 1. Agent faces a stochastic sequential decision problem 2. Agent acts in the world via its internal environment 3. Bounds exist on information processing in the internal environment 4. Agent is boundedly optimal
  • 10. Computational Rationality as a Theory of Interaction Agent structure point-of-view Standard RL Computational rationality
  • 11. Computational Rationality as a Theory of Interaction Policy estimation view Lewis & Howes 2019 Subjective utility payoff surface Boundedly optimal policy Standard RL Computational rationality Behaviors admitted by the internal environment Behaviors admitted by the external environment Behaviors admitted by the external environment
  • 12. Computational Rationality as a Theory of Interaction Modeling in practice External environment Agent Eye mov commands Finger mov commands Bounded vision Reward function Max speed and min errors Finger and eye positions Motor system Perception Internal environment Eye mov Finger mov Generates moment-by- moment traces, from which summary statistics can be computed
  • 13. Computational Rationality as a Theory of Interaction Comparison with human data Jokinen et al. CHI’21 Human data Model predictions The goal in CR is to accurately predict human behavior
  • 14. Computational Rationality as a Theory of Interaction Significant progress last 5 years 147 papers found 87 peer-reviewed 20 models of HCI tasks 15 used a rigorous method to find an optimal policy Six interactive tasks • Pointing • Menu selection • Driving • Typing • Multitasking • Decision-making
  • 15. Computational Rationality as a Theory of Interaction Opportunity: Explain behavior [Kangasrääsiö et al. CHI’17, Cognitive Science 2019] Inverse modeling with likelihood-free inference Bayesian methods Examples in the paper
  • 16. Computational Rationality as a Theory of Interaction Opportunity: Design interventions Examples in the paper
  • 17. Computational Rationality as a Theory of Interaction AI HCI’s interest is distinct HCI Supporting user- centered design and engineering Cognitive science Human intelligence General intelligence
  • 18. Computational Rationality as a Theory of Interaction Agenda: From micro- to macro-HCI Motivational dynamics Human learning Situations Social interaction
  • 19. Computational Rationality as a Theory of Interaction Antti Oulasvirta, Jussi Jokinen, Andrew Howes