SlideShare a Scribd company logo
Modelling interactions:
digital and physical
Alan Dix
https://www.alandix.com/academic/talks/ICTCS-School-2021/


ICTAC 2021

Part I – lightning tour
kinds of model
gaps and challenges


ICTAC 2021
what to model
users
– cognitive models
– task models
system
– behaviour
– architectural structure
world
– domain models

what to model
users
– cognitive models
– task models
system
– behaviour
– architectural structure
world
– domain models

types of system model
• dialogue – main modes
• full state definition
specific
system
example: car clock
three buttons:
mode – cycles between hours, mins, seconds
+/– – increments/decrements selected item
we will define state and actions
N.B. will not be right first time ... spot the mistakes ...
16:55:00
mode – +
clock state
state
hours: Nat, mins: Nat, secs: Nat – all just numbers
selected: { ‘NONE’, ‘HRS’, ‘MINS’, ‘SECS’ }
hours < 24 ∧ mins < 60 ∧ secs < 60
initial state
hours = 0, mins = 0, secs= 0
selected = ‘NONE’
display
hours “:” mins “:” secs (with selected flashing)
clock actions …
increment (+)
if ( selected = ‘NONE’ ) do nothing
if ( selected = ‘HRS’ )
if ( hours < 23 ) hours’ = hours+1
if ( hours = 23 ) hours’ = 0
if ( selected = ‘MINS’ )
if ( mins< 59 ) mins’ = mins+1
if ( mins= 59 ) mins’ = 0
...
types of system model
• dialogue – main modes
• full state definition
• abstract interaction model
specific
system
generic
issues
PIE model – abstract properties
predict
e.g. predictability:
undo
more complex undo – the cube
PIE model – abstract properties
predict
e.g. predictability:
common domains for formal methods
aerospace
nuclear
other areas?
need
cheaper/easier
techniques
safety critical
high investment
Chapter 3:
Trends and Gaps
not just keystrokes
and mouse-clicks
HCI trends: formal challenges
changing user interaction
– choice and ubiquity, diverse people, diverse devices
and contexts, physicality and embodiment, really
invisible, experience and values, social and personal
use, notification-based interaction, basic HCI
changing technology
– vast assemblies, big data, autonomy and complexity
changing design and development
– maker/hacker culture and mass customization, agile
and test-driven development
formalising interaction: challenges
what – actors and entities
– people, physical objects, space, information
what – levels of abstraction
– granularity, continuity and time, level of generality,
syntax vs semantics
who and when (and why?)
– reducing formal expertise, reducing effort, increasing
benefit
how
– types of reasoning, knowledge rich reasoning,
flexible levels of detail, multiple notations, generic
descriptions and standards
today
• domains – not nuclear!
• physical as well as digital
• granularity – not just dialogue
• flexible level of detail
• method users – no Maths degree
exercise
choose something physical
e.g. book, phone, scissors
if digital assume battery dead.
model it formally (-ish) … or whatever works!
– What it’s like
– What you can do with it
– How it fits with other things
Image Mark Turnauckas: https://www.flickr.com/photos/marktee/5590077419
Modelling interactions: digital and physical – Part 1 – lightning tour

More Related Content

What's hot

HCI 1st and 2nd sessions
HCI  1st and 2nd sessionsHCI  1st and 2nd sessions
HCI 1st and 2nd sessions
HannesChimusi
 
HUMAN COMPUTER INTERACTION
HUMAN COMPUTER INTERACTIONHUMAN COMPUTER INTERACTION
HUMAN COMPUTER INTERACTION
Javed Ahmed Samo
 
IntrIntroduction
IntrIntroductionIntrIntroduction
IntrIntroduction
Preeti Mishra
 
Human Computer Interaction of an Information System
Human Computer Interaction of an Information SystemHuman Computer Interaction of an Information System
Human Computer Interaction of an Information System
university of education,Lahore
 
Designing User Interactions with AI: Servant, Master or Symbiosis.
Designing User Interactions with AI: Servant, Master or Symbiosis. Designing User Interactions with AI: Servant, Master or Symbiosis.
Designing User Interactions with AI: Servant, Master or Symbiosis.
Alan Dix
 
Chapter 2
Chapter 2Chapter 2
Chapter 2
Faisal Aziz
 
HCI Presentation
HCI PresentationHCI Presentation
HCI Presentation
Abdul Rasheed Memon
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI) Human Computer Interaction (HCI)
Human Computer Interaction (HCI)
Sachith Perera
 
Human Computer Interaction
Human Computer InteractionHuman Computer Interaction
Human Computer Interaction
Jitu Choudhary
 
HCI
HCIHCI
Hci activity#2
Hci activity#2Hci activity#2
Hci activity#2
Desalegn Aweke
 
Human Computer Interaction Introduction
Human Computer Interaction IntroductionHuman Computer Interaction Introduction
Human Computer Interaction Introduction
N.Jagadish Kumar
 
Introducing Human Computer Interaction
Introducing Human Computer InteractionIntroducing Human Computer Interaction
Introducing Human Computer Interaction
hcicourse
 
Hci activity#1
Hci activity#1Hci activity#1
Hci activity#1
Desalegn Aweke
 
The Psychology of Human-Computer Interaction
The Psychology ofHuman-Computer InteractionThe Psychology ofHuman-Computer Interaction
The Psychology of Human-Computer Interaction
Simon Bignell
 
Hci Overview
Hci OverviewHci Overview
Human Computer Interaction-Basics
Human Computer Interaction-BasicsHuman Computer Interaction-Basics
Human Computer Interaction-Basics
Muhammad Asif
 
Chapter1(hci)
Chapter1(hci)Chapter1(hci)
Chapter1(hci)
Latesh Malik
 
Direct manipulation - ppt
Direct manipulation - pptDirect manipulation - ppt
Direct manipulation - ppt
Ayeesha Kissinger
 
Hci activity#3
Hci activity#3Hci activity#3
Hci activity#3
Desalegn Aweke
 

What's hot (20)

HCI 1st and 2nd sessions
HCI  1st and 2nd sessionsHCI  1st and 2nd sessions
HCI 1st and 2nd sessions
 
HUMAN COMPUTER INTERACTION
HUMAN COMPUTER INTERACTIONHUMAN COMPUTER INTERACTION
HUMAN COMPUTER INTERACTION
 
IntrIntroduction
IntrIntroductionIntrIntroduction
IntrIntroduction
 
Human Computer Interaction of an Information System
Human Computer Interaction of an Information SystemHuman Computer Interaction of an Information System
Human Computer Interaction of an Information System
 
Designing User Interactions with AI: Servant, Master or Symbiosis.
Designing User Interactions with AI: Servant, Master or Symbiosis. Designing User Interactions with AI: Servant, Master or Symbiosis.
Designing User Interactions with AI: Servant, Master or Symbiosis.
 
Chapter 2
Chapter 2Chapter 2
Chapter 2
 
HCI Presentation
HCI PresentationHCI Presentation
HCI Presentation
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI) Human Computer Interaction (HCI)
Human Computer Interaction (HCI)
 
Human Computer Interaction
Human Computer InteractionHuman Computer Interaction
Human Computer Interaction
 
HCI
HCIHCI
HCI
 
Hci activity#2
Hci activity#2Hci activity#2
Hci activity#2
 
Human Computer Interaction Introduction
Human Computer Interaction IntroductionHuman Computer Interaction Introduction
Human Computer Interaction Introduction
 
Introducing Human Computer Interaction
Introducing Human Computer InteractionIntroducing Human Computer Interaction
Introducing Human Computer Interaction
 
Hci activity#1
Hci activity#1Hci activity#1
Hci activity#1
 
The Psychology of Human-Computer Interaction
The Psychology ofHuman-Computer InteractionThe Psychology ofHuman-Computer Interaction
The Psychology of Human-Computer Interaction
 
Hci Overview
Hci OverviewHci Overview
Hci Overview
 
Human Computer Interaction-Basics
Human Computer Interaction-BasicsHuman Computer Interaction-Basics
Human Computer Interaction-Basics
 
Chapter1(hci)
Chapter1(hci)Chapter1(hci)
Chapter1(hci)
 
Direct manipulation - ppt
Direct manipulation - pptDirect manipulation - ppt
Direct manipulation - ppt
 
Hci activity#3
Hci activity#3Hci activity#3
Hci activity#3
 

Similar to Modelling interactions: digital and physical – Part 1 – lightning tour

chap-01 HCI.ppt
chap-01 HCI.pptchap-01 HCI.ppt
chap-01 HCI.ppt
LamaYig
 
Psychology Human Computer Interaction
Psychology Human Computer InteractionPsychology Human Computer Interaction
Psychology Human Computer Interaction
Seta Wicaksana
 
POLITEKNIK MALAYSIA
POLITEKNIK MALAYSIAPOLITEKNIK MALAYSIA
POLITEKNIK MALAYSIA
Aiman Hud
 
Human computer interaction Semester 1
Human computer interaction Semester 1Human computer interaction Semester 1
Human computer interaction Semester 1
HARISA MARDIANA
 
HCI_01.ppt
HCI_01.pptHCI_01.ppt
HCI_01.ppt
MuhammadWasayKhan2
 
control system.pdf
control system.pdfcontrol system.pdf
control system.pdf
k vimal kumar
 
01_Principles.pdf rata Tata principles and rules
01_Principles.pdf rata Tata principles and rules01_Principles.pdf rata Tata principles and rules
01_Principles.pdf rata Tata principles and rules
wearemaskedmascots
 
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdfCSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
sofiamuhammad2
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)
apppsych
 
Human computer interaction -Input output channel
Human computer interaction -Input output channelHuman computer interaction -Input output channel
Human computer interaction -Input output channel
N.Jagadish Kumar
 
1-intro.ppt
1-intro.ppt1-intro.ppt
1-intro.ppt
LallHussain
 
1-intro.ppt
1-intro.ppt1-intro.ppt
1-intro.ppt
Farahali78
 
HCI
HCIHCI
Know the user
Know the userKnow the user
Know the user
John Kelleher
 
Touch Research 2: HCI Details [Handouts]
Touch Research 2: HCI Details [Handouts]Touch Research 2: HCI Details [Handouts]
Touch Research 2: HCI Details [Handouts]
Harald Felgner, PhD
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
CARLOS III UNIVERSITY OF MADRID
 
Interaction Paradigms
Interaction ParadigmsInteraction Paradigms
Interaction Paradigms
Sebastian Weinhold
 
INCOSE IS 2019: AI and Systems Engineering
INCOSE IS 2019: AI and Systems EngineeringINCOSE IS 2019: AI and Systems Engineering
INCOSE IS 2019: AI and Systems Engineering
CARLOS III UNIVERSITY OF MADRID
 
Hci map
Hci mapHci map
Hci map
$an Ramaraju
 
Introduction to User Centred Design
Introduction to User Centred DesignIntroduction to User Centred Design
Introduction to User Centred Design
Eiji Slideshare
 

Similar to Modelling interactions: digital and physical – Part 1 – lightning tour (20)

chap-01 HCI.ppt
chap-01 HCI.pptchap-01 HCI.ppt
chap-01 HCI.ppt
 
Psychology Human Computer Interaction
Psychology Human Computer InteractionPsychology Human Computer Interaction
Psychology Human Computer Interaction
 
POLITEKNIK MALAYSIA
POLITEKNIK MALAYSIAPOLITEKNIK MALAYSIA
POLITEKNIK MALAYSIA
 
Human computer interaction Semester 1
Human computer interaction Semester 1Human computer interaction Semester 1
Human computer interaction Semester 1
 
HCI_01.ppt
HCI_01.pptHCI_01.ppt
HCI_01.ppt
 
control system.pdf
control system.pdfcontrol system.pdf
control system.pdf
 
01_Principles.pdf rata Tata principles and rules
01_Principles.pdf rata Tata principles and rules01_Principles.pdf rata Tata principles and rules
01_Principles.pdf rata Tata principles and rules
 
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdfCSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
CSE868 - Week 01 & 2 - Introduction and HCI Principles.pdf
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)
 
Human computer interaction -Input output channel
Human computer interaction -Input output channelHuman computer interaction -Input output channel
Human computer interaction -Input output channel
 
1-intro.ppt
1-intro.ppt1-intro.ppt
1-intro.ppt
 
1-intro.ppt
1-intro.ppt1-intro.ppt
1-intro.ppt
 
HCI
HCIHCI
HCI
 
Know the user
Know the userKnow the user
Know the user
 
Touch Research 2: HCI Details [Handouts]
Touch Research 2: HCI Details [Handouts]Touch Research 2: HCI Details [Handouts]
Touch Research 2: HCI Details [Handouts]
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
 
Interaction Paradigms
Interaction ParadigmsInteraction Paradigms
Interaction Paradigms
 
INCOSE IS 2019: AI and Systems Engineering
INCOSE IS 2019: AI and Systems EngineeringINCOSE IS 2019: AI and Systems Engineering
INCOSE IS 2019: AI and Systems Engineering
 
Hci map
Hci mapHci map
Hci map
 
Introduction to User Centred Design
Introduction to User Centred DesignIntroduction to User Centred Design
Introduction to User Centred Design
 

More from Alan Dix

AI for HCI – could this be a better title if I’d asked ChatGPT
AI for HCI – could this be a better title if I’d asked ChatGPTAI for HCI – could this be a better title if I’d asked ChatGPT
AI for HCI – could this be a better title if I’d asked ChatGPT
Alan Dix
 
Just Counting – a tool ecosystem for personal numeric information
Just Counting – a tool ecosystem for personal numeric informationJust Counting – a tool ecosystem for personal numeric information
Just Counting – a tool ecosystem for personal numeric information
Alan Dix
 
A flexible QR-code infrastructure for heritage
A flexible QR-code infrastructure for heritageA flexible QR-code infrastructure for heritage
A flexible QR-code infrastructure for heritage
Alan Dix
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
AI and the Humanities – provocations  – The Arts, Humanities & Responsible AI...AI and the Humanities – provocations  – The Arts, Humanities & Responsible AI...
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
Alan Dix
 
Can AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI preludeCan AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI prelude
Alan Dix
 
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbersCDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
Alan Dix
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Alan Dix
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Alan Dix
 
Human-Centred Artificial Intelligence – Malta 2024
Human-Centred Artificial Intelligence – Malta 2024Human-Centred Artificial Intelligence – Malta 2024
Human-Centred Artificial Intelligence – Malta 2024
Alan Dix
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
Alan Dix
 
Qualitative–Quantitative reasoning and lightweight numbers
Qualitative–Quantitative reasoning and lightweight numbersQualitative–Quantitative reasoning and lightweight numbers
Qualitative–Quantitative reasoning and lightweight numbers
Alan Dix
 
Invited talk at Diversifying Knowledge Production in HCI
Invited talk at Diversifying Knowledge Production in HCIInvited talk at Diversifying Knowledge Production in HCI
Invited talk at Diversifying Knowledge Production in HCI
Alan Dix
 
Exceptional Experiences for Everyone
Exceptional Experiences for EveryoneExceptional Experiences for Everyone
Exceptional Experiences for Everyone
Alan Dix
 
Inclusivity and AI: opportunity or threat
Inclusivity and AI: opportunity or threatInclusivity and AI: opportunity or threat
Inclusivity and AI: opportunity or threat
Alan Dix
 
Hidden Figures architectural challenges to expose parameters lost in code
Hidden Figures architectural challenges to expose parameters lost in codeHidden Figures architectural challenges to expose parameters lost in code
Hidden Figures architectural challenges to expose parameters lost in code
Alan Dix
 
ChatGPT, Culture and Creativity simulacrum and alterity
ChatGPT, Culture and Creativity simulacrum and alterityChatGPT, Culture and Creativity simulacrum and alterity
ChatGPT, Culture and Creativity simulacrum and alterity
Alan Dix
 
Why pandemics and climate change are hard to understand and make decision mak...
Why pandemics and climate change are hard to understand and make decision mak...Why pandemics and climate change are hard to understand and make decision mak...
Why pandemics and climate change are hard to understand and make decision mak...
Alan Dix
 
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Beyond the Wireframe: tools to design, analyse and prototype physical devicesBeyond the Wireframe: tools to design, analyse and prototype physical devices
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Alan Dix
 
Forever Cyborgs – a long view on physical-digital interaction
Forever Cyborgs – a long view on physical-digital interactionForever Cyborgs – a long view on physical-digital interaction
Forever Cyborgs – a long view on physical-digital interaction
Alan Dix
 

More from Alan Dix (20)

AI for HCI – could this be a better title if I’d asked ChatGPT
AI for HCI – could this be a better title if I’d asked ChatGPTAI for HCI – could this be a better title if I’d asked ChatGPT
AI for HCI – could this be a better title if I’d asked ChatGPT
 
Just Counting – a tool ecosystem for personal numeric information
Just Counting – a tool ecosystem for personal numeric informationJust Counting – a tool ecosystem for personal numeric information
Just Counting – a tool ecosystem for personal numeric information
 
A flexible QR-code infrastructure for heritage
A flexible QR-code infrastructure for heritageA flexible QR-code infrastructure for heritage
A flexible QR-code infrastructure for heritage
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
AI and the Humanities – provocations  – The Arts, Humanities & Responsible AI...AI and the Humanities – provocations  – The Arts, Humanities & Responsible AI...
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
 
Can AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI preludeCan AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI prelude
 
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbersCDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Human-Centred Artificial Intelligence – Malta 2024
Human-Centred Artificial Intelligence – Malta 2024Human-Centred Artificial Intelligence – Malta 2024
Human-Centred Artificial Intelligence – Malta 2024
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 
Qualitative–Quantitative reasoning and lightweight numbers
Qualitative–Quantitative reasoning and lightweight numbersQualitative–Quantitative reasoning and lightweight numbers
Qualitative–Quantitative reasoning and lightweight numbers
 
Invited talk at Diversifying Knowledge Production in HCI
Invited talk at Diversifying Knowledge Production in HCIInvited talk at Diversifying Knowledge Production in HCI
Invited talk at Diversifying Knowledge Production in HCI
 
Exceptional Experiences for Everyone
Exceptional Experiences for EveryoneExceptional Experiences for Everyone
Exceptional Experiences for Everyone
 
Inclusivity and AI: opportunity or threat
Inclusivity and AI: opportunity or threatInclusivity and AI: opportunity or threat
Inclusivity and AI: opportunity or threat
 
Hidden Figures architectural challenges to expose parameters lost in code
Hidden Figures architectural challenges to expose parameters lost in codeHidden Figures architectural challenges to expose parameters lost in code
Hidden Figures architectural challenges to expose parameters lost in code
 
ChatGPT, Culture and Creativity simulacrum and alterity
ChatGPT, Culture and Creativity simulacrum and alterityChatGPT, Culture and Creativity simulacrum and alterity
ChatGPT, Culture and Creativity simulacrum and alterity
 
Why pandemics and climate change are hard to understand and make decision mak...
Why pandemics and climate change are hard to understand and make decision mak...Why pandemics and climate change are hard to understand and make decision mak...
Why pandemics and climate change are hard to understand and make decision mak...
 
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Beyond the Wireframe: tools to design, analyse and prototype physical devicesBeyond the Wireframe: tools to design, analyse and prototype physical devices
Beyond the Wireframe: tools to design, analyse and prototype physical devices
 
Forever Cyborgs – a long view on physical-digital interaction
Forever Cyborgs – a long view on physical-digital interactionForever Cyborgs – a long view on physical-digital interaction
Forever Cyborgs – a long view on physical-digital interaction
 

Recently uploaded

Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
DianaGray10
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Vadym Kazulkin
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
christinelarrosa
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
DanBrown980551
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
LizaNolte
 

Recently uploaded (20)

Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
 

Modelling interactions: digital and physical – Part 1 – lightning tour

  • 1. Modelling interactions: digital and physical Alan Dix https://www.alandix.com/academic/talks/ICTCS-School-2021/   ICTAC 2021
  • 2.  Part I – lightning tour kinds of model gaps and challenges   ICTAC 2021
  • 3. what to model users – cognitive models – task models system – behaviour – architectural structure world – domain models 
  • 4. what to model users – cognitive models – task models system – behaviour – architectural structure world – domain models 
  • 5. types of system model • dialogue – main modes • full state definition specific system
  • 6. example: car clock three buttons: mode – cycles between hours, mins, seconds +/– – increments/decrements selected item we will define state and actions N.B. will not be right first time ... spot the mistakes ... 16:55:00 mode – +
  • 7. clock state state hours: Nat, mins: Nat, secs: Nat – all just numbers selected: { ‘NONE’, ‘HRS’, ‘MINS’, ‘SECS’ } hours < 24 ∧ mins < 60 ∧ secs < 60 initial state hours = 0, mins = 0, secs= 0 selected = ‘NONE’ display hours “:” mins “:” secs (with selected flashing)
  • 8. clock actions … increment (+) if ( selected = ‘NONE’ ) do nothing if ( selected = ‘HRS’ ) if ( hours < 23 ) hours’ = hours+1 if ( hours = 23 ) hours’ = 0 if ( selected = ‘MINS’ ) if ( mins< 59 ) mins’ = mins+1 if ( mins= 59 ) mins’ = 0 ...
  • 9. types of system model • dialogue – main modes • full state definition • abstract interaction model specific system generic issues
  • 10. PIE model – abstract properties predict e.g. predictability:
  • 11. undo
  • 12. more complex undo – the cube
  • 13. PIE model – abstract properties predict e.g. predictability:
  • 14. common domains for formal methods aerospace nuclear other areas? need cheaper/easier techniques safety critical high investment
  • 15.
  • 16. Chapter 3: Trends and Gaps not just keystrokes and mouse-clicks
  • 17. HCI trends: formal challenges changing user interaction – choice and ubiquity, diverse people, diverse devices and contexts, physicality and embodiment, really invisible, experience and values, social and personal use, notification-based interaction, basic HCI changing technology – vast assemblies, big data, autonomy and complexity changing design and development – maker/hacker culture and mass customization, agile and test-driven development
  • 18. formalising interaction: challenges what – actors and entities – people, physical objects, space, information what – levels of abstraction – granularity, continuity and time, level of generality, syntax vs semantics who and when (and why?) – reducing formal expertise, reducing effort, increasing benefit how – types of reasoning, knowledge rich reasoning, flexible levels of detail, multiple notations, generic descriptions and standards
  • 19. today • domains – not nuclear! • physical as well as digital • granularity – not just dialogue • flexible level of detail • method users – no Maths degree
  • 20. exercise choose something physical e.g. book, phone, scissors if digital assume battery dead. model it formally (-ish) … or whatever works! – What it’s like – What you can do with it – How it fits with other things Image Mark Turnauckas: https://www.flickr.com/photos/marktee/5590077419