Formal 5 – Dialogue models – what to do when
•Download as PPTX, PDF•
0 likes•201 views
Slides for the Formal Methods in HCI unit of my 2013 online course on HCI https://hcibook.com/hcicourse/2013/unit/09-formal * what is dialogue? * state transition networks * properties of dialogue * checking properties: completeness and reversability * checking properties: dangerous states * lexical issues and layout
Report
Share
Report
Share
Recommended
Formal 6 – A success story!
Slides for the Formal Methods in HCI unit of my 2013 online course on HCI
https://hcibook.com/hcicourse/2013/unit/09-formal
a practical story of how formal methods improved productivity, agility and reliability
HCI 3e - Ch 16: Dialogue notations and design
Chapter 16: Dialogue notations and design
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Formal 8 – Interaction Models – describing general properties of systems incl...
Slides for the Formal Methods in HCI unit of my 2013 online course on HCI
https://hcibook.com/hcicourse/2013/unit/09-formal
* the PIE model
* properties – WYSIWYG
* proving things – undo
* modelling artistic performance
Validation and mechanism: exploring the limits of evaluation
Talk at Evaluation, SummerPIT 2019, Aarhus University, 15th August 2019
https://alandix.com/academic/talks/PIT-2019-validation-and-mechanism/
Sometimes evaluation is straightforward. Perhaps our goal is to create a system in a well-understood environment that is fastest to use or with least errors. In this case, and if we believe design choices are effectively independent, then we can run a lab or in-situ study to compare design alternatives. However many things do not fit into this easy-to-evaluate category. Sometimes our goals or more diffuse or long term: sustainability, behavioural change, improving education. Sometimes the thing we wish to 'evaluate' is 'generative' such as toolkits or frameworks used by developers or designers to create systems that then are used by others. In these cases simple post-hoc 'try it and measure it' approaches to evaluation fail, or at best give partial results. However post-hoc evaluation is only one way to validate work – data (quantitative or qualitative) should be combined with an understanding of mechanism, how things work, in order to justify, generalise and innovate.
Hci activity#3
This document discusses models of interaction between humans and computers. It describes Norman's model of the execution-evaluation cycle, which outlines 7 stages of interaction: establishing a goal, forming an intention, specifying actions, executing actions, perceiving the system state, interpreting the state, and evaluating it. It also discusses Abowd and Beale's interaction framework, which includes the system, user, input, and output as components and how there are translations between them. Key concepts discussed include the gulfs of execution and evaluation, different interaction styles, and how interface design can help reduce errors.
Chapter 2
The document discusses various topics related to human-computer interaction (HCI), including usability paradigms, object-action interfaces, principles and guidelines. It describes key concepts like usability and its components (learnability, efficiency, etc.). It also covers the history of HCI through different paradigm shifts from time-sharing to ubiquitous computing. Theories, models, principles and guidelines for designing usable interactive systems are explained at different levels from conceptual to practical. The object-action interface model and its application in design is discussed in detail.
More than a Moment.
Talk at UCL Interaction Centre, London, 10th October 2018.
http://alandix.com/academic/talks/UCL-more-than-a-moment-2018/
In understanding and designing effective and engaging interaction, we often focus on the moments of interaction the periods of minutes or hours while keystrokes, mouse clicks or finger movements across the screen elicit changing patterns of pixels and bits on computer memory. Yet these moments of actual interaction are part of a larger matrix of days, weeks and years, where periods of direct interaction string together to create larger patterns. This is the territory where user experience design meets service design, and HCI research meets IS. It is familiar to those working in CSCW where asynchronous interactions and workflows naturally take you beyond the system itself into the apparent interstices, that are, in fact, often the activities that interaction is about. The failures at this timescale are often errors of omission rather than commission, the things tardy, forgotten and undone. This is an area beyond the twenty minute user test; where motivation, opportunity and prompts to action, are more important than consistency, feedback and direct usability; where novelty may lie in the assembly of off-the-shelf applications; and success lies in life beyond the screen.
In my personal work with various colleagues I have myself encountered and studied these long-term interactions over many years including trigger analysis for understanding cross-organisational processes, and extended episodic experience. For this talk I'll illustrate with more recent examples including using spreadsheets as interaction elements with musicologists, island community communication and an onion skin model of social and technology experience developed as part of the analysis of my 1000 mile round Wales walk.
interaction norman model in Human Computer Interaction(HCI)
interaction norman model in Human Computer Interaction(HCI)Daroko blog(www.professionalbloggertricks.com)
This Document by Daroko blog,this describe the human computer interface in use today,to read More about Notes on human computer intrface,kindly go to daroko blog,this is ust a section of those notes,go to daroko blog and read all the Notes,check on the tutorials part on that blog and then choose human computer interafec Recommended
Formal 6 – A success story!
Slides for the Formal Methods in HCI unit of my 2013 online course on HCI
https://hcibook.com/hcicourse/2013/unit/09-formal
a practical story of how formal methods improved productivity, agility and reliability
HCI 3e - Ch 16: Dialogue notations and design
Chapter 16: Dialogue notations and design
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Formal 8 – Interaction Models – describing general properties of systems incl...
Slides for the Formal Methods in HCI unit of my 2013 online course on HCI
https://hcibook.com/hcicourse/2013/unit/09-formal
* the PIE model
* properties – WYSIWYG
* proving things – undo
* modelling artistic performance
Validation and mechanism: exploring the limits of evaluation
Talk at Evaluation, SummerPIT 2019, Aarhus University, 15th August 2019
https://alandix.com/academic/talks/PIT-2019-validation-and-mechanism/
Sometimes evaluation is straightforward. Perhaps our goal is to create a system in a well-understood environment that is fastest to use or with least errors. In this case, and if we believe design choices are effectively independent, then we can run a lab or in-situ study to compare design alternatives. However many things do not fit into this easy-to-evaluate category. Sometimes our goals or more diffuse or long term: sustainability, behavioural change, improving education. Sometimes the thing we wish to 'evaluate' is 'generative' such as toolkits or frameworks used by developers or designers to create systems that then are used by others. In these cases simple post-hoc 'try it and measure it' approaches to evaluation fail, or at best give partial results. However post-hoc evaluation is only one way to validate work – data (quantitative or qualitative) should be combined with an understanding of mechanism, how things work, in order to justify, generalise and innovate.
Hci activity#3
This document discusses models of interaction between humans and computers. It describes Norman's model of the execution-evaluation cycle, which outlines 7 stages of interaction: establishing a goal, forming an intention, specifying actions, executing actions, perceiving the system state, interpreting the state, and evaluating it. It also discusses Abowd and Beale's interaction framework, which includes the system, user, input, and output as components and how there are translations between them. Key concepts discussed include the gulfs of execution and evaluation, different interaction styles, and how interface design can help reduce errors.
Chapter 2
The document discusses various topics related to human-computer interaction (HCI), including usability paradigms, object-action interfaces, principles and guidelines. It describes key concepts like usability and its components (learnability, efficiency, etc.). It also covers the history of HCI through different paradigm shifts from time-sharing to ubiquitous computing. Theories, models, principles and guidelines for designing usable interactive systems are explained at different levels from conceptual to practical. The object-action interface model and its application in design is discussed in detail.
More than a Moment.
Talk at UCL Interaction Centre, London, 10th October 2018.
http://alandix.com/academic/talks/UCL-more-than-a-moment-2018/
In understanding and designing effective and engaging interaction, we often focus on the moments of interaction the periods of minutes or hours while keystrokes, mouse clicks or finger movements across the screen elicit changing patterns of pixels and bits on computer memory. Yet these moments of actual interaction are part of a larger matrix of days, weeks and years, where periods of direct interaction string together to create larger patterns. This is the territory where user experience design meets service design, and HCI research meets IS. It is familiar to those working in CSCW where asynchronous interactions and workflows naturally take you beyond the system itself into the apparent interstices, that are, in fact, often the activities that interaction is about. The failures at this timescale are often errors of omission rather than commission, the things tardy, forgotten and undone. This is an area beyond the twenty minute user test; where motivation, opportunity and prompts to action, are more important than consistency, feedback and direct usability; where novelty may lie in the assembly of off-the-shelf applications; and success lies in life beyond the screen.
In my personal work with various colleagues I have myself encountered and studied these long-term interactions over many years including trigger analysis for understanding cross-organisational processes, and extended episodic experience. For this talk I'll illustrate with more recent examples including using spreadsheets as interaction elements with musicologists, island community communication and an onion skin model of social and technology experience developed as part of the analysis of my 1000 mile round Wales walk.
interaction norman model in Human Computer Interaction(HCI)
interaction norman model in Human Computer Interaction(HCI)Daroko blog(www.professionalbloggertricks.com)
This Document by Daroko blog,this describe the human computer interface in use today,to read More about Notes on human computer intrface,kindly go to daroko blog,this is ust a section of those notes,go to daroko blog and read all the Notes,check on the tutorials part on that blog and then choose human computer interafec E3 chap-05
The document discusses various concepts in interaction design including goals, constraints, understanding users, scenarios, prototypes, navigation, and iteration. It emphasizes the importance of understanding users and involving them in the design process through techniques like personas, cultural probes, and scenarios to design interactions that meet user needs and address human factors.
HCI
This document summarizes several key concepts in human-computer interaction (HCI), including:
1) Shneiderman's eight golden rules of interface design.
2) Norman's seven principles of design and his interaction theory, which views the HCI cycle as having execution and evaluation components.
3) Ten usability heuristics for interface design by Jakob Nielsen.
4) Contextual inquiry, which involves observing users in their normal activities and discussing tasks with them.
HCI 3e - Ch 5: Interaction design basics
The document discusses various topics related to interaction design basics including goals and constraints of design, understanding users through personas and scenarios, prototyping and iteration, navigation design, screen design principles, and more. It emphasizes the importance of an user-centered design approach and provides examples and guidelines to help design intuitive interactions.
Sources of Bias and Explanation
Talk at Understandable AI, SummerPIT 2019, Aarhus University, 14th August 2019
https://alandix.com/academic/talks/PIT-2019-bias-and-explanation/
In this talk I will pick up threads of research dating back to early work in the 1990s on gender and ethnic bias in black-box machine-learning systems, as well as more recent developments such as deep learning and concerns such as those that gave rise to the EPSRC human–like computing programme. In particular I will present nascent work on an AIX Toolkit (AI explainability): a structured collection of techniques designed to help developers of intelligent systems create more comprehensible representations of the reasoning. Crucial to the AIX Toolkit is the understanding that human–human explanations are rarely utterly precise or reproducible, but they are sufficient to inspire confidence and trust in a collaborative endeavour.
HCI 3e - Ch 4 (extra):
additional slides for Chapter 4: Paradigms
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
HCI 3e - Ch 3: The interaction
Chapter 3: The interaction
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Modelling interactions: digital and physical – Part 1 – lightning tour
Lecture at ICTAC School 2021: 18th International Colloquium on Theoretical Aspects of Computing, Nazarbayev University, Nur-Sultan, Kazakhstan, 1st September 2021.
https://www.alandix.com/academic/talks/ICTCS-School-2021/
The first part of this lecture gives a lightning introduction to the use of formal methods in human–computer interaction. This will include an overview of the kinds of models, and typical domains where technqiues are currently applied. It will then outline some of the potential future directions for the field based on the “Trends and Gaps” chaper of “The Handbook of Formal Methods in Human-Computer Interaction”.
HCI 3e - Ch 8: Implementation support
Chapter 8: Implementation support
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Human computer interaction 3 4(revised)
human computer interaction Human-Computer Interaction is a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them” -ACM/IEEE
Nota sendiri hci-HCI
- Principles provide general guidance on usability but have low authority. They promote learnability through predictability, familiarity and consistency. Flexibility is supported by dialogue initiative and multithreading. Robustness comes from observability, recoverability and responsiveness.
- Standards and guidelines specify more concrete design rules with higher authority but limited applications. They constrain design in systematic ways to promote usability.
- Design patterns capture proven solutions to common design problems and allow experience to be reused, improving efficiency and quality of new designs. They supplement principles, standards and guidelines.
Interaction styles
Slides from the Introduction and Theoretical Foundations of New Media course of the Interactive Media and Knowledge Environments master program (Tallinn University).
HCI - Chapter 6
The document discusses human-computer interaction in the software engineering process. It describes the typical lifecycle of software development, including requirements specification, design, implementation, testing, and maintenance. For interactive systems, a linear waterfall model is not suitable due to the need for extensive user testing and feedback. Usability engineering aims to make usability measurable by specifying requirements. Iterative design and prototyping help overcome incomplete requirements through simulations and prototypes to gather user feedback. Design rationale records the reasons for design decisions to aid communication, reuse of knowledge, and evaluation of tradeoffs.
HCI 3e - Ch 10: Universal design
The document discusses principles of universal design and multi-sensory interaction. It covers using multiple senses like sight, sound, and touch to provide richer interaction. Speech and non-speech sounds are explored as input and output methods. Handwriting recognition and gestures are also covered as alternative interaction techniques. The document examines applications and challenges of different technologies for users with varying abilities.
Wimp interface
History of WIMP Interface and its components as well as its advantage and dis advantage in a short and precised way.
Principles Of Good Screen Design
The document discusses several key factors in visual interface design including screen organization, language used, distinctiveness of components, and aesthetics. Common problems are discussed such as visual inconsistency, overuse of design elements, and poor typography. The document also outlines what users want from interfaces including orderliness, obvious indications of elements, expected locations of information, plain language, and clear indications of actions. Design goals are outlined as reducing visual, intellectual, memory, and motor work. Tests for good design focus on ability to identify elements without text labels. Principles of organizing screen elements, consistency, ordering, navigation, flow, balance, symmetry, regularity, predictability, sequentiality, economy, unity, groupings, simplicity,
golden rules of user interface design
The document discusses user interface design and provides three golden rules:
1) Place the user in control by allowing flexible, interruptible, and customizable interaction.
2) Reduce the user's memory load by providing defaults, intuitive shortcuts, progressive disclosure of information, and visual cues of past actions.
3) Make the interface consistent by using standardized visual organization, a limited set of input mechanisms, and indicators to help users understand context across tasks and applications.
Chapter1(hci)
This document outlines the syllabus for a course on Human Computer Interaction taught by Dr. Latesh Malik. The course objectives are to introduce students to concepts of HCI and how to design and evaluate interactive technologies. The syllabus covers topics like principles of interface design, the design process, screen design, interface components, and tools. The course aims to help students understand considerations for interface design and methods in HCI to design effective user interfaces.
Human computer interaction
This document provides an overview of human-computer interaction (HCI). It begins with early computing in 1945, which involved large specialized machines. As computers developed, they became smaller, cheaper, and more widely used. HCI emerged as a field to study the interaction between humans and computers. Key aspects of HCI include understanding human abilities and limitations as well as the computer system components that enable interaction such as input devices, output displays, and memory. The document explores various interaction paradigms that have developed over time including command lines, menus, natural language interfaces, and graphical user interfaces. It provides examples of how interaction involves both the human and computer systems working together.
Hci activity#1
The document provides an introduction to human-computer interaction (HCI). It defines HCI as the study of the interaction between humans and computers, including the design and evaluation of interactive systems. The document discusses why HCI is important, focusing on creating usable, intuitive systems. It also outlines some of the historical roots of HCI in fields like computer graphics, operating systems, and cognitive psychology. Finally, it discusses potential future developments in HCI, such as ubiquitous computing, mixed media interfaces, and more natural human-computer interaction.
E3 chap-16
The document discusses various notations for describing dialogue structures in user interfaces, including:
- Diagrammatic notations like state transition networks, JSD diagrams, and flow charts that represent dialogues graphically using states, transitions, and other visual elements.
- Textual notations like formal grammars, production rules, and process algebras that specify dialogues using formal languages and rules.
- Issues in dialogue notations include whether they are based on events or states, their expressiveness versus clarity, how well the notation matches the computational model, and representing sequential versus concurrent dialogues. Formal notations can help analyze, design, and test dialogue structures.
HCI - Chapter 3
The document discusses models of interaction between users and computer systems. It describes Norman's seven-stage model of interaction which focuses on the user's perspective when interacting with an interface. It also discusses Abowd and Beale's framework which identifies the major components involved in interaction, including user input and system output. Different styles of interaction are examined, such as command line interfaces, menus, and WIMP interfaces.
More Related Content
What's hot
E3 chap-05
The document discusses various concepts in interaction design including goals, constraints, understanding users, scenarios, prototypes, navigation, and iteration. It emphasizes the importance of understanding users and involving them in the design process through techniques like personas, cultural probes, and scenarios to design interactions that meet user needs and address human factors.
HCI
This document summarizes several key concepts in human-computer interaction (HCI), including:
1) Shneiderman's eight golden rules of interface design.
2) Norman's seven principles of design and his interaction theory, which views the HCI cycle as having execution and evaluation components.
3) Ten usability heuristics for interface design by Jakob Nielsen.
4) Contextual inquiry, which involves observing users in their normal activities and discussing tasks with them.
HCI 3e - Ch 5: Interaction design basics
The document discusses various topics related to interaction design basics including goals and constraints of design, understanding users through personas and scenarios, prototyping and iteration, navigation design, screen design principles, and more. It emphasizes the importance of an user-centered design approach and provides examples and guidelines to help design intuitive interactions.
Sources of Bias and Explanation
Talk at Understandable AI, SummerPIT 2019, Aarhus University, 14th August 2019
https://alandix.com/academic/talks/PIT-2019-bias-and-explanation/
In this talk I will pick up threads of research dating back to early work in the 1990s on gender and ethnic bias in black-box machine-learning systems, as well as more recent developments such as deep learning and concerns such as those that gave rise to the EPSRC human–like computing programme. In particular I will present nascent work on an AIX Toolkit (AI explainability): a structured collection of techniques designed to help developers of intelligent systems create more comprehensible representations of the reasoning. Crucial to the AIX Toolkit is the understanding that human–human explanations are rarely utterly precise or reproducible, but they are sufficient to inspire confidence and trust in a collaborative endeavour.
HCI 3e - Ch 4 (extra):
additional slides for Chapter 4: Paradigms
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
HCI 3e - Ch 3: The interaction
Chapter 3: The interaction
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Modelling interactions: digital and physical – Part 1 – lightning tour
Lecture at ICTAC School 2021: 18th International Colloquium on Theoretical Aspects of Computing, Nazarbayev University, Nur-Sultan, Kazakhstan, 1st September 2021.
https://www.alandix.com/academic/talks/ICTCS-School-2021/
The first part of this lecture gives a lightning introduction to the use of formal methods in human–computer interaction. This will include an overview of the kinds of models, and typical domains where technqiues are currently applied. It will then outline some of the potential future directions for the field based on the “Trends and Gaps” chaper of “The Handbook of Formal Methods in Human-Computer Interaction”.
HCI 3e - Ch 8: Implementation support
Chapter 8: Implementation support
from
Dix, Finlay, Abowd and Beale (2004).
Human-Computer Interaction, third edition.
Prentice Hall. ISBN 0-13-239864-8.
http://www.hcibook.com/e3/
Human computer interaction 3 4(revised)
human computer interaction Human-Computer Interaction is a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them” -ACM/IEEE
Nota sendiri hci-HCI
- Principles provide general guidance on usability but have low authority. They promote learnability through predictability, familiarity and consistency. Flexibility is supported by dialogue initiative and multithreading. Robustness comes from observability, recoverability and responsiveness.
- Standards and guidelines specify more concrete design rules with higher authority but limited applications. They constrain design in systematic ways to promote usability.
- Design patterns capture proven solutions to common design problems and allow experience to be reused, improving efficiency and quality of new designs. They supplement principles, standards and guidelines.
Interaction styles
Slides from the Introduction and Theoretical Foundations of New Media course of the Interactive Media and Knowledge Environments master program (Tallinn University).
HCI - Chapter 6
The document discusses human-computer interaction in the software engineering process. It describes the typical lifecycle of software development, including requirements specification, design, implementation, testing, and maintenance. For interactive systems, a linear waterfall model is not suitable due to the need for extensive user testing and feedback. Usability engineering aims to make usability measurable by specifying requirements. Iterative design and prototyping help overcome incomplete requirements through simulations and prototypes to gather user feedback. Design rationale records the reasons for design decisions to aid communication, reuse of knowledge, and evaluation of tradeoffs.
HCI 3e - Ch 10: Universal design
The document discusses principles of universal design and multi-sensory interaction. It covers using multiple senses like sight, sound, and touch to provide richer interaction. Speech and non-speech sounds are explored as input and output methods. Handwriting recognition and gestures are also covered as alternative interaction techniques. The document examines applications and challenges of different technologies for users with varying abilities.
Wimp interface
History of WIMP Interface and its components as well as its advantage and dis advantage in a short and precised way.
Principles Of Good Screen Design
The document discusses several key factors in visual interface design including screen organization, language used, distinctiveness of components, and aesthetics. Common problems are discussed such as visual inconsistency, overuse of design elements, and poor typography. The document also outlines what users want from interfaces including orderliness, obvious indications of elements, expected locations of information, plain language, and clear indications of actions. Design goals are outlined as reducing visual, intellectual, memory, and motor work. Tests for good design focus on ability to identify elements without text labels. Principles of organizing screen elements, consistency, ordering, navigation, flow, balance, symmetry, regularity, predictability, sequentiality, economy, unity, groupings, simplicity,
golden rules of user interface design
The document discusses user interface design and provides three golden rules:
1) Place the user in control by allowing flexible, interruptible, and customizable interaction.
2) Reduce the user's memory load by providing defaults, intuitive shortcuts, progressive disclosure of information, and visual cues of past actions.
3) Make the interface consistent by using standardized visual organization, a limited set of input mechanisms, and indicators to help users understand context across tasks and applications.
Chapter1(hci)
This document outlines the syllabus for a course on Human Computer Interaction taught by Dr. Latesh Malik. The course objectives are to introduce students to concepts of HCI and how to design and evaluate interactive technologies. The syllabus covers topics like principles of interface design, the design process, screen design, interface components, and tools. The course aims to help students understand considerations for interface design and methods in HCI to design effective user interfaces.
Human computer interaction
This document provides an overview of human-computer interaction (HCI). It begins with early computing in 1945, which involved large specialized machines. As computers developed, they became smaller, cheaper, and more widely used. HCI emerged as a field to study the interaction between humans and computers. Key aspects of HCI include understanding human abilities and limitations as well as the computer system components that enable interaction such as input devices, output displays, and memory. The document explores various interaction paradigms that have developed over time including command lines, menus, natural language interfaces, and graphical user interfaces. It provides examples of how interaction involves both the human and computer systems working together.
Hci activity#1
The document provides an introduction to human-computer interaction (HCI). It defines HCI as the study of the interaction between humans and computers, including the design and evaluation of interactive systems. The document discusses why HCI is important, focusing on creating usable, intuitive systems. It also outlines some of the historical roots of HCI in fields like computer graphics, operating systems, and cognitive psychology. Finally, it discusses potential future developments in HCI, such as ubiquitous computing, mixed media interfaces, and more natural human-computer interaction.
What's hot (20)
Modelling interactions: digital and physical – Part 1 – lightning tour
Modelling interactions: digital and physical – Part 1 – lightning tour
Similar to Formal 5 – Dialogue models – what to do when
E3 chap-16
The document discusses various notations for describing dialogue structures in user interfaces, including:
- Diagrammatic notations like state transition networks, JSD diagrams, and flow charts that represent dialogues graphically using states, transitions, and other visual elements.
- Textual notations like formal grammars, production rules, and process algebras that specify dialogues using formal languages and rules.
- Issues in dialogue notations include whether they are based on events or states, their expressiveness versus clarity, how well the notation matches the computational model, and representing sequential versus concurrent dialogues. Formal notations can help analyze, design, and test dialogue structures.
HCI - Chapter 3
The document discusses models of interaction between users and computer systems. It describes Norman's seven-stage model of interaction which focuses on the user's perspective when interacting with an interface. It also discusses Abowd and Beale's framework which identifies the major components involved in interaction, including user input and system output. Different styles of interaction are examined, such as command line interfaces, menus, and WIMP interfaces.
e3-chap-03 (1).ppt
The document discusses various models and concepts related to human-computer interaction and interfaces. It describes Norman's 7-stage model of interaction that focuses on the user's perspective. It also discusses Abowd and Beale's interaction framework that identifies the major components involved in interaction, including the user, input, system and output. Finally, it discusses the importance of designing interfaces to provide value to users that exceeds any costs of using the system in order to encourage engagement and use.
lecture-3-1523011494 Lecture #3).pptx
This document discusses human-computer interaction and interaction models. It begins by outlining the learning objectives, which are to understand basics of interaction, differentiate between interaction models and styles, and understand the impact of interaction in social and organizational contexts. It then defines interaction and discusses several interaction models and styles, including command line interfaces, menus, natural language, forms, spreadsheets, and WIMP (windows, icons, menus, pointers) interfaces. It also covers physical aspects of interfaces like ergonomics and different interaction contexts.
e3-chap-03.power point presentaion on interst rate
Interaction involves the communication between a user and a system. There are various models and frameworks for understanding interaction, including Norman's seven stage model of goal establishment, intention formation, action specification, execution, perception, interpretation, and evaluation. Abowd and Beale's framework separates interaction into the user, input, system, and output languages. Interfaces use various interaction styles such as command lines, menus, forms, and graphical user interfaces (GUIs) involving windows, icons, menus, and pointers (WIMP). The experience and engagement of users is important to consider in interaction design.
e3-chap-03.ppt
Interaction involves the communication between a user and a system. There are various models and frameworks for understanding interaction, including Norman's seven stage model of goal establishment, intention formation, action specification, execution, perception, interpretation, and evaluation. Abowd and Beale's framework extends Norman's model by including the user, input, system, and output components, with interaction involving translation between each component's unique language. Proper interaction design considers the physical ergonomics as well as interaction styles such as menus, forms, and natural language interfaces. The context of use also impacts interaction, including social and organizational factors.
ch3-interaction.pdf
This document discusses various aspects of human-computer interaction including interaction models, styles, and context. It describes Norman's 7-stage model of interaction that focuses on the user's perspective. It also discusses Abowd and Beale's interaction framework that identifies the major components involved in interaction including the user, input, system, and output. Finally, it examines elements of the WIMP interface such as windows, icons, menus, pointers, buttons, and toolbars.
ch3-interaction.pdf
This document discusses interaction models and styles. It defines interaction as communication between a user and system, but notes there is more to it than just language. Several models of interaction are presented, including Norman's 7-stage model and Abowd and Beale's 4-part framework. Different interaction styles like command lines, menus, natural language interfaces are also described. The document emphasizes that interaction design must consider both the look and feel of an interface by addressing both appearance and behavior. Context, experience, engagement and perceptions of value are important factors that influence interaction.
E3 chap-03
The document discusses models of interaction between users and computer systems. It describes Norman's seven-stage model of interaction that focuses on the user's perspective. It also discusses Abowd and Beale's interaction framework that identifies the major components involved in interaction, including the user, input, system core, and output. Context is an important factor that can affect interaction.
Unit ii design process
This document discusses human-computer interaction and design principles. It covers several key topics:
1) The design process involves understanding users, constraints, and iterative prototyping. Successful design puts the user first.
2) Design principles include understanding human and computer limitations, reducing human error, and designing based on user tasks and mental models.
3) Effective navigation design considers both local screen structure and global site structure, and ensures users know where they are, what they can do, and where they are going.
E3 chap-03
The document discusses various models of interaction including Norman's 7 stage model of interaction and Abowd and Beale's framework. It also covers different interaction styles like command line interfaces, menus, natural language interfaces. Finally, it discusses elements of the WIMP interface like windows, icons, menus and pointers and how to design the user experience and engagement.
Interaction.pptx
The document discusses different aspects of human-computer interaction including interaction models, ergonomics, interaction styles, and context. It provides definitions and examples of various interaction models including Norman's seven stage model, Abowd and Beale's four part framework, and different interaction styles like command line interfaces, menus, natural language, and WIMP interfaces. It also covers topics like ergonomics, error handling, initiative in interaction, and how social context can impact interaction.
E3 Chap 05 Interaction Design Basics
The document discusses various concepts in interaction design including goals, constraints, understanding users, scenarios, prototypes, navigation, and hierarchies. It provides examples of personas, cultural probes, scenarios, and diagrams to illustrate interaction design principles and help designers understand users. The central message is that interaction design is about more than just interfaces - designers must focus on the user.
Psychology
The document discusses several key concepts for designing everyday things:
1. Perceived affordances refer to the perceived properties of an object that suggest how it can be used. Problems occur when a user's perceptions do not match the designer's intentions.
2. Visible constraints provide cues about the range of possible actions. More constraints reduce opportunities for errors.
3. Mapping involves the relationship between controls and their effects. Natural mappings improve usability.
4. Causality and feedback are important for users to understand cause-and-effect. Subtle or delayed effects can cause confusion.
5. Transfer effects occur when users apply knowledge from similar prior experiences, which can help or hinder depending on similarities.
ch3-interaction.ppt
This document discusses models of human-computer interaction and interaction design. It contains the following key points:
1) It describes Norman's model of interaction which outlines 7 stages: establishing a goal, forming an intention, specifying actions, executing actions, perceiving the system state, interpreting the state, and evaluating it.
2) It discusses Abowd and Beale's interaction framework which extends Norman's model by separating the user, input, system, and output and defining translation between their languages.
3) Interaction design aims to balance usability and user experience by considering physical ergonomics, engagement, motivation and fun. Designing for value is important to encourage use of a system.
Morphees: toward high "shape resolution" in self-actuated flexible mobile dev...
Morphees: toward high "shape resolution" in self-actuated flexible mobile dev...University of Sussex
Publication:
Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: toward high "shape resolution" in self-actuated flexible mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 593-602. DOI: http://dx.doi.org/10.1145/2470654.2470738
We introduce the term shape resolution, which adds to the existing definitions of screen and touch resolution. We propose a framework, based on a geometric model (Non-Uniform Rational B-splines), which defines a metric for shape resolution in ten features. We illustrate it by comparing the current related work of shape changing devices. We then propose the concept of Morphees that are self-actuated flexible mobile devices adapting their shapes on their own to the context of use in order to offer better affordances. For instance, when a game is launched, the mobile device morphs into a console-like shape by curling two opposite edges to be better grasped with two hands. We then create preliminary prototypes of Morphees in order to explore six different building strategies using advanced shape changing materials (dielectric electro active polymers and shape memory alloys). By comparing the shape resolution of our prototypes, we generate insights to help designers toward creating high shape resolution Morphees.Tour of language landscape (code.talks)
The document provides an agenda for a tour guide on various F# programming language concepts including type providers, statically resolved type providers, implicit interface implementation, borrowed pointers, dependent types, uniqueness types, bit syntax, signals, macros, unit-of-measure, and the actor model. It also includes disclaimers on the influence of programming languages and how our first language shapes our thinking as well as quotes on programming language design.
Tour of language landscape (BuildStuff)
There seems to be a new programming language every week, and for us busy developers we just don't have the time to keep up with them. But have you wondered what we might have missed out on whilst we're busy working in our language of choice?
Having spent time with numerous programming languages the past few years Yan have learnt something new from each.
In this talk, Yan will take us on a whirlwind tour of the interesting concepts and ideas he have encountered, from F#'s type providers, Rust's borrowed pointers, to Elm's signals and Idris's dependent types to name a few.
Tour of language landscape (katsconf)
A whirlwind tour of programming languages across several paradigms, both static and dynamic - Go, Rust, F#, Erlang, Idris, Elm and Clojure.
Yikes...It Looks Like That?! - UI Worst Practices
The document provides examples of poor user interface design practices in applications. It discusses user interfaces that make data entry difficult by not properly handling formatting, provide unclear error messages that do not explain the problem or suggest solutions, use interface elements like radio buttons incorrectly, reuse components without ensuring they fit the context, use excessive and clashing colors, include too many tabs, show non-functional interface elements, are not designed for printing, integrate disparate programs in incoherent ways, and do not provide clear instructions for "magic" functions. The document emphasizes that applications must prioritize good user experience and learn from past mistakes.
Similar to Formal 5 – Dialogue models – what to do when (20)
e3-chap-03.power point presentaion on interst rate
e3-chap-03.power point presentaion on interst rate
Morphees: toward high "shape resolution" in self-actuated flexible mobile dev...
Morphees: toward high "shape resolution" in self-actuated flexible mobile dev...
More from Alan Dix
AI for HCI – could this be a better title if I’d asked ChatGPT
Seminar in Pisa, Italy, 11th June 2024
https://www.alandix.com/academic/talks/Pisa-AI4HCI-2024/
AI has entered into all aspects of life. Sometimes this is hidden, below the surface of the devices and applications we use; sometimes much more explicit in interactions with devices and user interfaces. In this talk I'll explore some of the ways in which AI can be used to enhance existing interactions and also how we can effectively design user interfaces for A-rich systems. In addition I can be used by UX designers and AI developers need better ways to interact with their tools and systems. Perhaps more fundamental is not the direct effects of AI, but the ways in which it is fundamentally changing the society and world in which we live.
Just Counting – a tool ecosystem for personal numeric information
, , ,,,,
Paper presented at 17th International Conference on Advanced Visual Interfaces (AVI 2024), Arenzano (Genoa), Italy. June 3rd -7th 2024
https://alandix.com/academic/papers/AVI2024-justcounting/
Numbers are part of day-to-day life from household budgeting to making sense of global warming and planning academic projects. But, for many, dealing with numeric information is daunting with multiple step changes in complexity moving from, say simple calculations to spreadsheet use, as well as difficulties managing different sources of complex information. In this paper we present an ecosystem of interconnected prototype tools that explore this space, including TSoW interpreting unfamiliar orders of magnitude; calQ a four-function calculator that shifts seamlessly to micro-spreadsheet; WS2 embedding spreadsheet-like features in web pages; and myData collating and connecting the diverse data sources. Collectively, these tools offer an envisionment to prompt discussion both of the way end-users can more easily deal with numeric information and of the background technical infrastructure necessary for this to happen.
A flexible QR-code infrastructure for heritage
Paper presented at AVICH 2024: Workshop on Advanced Visual Interfaces and Interactions in Cultural Heritage. AVI 2024 at Arenzano (Genoa), Italy, 4th June 2024
https://alandix.com/academic/papers/AVI2CH2024-qrarch/
QR codes are often used in outdoor cultural heritage settings. They are an established technology but inflexible, especially if the websites to which they point change their structure, or even disappear. This paper describes a web infrastructure for deploying QR codes that can be remapped dynamically, both as web resources move or change, but also to allow personalized and adaptable content. This is a small change in the underlying technology, but radically change potential applications. It can be used to personalise content to viewer’s preferences such as language choices, but could be used to support bespoke events or applications such as school visits or treasure hunts. The infrastructure has been deployed at the Memorial Gardens in the lost village of Troedrhiwfuwch, to enable the stories of fallen WWI and II service men to be retold for the current generation
Epistemic Interaction - tuning interfaces to provide information for AI support
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
Keynote at The Arts, Humanities & Responsible AI Symposium Aberystwyth University, Wales, 29th June 2024
https://www.alandix.com/academic/talks/AHRAI-2024/
The talk takes an excursion through several frameworks or ways of looking at the way artificial intelligence impacts:
* humanities and social science research
* social justice
* fundamental changes in society
Can AI do good? at 'offtheCanvas' India HCI prelude
Invited talk at 'offtheCanvas' IndiaHCI prelude, 29th June 2024.
https://www.alandix.com/academic/talks/offtheCanvas-IndiaHCI2024/
The world is being changed fundamentally by AI and we are constantly faced with newspaper headlines about its harmful effects. However, there is also the potential to both ameliorate theses harms and use the new abilities of AI to transform society for the good. Can you make the difference?
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
Talk at EPIC CDT Away Day, St Davids Hotel, Cardiff, 11th April 2024.
https://alandix.com/academic/talks/CDT-away-day-April-2024-QQ/
As academics we need to deal with numbers including project management spreadsheets and student marks. In addition, they are part of day-to-day life whether household budgeting or working out how many socks to pack for a journey. Perhaps most crucially, many national and global issues require an understanding of numeric information from climate change to tax rates, and of course the Covid-19 pandemic. If citizens are not able to make sense of this, democracy fails. Of course, many are not only uncertain when dealing with numbers, but suffer more or less extreme maths anxiety. Indeed a recent UK survey found that, “over a third of adults (35%) say that doing maths makes them feel anxious, while one in five are so fearful it even makes them feel physically sick”. Sometimes detailed calculations are necessary, but often the critical skill is qualitative–quantitative reasoning, that is a qualitative understanding of quantitative phenomena. This can after be aided by the ability to use back-of-the-envelope calculations and dealing with lightweight numeric information. This talk discusses these issues and presents some prototype tools to explore the design space for personal numeric information.
This talk is largely the same as the one of the same name given at Ulster University in February. However, the slides have been updated to correct web material misattributed to BBC which was actually Guardian. An eagle-eyed member of the audience spotted that the font in the screenshot was one found in the Guardian online web and not the BBC.
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Talk at the Computational Foundry, Swansea University, 24th April 2024.
https://alandix.com/academic/talks/Swansea-song-April-2024/
This talk was my last formal act as Director of the Computational Foundry, before retiring from Swansea University at the end of April 2024. It was the last part in a research afternoon of the School of Mathematics and Computer Science, during which there were talks by other members of the school including a wonderful potted history of Maths and CS in the University and the Computational Foundry by John Tucker and Matt Jones.
This talk is a summary (partial) of more personal research through my time at Swansea, some in collaboration with others across the university, some with those external to Swansea, and some more individual. The talk used a number of web-based prototypes and systems that I've developed, many as weekend projects, to look at areas including AI, digital humanities and heritage, qualitative-quantitative reasoning, statistics and maths education, physical prototyping and UX tools. The talk included work inspired by teaching, consultancy and other real-world problems, but almost always also including a strong theoretical dimension. This reflects my personal background, as the son of a carpenter, but where mathematics was my academic 'first love' -- always seeking out ways in which practical making and fundamental knowledge interact. A theme that runs through many of the examples is the way in which many if the things that were completed while at Swansea had roots before, and also things I started here will continue on the future. And now I look forward to the coming years; although my employment at Swansea has ended, I will continue to collaborate with many in the University, both those I have met since being in Swansea and those I know before.
From Family Reminiscence to Scholarly Archive .
, digital economy, human-computer interaction, design thinking, computational thinking
Keynote at Transforming Heritage Research in a Transforming World, the
International Hellenic University, Serres, Greece, 16-17 April 2024.
https://alandix.com/academic/talks/CAA-GR-2024/
Human-Centred Artificial Intelligence – Malta 2024
Rarely a day goes by without an AI story in the news. Sometimes, there is good news, such as the use of AI to discover a new pharmaceutical, but often more dark, about AI bias or the way it may rob us of jobs, privacy or autonomy. The human impact of AI is of two kinds. First, what AI does directly - systems that we use and can design better or worse. Second, how AI shapes society, the way AI can create mismatches of power between large corporations and nation states, and between organisations and individuals. Recent advances in large-langage models in particular may mean that AI is only in the hands of those who can afford massive computational power and technical expertise. However, there are signs of hope, in particular the way that generative AI might enable niches applications that would otherwise be impossible. In education this may allow personalised tuition, bit also changes what needs to be learnt ... not necessarily digital; the ability of LLMs to generalise may offer ways for minority languages to survive; and in health there is the possibility of personalised medicine, and affordable ways to help well-being and mental health.
The future of UX design support tools - talk Paris March 2024
talk to ACM SIGCHI Paris Chapter at Université Paris-Saclay, 19th March 2024.
https://alandix.com/academic/talks/Paris-UX-2024/
From the 1980s graphical interfaces have dominated the way we envisage user interactions. While we know and teach our students about the importance of taking a wider perspective, the vast majority of tools used in practical UX (user experience) design are dominated by screens. In this talk I will explore ways in which future design can step beyond the pixelated surface.
One strand is understanding the physical nature of devices, human bodies, and the environments within which they engage; this is addressed in my 2022 book “TouchIT – Understanding Design in a Physical-Digital World” co-authored with Steve Gill, Jo Hare, and Devina Ramduny-Ellis.
The other strand is work over the last few years with Miriam Sturdee and Anna Carter, collectively entitled InContext, in which we have been exploring next generation UX tools, including investigative workshops and focus groups. While not a major issue, AI was mentioned in these workshops, but they were before the recent rise in awareness fostered by ChatGPT. I will contextualise this building on two other books that I am completing relating to AI and Human–Computer Interaction.
I will demonstrate two tools that explore the space of design beyond the screen. One, ScenarioViewer enables screen-based prototypes, at various levels of fidelity, to be embedded within story-board-like contextual images. The other, PhysProto, allows physical prototypes to be interactively explored remotely using video clips and Physigrams, executable models of the physical behaviour of the device. These are prototypes of prototyping tools, but also provotypes, designed to provoke you to consider for yourself the future of UX design support tools.
Qualitative–Quantitative reasoning and lightweight numbers
Seminar at University of Ulster, 21st February 2024.
https://alandix.com/academic/talks/Ulster-2024-QQ/
As academics we need to deal with numbers including project management spreadsheets and student marks. In addition, they are part of day-to-day life whether household budgeting or working out how many socks to pack for a journey. Perhaps most crucially, many national and global issues require an understanding of numeric information from climate change to tax rates, and of course the Covid-19 pandemic. If citizens are not able to make sense of this, democracy fails.
Of course, many are not only uncertain when dealing with numbers, but suffer more or less extreme maths anxiety. Indeed a recent UK survey found that, “over a third of adults (35%) say that doing maths makes them feel anxious, while one in five are so fearful it even makes them feel physically sick”.
Sometimes detailed calculations are necessary, but often the critical skill is qualitative–quantitative reasoning, that is a qualitative understanding of quantitative phenomena. This can after be aided by the ability to use back-of-the-envelope calculations and dealing with lightweight numeric information.
This talk discusses these issues and presents some prototype tools to explore the design space for personal numeric information.
Invited talk at Diversifying Knowledge Production in HCI
Invited talk at workshop on Diversifying Knowledge Production in HCI: Exploring Materiality and Novel Formats for Scholarly Expression.
TEI'24, Cork, 11th Feb 2024
https://alandix.com/academic/talks/TEI-workshop-2024/
Exceptional Experiences for Everyone
Invited talk at AMID 2023 – 1st International Workshop on Accessibility and Multimodal Interaction Design Approaches in Museums for People with Impairments, in conjunction with MoileHCI Conference, 26 Sept. 2023.
https://alandix.com/academic/talks/AMID2023-exceptional/
Often accessibility is an afterthought or sticking plaster to fix the holes in an experience that was designed with a central audience in mind: maybe middle-aged, fully abled, well educated. Ideally we would have user experiences designed specifically for different kinds of modalities and in different tyles, not just because of the wide diversity of users, but also because any one user has varying needs and varying abilities at different times. In the context of a large museum or cultural institution this is already challenging, but appears impossible for smaller archives, or local community heritage. Yet if heritage and history is to be accessible this also applies to production, democratising digitisation and empowering marginalised groups.. We need appropriate architectures, tools, technology infrastructure and platforms, that make this not just possible, but simple. In this talk I offer some insights, some examples and many research challenges towards the goal of enabling exceptional experiences for everyone.
Inclusivity and AI: opportunity or threat
Keynote at 9th International Conference on Computing and Informatics (ICOCI 2023), "Nurturing an inclusive digital society for a sustainable nation", 13-14 September 2023, Kuala Lumpur, Malaysia
https://alandix.com/academic/talks/ICOCI2023-keynote/
AI is transforming many sectors of the economy and our day-today lives. We hear of success stories including medical advances, but also worries that AI will destroy jobs or even be an existential threat to humanity. We also know that for previous waves of technology – mechanical, electronic and digital – the costs and benefits do not fall equally to everyone in society. There are clear dangers that AI will further entrench existing power and deepen the digital divide: both at an individual level and globally. For example, training foundation models, such as GPT-4, requires enormous computational power and massive data sets accessible only to the largest corporations. However, the ways in which these can be used generatively in more niche areas, offers potential for minority languages and individualised learning that was previously only accessible to the rich. Whether the threats of AI or its opportunities dominate is not simply an abstract question, but one that impacts the most disadvantaged around us, and one that, as researchers and practitioners in digital technology, we can affect. If we truly want an inclusive digital society, then we need to make it happen.
Hidden Figures architectural challenges to expose parameters lost in code
Position paper presented at Engineering Interactive Systems Embedding AI Technologies at EICS 2023, Swansea, Wales, UK. 27 June. 2023.
https://alandix.com/academic/papers/EISEAIT2023-hidden/
Many critical user interaction design decisions are made in the heat of detailed development. These include simple parameter choices or more complex weightings in intelligent algorithms. Many would be appropriate for expert design review, user-preference choices or optimisation by machine learning, but they are buried deep in the code. Although the developer may realise this potential, the location of the decision is far removed in the code from where user feedback occurs, data can be collected and machine learning could be applied. This position paper describes several case studies and use them to frame an architectural challenge for tools and infrastructure to uncover these hidden variables to make them available for machine learning and user inspection.
ChatGPT, Culture and Creativity simulacrum and alterity
Keynote at Creative AI Research Conference 2023
https://alandix.com/academic/talks/CAR2023-keynote/
Over the years many of the ‘red lines’ of artificial intelligence have been crossed: challenges that were deemed to require uniquely human understanding. In 1997, chess fell as Deep Blue defeated Kasparov; then, twenty years later, AlphaGo beat Ke Jie, the world’s top Go player. Arguably, game playing can be considered artificial and formal, not representing the rich nuanced nature of human intelligence embodied in the real world. However, large language models have challenged these assumptions producing dialogue and texts that appear human – passing the Turing test . Furthermore, the text, and poems generated by ChatGPT and images created by DALL-E appear almost creative.
Has the last bastion fallen or is it merely the babbling of ‘stochastic parrots’? Is AI the ultimate charlatan peddling plagiarism or instead the child’s cry that reveals the emperor’s cloths of human creativity are sham? And what does it mean to be creative anyway?
I will attempt, if not to answer these deep questions, at least lay down some pointers. We will test the limits of the myth of the individual innate genius with inspiration gifted by the muses; and explore the way creativity is always embodied in culture and technology. Yet, while artists and philosophers debate, the child draws on.
Why pandemics and climate change are hard to understand and make decision mak...
Talk given as part of Online Seminars on Human Computer Interaction and User Experience
Presented by British Computer Society Interaction Group
and Interacting with Computers, 27 February 2023
https://alandix.com/academic/talks/BCS-IwC-Covid-Feb-2023/
This talk draws on diverse psychological, behavioural and numerical literature to understand some of the challenges we all face in making sense of large-scale phenomena and use this to create a roadmap for HCI responses. This body of research points the way toward current challenges and equips us with tools and principles that can help HCI researchers deliver value. The talk is framed by looking at patterns and information that highlight some of the common misunderstandings that arise – not just for politicians and the general public but also for those in the academic community’s heart. This talk does not have all the answers to this, but we hope it provides some and, perhaps more importantly, raises questions that we need to address as scientific and technical communities.
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Keynote at Fifth European Tangible Interaction Studio, ENAC Toulouse. Nov. 7-10 2022.
https://alandix.com/academic/talks/ETIS2022-keynote/
For many years interaction design was driven by the abstractions of WIMP (windows, icons, menus, pointer). The details differ on desktop applications, web pages or smart-phones and the ‘pointer’ has evolved from mice to trackpad and touch-based interactions, however, for many digital applications, the central aspects are unchanged. What is different is that the screens we encounter, as Weiser predicted, are everywhere: embedded in physical appliances such as showers and toasters and situated in office walls and building facades. Furthermore, we are often engaging with digital applications that have no obvious screen or where the screen if present is only a small part of the interaction; these include voice assistants, semi-autonomous vehicles, and smart cities.
Even where the dominant interaction is focused on a screen, the places where we use them and the physical activities, we are doing fundamentally affect the nature of the interactive experience: using a smartphone while sitting in an armchair and watching television, is very different from thumbing a quick message whilst walking down a busy city road on a rainy night.
In this talk I will describe several design techniques and prototype tools that seek to address the physicality of digital interactions including the physical nature of the device itself and the physical context in which it is placed. This will include ‘soft’ formal methods to describe physical aspects of devices, ways to use video to model physical prototypes during early design and tools to encourage designers to keep the context of use in mind even when working on largely screen-based interactions.
The talk draws on some long-standing work, parts of the recently published book 'TouchIT: Understanding Design in a Physical-Digital World' (co-authored with Steve Gill, Devina Ramduny-Ellis, and Jo Hare) and the InContext project (in collaboration with Miriam Sturdee and Anna Carter). The latter arose from the realisation that despite the vast number of design tools available, nearly all focus entirely on the screen and wireframes. We are asking "what is the Next Generation of UX design tool?" – perhaps you would like to join this conversation.
Forever Cyborgs – a long view on physical-digital interaction
Keynote at the European Conference on Cognitive Ergonomics (ECCE 2022), Kaiserslautern, Germany, 7th Oct 2022.
https://alandix.com/academic/talks/ECCE2022-keynote/
From prehistory to the internet age, humans have always lived as part of a technologically mediated world. Knapped flints have given way to touch-screens, cuneiform to CSS, but in both rapid hand-eye coordination and long-term social interactions, our experiences and actions in the world are embedded in a physical, mechanical, symbolic and digital nexus. After far too long in the writing, my co-authors and I are delighted that "TouchIT: Understanding Design in a Physical-Digital World" is finally published – symbolic words, recorded in digital media and printed on physical paper. This book covers established and emergent digital technology, but repeatedly the continuity of current and past technology, physical and digital worlds is evident. The fundamental cognitive resources that enable our digital existence in an age of constant flux are the result of aeons of development in a physical world that we remake and reimagine. In this talk I will explore multiple scales of digital interaction from seconds to years, informed by and illuminating what it means to be a fully embodied and richly reflective human.
More from Alan Dix (20)
AI for HCI – could this be a better title if I’d asked ChatGPT
AI for HCI – could this be a better title if I’d asked ChatGPT
Just Counting – a tool ecosystem for personal numeric information
Just Counting – a tool ecosystem for personal numeric information
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
AI and the Humanities – provocations – The Arts, Humanities & Responsible AI...
Can AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI prelude
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Human-Centred Artificial Intelligence – Malta 2024
Human-Centred Artificial Intelligence – Malta 2024
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
Qualitative–Quantitative reasoning and lightweight numbers
Qualitative–Quantitative reasoning and lightweight numbers
Invited talk at Diversifying Knowledge Production in HCI
Invited talk at Diversifying Knowledge Production in HCI
Hidden Figures architectural challenges to expose parameters lost in code
Hidden Figures architectural challenges to expose parameters lost in code
ChatGPT, Culture and Creativity simulacrum and alterity
ChatGPT, Culture and Creativity simulacrum and alterity
Why pandemics and climate change are hard to understand and make decision mak...
Why pandemics and climate change are hard to understand and make decision mak...
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Beyond the Wireframe: tools to design, analyse and prototype physical devices
Forever Cyborgs – a long view on physical-digital interaction
Forever Cyborgs – a long view on physical-digital interaction
Recently uploaded
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
A Deep Dive into ScyllaDB's Architecture
This talk will cover ScyllaDB Architecture from the cluster-level view and zoom in on data distribution and internal node architecture. In the process, we will learn the secret sauce used to get ScyllaDB's high availability and superior performance. We will also touch on the upcoming changes to ScyllaDB architecture, moving to strongly consistent metadata and tablets.
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/temporal-event-neural-networks-a-more-efficient-alternative-to-the-transformer-a-presentation-from-brainchip/
Chris Jones, Director of Product Management at BrainChip , presents the “Temporal Event Neural Networks: A More Efficient Alternative to the Transformer” tutorial at the May 2024 Embedded Vision Summit.
The expansion of AI services necessitates enhanced computational capabilities on edge devices. Temporal Event Neural Networks (TENNs), developed by BrainChip, represent a novel and highly efficient state-space network. TENNs demonstrate exceptional proficiency in handling multi-dimensional streaming data, facilitating advancements in object detection, action recognition, speech enhancement and language model/sequence generation. Through the utilization of polynomial-based continuous convolutions, TENNs streamline models, expedite training processes and significantly diminish memory requirements, achieving notable reductions of up to 50x in parameters and 5,000x in energy consumption compared to prevailing methodologies like transformers.
Integration with BrainChip’s Akida neuromorphic hardware IP further enhances TENNs’ capabilities, enabling the realization of highly capable, portable and passively cooled edge devices. This presentation delves into the technical innovations underlying TENNs, presents real-world benchmarks, and elucidates how this cutting-edge approach is positioned to revolutionize edge AI across diverse applications.Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Demystifying Knowledge Management through Storytelling
The Department of Veteran Affairs (VA) invited Taylor Paschal, Knowledge & Information Management Consultant at Enterprise Knowledge, to speak at a Knowledge Management Lunch and Learn hosted on June 12, 2024. All Office of Administration staff were invited to attend and received professional development credit for participating in the voluntary event.
The objectives of the Lunch and Learn presentation were to:
- Review what KM ‘is’ and ‘isn’t’
- Understand the value of KM and the benefits of engaging
- Define and reflect on your “what’s in it for me?”
- Share actionable ways you can participate in Knowledge - - Capture & Transfer
Essentials of Automations: Exploring Attributes & Automation Parameters
Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they?
Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality.
You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
What began over 115 years ago as a supplier of precision gauges to the automotive industry has evolved into being an industry leader in the manufacture of product branding, automotive cockpit trim and decorative appliance trim. Value-added services include in-house Design, Engineering, Program Management, Test Lab and Tool Shops.
The Microsoft 365 Migration Tutorial For Beginner.pptx
This presentation will help you understand the power of Microsoft 365. However, we have mentioned every productivity app included in Office 365. Additionally, we have suggested the migration situation related to Office 365 and how we can help you.
You can also read: https://www.systoolsgroup.com/updates/office-365-tenant-to-tenant-migration-step-by-step-complete-guide/
Leveraging the Graph for Clinical Trials and Standards
Katja Glaß
OpenStudyBuilder Community Manager - Katja Glaß Consulting
Marius Conjeaud
Principal Consultant - Neo4j
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
How we managed to grow and scale a RAG application from zero to thousands of users in 7 months. Lessons from technical challenges around managing high load for LLMs, RAGs and Vector databases.
Dandelion Hashtable: beyond billion requests per second on a commodity server
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
Session 1 - Intro to Robotic Process Automation.pdf
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program:
https://bit.ly/Automation_Student_Kickstart
In this session, we shall introduce you to the world of automation, the UiPath Platform, and guide you on how to install and setup UiPath Studio on your Windows PC.
📕 Detailed agenda:
What is RPA? Benefits of RPA?
RPA Applications
The UiPath End-to-End Automation Platform
UiPath Studio CE Installation and Setup
💻 Extra training through UiPath Academy:
Introduction to Automation
UiPath Business Automation Platform
Explore automation development with UiPath Studio
👉 Register here for our upcoming Session 2 on June 20: Introduction to UiPath Studio Fundamentals: https://community.uipath.com/events/details/uipath-lagos-presents-session-2-introduction-to-uipath-studio-fundamentals/
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable.
In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed:
Key Takeaways:
Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement.
Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers.
Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.
JavaLand 2024: Application Development Green Masterplan
My presentation slides I used at JavaLand 2024
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience
Mutation Testing for Task-Oriented Chatbots
Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots.
To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.
What is an RPA CoE? Session 1 – CoE Vision
In the first session, we will review the organization's vision and how this has an impact on the COE Structure.
Topics covered:
• The role of a steering committee
• How do the organization’s priorities determine CoE Structure?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
Recently uploaded (20)
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Formal 5 – Dialogue models – what to do when
- 1. dialogue notations what to do when
- 2. what is dialogue? conversation between two or more parties – usually cooperative in user interfaces – refers to the structure of the interaction – syntactic level of human–computer ‘conversation’ levels – lexical – shape of icons, actual keys pressed – syntactic – order of inputs and outputs – semantic – effect on internal application/data
- 3. structured human dialogue human-computer dialogue very constrained some human-human dialogue formal too … Minister: do you man’s name take this woman … Man: I do Minister: do you woman’s name take this man … Woman: I do Man: With this ring I thee wed (places ring on womans finger) Woman: With this ring I thee wed (places ring ..) Minister: I now pronounce you man and wife
- 4. lessons about dialogue wedding service – sort of script for three parties – specifies order – some contributions fixed – “I do” – others variable – “do you man’s name …” – instructions for ring concurrent with saying words “with this ring …” if you say these words are you married? – only if in the right place, with marriage licence – syntax not semantics
- 5. … and more what if woman says “I don’t”? real dialogues often have alternatives: the process of the trial depends on the defendant’s response focus on normative responses doesn’t cope with judge saying “off with her head” or in computer dialogue user standing on keyboard! Judge: How do you plead guilty or not guilty? Defendant: either Guilty or Not guilty
- 8. a simple graphics package File Graphics Text Paint Circle Line
- 9. state transition networks (STN) circles - states arcs - actions/events
- 10. state transition networks - events arc labels a bit cramped because: – notation is `state heavy‘ – the events require most detail
- 11. state transition networks - states labels in circles a bit uninformative: – states are hard to name – but easier to visualise
- 12. hierarchical STNs managing complex dialogues named sub-dialogues Graphics Submenu Text Submenu Paint Submenu Main Menu select ‘graphics’ select ‘paint’ select ‘text’
- 15. action properties (local) completeness missed arcs unforeseen circumstances determinism several arcs for one action deliberate: application decision accident: production rules nested escapes consistency same action, same effect? modes and visibility
- 16. state properties (global) reachability can you get anywhere from anywhere? ... and how easily reversibility can you get to the previous state? ... but NOT undo dangerous states some states you don't want to get to e.g. digital watch: time/alarm set, button press for 2 secs
- 18. checking properties completeness and reversability
- 19. checking properties (i) completeness – double-click in circle states? double click ?
- 20. checking properties (ii) Reversibility: – to reverse select `line'
- 21. checking properties (ii) Reversibility: – to reverse select `line' – click
- 22. checking properties (ii) Reversibility: – to reverse select `line' – click - double click
- 23. checking properties (ii) Reversibility: – to reverse select `line' – click - double click - select `graphics' – (3 actions)
- 24. checking properties (ii) Reversibility: – to reverse select `line' – click - double click - select `graphics' – (3 actions) N.B. not undo
- 27. dangerous states word processor: two modes and exit F1 - changes mode F2 - exit (and save) Esc - no mode change but ... Esc resets autosave edit exitmenu F1 F2 Esc
- 28. dangerous states (ii) exit with/without save dangerous states duplicate states - semantic distinction F1-F2 - exit with save F1-Esc-F2 - exit with no save edit exitmenu F1 F2 Esc edit exitmenu F1 F2 Esc any update autosave no save
- 30. lexical issues and layout Seeheim sense
- 31. lexical Issues visibility differentiate modes and states annotations to dialogue style command - verb noun mouse based - noun verb layout not just appearance ...
- 32. layout matters word processor - dangerous states old keyboard - OK Esc F1 F2 F3 ... F4 ... 1 tab ... ... edit exitmenu F1 F2 Esc edit exitmenu F1 F2 Esc any update
- 33. layout matters new keyboard layout intend F1-F2 (save) finger catches Esc Esc F1 F2 F3 ... edit exitmenu F1 F2 Esc edit exitmenu F1 F2 Esc any update
- 34. layout matters new keyboard layout intend F1-F2 (save) finger catches Esc F1-Esc-F2 - disaster! Esc F1 F2 F3 ... edit exitmenu F1 F2 Esc edit exitmenu F1 F2 Esc any update