Introduction

1. Modality and Human-
Computer Interaction:
A brief on issues
MID1043 Multimodal Interaction Design
week 1
Yonggeun Kim

2. TOC
What will we discuss?
Which direction are we heading towards?

3. Modalities - “means of communication”
Bourguet, Marie-Luce. “An Overview of Multimodal Interaction Techniques and Applications.” Intelligent Information Technologies: Concepts, Methodologies, Tools, and
Applications, IGI Global, 2008, pp. 1–7.

4. © Trey Ratcliff

5. © Trey Ratcliff
Where is McDonald’s
nearby?

6. © Trey Ratcliff
1 2
3
4 5
6 7
8
9

7. © Trey Ratcliff
Where is McDonald’s
nearby?
Usability

8. ▸ Note
■ Usability, as defined in this document, is not an attribute of a product, although appropriate
product attributes can contribute to the product being usable in a particular context of use.
■ Usability is a more comprehensive concept than is commonly understood by “ease-of-use” or
“user friendliness”.
Usability*
*ISO 9241-11:2018(En), Ergonomics of Human-System Interaction — Part 11: Usability: Definitions and Concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-
2:v1:en. Accessed 5 July 2018.
© Trey Ratcliff

9. ▸ Note
■ Usability, as defined in this document, is not an attribute of a product, although appropriate
product attributes can contribute to the product being usable in a particular context of use.
■ Usability is a more comprehensive concept than is commonly understood by “ease-of-use” or
“user friendliness”.
Usability*
*ISO 9241-11:2018(En), Ergonomics of Human-System Interaction — Part 11: Usability: Definitions and Concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-
2:v1:en. Accessed 5 July 2018.
© Trey Ratcliff

10. ▸ Note
■ Usability, as defined in this document, is not an attribute of a product, although appropriate
product attributes can contribute to the product being usable in a particular context of use.
■ Usability is a more comprehensive concept than is commonly understood by “ease-of-use” or
“user friendliness”.
Usability*
*ISO 9241-11:2018(En), Ergonomics of Human-System Interaction — Part 11: Usability: Definitions and Concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-
2:v1:en. Accessed 5 July 2018.
© Trey Ratcliff

12. face

13. face activity

14. face activity

15. face activity

16. face activity

17. face activity
possibilities

18. face Possible activities
Possibilities for
temporal/temporary choice

19. face activity action

20. SEE
face activity action

21. SEE THINK
activity actionface

22. DOSEE THINK
actionactivityface

23. SEE THINK DO
interactioninteractivityinterface

24. THINKSEE DO
interactioninteractivityinterface

25. THINKSEE DO
interactioninteractivityinterface
A carefully chosen and seamlessly integrated modalities
helps effective communication.
And it might be efficient.

26. THINKSEE DO
interactioninteractivityinterface
A carefully chosen and seamlessly integrated modalities
helps effective communication.
And it might be efficient.

27. THINKSEE DO
interactioninteractivityinterface
A carefully chosen and seamlessly integrated modalities
helps effective kind communication.
And it might be efficient.