Types of Interaction 2

1. Audio and Voice Interface
Types of Interaction 2
Yonggeun Kim

2. TOC
1. Type of Interactions
a. Basics
i. Bridging Physical and Digital: Sensors and Actuators
ii. Interface and Interaction Design of Modalities
b. Uncommon Modalities 1; Taste
c. Uncommon Modalities 2; Smell
d. Types of Interaction
i. Physical Controls
ii. Audio and Voice Interface

3. Types of Interaction 2
Audio and Voice Interface

4. Introduction
This blended learning slot consists of 3 modules.
1. Video lecture
2. Reading Material
3. Survey

5. 1. Video Lecture
Defining Multimodal Interactions: One Size Does
Not Fit All (Google I/O '17)

6. Summary
▸ Factors that influence multimodality
■ Motion
■ Environment
■ Proximity
■ Audio capability
■ Visual capability
■ Capabilities in other modalities

7. Summary
▸ Factors that influence multimodality; Application

8. Summary
▸ Factors that influence multimodality; Application

9. Summary
▸ Factors that influence multimodality; Application

10. Summary
▸ Factors that influence multimodality
■ Guidelines
➜ Voice modalities
× Don’t read, listen
× Avoid information overload
× Answer question

11. Summary
▸ Factors that influence multimodality
■ Guidelines
➜ Multimodalities
× If one mode goes away, the other should take over
× Optimize for the strongest mode, but allow both
× Leverage the strengths of each mode & avoid redundancy across modalities

12. Summary
▸ Take-Aways
■ Know the strengths and weaknesses of each mode
■ Optimize for the strongest mode, but allow both
■ Don’t read, listen
■ Keep it short and sweet

13. Summary
▸ Future Considerations
■ Automatically adapt to user’s environment and conditions
■ Cross multi-surface experiences
■ More complex multimodal interactions

14. 2. Reading
Rowland, Claire, et al., editors. Designing Connected Products: UX for the
Consumer Internet of Things. O’Reilly, 2015. P. 290-294 🔗

15. 3. Provide your critical thinking
▸ Google Form survey
■ Link; https://goo.gl/forms/J7v0UTtDHMVsnQQy2
■ Due; 5th September 2018