This document provides an overview of the topics to be covered in Week 6 of an Intelligent Interfaces course, including trends in IUIs, designing adaptive and speech-based interfaces, and automatic speech recognition. The key learning outcomes are to identify future IUI trends, evaluate interface designs, and understand recent advances and challenges in ASR. The lecture will cover emerging IUI technologies, design guidelines for IUIs, and an activity on ASR trends, applications, and challenges.

1. ICS3211 - Intelligent
Interfaces II
Combining design with technology for effective human-
computer interaction
Week 6 Department of AI,
University of Malta

2. IUI’s Trends, Designs &
ASRs
Week 6 overview:
• What’s new in IUIs? : trends and challenges;
• Adaptive UIs and Design guidelines for UIs;
• Automatic Speech Recognition;

3. Learning Outcomes
At the end of this session you should be able to:
• Identify future trends in IUI’s
• Illustrate design guidelines and criticise UI designs
• Characterise ASR systems, with recent advancements
and identify challenges in their development

4. Lecture Outline
• The Future of IUIs
• Design of IUIs
• Activity
• ASR: trends, applications & challenges

6. The Future of IUIs
• Ubiquitous computing vision;
• Synthesise structure from low level input;
• Smart homes, smart wearables with intelligent use
of sensors;

7. What’s new in IUIs? : trends
& challenges
• Interfaces as important components for interaction
tasks;
• Sensor-based new interaction paradigms;
• Human-Centred data analysis;
• Pervasive affective computing;
• Challenges of IUIs;

8. Recap
• Check out the following two projects:
• https://www.fastcompany.com/3021522/mit-invents-
a-shapeshifting-display-you-can-reach-through-and-
touch
• https://digitash.com/uncategorized/interactive-
splash-display-projects-images-into-air/
• What properties characterise the input devices in these
projects? How would you choose to evaluate them?

9. Design Guidelines
• Poster Analogy
• Design for the most difficult common denominator;
• Avoid overuse of saturated colours;
• Consider different users’ levels of skill;
• Be aware of the fatigue factor;
• Other differences to consider;
• Use the squint test;

10. Designing Interfaces
• Effective & appropriate
use of the medium;
• Element of time;
• Consistent &
appropriate visual
language;
• Navigation aids;
• Graphics/icons;
• Metaphor;
• Colour;
• Legibility
• Readability

11. Adaptive User Interfaces
• Context awareness;
• Pervasive information visualisation;
• Ontologies in information visualisation;
• Information visualisation services;

13. Designing & Visualising
Information
• Log on to the site: http://
www.informationisbeautiful.net/
• Focus on design of the information visualisation,
and the interactivity provided by the user interface
• Now find: http://www.informationisbeautiful.net/
visualizations/the-internet-of-things-a-primer/
• How can intelligence be added to an interface for a
more improved information visualisation?

14. Designing for Human
Information Processing
• Stimulus- Response compatibility: classes;
• S-S
• S-R
• S-C-R
• R-R
• R-E

15. • Stimulus- Response compatibility:
• S-S
• S-R
• S-C-R
• R-R
• R-E

16. • Compatibilities between alternate displays,
responses and consequences play important role
• Spatial compatibility for any task with spatial
properties
• Performance limitations from incompatibilities
cannot be easily overcome
• Use of Simon-type correspondence effects
• Compatibility issues arise for binary choices as well
as multiple task contexts

17. • More direct input manipulation requires taking into
consideration compatibility effects between
responses
• C:D relations can be optimised by adhering to
population stereotypes
• High compatibility essential for products intended
for use by older adults

18. Automatic Speech
Recognition
• Real life examples where such ASR have its
benefits include for accessibility for the visually
impaired
• A recent paper: "Intelligent Human-Robot
Interaction Using Voice Commands and Machine
Learning" Authors: Chen,L.,Wang,Y., Liu, J.
Published: 2020

19. Automatic Speech
Recognition
• ASR can be categorised depending on various
factors:

20. Speech Recognition
Techniques
• The SR system combines three stages:

21. Advancements in ASR
Systems
• ASR Using Deep Learning
• Speech Emotion Recognition Systems
• Development of Tools for High-Performance
Speech Recognition Systems

22. Applications of ASR
Systems
• Telecommunications Industry
• Emotion Recognition
• Healthcare Industry
• Aviation Industry

23. Challenges in ASR Systems
• Variation in Accents
• Children-centric Focus
• Model Training
• Noise

24. –Rick Rashid
“These devices will eventually replace paper
print media. We are reaching a point in the
future where any surface can be an interactive
surface.”