SlideShare a Scribd company logo
1 of 24
Download to read offline
ICS3211 - Intelligent
Interfaces II
Combining design with technology for effective human-
computer interaction
Week 6 Department of AI,
University of Malta
IUI’s Trends, Designs &
ASRs
Week 6 overview:
• What’s new in IUIs? : trends and challenges;
• Adaptive UIs and Design guidelines for UIs;
• Automatic Speech Recognition;
Learning Outcomes
At the end of this session you should be able to:
• Identify future trends in IUI’s
• Illustrate design guidelines and criticise UI designs
• Characterise ASR systems, with recent advancements
and identify challenges in their development
Lecture Outline
• The Future of IUIs
• Design of IUIs
• Activity
• ASR: trends, applications & challenges
The Future of IUIs
• Ubiquitous computing vision;
• Synthesise structure from low level input;
• Smart homes, smart wearables with intelligent use
of sensors;
What’s new in IUIs? : trends
& challenges
• Interfaces as important components for interaction
tasks;
• Sensor-based new interaction paradigms;
• Human-Centred data analysis;
• Pervasive affective computing;
• Challenges of IUIs;
Recap
• Check out the following two projects:
• https://www.fastcompany.com/3021522/mit-invents-
a-shapeshifting-display-you-can-reach-through-and-
touch
• https://digitash.com/uncategorized/interactive-
splash-display-projects-images-into-air/
• What properties characterise the input devices in these
projects? How would you choose to evaluate them?
Design Guidelines
• Poster Analogy
• Design for the most difficult common denominator;
• Avoid overuse of saturated colours;
• Consider different users’ levels of skill;
• Be aware of the fatigue factor;
• Other differences to consider;
• Use the squint test;
Designing Interfaces
• Effective & appropriate
use of the medium;
• Element of time;
• Consistent &
appropriate visual
language;
• Navigation aids;
• Graphics/icons;
• Metaphor;
• Colour;
• Legibility
• Readability
Adaptive User Interfaces
• Context awareness;
• Pervasive information visualisation;
• Ontologies in information visualisation;
• Information visualisation services;
Designing & Visualising
Information
• Log on to the site: http://
www.informationisbeautiful.net/
• Focus on design of the information visualisation,
and the interactivity provided by the user interface
• Now find: http://www.informationisbeautiful.net/
visualizations/the-internet-of-things-a-primer/
• How can intelligence be added to an interface for a
more improved information visualisation?
Designing for Human
Information Processing
• Stimulus- Response compatibility: classes;
• S-S
• S-R
• S-C-R
• R-R
• R-E
• Stimulus- Response compatibility:
• S-S
• S-R
• S-C-R
• R-R
• R-E
• Compatibilities between alternate displays,
responses and consequences play important role
• Spatial compatibility for any task with spatial
properties
• Performance limitations from incompatibilities
cannot be easily overcome
• Use of Simon-type correspondence effects
• Compatibility issues arise for binary choices as well
as multiple task contexts
• More direct input manipulation requires taking into
consideration compatibility effects between
responses
• C:D relations can be optimised by adhering to
population stereotypes
• High compatibility essential for products intended
for use by older adults
Automatic Speech
Recognition
• Real life examples where such ASR have its
benefits include for accessibility for the visually
impaired
• A recent paper: "Intelligent Human-Robot
Interaction Using Voice Commands and Machine
Learning" Authors: Chen,L.,Wang,Y., Liu, J.
Published: 2020
Automatic Speech
Recognition
• ASR can be categorised depending on various
factors:
Speech Recognition
Techniques
• The SR system combines three stages:
Advancements in ASR
Systems
• ASR Using Deep Learning
• Speech Emotion Recognition Systems
• Development of Tools for High-Performance
Speech Recognition Systems
Applications of ASR
Systems
• Telecommunications Industry
• Emotion Recognition
• Healthcare Industry
• Aviation Industry
Challenges in ASR Systems
• Variation in Accents
• Children-centric Focus
• Model Training
• Noise
–Rick Rashid
“These devices will eventually replace paper
print media. We are reaching a point in the
future where any surface can be an interactive
surface.”

More Related Content

Similar to ICS3211_lecture_week62023.pdf

Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
ijceronline
 
Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
Luis Carlos Aceves
 

Similar to ICS3211_lecture_week62023.pdf (20)

Unit - 1 - HCI.pptx
Unit - 1 - HCI.pptxUnit - 1 - HCI.pptx
Unit - 1 - HCI.pptx
 
Unit - 1 - HCI.pptx
Unit - 1 - HCI.pptxUnit - 1 - HCI.pptx
Unit - 1 - HCI.pptx
 
Software Architecture in an Agile World
Software Architecture in an Agile WorldSoftware Architecture in an Agile World
Software Architecture in an Agile World
 
Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
Tools and Techniques for Designing, Implementing, & Evaluating Ubiquitous Com...
 
B19CA4020_SE_Unit3.pptx
B19CA4020_SE_Unit3.pptxB19CA4020_SE_Unit3.pptx
B19CA4020_SE_Unit3.pptx
 
Meetup 10 here&now: Megatris Comp design method (Part 1)
Meetup 10 here&now: Megatris Comp design method (Part 1)Meetup 10 here&now: Megatris Comp design method (Part 1)
Meetup 10 here&now: Megatris Comp design method (Part 1)
 
Meetup 10 here&now_megatriscomp_design_methodparti_v1
Meetup 10 here&now_megatriscomp_design_methodparti_v1Meetup 10 here&now_megatriscomp_design_methodparti_v1
Meetup 10 here&now_megatriscomp_design_methodparti_v1
 
ICS3211_lecture 03 2023.pdf
ICS3211_lecture 03 2023.pdfICS3211_lecture 03 2023.pdf
ICS3211_lecture 03 2023.pdf
 
Chapter1(hci)
Chapter1(hci)Chapter1(hci)
Chapter1(hci)
 
UI Design Based on Schematics and Calm Technology by Omar Sosa Tzec et al., C...
UI Design Based on Schematics and Calm Technology by Omar Sosa Tzec et al., C...UI Design Based on Schematics and Calm Technology by Omar Sosa Tzec et al., C...
UI Design Based on Schematics and Calm Technology by Omar Sosa Tzec et al., C...
 
Kristiaan De Roeck at UX Antwerp Meetup - 30 January 2018
Kristiaan De Roeck at UX Antwerp Meetup - 30 January 2018Kristiaan De Roeck at UX Antwerp Meetup - 30 January 2018
Kristiaan De Roeck at UX Antwerp Meetup - 30 January 2018
 
ICS2208 lecture1
ICS2208 lecture1ICS2208 lecture1
ICS2208 lecture1
 
Design Learnings
Design LearningsDesign Learnings
Design Learnings
 
ui/ux training institutes in Hyderabad
ui/ux training institutes in Hyderabadui/ux training institutes in Hyderabad
ui/ux training institutes in Hyderabad
 
ui/ux training institutes in Hyderabad
ui/ux training institutes in Hyderabadui/ux training institutes in Hyderabad
ui/ux training institutes in Hyderabad
 
UI_UX Training in Hyd PPT.pptx
UI_UX Training in Hyd PPT.pptxUI_UX Training in Hyd PPT.pptx
UI_UX Training in Hyd PPT.pptx
 
UI_UX Training in Hyd PPT-converted.pdf
UI_UX Training in Hyd PPT-converted.pdfUI_UX Training in Hyd PPT-converted.pdf
UI_UX Training in Hyd PPT-converted.pdf
 
Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
 
Mse sept13 (3/3)
Mse sept13 (3/3)Mse sept13 (3/3)
Mse sept13 (3/3)
 
lecture 1-5.pdf
lecture 1-5.pdflecture 1-5.pdf
lecture 1-5.pdf
 

More from Vanessa Camilleri

More from Vanessa Camilleri (20)

ICS 2208 Lecture 8 Slides AI and VR_.pdf
ICS 2208 Lecture 8 Slides AI and VR_.pdfICS 2208 Lecture 8 Slides AI and VR_.pdf
ICS 2208 Lecture 8 Slides AI and VR_.pdf
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6
 
ICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdfICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdf
 
ICS2208 Lecture3 2023-2024 - Model Based User Interfaces
ICS2208 Lecture3 2023-2024 - Model Based User InterfacesICS2208 Lecture3 2023-2024 - Model Based User Interfaces
ICS2208 Lecture3 2023-2024 - Model Based User Interfaces
 
ICS Lecture 11 - Intelligent Interfaces 2023
ICS Lecture 11 - Intelligent Interfaces 2023ICS Lecture 11 - Intelligent Interfaces 2023
ICS Lecture 11 - Intelligent Interfaces 2023
 
ICS3211_lecture 09_2023.pdf
ICS3211_lecture 09_2023.pdfICS3211_lecture 09_2023.pdf
ICS3211_lecture 09_2023.pdf
 
ICS3211_lecture 08_2023.pdf
ICS3211_lecture 08_2023.pdfICS3211_lecture 08_2023.pdf
ICS3211_lecture 08_2023.pdf
 
ICS3211_lecture_week52023.pdf
ICS3211_lecture_week52023.pdfICS3211_lecture_week52023.pdf
ICS3211_lecture_week52023.pdf
 
ICS3211_lecture 04 2023.pdf
ICS3211_lecture 04 2023.pdfICS3211_lecture 04 2023.pdf
ICS3211_lecture 04 2023.pdf
 
ICS3211_lecture 11.pdf
ICS3211_lecture 11.pdfICS3211_lecture 11.pdf
ICS3211_lecture 11.pdf
 
FoundationsAIEthics2023.pdf
FoundationsAIEthics2023.pdfFoundationsAIEthics2023.pdf
FoundationsAIEthics2023.pdf
 
ICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdfICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdf
 
ICS1020CV_2022.pdf
ICS1020CV_2022.pdfICS1020CV_2022.pdf
ICS1020CV_2022.pdf
 
ARI5902_2022.pdf
ARI5902_2022.pdfARI5902_2022.pdf
ARI5902_2022.pdf
 
ICS2208 Lecture10
ICS2208 Lecture10ICS2208 Lecture10
ICS2208 Lecture10
 
ICS2208 lecture9
ICS2208 lecture9ICS2208 lecture9
ICS2208 lecture9
 
ICS2208 lecture7
ICS2208 lecture7ICS2208 lecture7
ICS2208 lecture7
 
ICS2208 lecture6
ICS2208 lecture6ICS2208 lecture6
ICS2208 lecture6
 
ICS2208 Lecture 5
ICS2208 Lecture 5ICS2208 Lecture 5
ICS2208 Lecture 5
 

Recently uploaded

The basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptxThe basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptx
heathfieldcps1
 
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
Krashi Coaching
 
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
中 央社
 

Recently uploaded (20)

The basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptxThe basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptx
 
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
 
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
MSc Ag Genetics & Plant Breeding: Insights from Previous Year JNKVV Entrance ...
 
MichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdfMichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdf
 
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
 
How to Analyse Profit of a Sales Order in Odoo 17
How to Analyse Profit of a Sales Order in Odoo 17How to Analyse Profit of a Sales Order in Odoo 17
How to Analyse Profit of a Sales Order in Odoo 17
 
Features of Video Calls in the Discuss Module in Odoo 17
Features of Video Calls in the Discuss Module in Odoo 17Features of Video Calls in the Discuss Module in Odoo 17
Features of Video Calls in the Discuss Module in Odoo 17
 
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
 
The Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptxThe Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptx
 
Graduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptxGraduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptx
 
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjjStl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
 
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
 
ANTI PARKISON DRUGS.pptx
ANTI         PARKISON          DRUGS.pptxANTI         PARKISON          DRUGS.pptx
ANTI PARKISON DRUGS.pptx
 
Capitol Tech Univ Doctoral Presentation -May 2024
Capitol Tech Univ Doctoral Presentation -May 2024Capitol Tech Univ Doctoral Presentation -May 2024
Capitol Tech Univ Doctoral Presentation -May 2024
 
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
 
How to Manage Closest Location in Odoo 17 Inventory
How to Manage Closest Location in Odoo 17 InventoryHow to Manage Closest Location in Odoo 17 Inventory
How to Manage Closest Location in Odoo 17 Inventory
 
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General QuizPragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
 
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptxHVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
 
Word Stress rules esl .pptx
Word Stress rules esl               .pptxWord Stress rules esl               .pptx
Word Stress rules esl .pptx
 
IPL Online Quiz by Pragya; Question Set.
IPL Online Quiz by Pragya; Question Set.IPL Online Quiz by Pragya; Question Set.
IPL Online Quiz by Pragya; Question Set.
 

ICS3211_lecture_week62023.pdf

  • 1. ICS3211 - Intelligent Interfaces II Combining design with technology for effective human- computer interaction Week 6 Department of AI, University of Malta
  • 2. IUI’s Trends, Designs & ASRs Week 6 overview: • What’s new in IUIs? : trends and challenges; • Adaptive UIs and Design guidelines for UIs; • Automatic Speech Recognition;
  • 3. Learning Outcomes At the end of this session you should be able to: • Identify future trends in IUI’s • Illustrate design guidelines and criticise UI designs • Characterise ASR systems, with recent advancements and identify challenges in their development
  • 4. Lecture Outline • The Future of IUIs • Design of IUIs • Activity • ASR: trends, applications & challenges
  • 5.
  • 6. The Future of IUIs • Ubiquitous computing vision; • Synthesise structure from low level input; • Smart homes, smart wearables with intelligent use of sensors;
  • 7. What’s new in IUIs? : trends & challenges • Interfaces as important components for interaction tasks; • Sensor-based new interaction paradigms; • Human-Centred data analysis; • Pervasive affective computing; • Challenges of IUIs;
  • 8. Recap • Check out the following two projects: • https://www.fastcompany.com/3021522/mit-invents- a-shapeshifting-display-you-can-reach-through-and- touch • https://digitash.com/uncategorized/interactive- splash-display-projects-images-into-air/ • What properties characterise the input devices in these projects? How would you choose to evaluate them?
  • 9. Design Guidelines • Poster Analogy • Design for the most difficult common denominator; • Avoid overuse of saturated colours; • Consider different users’ levels of skill; • Be aware of the fatigue factor; • Other differences to consider; • Use the squint test;
  • 10. Designing Interfaces • Effective & appropriate use of the medium; • Element of time; • Consistent & appropriate visual language; • Navigation aids; • Graphics/icons; • Metaphor; • Colour; • Legibility • Readability
  • 11. Adaptive User Interfaces • Context awareness; • Pervasive information visualisation; • Ontologies in information visualisation; • Information visualisation services;
  • 12.
  • 13. Designing & Visualising Information • Log on to the site: http:// www.informationisbeautiful.net/ • Focus on design of the information visualisation, and the interactivity provided by the user interface • Now find: http://www.informationisbeautiful.net/ visualizations/the-internet-of-things-a-primer/ • How can intelligence be added to an interface for a more improved information visualisation?
  • 14. Designing for Human Information Processing • Stimulus- Response compatibility: classes; • S-S • S-R • S-C-R • R-R • R-E
  • 15. • Stimulus- Response compatibility: • S-S • S-R • S-C-R • R-R • R-E
  • 16. • Compatibilities between alternate displays, responses and consequences play important role • Spatial compatibility for any task with spatial properties • Performance limitations from incompatibilities cannot be easily overcome • Use of Simon-type correspondence effects • Compatibility issues arise for binary choices as well as multiple task contexts
  • 17. • More direct input manipulation requires taking into consideration compatibility effects between responses • C:D relations can be optimised by adhering to population stereotypes • High compatibility essential for products intended for use by older adults
  • 18. Automatic Speech Recognition • Real life examples where such ASR have its benefits include for accessibility for the visually impaired • A recent paper: "Intelligent Human-Robot Interaction Using Voice Commands and Machine Learning" Authors: Chen,L.,Wang,Y., Liu, J. Published: 2020
  • 19. Automatic Speech Recognition • ASR can be categorised depending on various factors:
  • 20. Speech Recognition Techniques • The SR system combines three stages:
  • 21. Advancements in ASR Systems • ASR Using Deep Learning • Speech Emotion Recognition Systems • Development of Tools for High-Performance Speech Recognition Systems
  • 22. Applications of ASR Systems • Telecommunications Industry • Emotion Recognition • Healthcare Industry • Aviation Industry
  • 23. Challenges in ASR Systems • Variation in Accents • Children-centric Focus • Model Training • Noise
  • 24. –Rick Rashid “These devices will eventually replace paper print media. We are reaching a point in the future where any surface can be an interactive surface.”