MULTIMODAL INTERFACE
• Multimodal interfaces are a class of intelligent multimedia systems
that make use of multiple and natural means of communication
(modalities), such as speech, handwriting, gestures, and gaze, to
support human-machine interaction.
• More specifically, the term modality describes human perception on
one of the three following perception channels: visual, auditive, and
tactile.
• Multimodality qualifies interactions that comprise more than one
modality on either the input (from the human to the machine) or the
output (from the machine to the human) and the use of more than
one device on either side (e.g., microphone, camera, display,
keyboard, mouse, pen, track ball, data glove).
https://www.researchgate.net/publication/268200735_O_An_Overview_of_Multimoda
l_Interaction_Techniques_and_Applications
Multimodal Interfaces as an Assistive
Technology
• People with disabilities (Permanent/Temporary)
– Visual Impaired
– Hearing impaired
– Colour blindness
– Motor and Cognitive disabilities
– Learning disabilities
– Elderly
– People with special needs
https://www.perkins.org/resource/9-ways-to-set-up-your-home-office-when-youre-blind-or-visually-impaired/
https://www.sciencedirect.com/science/article/pii/S1532046419301686
???
Reading Sources
http://humancarinteraction.com/multimodal-interaction.html
https://link.springer.com/chapter/10.1007/978-3-030-51968-
1_1
https://www.researchgate.net/publication/268200735_O_An
_Overview_of_Multimodal_Interaction_Techniques_and_App
lications
https://www.toptal.com/designers/ui/multimodal-design-
adobe-xd

KMU1053 Multimodal Interface Sem12021.pptx