03 multi sensory design

684 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
684
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
27
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

03 multi sensory design

  1. 1. Multi sensory designMINOR EXPERIENCEEMOTIONS
  2. 2. Kan Martine Redert NU de klas verlaten?
  3. 3. Kunnen deze twee even naarbuiten?
  4. 4. Attentie
  5. 5. Multi sensory designMINOR EXPERIENCEEMOTIONS
  6. 6. Real life multimodal use Sequential: Exclusive-Sequential use of modalities that are not linked together in the same task. For example, recording speech and then closing all the unnecessary windows with a mouse. Sequential: AlternateThe use of modalities is sequential, but they are linked together in the same task. For example, pointing an object with a mouse and giving a voice command to copy it. Parallel: ConcurrentThe use of modalities is parallel, but they are not linked together. Usually the hardest kind of multimodal systems, but may result in a better efficiency with some training. For example, driving a car while speaking in a mobile phone Parallel: SynergisticThe use of modalities is parallel and they are linked together. For example, pointing and speech command at the same time.[Nigay and Coutaz]
  7. 7. Multimodal versus Multimedia Multimodal systems use more than one sense/mode of interaction e.g. visual and aural senses: a text processor may speak the words as well as printing them to the screen Multimedia systems use a number of different media to communicate information e.g. an e-learning system may use video, animation, text and still images and use speech and non-speech Interaction with these systems The combination of human output channels effectively increases the bandwidth of the human- machine channel (e.g., Oviatt, 1999)
  8. 8. “Bandwith” in computer game historyExamplestext based adventuresadding graphicsprintSound and space3 d space3d audiohaptic
  9. 9. Multimodal output-Visual: Text, pictures, signs, color-Audio: Verbal, non-verbal, signals-Olfactory: Smell-Haptic (combination of movement and tactile)
  10. 10. Signs
  11. 11. Signs (sound)
  12. 12. Taal van GeluidVanuit Film en Tekenfilm is er een“geluidstaal” ontstaan, waar rekening mee gehouden moet worden...http://www.youtube.com/watch?v=7EeE2kWkFqA&fmt=18http://www.youtube.com/watch?v=AQPSb2Piznk
  13. 13. Beeld en Geluid kunnen-Informatie aanvullen-ontkrachten-emoties “versterken”http://www.youtube.com/watch?v=9blFYZArEwA&fmt=18
  14. 14. Mismatch?http://www.youtube.com/watch?v=YO_CHjjOoGg&fmt=18http://www.youtube.com/watch?v=hnhwXyVLG_E&fmt=18
  15. 15. Smell
  16. 16. HapticHaptic torch
  17. 17. Synchronisation and spaceexample
  18. 18. Multimodalinteraction and multisenory feedback can exert significant cognitive demands on users. Attention isselective and has limited capacity. Short term memory also has limitations. Consider human ability when designingthe interface, essential for control and learning affordancesClassic exampleConfusion...
  19. 19. Questions?...Any? Who dares?

×