UXD Multimedia output

  • 427 views
Uploaded on

 

More in: Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
427
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
6
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1.
    • Kan Janneke even de klas verlaten?
  • 2. Kunnen deze twee even naar buiten?
  • 3. Attentie
  • 4. Multimodal output
  • 5. Real life multimodal use
    • Sequential: Exclusive
    • -Sequential use of modalities that are not linked together in the same task. For example, recording speech and then closing all the unnecessary windows with a mouse.
    • Sequential: Alternate
    • The use of modalities is sequential, but they are linked together in the same task. For example, pointing an object with a mouse and giving a voice command to copy it.
    • Parallel: Concurrent
    • The use of modalities is parallel, but they are not linked together. Usually the hardest kind of multimodal systems, but may result in a better efficiency with some training. For example, driving a car while speaking in a mobile phone
    • Parallel: Synergistic
    • The use of modalities is parallel and they are linked together. For example, pointing and speech command at the same time.
    • [Nigay and Coutaz]  
  • 6. Multimodal versus Multimedia
    • Multimodal systems use more than one sense/mode of interaction e.g. visual and aural senses: a text processor may speak the words as well as printing them to the screen
    • Multimedia systems use a number of different media to communicate information e.g. an e-learning system may use video, animation, text and still images and use speech and non-speech
    • Interaction with these systems The combination of human output channels effectively increases the bandwidth of the human-machine channel (e.g., Oviatt, 1999)
  • 7. “ Bandwith” in computer game history
    • Examples
    • text based adventures
    • adding graphics
    • print
    • Sound and space
    • 3 d space
    • 3d audio
    • haptic
  • 8. Multimodal output
    • -Visual: Text, pictures, signs, color
    • -Audio: Verbal, non-verbal, signals
    • -Olfactory: Smell
    • -Haptic (combination of movement and tactile)
  • 9. Signs
  • 10. Signs (sound)
  • 11. Smell
  • 12.  
  • 13. Haptic
    • Haptic torch
  • 14. Synchronisation and space
    • example
  • 15. Multimodal interaction and multisenory feedback can exert significant cognitive demands on users. Attention is selective and has limited capacity. Short term memory also has limitations. Consider human ability when designing the interface, essential for control and learning affordances 
    • Classic example
    • Convention communication
    • Confusion...
  • 16. Questions?...
    • Any? Who dares?