Multimodal Explained Sameer

798 views

Published on

the slide shows what is achievable in multimodal field using current technologies.

Published in: Design
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
798
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
22
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Multimodal Explained Sameer

  1. 1. communication perception motor cognition <ul><li>Receive information through – </li></ul><ul><li>5 human Senses and Perception </li></ul><ul><ul><li>vision </li></ul></ul><ul><ul><li>Sound </li></ul></ul><ul><ul><li>Tactile feedback </li></ul></ul><ul><ul><li>Taste </li></ul></ul><ul><ul><li>Smell </li></ul></ul><ul><li>Take action on information </li></ul><ul><li>Gesture input </li></ul><ul><li>Two-handed input </li></ul><ul><li>Speech and NL </li></ul><ul><li>Body position, orientation, and gaze </li></ul><ul><li>Process Information </li></ul><ul><li>Spatial memory </li></ul><ul><li>Cognitive chunking </li></ul><ul><li>Attention </li></ul><ul><li>Curiosity </li></ul><ul><li>Time Constants </li></ul>Human can interact using - Simultaneous Multimodal Interaction / Natural Interactions - until 2010 Computers can take input from- Computers produce output using- © SameerChavan.com All rights reserved Human Process Step-1 Step-2 Step-3 Voice Speech Gestures Touch-Less 3D hand Gestures Body & Face Gesture Gaze Tactile Tactile Direct manipulation Touch Gestures voice Natural language Touch Gestures Single and multi Picture Recognition Hand gestures Body, Gaze, Face recognition Sensors Motion, Compass, Pressure, temperature Direct manipulation Typing, hardware buttons Sound Sound tones, music, noise, Graphical display Text , Images, Motion Videos Haptics Localized vibrations and tones Physical deformation Change shape, movements

×