MULTI-MODALRESEARCH 1  영상 스튜디오              강초희   김예지              조소영   김지영
‘Electronic Telepathy’
‘We shape our tools and thereafter our tools shape us.’                   -Marshall McLuhan-
MODALITY Major        Haptic                                  OtherModalities   Modalities                              Mo...
MULTI-MODAL   Input                        Input & Output‘accessibility’                   ‘understanding’                ...
EVOLUTION OF USER INTERFACECLI  Command                         GUI                          Graphic user                 ...
HISTORY OF COMPUTER INTERFACE                                                                                             ...
TECHNOLOGYSPEECH RECOGNITION   IMAGE RECOGNITION      SENSOR3D Speech            Image               Touchrecognition     ...
Segmentation of senses                                         AFFECTIVE HAPTICS      Physiological changes           Soci...
Example of using affective haptics              IFeelIM                                     Wikipedia_Affective Haptics
What is the next?
Ultimate logical interfaceBRAIN COMPUTER INTERFACE
Ultimate logical interfaceBRAIN COMPUTER INTERFACE         ?
Brain-computer Interface                                                                 TYPES OF BCI                EEG  ...
Brain-computer Interface                    TYPES OF BCI Research                   Diagnosis                  Computer in...
SOME EARLY RESEARCH READING MINDSHuman participants’ mental imaging(MRI)      Cat vision mental imaging(invasive BCI)
How has it been applied?               MEDICINE    Physically handicappedControlling a familiar cursor-based interface    ...
How has it been applied?                             TOY INDUSTRYThree point sensor headset                  Star Wars For...
How has it been applied? GAMING AND COMPUTING    Emotiv Neuroheadsets
How has it been applied?                         SMARTPHONE APPLICATIONMake a phone call by thinking of the recipient inst...
WHAT CAN WE EXPECT?                           True virtual realityBy sending signals both ways you could achieve a Matrix-...
WHAT CAN WE EXPECT?                          Telepathic conversationCommunicate emotions, sensations and feelings without ...
WHAT CAN WE EXPECT?                      Deeper understanding of human thoughtLearning more about the science of the brain...
Ultimate logical interfaceBRAIN COMPUTER INTERFACE          ?
Ultimate logical interfaceBRAIN COMPUTER INTERFACE  Time...
Multi-modal_1st_Research_ETstudio
Upcoming SlideShare
Loading in...5
×

Multi-modal_1st_Research_ETstudio

621

Published on

Published in: Technology, Health & Medicine
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
621
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Multi-modal_1st_Research_ETstudio

  1. 1. MULTI-MODALRESEARCH 1 영상 스튜디오 강초희 김예지 조소영 김지영
  2. 2. ‘Electronic Telepathy’
  3. 3. ‘We shape our tools and thereafter our tools shape us.’ -Marshall McLuhan-
  4. 4. MODALITY Major Haptic OtherModalities Modalities Modalities Taste Seeing Touch Smell Hearing Proprioception Thermoception Nociception Equilibrioception Proprioception 고유 수용성 감각 (신체 위치, 자세, 평형 및 움직임에 대한 정보를 파악) Thermoception 온도 Nociception 통증수용 Equilibrioception 평형감각
  5. 5. MULTI-MODAL Input Input & Output‘accessibility’ ‘understanding’ Wikipedia_Multi-modal interaction
  6. 6. EVOLUTION OF USER INTERFACECLI Command GUI Graphic user NUINatural userline interface interface interface August de los Reyes_ Evolution of the user interface
  7. 7. HISTORY OF COMPUTER INTERFACE Brain-Computer Interface Augmented Reality Voice Recognition Force Feedback (Haptic) Gesture Sensing Multitouch Screen Touchpad MouseCommand line PAST PRESENT FUTURE April 6, 2009. Technology Review
  8. 8. TECHNOLOGYSPEECH RECOGNITION IMAGE RECOGNITION SENSOR3D Speech Image Touchrecognition Segmentation Laser finderSpeech synthesis Gesture Acceleration recognition RFID Pose recognition Biomedical Motion capture Signal VR/AR/MR EEG Haptic
  9. 9. Segmentation of senses AFFECTIVE HAPTICS Physiological changes Social touch Physical stimulation Emotional haptic designHeart beat rate, body temperature Hug, Handshake Tickling Shape of device, material, texture Wikipedia_Affective Haptics
  10. 10. Example of using affective haptics IFeelIM Wikipedia_Affective Haptics
  11. 11. What is the next?
  12. 12. Ultimate logical interfaceBRAIN COMPUTER INTERFACE
  13. 13. Ultimate logical interfaceBRAIN COMPUTER INTERFACE ?
  14. 14. Brain-computer Interface TYPES OF BCI EEG EMG fRMI Electroencephalography Electromyography function Magnetic Resonance ImagingMeasures electrical activity along the scalp Measures electrical potential generated by your muscles Visualize complex internal structure
  15. 15. Brain-computer Interface TYPES OF BCI Research Diagnosis Computer inputPhysiology of Brain death New toys , games Psychology Neurological User interface for those with mentalNeuroscience disorders disorders Neuromuscular disorders Poor motor skills
  16. 16. SOME EARLY RESEARCH READING MINDSHuman participants’ mental imaging(MRI) Cat vision mental imaging(invasive BCI)
  17. 17. How has it been applied? MEDICINE Physically handicappedControlling a familiar cursor-based interface with an invasive BCI http://www.youtube.com/watch?v=NIG47YgndP8
  18. 18. How has it been applied? TOY INDUSTRYThree point sensor headset Star Wars Force Trainer in use
  19. 19. How has it been applied? GAMING AND COMPUTING Emotiv Neuroheadsets
  20. 20. How has it been applied? SMARTPHONE APPLICATIONMake a phone call by thinking of the recipient instead of choosing one from a list
  21. 21. WHAT CAN WE EXPECT? True virtual realityBy sending signals both ways you could achieve a Matrix-like virtual reality
  22. 22. WHAT CAN WE EXPECT? Telepathic conversationCommunicate emotions, sensations and feelings without the baggage of language
  23. 23. WHAT CAN WE EXPECT? Deeper understanding of human thoughtLearning more about the science of the brain could bring huge advances in psychology By understanding how out brains work, we could develop similar computation
  24. 24. Ultimate logical interfaceBRAIN COMPUTER INTERFACE ?
  25. 25. Ultimate logical interfaceBRAIN COMPUTER INTERFACE Time...

×