Published on

Published in: Technology, Health & Medicine
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. MULTI-MODALRESEARCH 1 영상 스튜디오 강초희 김예지 조소영 김지영
  2. 2. ‘Electronic Telepathy’
  3. 3. ‘We shape our tools and thereafter our tools shape us.’ -Marshall McLuhan-
  4. 4. MODALITY Major Haptic OtherModalities Modalities Modalities Taste Seeing Touch Smell Hearing Proprioception Thermoception Nociception Equilibrioception Proprioception 고유 수용성 감각 (신체 위치, 자세, 평형 및 움직임에 대한 정보를 파악) Thermoception 온도 Nociception 통증수용 Equilibrioception 평형감각
  5. 5. MULTI-MODAL Input Input & Output‘accessibility’ ‘understanding’ Wikipedia_Multi-modal interaction
  6. 6. EVOLUTION OF USER INTERFACECLI Command GUI Graphic user NUINatural userline interface interface interface August de los Reyes_ Evolution of the user interface
  7. 7. HISTORY OF COMPUTER INTERFACE Brain-Computer Interface Augmented Reality Voice Recognition Force Feedback (Haptic) Gesture Sensing Multitouch Screen Touchpad MouseCommand line PAST PRESENT FUTURE April 6, 2009. Technology Review
  8. 8. TECHNOLOGYSPEECH RECOGNITION IMAGE RECOGNITION SENSOR3D Speech Image Touchrecognition Segmentation Laser finderSpeech synthesis Gesture Acceleration recognition RFID Pose recognition Biomedical Motion capture Signal VR/AR/MR EEG Haptic
  9. 9. Segmentation of senses AFFECTIVE HAPTICS Physiological changes Social touch Physical stimulation Emotional haptic designHeart beat rate, body temperature Hug, Handshake Tickling Shape of device, material, texture Wikipedia_Affective Haptics
  10. 10. Example of using affective haptics IFeelIM Wikipedia_Affective Haptics
  11. 11. What is the next?
  12. 12. Ultimate logical interfaceBRAIN COMPUTER INTERFACE
  13. 13. Ultimate logical interfaceBRAIN COMPUTER INTERFACE ?
  14. 14. Brain-computer Interface TYPES OF BCI EEG EMG fRMI Electroencephalography Electromyography function Magnetic Resonance ImagingMeasures electrical activity along the scalp Measures electrical potential generated by your muscles Visualize complex internal structure
  15. 15. Brain-computer Interface TYPES OF BCI Research Diagnosis Computer inputPhysiology of Brain death New toys , games Psychology Neurological User interface for those with mentalNeuroscience disorders disorders Neuromuscular disorders Poor motor skills
  16. 16. SOME EARLY RESEARCH READING MINDSHuman participants’ mental imaging(MRI) Cat vision mental imaging(invasive BCI)
  17. 17. How has it been applied? MEDICINE Physically handicappedControlling a familiar cursor-based interface with an invasive BCI
  18. 18. How has it been applied? TOY INDUSTRYThree point sensor headset Star Wars Force Trainer in use
  19. 19. How has it been applied? GAMING AND COMPUTING Emotiv Neuroheadsets
  20. 20. How has it been applied? SMARTPHONE APPLICATIONMake a phone call by thinking of the recipient instead of choosing one from a list
  21. 21. WHAT CAN WE EXPECT? True virtual realityBy sending signals both ways you could achieve a Matrix-like virtual reality
  22. 22. WHAT CAN WE EXPECT? Telepathic conversationCommunicate emotions, sensations and feelings without the baggage of language
  23. 23. WHAT CAN WE EXPECT? Deeper understanding of human thoughtLearning more about the science of the brain could bring huge advances in psychology By understanding how out brains work, we could develop similar computation
  24. 24. Ultimate logical interfaceBRAIN COMPUTER INTERFACE ?
  25. 25. Ultimate logical interfaceBRAIN COMPUTER INTERFACE Time...