Download as PDF, PPTX
![Social Panoramas (ISMAR 2014)
• Capture and share social spaces in real time
• Supports independent views into Panorama
Reichherzer, C., Nassani, A., & Billinghurst, M. (2014, September). [Poster] Social panoramas using
wearable computers. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium
on (pp. 303-304). IEEE.](https://image.slidesharecdn.com/chiuxid2016-160414221331/85/From-Interaction-to-Empathy-38-320.jpg)
Uploaded byMark Billinghurst
From Interaction to Empathy
The document discusses advancements in empathic computing and interface technology, emphasizing the importance of shared understanding and connected networks in enhancing user interactions. It highlights various technologies such as augmented reality and wearable devices designed to foster empathy through experience sharing and emotional recognition. Future research directions are suggested, focusing on scaling experiences to broader populations and improving collaborative technologies.
More Related Content
Similar to From Interaction to Empathy
From Interaction to Empathy
- 1. FROM INTERACTION TOEMPATHY: NEW DIRECTIONS IN INTERFACE TECHNOLOGY Mark Billinghurst mark.billinghurst@unisa.edu.au April 14th 2016 CHIuXiD 2016 Conference Jakarta, Indonesia
- 3. How did thatwork? How could I get a whole room of people clapping together with no instruction? Clear goal Simple feedback Well connected network Everyone understood each other Successful crowd-sourced behaviour
- 4. Computing Evolution • Changein interface over time -> new challenges for design
- 5. Interface Design forthe Future • Key topics • Feedback • Connected Networks • Shared Understanding Single user Connected communities
- 6.
- 7. Interaction Technology Natural Time Punch Card Keyboard Mouse Speech Gesture Emotion 1950 19601980 1990 2000 2010 Thought
- 8.
- 9. Interaction Technology Natural Time Punch Card Keyboard Mouse Speech Gesture Emotion 1950 19601980 1990 2000 2010 Thought Implicit Explicit
- 10. Content Capture Realism Time Photo Film Live Video Panorama 360 Video 3DSpace 1850 1900 1940 1990 2000 2010
- 11. 3D Image/Space Capture GoogleProject TangoSamsung Project Beyond
- 12. Content Capture Realism Time Photo Film Live Video Panorama 360 Video 3DSpace 1850 1900 1940 1990 2000 2010 2D Static Immersive Live Experience
- 13. Networking Speeds Log (b/s) Time 100b/s 10 Kb/s 1 Mb/s 1980 1985 1990 1995 2000 2010 100 Mb/s 2005
- 14.
- 15. Networking Speeds Log (b/s) Time 100b/s 10 Kb/s 1 Mb/s 1980 1985 1990 1995 2000 2010 100 Mb/s 2005 Text Audio Natural Video
- 16. Holoportation • Augmented Reality+ 3D capture + high bandwidth • http://research.microsoft.com/en-us/projects/holoportation/
- 17.
- 18.
- 19.
- 20.
- 21. Empathy “Seeing with theEyes of another, Listening with the Ears of another, and Feeling with the Heart of another..” Alfred Adler
- 22. Empathic Computing 1. Understanding:Systems that can understand your feelings and emotions 2. Experiencing: Systems that help you better experience the world of others 3. Sharing: Systems that help you better sharing the feelings of others
- 23. Understanding: Affective Computing • RosPicard – MIT Media Lab • Systems that recognize emotion
- 24. Appliances That MakeYou Happy • Jun Rekimoto – University of Tokyo/Sony CSL • Smile detection + smart appliances
- 25.
- 26. Experiencing: Virtual Reality "Virtualreality offers a whole different medium to tell stories that really connect people and create an empathic connection." Nonny de la Peña http://www.emblematicgroup.com/
- 27. Hunger • Experience ofhomeless waiting in food line https://www.youtube.com/watch?v=wvXPP_0Ofzc
- 28. CHILDHOOD • Kenji Suzuki,University of Tsukuba • What does it feel like to be a child? • VR display + moved cameras + hand restrictors
- 29.
- 30. Sharing Can we developsystems that allow us to share what we are seeing, hearing and feeling with others?
- 31.
- 32.
- 34.
- 35. Using AR/Wearables forEmpathy • Remove technology barriers • Enhance communication • Change perspective • Share experiences • Enhance interaction in real world
- 36. Example: Google Glass • Camera+ Processing + Display + Connectivity • Ego-Vision Collaboration (But with FixedView)
- 37. Current Collaboration onWearables • Firstperson remote conferencing/hangouts • Limitations • Single POV, no spatial cues, no annotations, etc
- 38. Social Panoramas (ISMAR2014) • Capture and share social spaces in real time • Supports independent views into Panorama Reichherzer, C., Nassani, A., & Billinghurst, M. (2014, September). [Poster] Social panoramas using wearable computers. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on (pp. 303-304). IEEE.
- 39. Implementation • Google Glass • Capture liveimage panorama (compass + camera) • Remote device (tablet) • Immersive viewing, live annotation
- 40.
- 41.
- 42. Lessons Learned • Good • Communication easyand natural • Users enjoy have view independence • Sharing panorama enhances the shared experience • Bad • Difficult to support equal input • Need to provide better awareness cues
- 43. CoSense (CHI 2015) • Realtime sharing - Emotion, video, and audio • Wearable (send emotion) –> Desktop (remote view) Google Glasse-Health 2.0 board + Ayyagari, S. S., Gupta, K., Tait, M., & Billinghurst, M. (2015, April). Cosense: Creating shared emotional experiences. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (pp. 2007-2012). ACM.
- 44. Implementation Data Capture Feature Detection EmotionRecognition Emotion Representation Empathic User Interface Hardware User Interface
- 45. Wearable Interface • Google Glass+ e-Health + Spydroid + SSI • Measure GSR, pulse oxygen, ECG, voice pitch • Share video and audio remotely • Representative emotions sent back to Glass user ! !
- 46.
- 47.
- 48. Lessons Learned • Good • System waswearable • Sender and receiver mirrored emotion • Minimal cues provided best experience • Bad • System delays • Need for good stimulus • Difficult to represent emotion
- 49. Empathy Glasses (CHI2016) • Combine together eye-tracking, display, face expression • Impicit cues – eye gaze, face expression ++ Pupil Labs Epson BT-200 AffectiveWear Masai, K., Sugimoto, M., Kunze, K., & Billinghurst, M. (2016, May). Empathy Glasses. In Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM.
- 50. AffectiveWear – EmotionGlasses • Photo sensors to recognize expression • User calibration • Machine learning • Recognizing 8 face expressions
- 51. Integrated System • Local User • Videocamera • Eye-tracking • Face expression • Remote Helper • Remote pointing
- 52. System Diagram • Twomonitors on Remote User side • Scene + Emotion Display
- 53.
- 54. Lessons Learned • Pointing reallyhelps in remote collaboration • Makes remote user feel more connected • Gaze looks promising • shows context of what person talking about • More work needed on emotion/expression cues • Limitations • Limited implicit cues • Two separate displays • Task was a poor emotional trigger • AffectiveWear needs improvement
- 55.
- 56. Looking to theFuture
- 57. Scaling Up • Seeing actionsof millions of users in the world • Augmentation on city/country level
- 58. AR + SmartSensors + Social Networks • Track population at city scale (mobile networks) • Match population data to external sensor data • Mine data for applications
- 59. Example: MIT SENSEableCity Lab http://senseable.mit.edu/wikicity/rome/
- 60. Example: CSIRO WeFeelTool • Emotionally mining global Twitter feeds • http://wefeel.csiro.au
- 61.
- 62. Conclusions • Empathic Computing • Sharing whatyou see, hear and feel • AR/Wearables Enables Empathic Experiences • Removing technology • Changing perspective • Sharing space/experience • Many directions for future research
- 63.