Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Maps for Understanding VR & Reality: Kent Bye's ITC Keynote

1,392 views

Published on

These are the maps that I use to understand reality & virtual reality, but can also be used as experiential design frameworks. This is the keynote I gave at the Immersive Technology Conference in Houston, TX on Monday, November 6th, 2017.

Published in: Technology
  • Be the first to comment

Maps for Understanding VR & Reality: Kent Bye's ITC Keynote

  1. 1. Kent Bye, Voices of VR Podcast Consciousness Biology Psychology Physics Chemistry Ideal Forms
  2. 2. @KentBye
  3. 3. The Map is Not the Territory “The Map is not the Territory” by Claudio Gatti
  4. 4. © Francesco Franchi, 2013
  5. 5. What is the Ultimate Potential of Virtual Reality?
  6. 6. Kent Bye, Voices of VR Podcast
  7. 7. Kent Bye, Voices of VR Podcast
  8. 8. Left Brain Objective Quantitative Right Brain Subjective Qualitative
  9. 9. Lascaux Cave Paintings, Bradshaw Foundation, http://www.bradshawfoundation.com/lascaux/
  10. 10. Doc Searls - https://www.flickr.com/photos/docsearls/5500714140/
  11. 11. Phoenician Alphabet,Wikipedia
  12. 12. Left Brain Objective Quantitative Right Brain Subjective Qualitative
  13. 13. Virtual Reality is a Holistic Medium
  14. 14. Holism vs Reductionism Jacques deVaucanson's "Digesting Duck" 1739
  15. 15. Ken Wilber’s Integral Theory
  16. 16. Ken Wilber’s Integral Theory Right Brain Subjective Qualitative
  17. 17. Ken Wilber’s Integral Theory Right Brain Subjective Qualitative Left Brain Objective Quantitative
  18. 18. Gardner’s Multiple Intelligences hunterswritings.com
  19. 19. Kohlberg’s Moral Stages en.wikipedia.orgduenos.net
  20. 20. Spiral Dynamics Worldviews Formless Mountain “Spiral Dynamics: MasteringValues, Leadership and Change” by Don Beck & Christopher Cowan
  21. 21. Formless Mountain ©2008
  22. 22. Creates a Hierarchical Mindset rabbisacks.org
  23. 23. Reinforces the Cartesian Split
  24. 24. Yevgenia Nayberg, Beloit College Magazine
  25. 25. Green House Seed Co. Flavor Wheel www.sweetpeasmeals.com
  26. 26. Institute of Noetic Sciences
  27. 27. © Francesco Franchi, 2013
  28. 28. Fludd Robert, “The Mirror of the Whole of Nature and the Image of Art.“ (1617) Leibniz, Gottfried Wilhelm, Ars Combinatoria. (1690)
  29. 29. Leibniz, Gottfried Wilhelm, Ars Combinatoria. (1690)
  30. 30. Mental & Social Presence Active Presence Emotional Presence Embodied Presence
  31. 31. Mental & Social Presence Active Presence Emotional Presence Embodied Presence x •Choices •Communication •Mental Abstractions •Mental Friction (puzzles) •Natural Language Processing •Conversational Interfaces •Models of the Future •Cognitive Enhancement •Brain-Computer Interfaces •Social Interactions
  32. 32. Mental & Social Presence Active Presence Emotional Presence Embodied Presence •Agency •Gameplay Mechanics •Taking Action •Intuitive Interactions •Expression of Creativity •Exercise •Behaviors •Live Performance •Peripherals •Exploration •Interactive learning
  33. 33. Mental & Social Presence Active Presence Emotional Presence Embodied Presence •Sensory Perception •The Body •Embodied Cognition •Hand Presence •Avatar •Virtual Body Ownership Illusion •Haptics •Sensory Replacement •Biometric data •Body Language •Environmental Presence
  34. 34. Mental & Social Presence Active Presence Emotional Presence Embodied Presence x •Engaging Emotions •Story •Character •Color •Music & Rhythm •Cycles •Ambiance •Facial Tracking •Empathy •Symbols •Soul
  35. 35. Mental & Social Presence Active Presence Emotional Presence Embodied Presence
  36. 36. AirFire WaterEarth
  37. 37. Air Fire Water Earth
  38. 38. Thinking Agency Feeling Senses The Cone of Experience
  39. 39. Thinking Behavior Feelings Senses http://www.unique-design.net/library/word/subconscious.html
  40. 40. https://www.safaribooksonline.com/library/view/understanding-context/9781449326531/ch04.html
  41. 41. ThinkingIntuition FeelingSensing
  42. 42. Thinking Intuitive Feeling Sensing
  43. 43. Galen Temperaments Used in Waldorf Isidore de Séville, De Natura Rerum (On the Nature of Things) ©Waldorf Essentials.com 2014 - Melisa Nielsen - Artwork by Amber Hellewell
  44. 44. Gardner’s Multiple Intelligences http://questgarden.com/96/85/8/120318091157/images/
  45. 45. Cognitive & Social Intelligence Manipulative Intelligence Emotional Intelligence Perceptual Intelligence
  46. 46. Text From Information Age to Experiential Age
  47. 47. Pine II, B & H. Gilmore, James. (1998).Welcome to the Experience Economy. Harvard Business Review. 76. 97-105. Moving from Delivering intangible & customized SERVICES on-demand to To Staging memorable & personal EXPERIENCES that are revealed over a duration of time.
  48. 48. Welcome to the Experiential Age!
  49. 49. Text Using Elemental Theory for Experiential Design
  50. 50. Mental & Social Presence Active Presence Emotional Presence Embodied Presence
  51. 51. •What are the rules? •How can you connect? •What will you learn? •How can you participate? •What actions can you take? •What can you explore? •What emotions are invoked? •What’s the story? •What’s the vibe? •How are you immersed? •Who do you become? •Where do you go?
  52. 52. Active Presence
  53. 53. •Embodied Puzzle •Rule: Body Movement Moves Time •First-Person Shooter (Vanquishing Enemies) •Cinematics Between Levels (Context Switch to Story) •Embodied Gameplay •YOU ARE THE CONTROLLER! SUPERHOT
  54. 54. •Puzzle of where to punch•Exercise •FLOW STATES •Rhythm Game •Emotion of Music •Record your Embodied Movement & play it back. •Encourages Hemi-spheric Brain Synchronization Soundboxing
  55. 55. Flow States
  56. 56. •Chat with Users •In-Game Co-op Dialog •Performance •Live! (quality of the moment) •Watch people in peak performance FLOW states •Use Gaming as Quest •Authentically Express Emotion •Color Commentary Narration •Play Archetypal Characters •See the Body Language •Yin Currency of Donations Twitch.tv
  57. 57. Social & Mental Presence
  58. 58. •Social Meet-ups•Explore Worlds without teleporting •Emotional Transfer from interactions •World-Building by Users •Custom Avatars/Identity •Hand Movements VRChat
  59. 59. •Casual Social Play •Collaborative Games •Quiz Shows •Social Games & Activities •Quests •Create Your Own Game •Embodied Gameplay •Avatar Ready Room •Emotional Transfer from interactions Rec Room
  60. 60. •Solve Puzzle to Escape•Combine Objects •Narration Tips & Backstory•Escape Room I Expect You to Die
  61. 61. •Pull Information from Web •Ephemeral Experiences that don’t require an app •Cruise the Metaverse •Interconnected Worlds (Metcalfe’s Law) •Mobile Phone •Limited Embodiment •Location-Based Stories WebVR
  62. 62. Embodied Presence
  63. 63. •New Perspectives on Where You’ve Lived •Explore the World •Nostalgia of Memories •Awe & Wonder •Experience Architecture •Embodied Cognition •See Geography of Earth Google Earth
  64. 64. •Randomly Meet People •Play With/Against Friends •Physical Exercise (Dopamine) •Explore Physical World •Memories of Characters•Location-Based Game •AR is Window into World •Collecting Virtual Objects Pokémon Go
  65. 65. Mixed Reality Spectrum
  66. 66. Emotional Presence
  67. 67. •Decide Where to Look•Gaze Changes Experience •Great for Storytelling •Great for Empathy •Closest Analog to Film •Transported to Another Place •Not Volumetric (3DoF) •Great for Mobile Phones 360 Video
  68. 68. •Solve Puzzles •Lite Branching Decisions •3DoF Mobile Interactions •Volumetric Storytelling on Mobile •Great Writing •Lots of Humor •VR Incepted in VR •Limited Embodiment Virtual Virtual Reality
  69. 69. Text The Future of Storytelling is Immersive & Interactive
  70. 70. Authored Narrative Generative Narrative http://ffden-2.phys.uaf.edu/webproj/212_spring_2014/Abdel_Abouhaib/101559128653564b3256663/uploads/2/8/6/1/28617611/1047737_orig.jpg
  71. 71. Lebowitz, Josiah and Klug, Chris. "Interactive Storytelling forVideo Games." Focal Press. 2011 Authored Narrative Generative Narrative
  72. 72. Authored Narrative Generative Narrative http://www.kateforsyth.com.au/images/Blog%20January%202013/ThreeActStructureFlat.jpg
  73. 73. Authored Narrative Generative Narrative Riedl, Mark. "Incorporating Authorial Intent into Generative Narrative Systems," Association for the Advancement of Artificial Intelligence, 2009.
  74. 74. Authored Narrative Generative Narrative Chooseco LLC, Journey Under the Sea
  75. 75. Authored Narrative Generative Narrative https://i0.wp.com/www.raphkoster.com/wp-content/uploads/2013/04/CASlide7.jpg
  76. 76. Authored Narrative Generative Narrative Mateas, Michael. "Interactive Drama,Art, and Artificial Intelligence." PhDThesis.Technical Report CMU-CS-02-206. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, December 2002.
  77. 77. Authored Narrative Generative Narrative Emily Short, Spirit AI, Game Developers Conference “Narrative Innovation Showcase” 2017.
  78. 78. Mental & Social Presence Active Presence Emotional Presence Embodied Presence
  79. 79. TextWhat is Reality?
  80. 80. Dualism & Materialism
  81. 81. Idealism & Panpsychism
  82. 82. • Are virtual objects real or fictional? • Do virtual events really happen or not? • Are virtual experiences non-illusory or illusory? • Are experiences in VR as valuable or not as valuable as experiences outside of it? David Chalmers’ Virtual Realism
  83. 83. Biology Physics Chemistry Psychology Consciousness? Materialism
  84. 84. • Virtual objects are fictional. • Virtual events do not really happen. • Virtual experiences are illusory. • Experiences in VR are not as valuable as experiences outside of it. Chalmers’ Virtual Irrealism
  85. 85. Transcendental Idealism Chemistry Consciousness Biology Psychology Physics
  86. 86. • Virtual objects are real. • Virtual events do really happen. • Virtual experiences are non-illusory. • Experiences in VR are as valuable as experiences outside of it. Chalmers’ Virtual Realism
  87. 87. Mathematical Universe Hypothesis
  88. 88. Pythagoreanism Consciousness Biology Psychology Physics Chemistry Mathematics
  89. 89. Neo-Platonism Consciousness Biology Psychology Physics Chemistry Ideal Forms
  90. 90. Camille Flammarion‘s L‘atmosphère: météorologie populaire, 1888
  91. 91. Panpsychism Biology Psychology Physics Chemistry Consciousness
  92. 92. What is Conscious? Tarnas, Richard. (2006). Cosmos and Psyche: Intimations of a new world view. New York: Viking.
  93. 93. TextReality Turing Test
  94. 94. The Map is Not the Territory “The Map is not the Territory” by Claudio Gatti
  95. 95. @KentBye Questions?
  96. 96. Text Extra Slides
  97. 97. Koestler's Holon: Simultaneously Whole & Part
  98. 98. Individuals are Holons within a Culture & Society
  99. 99. Yang Yin Competition Walled Garden Curated Content Vertical-Integration Proprietary App Store Cooperation Open Ecosystem No Gatekeepers Horizontal Platform Shared Source Code Open Access
  100. 100. Rogers, Everett. Diffusion of Innovations. Free Press, 1962. via Wikipedia.org Rogers’ Diffusion of Innovation Model
  101. 101. Moore, Geoffrey. "Crossing the Chasm: Marketing and Selling High-Tech Products to Mainstream Customers" HarperBusiness, 1991 Graphic via https://blog.prototypr.io/design-for-crossing-the-chasm-1c4d4c68a3f1 “Crossing the Chasm” into the Mainstream
  102. 102. http://www.bradshawfoundation.com/lascaux/ Wardley’s Model of Technology Evolution Wardley, Simon (2015). http://blog.gardeviance.org/2015/03/evolution-diffusion-hype-cycle-and.html
  103. 103. S-Curve Technology Evolution https://ideagenius.com/the-s-curve-pattern-of-innovation-a-full-analysis/
  104. 104. Is Paradigm Diffusion Similar to Technology Diffusion?
  105. 105. Kuhn: Paradigm Shifts Catalyzed by Anomalies Kuhn, Thomas S. 1996. The structure of scientific revolutions. Chicago, IL: University of Chicago Press. Graphics via http://faculty.humanities.uci.edu/bjbecker/revoltingideas/week1d.html & https://www.slideshare.net/MarkReynolds44/2016-0419-machine-learning
  106. 106. Worldviews & Paradigms are Ontologies with Epistemologies http://blogs.warwick.ac.uk/cesphd/entry/researchers_paradigm/
  107. 107. https://www.reddit.com/r/GetMotivated/comments/3fqudm/image_first_they_ignore_you/ We Naturally Resist Change
  108. 108. Scott, Cynthia D. & Dennis T. Jaffe (1988). “Survive and Thrive in Times of Change,” Training and Development Journal, April. Graphic via https://www.pocketbook.co.uk/blog/tag/dennis-jaffe/ Scott & Jaffe’s Change Grid Starts with Deny & Resist
  109. 109. Inman, Matthew. (May 2, 2017). "You're not going to believe what I'm about to tell you." The Oatmeal Comic. Retrieved from http://theoatmeal.com/comics/believe The Oatmeal Comic on the Backfire Effect
  110. 110. Hegelian Dialectic: Thesis, Antithesis, Synthesis
  111. 111. Is Paradigm Diffusion Similar to Technology Diffusion?
  112. 112. Kent Bye, Voices of VR Podcast Consciousness Biology Psychology Physics Chemistry Ideal Forms

×