Maps for Understanding VR & Reality: Kent Bye's ITC Keynote

1. Kent Bye, Voices of VR Podcast Consciousness Biology Psychology Physics Chemistry Ideal Forms

2. @KentBye

3. The Map is Not the Territory “The Map is not the Territory” by Claudio Gatti

4. © Francesco Franchi, 2013

5. What is the Ultimate Potential of Virtual Reality?

6. Kent Bye, Voices of VR Podcast

7. Kent Bye, Voices of VR Podcast

8. Left Brain Objective Quantitative Right Brain Subjective Qualitative

9. Lascaux Cave Paintings, Bradshaw Foundation, http://www.bradshawfoundation.com/lascaux/

10. Doc Searls - https://www.ﬂickr.com/photos/docsearls/5500714140/

11. Phoenician Alphabet,Wikipedia

12. Left Brain Objective Quantitative Right Brain Subjective Qualitative

13. Virtual Reality is a Holistic Medium

14. Holism vs Reductionism Jacques deVaucanson's "Digesting Duck" 1739

15. Ken Wilber’s Integral Theory

16. Ken Wilber’s Integral Theory Right Brain Subjective Qualitative

17. Ken Wilber’s Integral Theory Right Brain Subjective Qualitative Left Brain Objective Quantitative

18. Gardner’s Multiple Intelligences hunterswritings.com

19. Kohlberg’s Moral Stages en.wikipedia.orgduenos.net

20. Spiral Dynamics Worldviews Formless Mountain “Spiral Dynamics: MasteringValues, Leadership and Change” by Don Beck & Christopher Cowan

22. Creates a Hierarchical Mindset rabbisacks.org

23. Reinforces the Cartesian Split

24. Yevgenia Nayberg, Beloit College Magazine

25. Green House Seed Co. Flavor Wheel www.sweetpeasmeals.com

26. Institute of Noetic Sciences

27. © Francesco Franchi, 2013

28. Fludd Robert, “The Mirror of the Whole of Nature and the Image of Art.“ (1617) Leibniz, Gottfried Wilhelm, Ars Combinatoria. (1690)

29. Leibniz, Gottfried Wilhelm, Ars Combinatoria. (1690)

30. Mental & Social Presence Active Presence Emotional Presence Embodied Presence

31. Mental & Social Presence Active Presence Emotional Presence Embodied Presence x •Choices •Communication •Mental Abstractions •Mental Friction (puzzles) •Natural Language Processing •Conversational Interfaces •Models of the Future •Cognitive Enhancement •Brain-Computer Interfaces •Social Interactions

32. Mental & Social Presence Active Presence Emotional Presence Embodied Presence •Agency •Gameplay Mechanics •Taking Action •Intuitive Interactions •Expression of Creativity •Exercise •Behaviors •Live Performance •Peripherals •Exploration •Interactive learning

33. Mental & Social Presence Active Presence Emotional Presence Embodied Presence •Sensory Perception •The Body •Embodied Cognition •Hand Presence •Avatar •Virtual Body Ownership Illusion •Haptics •Sensory Replacement •Biometric data •Body Language •Environmental Presence

34. Mental & Social Presence Active Presence Emotional Presence Embodied Presence x •Engaging Emotions •Story •Character •Color •Music & Rhythm •Cycles •Ambiance •Facial Tracking •Empathy •Symbols •Soul

36. AirFire WaterEarth

37. Air Fire Water Earth

38. Thinking Agency Feeling Senses The Cone of Experience

39. Thinking Behavior Feelings Senses http://www.unique-design.net/library/word/subconscious.html

40. https://www.safaribooksonline.com/library/view/understanding-context/9781449326531/ch04.html

41. ThinkingIntuition FeelingSensing

42. Thinking Intuitive Feeling Sensing

43. Galen Temperaments Used in Waldorf Isidore de Séville, De Natura Rerum (On the Nature of Things) ©Waldorf Essentials.com 2014 - Melisa Nielsen - Artwork by Amber Hellewell

44. Gardner’s Multiple Intelligences http://questgarden.com/96/85/8/120318091157/images/

45. Cognitive & Social Intelligence Manipulative Intelligence Emotional Intelligence Perceptual Intelligence

46. Text From Information Age to Experiential Age

47. Pine II, B & H. Gilmore, James. (1998).Welcome to the Experience Economy. Harvard Business Review. 76. 97-105. Moving from Delivering intangible & customized SERVICES on-demand to To Staging memorable & personal EXPERIENCES that are revealed over a duration of time.

48. Welcome to the Experiential Age!

49. Text Using Elemental Theory for Experiential Design

51. •What are the rules? •How can you connect? •What will you learn? •How can you participate? •What actions can you take? •What can you explore? •What emotions are invoked? •What’s the story? •What’s the vibe? •How are you immersed? •Who do you become? •Where do you go?

52. Active Presence

53. •Embodied Puzzle •Rule: Body Movement Moves Time •First-Person Shooter (Vanquishing Enemies) •Cinematics Between Levels (Context Switch to Story) •Embodied Gameplay •YOU ARE THE CONTROLLER! SUPERHOT

54. •Puzzle of where to punch•Exercise •FLOW STATES •Rhythm Game •Emotion of Music •Record your Embodied Movement & play it back. •Encourages Hemi-spheric Brain Synchronization Soundboxing

55. Flow States

56. •Chat with Users •In-Game Co-op Dialog •Performance •Live! (quality of the moment) •Watch people in peak performance FLOW states •Use Gaming as Quest •Authentically Express Emotion •Color Commentary Narration •Play Archetypal Characters •See the Body Language •Yin Currency of Donations Twitch.tv

57. Social & Mental Presence

58. •Social Meet-ups•Explore Worlds without teleporting •Emotional Transfer from interactions •World-Building by Users •Custom Avatars/Identity •Hand Movements VRChat

59. •Casual Social Play •Collaborative Games •Quiz Shows •Social Games & Activities •Quests •Create Your Own Game •Embodied Gameplay •Avatar Ready Room •Emotional Transfer from interactions Rec Room

60. •Solve Puzzle to Escape•Combine Objects •Narration Tips & Backstory•Escape Room I Expect You to Die

61. •Pull Information from Web •Ephemeral Experiences that don’t require an app •Cruise the Metaverse •Interconnected Worlds (Metcalfe’s Law) •Mobile Phone •Limited Embodiment •Location-Based Stories WebVR

62. Embodied Presence

63. •New Perspectives on Where You’ve Lived •Explore the World •Nostalgia of Memories •Awe & Wonder •Experience Architecture •Embodied Cognition •See Geography of Earth Google Earth

64. •Randomly Meet People •Play With/Against Friends •Physical Exercise (Dopamine) •Explore Physical World •Memories of Characters•Location-Based Game •AR is Window into World •Collecting Virtual Objects Pokémon Go

65. Mixed Reality Spectrum

66. Emotional Presence

67. •Decide Where to Look•Gaze Changes Experience •Great for Storytelling •Great for Empathy •Closest Analog to Film •Transported to Another Place •Not Volumetric (3DoF) •Great for Mobile Phones 360 Video

68. •Solve Puzzles •Lite Branching Decisions •3DoF Mobile Interactions •Volumetric Storytelling on Mobile •Great Writing •Lots of Humor •VR Incepted in VR •Limited Embodiment Virtual Virtual Reality

69. Text The Future of Storytelling is Immersive & Interactive

70. Authored Narrative Generative Narrative http://ffden-2.phys.uaf.edu/webproj/212_spring_2014/Abdel_Abouhaib/101559128653564b3256663/uploads/2/8/6/1/28617611/1047737_orig.jpg

71. Lebowitz, Josiah and Klug, Chris. "Interactive Storytelling forVideo Games." Focal Press. 2011 Authored Narrative Generative Narrative

72. Authored Narrative Generative Narrative http://www.kateforsyth.com.au/images/Blog%20January%202013/ThreeActStructureFlat.jpg

73. Authored Narrative Generative Narrative Riedl, Mark. "Incorporating Authorial Intent into Generative Narrative Systems," Association for the Advancement of Artiﬁcial Intelligence, 2009.

74. Authored Narrative Generative Narrative Chooseco LLC, Journey Under the Sea

75. Authored Narrative Generative Narrative https://i0.wp.com/www.raphkoster.com/wp-content/uploads/2013/04/CASlide7.jpg

76. Authored Narrative Generative Narrative Mateas, Michael. "Interactive Drama,Art, and Artiﬁcial Intelligence." PhDThesis.Technical Report CMU-CS-02-206. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, December 2002.

77. Authored Narrative Generative Narrative Emily Short, Spirit AI, Game Developers Conference “Narrative Innovation Showcase” 2017.

79. TextWhat is Reality?

80. Dualism & Materialism

81. Idealism & Panpsychism

82. • Are virtual objects real or ﬁctional? • Do virtual events really happen or not? • Are virtual experiences non-illusory or illusory? • Are experiences in VR as valuable or not as valuable as experiences outside of it? David Chalmers’ Virtual Realism

83. Biology Physics Chemistry Psychology Consciousness? Materialism

84. • Virtual objects are ﬁctional. • Virtual events do not really happen. • Virtual experiences are illusory. • Experiences in VR are not as valuable as experiences outside of it. Chalmers’ Virtual Irrealism

85. Transcendental Idealism Chemistry Consciousness Biology Psychology Physics

86. • Virtual objects are real. • Virtual events do really happen. • Virtual experiences are non-illusory. • Experiences in VR are as valuable as experiences outside of it. Chalmers’ Virtual Realism

87. Mathematical Universe Hypothesis

88. Pythagoreanism Consciousness Biology Psychology Physics Chemistry Mathematics

89. Neo-Platonism Consciousness Biology Psychology Physics Chemistry Ideal Forms

90. Camille Flammarion‘s L‘atmosphère: météorologie populaire, 1888

91. Panpsychism Biology Psychology Physics Chemistry Consciousness

92. What is Conscious? Tarnas, Richard. (2006). Cosmos and Psyche: Intimations of a new world view. New York: Viking.

93. TextReality Turing Test

94. The Map is Not the Territory “The Map is not the Territory” by Claudio Gatti

95. @KentBye Questions?

96. Text Extra Slides

97. Koestler's Holon: Simultaneously Whole & Part

98. Individuals are Holons within a Culture & Society

99. Yang Yin Competition Walled Garden Curated Content Vertical-Integration Proprietary App Store Cooperation Open Ecosystem No Gatekeepers Horizontal Platform Shared Source Code Open Access

100. Rogers, Everett. Diffusion of Innovations. Free Press, 1962. via Wikipedia.org Rogers’ Diffusion of Innovation Model

101. Moore, Geoffrey. "Crossing the Chasm: Marketing and Selling High-Tech Products to Mainstream Customers" HarperBusiness, 1991 Graphic via https://blog.prototypr.io/design-for-crossing-the-chasm-1c4d4c68a3f1 “Crossing the Chasm” into the Mainstream

102. http://www.bradshawfoundation.com/lascaux/ Wardley’s Model of Technology Evolution Wardley, Simon (2015). http://blog.gardeviance.org/2015/03/evolution-diffusion-hype-cycle-and.html

103. S-Curve Technology Evolution https://ideagenius.com/the-s-curve-pattern-of-innovation-a-full-analysis/

104. Is Paradigm Diffusion Similar to Technology Diffusion?

105. Kuhn: Paradigm Shifts Catalyzed by Anomalies Kuhn, Thomas S. 1996. The structure of scientiﬁc revolutions. Chicago, IL: University of Chicago Press. Graphics via http://faculty.humanities.uci.edu/bjbecker/revoltingideas/week1d.html & https://www.slideshare.net/MarkReynolds44/2016-0419-machine-learning

106. Worldviews & Paradigms are Ontologies with Epistemologies http://blogs.warwick.ac.uk/cesphd/entry/researchers_paradigm/

107. https://www.reddit.com/r/GetMotivated/comments/3fqudm/image_ﬁrst_they_ignore_you/ We Naturally Resist Change

108. Scott, Cynthia D. & Dennis T. Jaffe (1988). “Survive and Thrive in Times of Change,” Training and Development Journal, April. Graphic via https://www.pocketbook.co.uk/blog/tag/dennis-jaffe/ Scott & Jaffe’s Change Grid Starts with Deny & Resist

109. Inman, Matthew. (May 2, 2017). "You're not going to believe what I'm about to tell you." The Oatmeal Comic. Retrieved from http://theoatmeal.com/comics/believe The Oatmeal Comic on the Backﬁre Effect

110. Hegelian Dialectic: Thesis, Antithesis, Synthesis

111. Is Paradigm Diffusion Similar to Technology Diffusion?

112. Kent Bye, Voices of VR Podcast Consciousness Biology Psychology Physics Chemistry Ideal Forms