The NeuroPsychology of Presence

Slide 1: The Neuropsychology of Presence Giuseppe Riva, Ph.D. Department of Psychology Università Cattolica Applied Technology for del Sacro Cuore, Milan, Italy Neuro-Psychology Lab. ATN-P Lab. Istituto Auxologico Italiano, Milan, Italy http://www.emergingcommunication.com http://www.e-psychology.net E-mail: auxo.psylab@auxologico.it http://www.ambientintelligence.org Giuseppe Riva, PhD 1 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 2: Summary This presentation will focus on:  The concept of presence:  How it is born and its technology background;  Its different faces;  The difficulties experienced;  What we already know.  A new vision of the concept of presence based on the latest neuropsychological theories and development:  Its meaning for the development of VR applications for rehabilitation:  A layered sense of presence;  The focus on the final application.  To deepen this vision: two free books (PDF)  http://www.emergingcommunication.com/volume5.html  http://www.emergingcommunication.com/volume8.html Giuseppe Riva, PhD 2 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 3: The background What do people do at work? They go to meetings. How do we deal with meetings? What is it about sitting face to face that we need to capture? We need software that makes it possible to hold a meeting with distributed participants -- a meeting with interactivity and feeling, such that, in the future, people will prefer being telepresent. Bill Gates, 1999 Giuseppe Riva, PhD 3 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 4: The background The biggest challenge to developing telepresence is achieving that sense of “being there.” Can telepresence be a true substitute for the real thing? Will we be able to couple our artificial devices naturally and comfortably to work together with the sensory mechanisms of human organisms? Marvin Minsky, 1980 Giuseppe Riva, PhD 4 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 5: What is presence? • The sense of ‘being there’ (Held & Durlach, Sheridan, Zeltzer: premier issue of PRESENCE, 1992) • ‘A perceptual illusion of nonmediation’ (Lombard and Ditton, 1997) • ‘A mental state in which a user feels physically present within the computer-mediated environment’ (Draper & Kaber, 1998) • ‘The subjective experience of being in one place or environment, even when one is physically situated in another’ (Witmer & Singer, 1998) Giuseppe Riva, PhD 5 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 6: Why presence is important? • In our application we have to focus more on the quality of graphics or to the quality of interaction ?; • What is the best effort/performance ratio for VR in different application ?: – In VR for surgical simulation is more important the quality of graphics or the realism of the interaction? => I have to invest more on a graphic card or on some haptic device? – How much effort I have to spend in the development of 3D models => more polygons are better? Giuseppe Riva, PhD 6 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 7: The origin of presence • Telepresence research (1971-1980) Local Remote Physica Physica l l Space Space Giuseppe Riva, PhD 7 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 8: The origin of presence Virtual Physica Space l Space • In this position the key goal of VR is to reproduce real world: the more is accurate the reproduction, the more you are present => Quality of graphics is a must Giuseppe Riva, PhD 8 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 9: Is this true? What is better (Slater, 2004)? => Static vs dynamic Stereoscopic vs 2D Immersive vs non Immersive Tracking vs Mouse Meaningful vs Boring Giuseppe Riva, PhD 9 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 10: Being There: the efforts Creating the sense of presence is a major challenge and is leading to the development of new interdisciplinary research combining • cognitive psychology, • haptic (sense of touch) studies, • computer graphics and multimedia design, • advanced communication theory and socio- cultural issues • communication technologies. Giuseppe Riva, PhD 10 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 11: VR SYSTEMS THE USER REPRESENTATION VR - RENDER VR - DISPLAYS Visual Visual Visual SENSORY ORGANS Aural Aural Aural Haptic Haptic Haptic Other Other Other INPUT DEVICES Augmented Reality VIRTUAL WORLD REAL WORLD Giuseppe Riva, PhD 11 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 12: VR SYSTEMS INPUT USER MONITORING (USER INPUT TO THE VIRTUAL WORLD) Head Hands & Fingers Eyes Temperature Torso Perspiration Feet Heart Rate Other: Electromagnetic Respiration Rate Position Direct Mechanical Emotional State Optical Brain Waves Body Tracking SENSORS Tracking Videometric Ultrasonic Inertial Indirect Orientation Neural Props Platforms Buttons Switches Sliders Physical Controls Valuators Dial Physical Input Prop Devices Platforms Ring Platform Kiosk Platform Ambulatory Platform Vehicle Platform (Cockpit) Stationary VR Display Platform Giuseppe Riva, PhD 12 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 13: VR SYSTEMS OUTPUT VISUAL DISPLAYS VISUAL (Alcaniz, 2004) TYPES • Stationary Displays Monitor Based (Fishtank) VR Projection VR • Head Based Displays Occlusive HMD Nonoclusive HMD ( See- Through ) • Hand Based Displays Palm VR Giuseppe Riva, PhD 13 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 14: VR SYSTEMS OUTPUT VISUAL DISPLAYS VISUAL PROPERTIES • Visual Presentation VISUAL DEPTH CUES Color Spatial Resolution Contrast • Monoscopic Image Depth Cues Brightness Interposition Number of Display Channels Shading Focal Distance Size Opacity Masking Linear Perspective Field of View Surface Texture Gradient Field of Regard Height in the Visual Field Head Position Information Atmospheric Effects Graphics Latency Tolerance Brightness Temporal Resolution (Frame Rate) • Logistic • Stereoscopic Image Depth Cues User Mobility (Stereopsis) Interface with Tracking Methods Environment Requirements • Motion Depth Cues Associability with Other Sense Displays Portability Throughput • Physiological Depth Cues Encumbrance Accommodation Safety Cost Converge Giuseppe Riva, PhD 14 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 15: VR SYSTEMS OUTPUT AURAL DISPLAYS AURAL (Alcaniz, 2004) PROPERTIES • Visual Presentation Number of Display Channels Sound Stage Localization Masking AURAL LOCALIZATION CUES Amplification LOCALIZATION SPATIALIZATION • Logistic Noise Pollution User Mobility Interface with Tracking Methods Environment Requirements Associability with Other Sense Displays Portability Throughput Encumbrance Safety Cost Giuseppe Riva, PhD 15 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 16: VR SYSTEMS OUTPUT HAPTIC DISPLAYS HAPTIC (Alcaniz, 2004) TYPES • Tactile Haptic Displays Actuators • End-Effector Displays • Robotically Operated Displays Giuseppe Riva, PhD 16 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 17: Being There: The holy grail • A final theory of presence - emerging through this interdisciplinary research - should explore the cognitive and affective roots of sensory perception, consciousness and self. • This theory could allow the design of innovative systems that offer "richer" experiences than any current media and communication technologies. • However, this is not an easy task. Giuseppe Riva, PhD 17 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 18: Book Problem: Low immersion > High presence Same Problem, Different Faces (Biocca, 2003): Physical-Reality Problem: Failure to account High immersion > for: Moderate Presence •Mental Imagery, •Attention and •Emotions Dream State Problem: High immersion > Moderate Presence Giuseppe Riva, PhD 18 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 19: Presence: The holy grail Giuseppe Riva, PhD 19 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 20: Presence: the efforts Moreover, we have different “presences” (Riva et al., 2004): • Physical presence refers to the sense of being physically located in mediated space; • Social presence refers to the feeling of being together, of social interaction with a virtual or remotely located communication partner. • At the intersection of these two categories, we can then identify Co-presence or a sense of being together in a shared space, combining significant characteristics of both physical and social presence. Giuseppe Riva, PhD 20 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 21: Presence: the efforts Giuseppe Riva, PhD 21 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 22: Presence: What we know • There is consensus that the experience of presence is a complex, multidimensional perception, formed through an interplay of raw (multi-)sensory data and various cognitive processes – an experience in which attentional factors play a crucial role as well. • Two categories of variables can determine a user's presence: (i) media characteristics, and (ii) user characteristics. Giuseppe Riva, PhD 22 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 23: Presence: What we know • Characteristics of the medium can be subdivided into media form and media content variables. • Both of these are known to have a significant impact on the individual’s sense of presence such that, depending on the levels of appropriate, rich, consistent, and captivating sensory stimulation, varying levels of presence can be produced. Giuseppe Riva, PhD 23 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 24: Presence: What we know • About the characteristics of the users we also know that an important role is played by the context in which the user is in. • Presence is always mediated by both physical (our body, technological devices, etc.) and conceptual (expectations, roles, etc.) tools (ARTIFACTS), that belong to a given culture: we have to develop synthetic environments in which actors may function in an ecologically valid way easily identifying what they have to do. Giuseppe Riva, PhD 24 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 25: Presence Summary (EMMA project, 2004) FACTORS CONTRIBUTING TO PRESENCE Slater and Usoh (1993) EXTERNAL FACTORS INTERNAL FACTORS STRUCTURAL ASPECTS PSYCHOLOGICAL ASPECTS COMMON PROCESSES INDIVIDUAL DIFFERENCES EMOTIONS “Psychology is the physics of VR in the sense that the virtual environment is manufactured towards creating a cognitive state” (R. Lauria, 1997) Giuseppe Riva, PhD 25 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 26: The holy grail • Evolutionary feasibility: – Presence shifts must predate all media. – Mechanisms must serve other cognitive functions. • Psycho-neurological plausibility. • Cross-media generalizability: – Should use same mechanisms to explain all shifts in presence both mediated and non-mediated. Giuseppe Riva, PhD 26 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 27: Our attempt Recent research in neuroscience has tried to understand human action from two different but converging perspectives: the cognitive and the volitional. • On one side, cognitive studies analyze how action is planned and controlled in response to environmental conditions. • On the other side, volitional studies analyze how action is planned and controlled by subject’s needs, motives and goals. In our vision (Riva et al., 2006) we suggest that presence is the missing link between these two approaches. Giuseppe Riva, PhD 27 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 28: Presence as selection mechanism (1) • Specifically we consider presence as a selective neuropsychological phenomenon, evolved from the interplay of our biological and cultural inheritance, whose goal is the enaction of the volition of the self: presence is the non mediated (prereflexive) perception of successful intentions in action. • The model makes sense in terms of evolutionary psychology and is beginning to be supported by evidence of the neural and other physical correlates of action, imitation and self-monitoring. Giuseppe Riva, PhD 28 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 29: Presence as selection mechanism (2) • Presence is described here as a defining feature of the nervous system able to solve a key problem for its survival: how to differentiate between internal and external intentions. • In other words, it is presence that transforms intentionality – the ability to recognize purposeful actions – into the ability of producing an intention – the agent’s mental state that drives such actions. • The presence process can be described as a sophisticated but unconscious form of monitoring of action and experience, transparent to the self but critical for its existence. Giuseppe Riva, PhD 29 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 30: Presence as selection mechanism (3) • At the neural level, recent research indicates that the insula and the right inferior parietal cortex may be crucial in distinguishing the self from the other. • Activation in the right inferior parietal lobe is found in reciprocal imitation. Similarly, activation of the right inferior parietal lobe correlates with the subjective sense of ownership in action execution. • Further, mentally simulating the actions of another person results in activation in the right inferior parietal cortex. The main experiential outcome of this process is the sense of agency: we feel that we are both the author and the owner of our own action. Giuseppe Riva, PhD 30 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 31: Presence as selection mechanism (4) • Here we argue that is the feeling of presence that provides to the self feedback about the status of its activity: the self perceives the variations in the feeling of presence and tunes its activity accordingly. • This is achieved through a : during self-produced actions a sensory simulative forward model prediction of the outcome of the action is produced along with the actual motor command. • The results of the comparison (which occurs at a sub-personal level) between the sensory prediction and the sensory consequences of the act can then be used to determine both the agent of the action and to track any possible variation in its course. • If no variations are perceived, the self is able to concentrate on the action and not on its monitoring. Giuseppe Riva, PhD 31 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 32: Why is presence a distinct psychological process ? Recently the observation of mirror neurons has lead to the suggestion that there is not only a rich representation of motor action but also that this representation is used for multiple purposes: action execution, action planning, action imaging, and action recognition. Of particular importance is the observation that one agent can recognise an action plan of another one and that the same neurons are involved. Giuseppe Riva, PhD 32 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 33: Why is presence a distinct psychological process ? Mirror neurons and canonical neurons provide neural mechanisms for the centrality of observation and imitation in the ontogeny and phylogeny of the learning and transmission of cultural tool systems. BUT we need Presence to differentiate between: • The real act of doing something; • Its mental representation. Without this basic distinction imitation and learning is totally impossible Giuseppe Riva, PhD 33 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 34: Embodiment and Cognition • Maturana & Varela’s (1980, 1987) definition of autopoietic systems: A living system is an autopoietic machine whose function it is to create and maintain the unity that distinguishes it from the medium in which it exists. • Lakoff & Johnson (1980, 1999) argued that abstract concepts are based on metaphors grounded in bodily experience/activity. Giuseppe Riva, PhD 34 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 35: Embodiment and Cognition • These vision support a shift from: – the traditional cognitive theories of selfhood assuming that self and personal identity are wholly mind-based, – to an embodied approach. • This new approach, headed by recent work from Damasio, finds in the evolution of the central nervous system the origin of the self. Giuseppe Riva, PhD 35 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 36: Presence as selection mechanism Presence as feeling of being in an external world Giuseppe Riva, PhD 36 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 37: A layered self According to Damasio, self is a layered concept: the proto self: a coherent collection of neural patterns that map, moment by moment, the physical state of the organism; the core self: a transient entity which is continuously generated through encounters with objects; • the autobiographical self: a systematic record of the more invariant properties that the organism has discovered about itself. Giuseppe Riva, PhD 37 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 38: Presence as layered process • In particular we hypothesize that is possible to associate a specific layer of presence with each of the three levels of self identified by Damasio. – Self versus non-self (proto presence) – Self versus present external world (core presence) – Self relative to present external world (extended presence) • Given that each layer of presence solves a peculiar facet of the internal/external world separation, it is characterized by specific properties. Giuseppe Riva, PhD 38 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 39: First layer: Proto Presence • The evolutionary goal of the proto self is to predict the characteristics of the external world as it is experienced through sensorial inputs. • Proto presence is an embodied presence related to the level of perception-action coupling (self vs. non-self): the more the organism is able to couple correctly perceptions and movements, the more it differentiates itself from the external world, thus increasing its probability of surviving. Giuseppe Riva, PhD 39 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 40: Second layer: Core Presence • The evolutionary goal of the core self is the integration of specific sensory occurrences into single percepts. • We can define the core presence as the activity of selective attention made by the self on perceptions: the more the organism can focus on its sensorial experience by leaving in the background the remaining neural processes, the more it can identify the present moment and its current tasks, rising its probability of surviving. Giuseppe Riva, PhD 40 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 41: Third layer: Extended Presence • The evolutionary goal of extended self is the shift from meaning-as-comprehensibility to meaning-as-significance. • The role of extended presence is to verify the significance (“Relevance”, Sperber and Wilson, 1995) of the experience for the self: • The more the self is present in significant experiences, the more he will be able to reach its goals, augmenting its possibility of surviving. Giuseppe Riva, PhD 41 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 42: The Mental States of Presence Giuseppe Riva, PhD 42 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 43: In Summary (1) • Proto Presence => perception-action coupling (tracking/interface system) • Core Presence => vividness and immersion (quality of virtual experience) • Extended Presence => meaning (attractiveness of the experience for the goals of the subject) Giuseppe Riva, PhD 43 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 44: In Summary (2) • A media may influence only some layers: – In a compelling book reading only extended consciousness is involved, – and with a movie experience we can modify both core presence and extended presence but not proto presence. – Only in immersive virtual reality all the three layers of presence are modified by the media experience. • We suggest that this gives immersive VR a privileged status as a medium for meaningful experiences. Giuseppe Riva, PhD 44 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 45: In summary (3) • The importance of a layer is related to the goal of the VR esperience: – Seeing: core presence is critical (vividness and immersiveness); – Navigation/Exploration: both proto presence (perception/action coupling) and core presence; – Interaction: core presence and extended presence (meaning) are critical; – Communication: extended presence is the most relevant. Giuseppe Riva, PhD 45 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 46: Conclusions (1) This approach has three corollaries: • in real world the level of presence is not the same in all the situations. • there are exceptional situations in real life that have the highest possible level of presence. In these situations all the three layers are activated. • it should be possible to design mediated situations that elicit exceptionally high presence. Giuseppe Riva, PhD 46 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 47: Conclusions (2) • To optimize experienced presence in virtual environments we must design in a way that integrates the three layers of presence. • We need to provide as much immersion as possible, integrating proto (spatial) and core (sensory) presence. But if what is happening is not of interest or importance to the individual, the layers of presence will not be integrated and presence will be relatively weak: the situations experienced in the virtual environment must have immediate significance for the participant. Giuseppe Riva, PhD 47 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 48: Being There: More tips here • This book is an attempt to help designer and researchers in approaching this field, by developing a better understanding of how a real sense of presence can be achieved. • It involves learning and discovering what is going on when people use their senses to understand and interpret their surrounding environment and when they interact with objects in that environment. Giuseppe Riva, PhD 48 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 49: Being There: The book structure • For the complexity of the discussed topic, we have put a great deal of thought and effort in the definition of the structure of the book and the sequence of the contributions. • To this end we have divided the book in four main Sections comprising 21 chapters overall: 1. Presence: Past, Present and Future; 2. Presence: Theory and Methods; 3. Presence in Practice: Applications; 4. Social Presence: Creating a Common Ground. Giuseppe Riva, PhD 49 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 50: Being There: The approach • As noted by Frank Biocca in the Introduction (pp. I-II): “As Munsterberg, McLuhan, Bricken and others have envisioned, presence is about how the mind “perceives” reality, not the reality itself; not physics, but psychology; the extended mind, the place where experience, technology, and psychology meet… As interface design makes clear, a cyclotron of the mind can only be created by perfectly simulating the medium of the mind, the body, or what McLuhan called the extended senses. ” Giuseppe Riva, PhD 50 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 51: Being There: 1. Past, Present and Future • In Chapter 1, IJsselsteijn and Riva present the forms of the experience of “being there” in a mediated environment by discussing different types of presence: physical presence, social presence and co-presence. • IJsselsteijn in Chapter 2 provides an historical review of the development of cinema, television, telerobotics and virtual environments in search for the roots of the concept of presence in today’s media technology. Giuseppe Riva, PhD 51 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 52: Being There: 1. Past, Present and Future • Davide and Walker, starting from the analysis of the techniques used by artists, try to outline in Chapter 3 a four-stage strategy for engineering presence using virtual environments. • Chapter 4 by Riva, Loreti, Lunghi, Vatalaro and Davide, shows how the significant advances in virtual environments, mobile communication and sensors/biosensors, allow the emergence of a new vision: the Ambient Intelligence. Giuseppe Riva, PhD 52 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 53: Being There: 2. Theory and Methods • Main focus of Chapter 5 by Marsh is the discussion of an activity-based approach to the analysis and design of interactive mediated environments. • In the chapter 6 by Gamberini and Spagnolli, the authors analyze the relationship between presence In the proposed perspective, user’s presence is taken to emerge from the actions performed, and usability is referred to the complex object created by the situated interaction with the simulation. Giuseppe Riva, PhD 53 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 54: Being There: 2. Theory and Methods • In Chapter 7, Insko makes a review of subjective, behavioral and physiological methods to measure presence, discussing their use in the field, advantages and disadvantages. • Gaggioli, Bassi and Delle Fave present in Chapter 8 a theoretical and methodological approach to the study of presence focusing on the analysis of the quality of experience associated with the virtual environments. Giuseppe Riva, PhD 54 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 55: Being There: 2. Theory and Methods • The chapter by Zhao (Chapter 9) differentiates two basic modes of mediated presence, remote presence and virtual presence, through the use of the metaphor of “being there”. Giuseppe Riva, PhD 55 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 56: Being There: 3. Applications • Chapter 10 by Davies, Rydberg, Mitchell, Hornyansky, Dalhom and Nichols focuses on the role played by presence in mixed reality for participatory design. • In chapter 11 by Mantovani F. and Castelnuovo, the role of the sense of presence in Virtual Training Environments is explored. The relationship between sense of presence and training efficacy is also discussed. Giuseppe Riva, PhD 56 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 57: Being There: 3. Applications • Da Bormida and Lefrere discuss in Chapter 12 three forms of mobile-supported user presence: ‘anticipatory user presence’, ‘super- real presence’ and ‘retrospective presence’. • The persuasive effects of presence in immersive virtual environments are the topic covered by Grigorovici in Chapter 13. Possible applications in entertainment VR, e- marketing, advertising, public or health communication are also discussed. Giuseppe Riva, PhD 57 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 58: Being There: 3. Applications • Chapter 14 by Farshchian deals with the analysis of presence technologies for supporting informal collaboration, by investigating existing presence applications designed to support informal collaboration, • Waterworth and Waterworth in Chapter 15 present an approach to presence focused on its role in eliciting creativity. They provide an example of a novel immersive environment – the Interactive Tent – and an artistic production within it – The Illusion of Being. Giuseppe Riva, PhD 58 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 59: Being There: 3. Applications • Chapter 16 by Hofmann and Bubb reports the concept and results of an empirical study that explored presence in industrial virtual environment applications. The work analyzed the effects of immersion and pictorial realism on the sense of presence in the virtual environment. Giuseppe Riva, PhD 59 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 60: Being There: 4. Social Presence • In Chapter 17, Cottone and Mantovani G. discuss the importance of creating a “common ground” and support to co-reference in distant learning in order to enhance social presence and the situation awareness. • Chapter 18 by Markopoulos, IJsselsteijn, Huijnen, Romijn and Philopoulos discusses research carried out to understand the requirements of elderly for informal social telecommunication media that may be addressed through awareness technologies. Giuseppe Riva, PhD 60 Valencia Helsinki Embodiment and Presence 25-26 March 2006 IST 2003 http://www.ambientintelligence.org

Slide 61: Being There: 4. Social Presence • In chapter 19, Heeter, Gregg, Climo, Biocca and Dekker present findings from case studies focusing on the use of Tel