Katherine Del Giudice Michelle K. Gardner University of Central Florida The Message of the Pensieve: Realizing Memories th...
What is a Pensieve? <ul><li>A Pensieve is a device that allows one to add “ e x cess thoughts from one’s mind . . . examin...
Lifelogging as an upcoming phenomenon Technology now enables users to capture (and store) every moment of their lives http...
A Muggle Pensieve
Inverse Surveillance
Hello YouTube!
Reality to Archive Experiments with wearable computing suggest it would be relatively easy to extend our experience-captur...
EEG Recording of Thoughts and Affective State
How can we make this data more ‘real’? Virtual reality gives us the potential to ‘play back’ our memories, given that we c...
What are the implications of this technology? Shifting perceptions of the self Over-reliance on memory-extending technolog...
References <ul><li>Innis, H. (1949). The bias of communication.  The Canadian Journal of Economics and Political Science, ...
References <ul><li>Neva, P. (2005). The Memory Place. Second Thoughts. Retrieved April 14, 2009  http://secondthoughts.typ...
Upcoming SlideShare
Loading in …5
×

Message of the Pensieve: Realizing Memories through the WWW and Virtual Reality

670 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
670
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • - In the magical world a wand is used to extract a gaseous fluid-like memory from ones brain and place that memory into the Pensieve. The wizard then leans into the Pensieve and ‘falls’ into the memory. Each memory is a complete 3 dimensional, objective display of the memory and the visiting wizard can then wander around within the memory. - If this idea is brought out of the magical world and into the muggle (non-magical) world, we would have the ability to not only share a memory but give the person the tools to immerse themselves into the memory to the extent that he/she could relive the experience.
  • Lifelogging as a phenomenon --------------------------------------------------------------------------------------------- - Steven Mann from MIT was the first person to log his life using wearable computing technology in the 1980s. He named his method “glogging”, short for cyborg-logs. Starting in 1994, Mann continuously transmitted his everyday life 24 hours a day, 7 days a week. - Gordon Bell is an experimental subject for Microsoft’s MyLifeBits software. He is currently creating a lifetime of memory storage. His memories exist as captured images, recorded audio, and every bit of data that he encounters in a day (letters, emails, books, etc.). Unlike Mann, his logs are limited to use only on his local computer. - Others have since jumped on the glogging, or ‘lifelogging’ phenomenon, employing wearable webcams and microphones to record everyday events. Some lifeloggers use their cell phone cameras as inexpensive logging devices. - There are over 20,000 lifeloggers already on the Web. You can find them at http: //glogger . mobi/
  • A surprising number of blogs called a Pensieve. Memory Palace - The idea of a memory palace as endorse by the Greeks and Thomas Aquinos is a palace you construct in your head that has room. In these rooms you store memory objects. The idea for instance if you have an oration to memorize, is you put memory trigger objects around the palace and as you ‘stroll through’ in your mind the objects you have associated with a particular portion of the text is easily recalled. Within a Virtual World like Second Life, the ability to create a ‘real’ memory palace is realized. For instance… I know of a house structure that was built within second life. The woman who built it was diagnosed with cancer and she created the building to explain her progress through the diases. When you walk into the first room a voices booms from somewhere” You have XYZ Cancer” as you progress through two stories up and down through some times convoluted areas there are rooms with moving MRI’s machines, chemo rooms, the wholle process. Once you go through the whole building you exit cancer free.I am sure building this was very theraputic for her but in doing so she created a Memory Palace that will always be there to remind her or educate others on the experience of being diagnosed with Cancer.
  • There is a flickr account called the panopticon - One group on flickr ョ , called the Panopticon, created the group with the sole purpose of documenting images of surveillance cameras, or in essence documenting those who document. This is a form of inverse surveillance (Mann, 2004b). Viewing of an event from several perspectives is possible by consolidating the multiple perspectives provided by individuals through photographs on flickr ョ or videos on YouTube. Each of these files records the event from the perspective of one individual and, when viewed collectively, acts as a Pensieve-like archive of the entire event. One recent example of this type of memory archive is the photographic record of the Obama presidential inauguration, in which hundreds of 2-D photographs from numerous independent viewers were combined form a 3-D view of the environment ( The 44 th President Inauguration, n.d.). Examples of this type of life examination and archiving pervade the Web and demonstrate the desire of users to share and combine digital memory records in the future.
  • Wearable Computing (capturing more data) ---------------------------------------------------------------------------------------------- - To create a truly Pensieve-like device, we need to incorporate more cues than just first-person video! We need to capture more data (body data, location data, data from other cameras in the environment, emotional and affective state data) to be able to re-create the experience virtually. - In the future, we could have a wearable camera that captures a 360 degree view of a scene. Our wearable computing devices might also interface with cameras elsewhere in the environment and other user’s cameras to capture parts of a scene we cannot immediately see from our location, allowing for a near-omniscient view of the scene much as the Pensieve does. - EEG headsets make it possible to record the wearer’s internal state, such as rudimentary emotions, thoughts, and potentially much more. - Body sensing technology could allow us to capture data about the user’s movement, level of engagement, and other bodily states. - Putting all this together, it might be possible to capture what the user sees, what they hear, what they are thinking, what they are feeling, and the surrounding context they are in.
  • How can we make these experiences more ‘real’? (VR) ---------------------------------------------------------------------------------------------- To create a truly immersive experience we will most likely need to transmit visual, auditory, olfactory, haptic, and perhaps even emotional or affective data to the user. Delivery vehicles could include a holodeck-like platform, similar to a CAVE environment, and other environments that would allow us to be completely immersed in the re-played memory, employing all the major senses. - The ultimate simulated reality memory experience may eventually be delivered through brain-computer interfaces, especially if we develop the ability to record experiences from inside the brain (EEG) instead of outside (eye and other senses). Theoretically, delivering the experience of memories from stimulation inside the brain would be indistinguishable from experiencing it yourself.
  • When viewing the memory of another individual, the incorporation of experiences by the engaged viewer into his/her concept of self is subject to personal misinterpretation, regardless of how objectively the data is captured. Consider for instance the idea of a physically challenged individual (e.g., wheelchair bound) as a lifelogger. Through immersion into this person’s memories, would a non-physically challenged individual be able to embody their experiences? Inscribing the concepts of being wheelchair bound onto the viewer is possible, but for a truly relational experience he/she would need at the least an immersive CAVE-like environment. Depending on the cognitive skills of the engaged individual, the ability to incorporate this altered life style is possible. we might become even more cognitively lazy than we already are. Gordon Bell has noted his tendency to neglect life in real-time as he comes to rely more and more on his digital store, essentially using his record as a second self On a societal level, there is the potential for misunderstandings brought about by the sharing of immersive virtual memories. One would initially think that being able to ‘live’ another’s experience would serve to increase understanding. However, immersive memory archives are likely to lead to misunderstandings and a biased interpretation of the archival record when viewed by non-participating individuals, despite an immersive physical experience of the event.
  • Message of the Pensieve: Realizing Memories through the WWW and Virtual Reality

    1. 1. Katherine Del Giudice Michelle K. Gardner University of Central Florida The Message of the Pensieve: Realizing Memories through the World Wide Web and Virtual Reality www.slideshare.net/MKGardner
    2. 2. What is a Pensieve? <ul><li>A Pensieve is a device that allows one to add “ e x cess thoughts from one’s mind . . . examine them at one’s leisure . . . [and] spot patterns and links . . . [better] when they are in this form.” (Rowling 597) </li></ul>
    3. 3. Lifelogging as an upcoming phenomenon Technology now enables users to capture (and store) every moment of their lives http://glogger.mobi
    4. 4. A Muggle Pensieve
    5. 5. Inverse Surveillance
    6. 6. Hello YouTube!
    7. 7. Reality to Archive Experiments with wearable computing suggest it would be relatively easy to extend our experience-capturing capabilities to collect even more data
    8. 8. EEG Recording of Thoughts and Affective State
    9. 9. How can we make this data more ‘real’? Virtual reality gives us the potential to ‘play back’ our memories, given that we can record them in sufficient detail
    10. 10. What are the implications of this technology? Shifting perceptions of the self Over-reliance on memory-extending technologies Memories open to interpretation by outsiders Do we really need a complete archive of everyday experience?
    11. 11. References <ul><li>Innis, H. (1949). The bias of communication. The Canadian Journal of Economics and Political Science, 15(4), 457-476. </li></ul><ul><li>Malamud, Carl. (2000) Memory Places: A Millennial Metaphor? Media.org Retrieved April 14, 2009 http://mappa.mundi.net/cartography/Palace/ </li></ul><ul><li>Mann, S., & Niedzviecki, H. (2001). Cyborg: Digital Destiny and Possibility in the Age of the Wearable Computer . Ontario: Anchor Canada. </li></ul><ul><li>Mann, S. (2004a, October 15). Continuous lifelong capture of personal experience with EyeTap. Proceedings of the First ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE) , New York: NY, 1-21. </li></ul><ul><li>Mann, S. (2004b, October 10-16). Sousveillance: Inverse surveillance in multimedia imaging. Proceedings of the 12 th Annual ACM International Conference on Multimedia . New York: NY, 620-627. </li></ul>
    12. 12. References <ul><li>Neva, P. (2005). The Memory Place. Second Thoughts. Retrieved April 14, 2009 http://secondthoughts.typepad.com/second_thoughts/2005/11/the_memory_pala.html. </li></ul><ul><li>Rabinow, Paul. (1984). The Foucault reader . New York: Random House. </li></ul><ul><li>Rowling, J.K. (2000). Harry Potter and the Goblet of Fire . New York: Scholastic. </li></ul><ul><li>The 44 th President Inauguration. (n.d.). Retrieved March 15, 2009, from: http://www.cnn.com/SPECIALS/2009/44.president/inauguration/themoment/. </li></ul><ul><li>Wesch, Michael. (2008). Address to the Library of Congress. An Antropological Introduction to YouTube. Washington DC. June 23, 2008. Uploaded to YouTube July 26, 2008. Retrieved November 27, 2008 < http://www.youtube.com/watch? v=TPAO-lZ4_hU > </li></ul>

    ×