Your SlideShare is downloading. ×
0
Tailoring the Adaptive Augmented Reality (A²R) Museum Visit:  Identifying Cultural Heritage Professionals Motivations and ...
How can we improve the AR museum visiting experience ?                                 Dr Areti Damala, Dr Nenad Stojanovi...
Plan of the presentation        The ARtSENSE project              Adaptive Augmented Reality: Main components             ...
Augmented Reality Supported adaptive andpersonalized Experience in a museum based onprocessing real-time Sensor EventsEuro...
Consortium Partners                                 Dr Areti Damala, Dr Nenad Stojanovic     Tailoring the A²R Museum Visi...
Cultural Heritage Partners   An Art and Design museum       The National Museum of Decorative Arts, Madrid, Spain (MNAD)  ...
From AR to A²R: The ARtSENSE approach             Visual                               Audio                              ...
From AR to A²R: A Theoretical Framework“Human users need to be treated as centers, immersed in ARinterfaces, rather than a...
From AR to A²RAdaptive Augmented Reality =Visual + Acoustic + Affective Monitoring andAugmentationVision bears the heavies...
From AR to A²R    Adaptive Augmented Reality = Visual + Acoustic + Affective    Monitoring and AugmentationMusée des arts ...
From AR to A²RAdaptive Augmented Reality = Visual + Acoustic + AffectiveMonitoring and Augmentation Cognitive Engagement  ...
ARtSENSE: System Architecture Overview                                 Dr Areti Damala, Dr Nenad Stojanovic     Tailoring ...
Design ChallengesFor the CH professionals    Understand the potential of the technology       Difficult to express needs a...
Design challenges: Creating the third space…Questions and issues to resolve  What is the potential of AR for the museum vi...
Design challenges: Creating the third space…A Multi-layered, participatory design approachMuseum visitors  On site, inobtr...
Design challenges: Creating the third space…Technical partners  Immersion in the sensitive museum ecology  Collaboration e...
Rendering visible the invisible    Observing and comprehending artifacts from    multiple viewpointsMNAD, Spain           ...
Identifying motivations and needs: MNAD,Madrid, Spain • Museo Nacional de Artes Decorativas, Madrid, Spain • 3000 objects ...
Motivations and needs: MNAD, Madrid, Spain1.  Observing artefacts from multiple viewpoints2.  Open hidden compartments3.  ...
MNAD Selected Exhibit                                                   Jorge 3D audio kitchenLate 18th century tiled kitc...
Gaze Tracking                            Dr Areti Damala, Dr Nenad StojanovicTailoring the A²R Museum Visit: Identifying C...
3D Audio spatialization The woman is speaking directly to me. Her voice comes from her head.                              ...
Motivations and needs: MAM, Paris,France• Musée des arts et métiers, Paris, France• 4.000 objects displayed, approximately...
Identifying motivations and needs: MAM,France, Paris  1. Reveal and assist visitors visualize complex physical     phenome...
Activation of Right Hemisphere                                                                               Negative affe...
Motivations and needs: FACT, Liverpool,UK  • Leading organisation for the    development, support and exhibition    of fil...
Motivations and needs: FACT, Liverpool,UK1. Encourage different interpretations of the   idea of an artifact2. Present non...
FACT selected artifact                                                VIP Signature Pillar                                ...
FACT, Liverpool, UK: Artwork commissionto Manifest.AR1.   Implication of the International Artists Collective Manifest.AR2...
Conclusions• From “designing for” to “designing with”• One step back, two steps forward?• First impression = life circle o...
The potential of A²R for Art and CulturalHeritage• Visual monitoring and augmentation as important as audio and affective ...
Thank you for your attention!                      Questions?                                 www.artsense.eu             ...
Upcoming SlideShare
Loading in...5
×

ISMAR 2012: Tailoring the Adaptive Augmented Reality (A²R) Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs

7,089

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
7,089
On Slideshare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
31
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "ISMAR 2012: Tailoring the Adaptive Augmented Reality (A²R) Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs"

  1. 1. Tailoring the Adaptive Augmented Reality (A²R) Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs The 11th IEEE International Symposium on Mixed and Augmented Reality Museums and Theater Session Atlanta, Georgia, USA Wednesday, November 7th 2012 Dr Areti DAMALA, Dr Nenad STOJANOVICCentre d’Etude et de Recherche en Informatique et Communications (CEDRIC) Conservatoire National des Arts et Métiers (CNAM), Paris, France & Forschungszentrum Informatik Karlsruhe (FZI), Karlsruhe, Germany
  2. 2. How can we improve the AR museum visiting experience ? Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  3. 3. Plan of the presentation The ARtSENSE project Adaptive Augmented Reality: Main components Theoretical background System Architecture Design challenges within a Cultural Heritage context A multi-layered and participatory design approach Identifying main motivations and needs Conclusions and directions for future work Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  4. 4. Augmented Reality Supported adaptive andpersonalized Experience in a museum based onprocessing real-time Sensor EventsEuropean Union co-funded project36 months durationwww.artsense.euSee, hear, feel, experience! Dr Areti Damala, Dr Nenad StojanovicTailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  5. 5. Consortium Partners Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  6. 6. Cultural Heritage Partners An Art and Design museum The National Museum of Decorative Arts, Madrid, Spain (MNAD) A History of Science and Technology museum The National Museum of the History of Science and Technology, Paris, France (MAM) A Contemporary Gallery and New Media Arts Center Foundation for Art and Creative Technology, Liverpool, UK (FACT) Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  7. 7. From AR to A²R: The ARtSENSE approach Visual Audio Bio 1. Visual Monitoring and Augmentation 2. Acoustic Monitoring and Augmentation 3. Affective Monitoring and Augmentation Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  8. 8. From AR to A²R: A Theoretical Framework“Human users need to be treated as centers, immersed in ARinterfaces, rather than as viewers, seeing interfaces or graphicaloverlays”Guidelines1. Center the human participant2. Consider the idea of sound as much as the idea of sight3. Acknowledge that human participants move, think and existsimultaneously [Pedersen, 2009] Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  9. 9. From AR to A²RAdaptive Augmented Reality =Visual + Acoustic + Affective Monitoring andAugmentationVision bears the heaviest responsibility among allsenses. In a CH context: Linking the signifier withthe signified Stedelijk AR(t): Jan RothuizenFine Arts Museum, Rennes, France Street Museum, Museum of London, UK Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  10. 10. From AR to A²R Adaptive Augmented Reality = Visual + Acoustic + Affective Monitoring and AugmentationMusée des arts et métiers, Paris, France [Kaghat et al., 2011] Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  11. 11. From AR to A²RAdaptive Augmented Reality = Visual + Acoustic + AffectiveMonitoring and Augmentation Cognitive Engagement Attention Knowledge Acquisition Emotion Activation/Stimulation Positive Affect Negative Affect Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  12. 12. ARtSENSE: System Architecture Overview Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  13. 13. Design ChallengesFor the CH professionals Understand the potential of the technology Difficult to express needs as AR scenarios Understand how it works Apply the AR potential in the design phase Emerging technologies = inedited design challenges No established design guidelines No standardized AR displays Conceive and create content for the AR application Evaluate and test the learning materials to be delivered& AR and A²R challenges Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  14. 14. Design challenges: Creating the third space…Questions and issues to resolve What is the potential of AR for the museum visit? What is the look and feel of AR displays? How can A²R can be exploited? Which are the possible narratives and scenarios that can bedeveloped? Early design process, open to: Technical partners CH professionals New Media Artists Museum visitors Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  15. 15. Design challenges: Creating the third space…A Multi-layered, participatory design approachMuseum visitors On site, inobtrusive observations of museum visits Participatory observations of guided visits Inobtrusive observations of creative workshopsCH professionals Brainstorming sessions Interviews Testing of several AR displays in the museum environment and gesture interactiontests Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  16. 16. Design challenges: Creating the third space…Technical partners Immersion in the sensitive museum ecology Collaboration exercises among technical and CH partnersNew Media Artists Collaboration of the Consortium with the International Artists’collective Manifest.AR Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  17. 17. Rendering visible the invisible Observing and comprehending artifacts from multiple viewpointsMNAD, Spain FACT, UK MAM, France Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  18. 18. Identifying motivations and needs: MNAD,Madrid, Spain • Museo Nacional de Artes Decorativas, Madrid, Spain • 3000 objects in the permanent exhibition, ca 30.000 visitors per year • Spanish decorative arts: pottery, glass, textiles, carpets, jewellery, furniture, oriental collections (especially Chinese), avant-garde european and contemporary design • Representative of History of Art, Design and Decorative Art museums Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  19. 19. Motivations and needs: MNAD, Madrid, Spain1. Observing artefacts from multiple viewpoints2. Open hidden compartments3. Contextualize4. Facilitate the comparison of objects dispersed in different collections5. Linking with non exposed objects6. Linking with other objects of the collection(Compare “parallels”) Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  20. 20. MNAD Selected Exhibit Jorge 3D audio kitchenLate 18th century tiled kitchen from Valencia Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  21. 21. Gaze Tracking Dr Areti Damala, Dr Nenad StojanovicTailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  22. 22. 3D Audio spatialization The woman is speaking directly to me. Her voice comes from her head. Position 1 Position 2 Position 3 Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  23. 23. Motivations and needs: MAM, Paris,France• Musée des arts et métiers, Paris, France• 4.000 objects displayed, approximately 250.000 visitors per year• A University museum• The French National Museum of the History of Science and Technology Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  24. 24. Identifying motivations and needs: MAM,France, Paris 1. Reveal and assist visitors visualize complex physical phenomena 2. Seeing the machines working again 3. Creating sound-scapes, reconstructing sounds (intangible cultural heritage) 4. Historical context surrounding the invention Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  25. 25. Activation of Right Hemisphere Negative affect/avoidance Activation of Left Hemisphere Positive affect/approachMAM Selected ExhibitThe Lavoisier Laboratory and the synthesis of water (1743-1794) Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  26. 26. Motivations and needs: FACT, Liverpool,UK • Leading organisation for the development, support and exhibition of film, video, new and emerging media (established in 1989) • 300.000 entries per year • Non-existence of a permanent, physical exhibition Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  27. 27. Motivations and needs: FACT, Liverpool,UK1. Encourage different interpretations of the idea of an artifact2. Present non-static works (video, narratives, interactives)3. Expose inner workings of a building4. Provide access to “denied” areas5. Annotation of the architectural building as a public and social place Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  28. 28. FACT selected artifact VIP Signature Pillar Artists and auteurs, filmakers and talks A growing, ongoing archive A “hidden” story is revealed that is also the history of events and programme FACT history, major events, activities This rich media content including moving image Physiological data analysis based on moving image media experience Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  29. 29. FACT, Liverpool, UK: Artwork commissionto Manifest.AR1. Implication of the International Artists Collective Manifest.AR2. Artistic creation and technological innovation3. A dedicated exhibition opening in June 2013 featuring eight mobile AR projects4. More lightweight approach, “technology demistification” http://manifestarblog.wordpress.com/manifest-ar-fact/ Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  30. 30. Conclusions• From “designing for” to “designing with”• One step back, two steps forward?• First impression = life circle of conceptual modeling and prototyping longer• Better comprehension of technology = better approach towards the development of interactive features• Better comprehension of the needs of CH professionals = pushing technology to the limits in a meaningful way• A more enjoyable experience for all project stakeholders• Museum professionals learning and inspired from each other Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  31. 31. The potential of A²R for Art and CulturalHeritage• Visual monitoring and augmentation as important as audio and affective monitoring and augmentation• Physiological (bio) sensors: monitoring of the affective impact of the AR visit• How to interact once the interaction surface disappears?• Gaining a better understanding of a visitor’s gaze upon a work of art (eye- tracking and creation of heat-maps)• Learning about the physiology of museum visiting• Content adaptation according to the visitors’ emotions and states• Can A²R assist us for the shaping of a rewarding museum visit?• What can we learn about the interrelations among emotion, cognition and learning? Dr Areti Damala, Dr Nenad Stojanovic Tailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  32. 32. Thank you for your attention! Questions? www.artsense.eu ISMAR ARtSENSE Contacts areti.damala@cnam.fr nstojano@fzi.de stojanov@fzi.de sascha.voth@iosb.fraunhofer.de Dr Areti Damala, Dr Nenad StojanovicTailoring the A²R Museum Visit: Identifying Cultural Heritage Professionals Motivations and Needs
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×