Augmented Visualization on Handheld Devices for
Cultural Heritage
Giovanni Murru
Marco Fratarcangeli
Tommaso Empler
Click to edit Master title styleOutline
Context	
  
Design	
  
Implementation	
  
Experiments	
  
Conclusion	
  
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Context – Cultural Heritage
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Context – Cultural Heritage
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Context – Cultural Heritage
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Context – Cultural Heritage
Cultural	
  
Heritage	
  
People	
  
Mobile	
  
History	
  
Reconstruction	
  
Understanding	
  
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Context – Augmented Reality
¤  Augmented Reality enriches information
¤  3D models, 2D informative labels
¤  Illusion that what is real and what is virtual
coexist in the same space. [Azuma-1997]
¤  A new kind of human-computer interaction.
¤  Two main approaches
¤  Specialized Devices
¤  Smartphone and tablets
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Design – Choice of Hardware
¤  Smartphones and Tablets.
¤  Limitation in memory, cpu and gpu power.
¤  Rich equipment of sensors.
¤  Possible to use OpenGL and shaders.
¤  Portable and Lightweight
¤  Well suited for AR application.
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleDesign – Choice of Software
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleDesign – Architecture Models
¤  Design of a 3D reconstruction based on
the research of [Viscogliosi, 2010]
¤  Collaboration with the faculty of
Architecture, Valle Giulia in Rome.
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleDesign – Information Board
¤  Design of a custom
information board
¤  Placed near the ruins
of Imperial Fora
¤  Augmented Reality
on the map
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleDesign – System Architecture
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title style
A	
  video	
  showing	
  how	
  the	
  app	
  works	
  
Nervar – Promotional Video
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleImplementation – Nervar
¤  Development of Nervar, an app dedicated to the
Imperial Fora of Rome.
¤  Access an interactive reconstruction of the area
directly on a panel located near the ruins.
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleImplementation – Nervar
¤  Maps with Localization and highlighted area of
the Imperial Fora of Rome
¤  Ruins vs Reconstruction status button
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleImplementation – Nervar
¤  Maps with Localization and highlighted area of
the Imperial Fora of Rome
¤  Ruins vs Reconstruction status button
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleImplementation – Nervar
Point	
  of	
  Interest	
  
Photo	
  Gallery	
  
3D	
  model	
  details	
  
History	
  
Audio	
  guide	
  
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleExperiments – Performance charts
¤  Test of the application in different conditions:
¤  Indoor/Outdoor
¤  Low/High light condition
¤  Reflections / Partial occlusion
¤  Performance comparison between different devices:
¤  Last test of Nervar
¤  Needs Dual Core
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Single	
  Core	
  A4	
   Dual	
  Core	
  A5	
  
Ruins	
   12-­‐17	
  fps	
   60	
  fps	
  
Reconstruction	
   7-­‐8	
  fps	
   30	
  fps	
  
Click to edit Master title styleExperiments – Nervar
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  
Heritage	
  	
  
Click to edit Master title styleConclusion
¤  A framework for providing cultural information using augmented reality
on mobile smartphones and tablets.
¤  Test of the framework in a real case scenario, the app Nervar.
¤  Collaboration with experts of Architecture, Archaeology and History.
¤  Work was presented at CAA UK 2013:
¤  Conference about new and innovative developments in the digital technologies
applied to cultural heritage and ancient world studies.
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  
Click to edit Master title styleank You For Your Attention! J
¤ Questions?
¤ Demo of the app
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
¤  [Azuma, 1997] Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators
and Virtual Environments, 6(4):355–385.
¤  [Viscogliosi, 2010] Viscogliosi, A. (2010). Il foro transitiorio. In Divus Ves- pasianus. Il
bimillenario dei Flavi., pages 202–208. Mondadori Electa.
Augmented	
  Visualization	
  on	
  Handheld	
  Devices	
  for	
  Cultural	
  Heritage	
  	
  

Practical Augmented Visualization on Handheld Devices for Cultural Heritage

  • 1.
    Augmented Visualization onHandheld Devices for Cultural Heritage Giovanni Murru Marco Fratarcangeli Tommaso Empler
  • 2.
    Click to editMaster title styleOutline Context   Design   Implementation   Experiments   Conclusion   Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 3.
    Context – CulturalHeritage Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 4.
    Context – CulturalHeritage Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 5.
    Context – CulturalHeritage Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 6.
    Context – CulturalHeritage Cultural   Heritage   People   Mobile   History   Reconstruction   Understanding   Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 7.
    Context – AugmentedReality ¤  Augmented Reality enriches information ¤  3D models, 2D informative labels ¤  Illusion that what is real and what is virtual coexist in the same space. [Azuma-1997] ¤  A new kind of human-computer interaction. ¤  Two main approaches ¤  Specialized Devices ¤  Smartphone and tablets Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 8.
    Design – Choiceof Hardware ¤  Smartphones and Tablets. ¤  Limitation in memory, cpu and gpu power. ¤  Rich equipment of sensors. ¤  Possible to use OpenGL and shaders. ¤  Portable and Lightweight ¤  Well suited for AR application. Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 9.
    Click to editMaster title styleDesign – Choice of Software Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 10.
    Click to editMaster title styleDesign – Architecture Models ¤  Design of a 3D reconstruction based on the research of [Viscogliosi, 2010] ¤  Collaboration with the faculty of Architecture, Valle Giulia in Rome. Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 11.
    Click to editMaster title styleDesign – Information Board ¤  Design of a custom information board ¤  Placed near the ruins of Imperial Fora ¤  Augmented Reality on the map Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 12.
    Click to editMaster title styleDesign – System Architecture Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 13.
    Click to editMaster title style A  video  showing  how  the  app  works   Nervar – Promotional Video Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 14.
    Click to editMaster title styleImplementation – Nervar ¤  Development of Nervar, an app dedicated to the Imperial Fora of Rome. ¤  Access an interactive reconstruction of the area directly on a panel located near the ruins. Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 15.
    Click to editMaster title styleImplementation – Nervar ¤  Maps with Localization and highlighted area of the Imperial Fora of Rome ¤  Ruins vs Reconstruction status button Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 16.
    Click to editMaster title styleImplementation – Nervar ¤  Maps with Localization and highlighted area of the Imperial Fora of Rome ¤  Ruins vs Reconstruction status button Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 17.
    Click to editMaster title styleImplementation – Nervar Point  of  Interest   Photo  Gallery   3D  model  details   History   Audio  guide   Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 18.
    Click to editMaster title styleExperiments – Performance charts ¤  Test of the application in different conditions: ¤  Indoor/Outdoor ¤  Low/High light condition ¤  Reflections / Partial occlusion ¤  Performance comparison between different devices: ¤  Last test of Nervar ¤  Needs Dual Core Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage     Single  Core  A4   Dual  Core  A5   Ruins   12-­‐17  fps   60  fps   Reconstruction   7-­‐8  fps   30  fps  
  • 19.
    Click to editMaster title styleExperiments – Nervar Augmented  Visualization  on  Handheld  Devices  for  Cultural   Heritage    
  • 20.
    Click to editMaster title styleConclusion ¤  A framework for providing cultural information using augmented reality on mobile smartphones and tablets. ¤  Test of the framework in a real case scenario, the app Nervar. ¤  Collaboration with experts of Architecture, Archaeology and History. ¤  Work was presented at CAA UK 2013: ¤  Conference about new and innovative developments in the digital technologies applied to cultural heritage and ancient world studies. Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage    
  • 21.
    Click to editMaster title styleank You For Your Attention! J ¤ Questions? ¤ Demo of the app ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ¤  [Azuma, 1997] Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355–385. ¤  [Viscogliosi, 2010] Viscogliosi, A. (2010). Il foro transitiorio. In Divus Ves- pasianus. Il bimillenario dei Flavi., pages 202–208. Mondadori Electa. Augmented  Visualization  on  Handheld  Devices  for  Cultural  Heritage