SlideShare a Scribd company logo
Evaluation of Multi-Platform
Mobile AR Frameworks for
Roman
Mosaic Augmentation
EUROGRAPHICS Workshop on Graphics and Cultural Heritage (2018)
Vienna, Austria, November 12-15, 2018
Jorge C. S. Cardoso, André Belo
CISUC/DEI, Universidade de Coimbra
Contents
1. “Mosaico - Conímbriga e Sicó” project
a. Digital Tools for Exploring Roman Mosaic
2. Prototype AR Application
3. AR Framework Testing
4. Conclusions
“Mosaico -
Conímbriga e
Sicó” Project
“Mosaico - Conímbriga e Sicó” Project
● Based on the Roman Mosaic
Heritage present in the
geographical axis constituted by
○ the Ruins of the Roman city of
Conímbriga,
○ the Roman Villa of Rabaçal, and
○ the Monumental Complex of
Santiago da Guarda.
“Mosaico - Conímbriga e Sicó” Project
● Promotes cultural and creative
activities within the museums,
interpretative centers and
archaeological sites
○ Integrated into the CREATOUR
national project as a pilot initiative
● Alternative experiences of
sharing knowledge about the
Roman Mosaic Heritage
● Mosaic as a modern expression
of creativity brought into the
present and reinterpreted
Digital Tools for
Exploring
Roman Mosaic
In the context of the “Mosaico -
Conímbriga e Sicó” project
Various planned digital tools to
support different activities for
exploring roman mosaic
Digital Tools for Exploring Roman Mosaic
● Mosaic Editor
○ Support for mosaic workshops for
non-professionals
● Programming Environment
(Adapted Snap! Environment)
○ Learning computer programming by
creating mosaic patterns
● Interactive Sandbox
○ Interactive experiences for kids
○ Simulating uncovering mosaics
Augmented
Reality Mobile
Application
An AR application that provides
in-place, contextual information
about the roman mosaics
Augmented Reality Mobile Application for Mosaics
● Purpose
○ Display technical information about the
mosaics, for example, when they were
uncovered, what was the latest
conservation or restoration work, etc.
○ Display image overlays of the
conservation or restoration works on
mosaics over time.
○ Provide a platform for the visualization of
virtual restoration of the existing mosaics.
○ Highlight mosaics with graphical
information regarding various motifs
■ geometric patterns, animals, plants,
compositions, mythological figures, etc.
Types of Augmented Reality
Location-based Structured markers
“Instant tracking” Natural image features
Augmented Reality Mobile Application
● Requirement
○ Multi-platform application (run on
Android, iOS, etc.)
■ Single code base
■ Lower development effort
● What AR development
frameworks are available for
multi-platform mobile
development?
● Which AR development
frameworks are most suitable
for detecting real mosaics?
AR Framework
Testing
AR Development Frameworks
● We studied multi-platform AR development frameworks and their
features
○ With natural image feature detection
● Narrowed down to 3 frameworks: CraftAR, PixLive, Wikitude
AR Framework Evaluation
● Real-world evaluation with roman mosaics at Conímbriga
● Targets with different characteristics were captured
AR Test Application
● A simple test application was developed using each of the 3 AR
frameworks
● Test application overlaid graphical shapes over the targets
○ Simple shapes, easy to verify alignment
AR Test Application
● We screen-captured in video the execution of the application over
each of the mosaic targets
● Three camera movements:
○ Camera face down, turn up towards the target, then turn left, then right
○ Horizontal pan left/right
○ “Zoom in/out”
AR Test Application
● We screen-captured in video the execution of the application over
each of the mosaic targets
● We analysed the various videos and extracted 3 metrics
○ Recognition delay
○ Minimum required target area
○ Visual alignment and stability
AR Framework Evaluation Results - Overall Recognition
● Not all targets were
recognized
○ This was expected
○ Targets were captured from a
distance
○ Not much effort in capturing
targets
● Wikitude performed very
poorly
○ Unexpected
○ Requires further study as to
why
AR Framework Evaluation Results - Recognition Delay
● CraftAR is faster
than PixLive
○ Almost 0.5
seconds faster
● PixLive requires less
visible target area
AR Framework Evaluation Results - Visual alignment and
stability
1. Subjectively rated by the two authors
a. -1: bad alignment / stability
b. 0: ok alignment / stability
c. 1: good alignment / stability
Conclusion
Conclusion
● Evaluation in a real scenario setting
○ Compared three frameworks: CraftAR, PixLive, Wikitude
○ Wikitude failed, but more testing is required to dismiss it
● Study allowed us to understand strong and weak points of these
AR frameworks
○ AR frameworks’ performance varies greatly depending on the type of
image they are recognizing
○ AR frameworks have different performance compromises
■ No single one is best at every performance attribute
● Virtual Heritage application developers should test different
frameworks before commiting to one

More Related Content

Similar to Evaluation of Multi-Platform Mobile AR Frameworks for Roman Mosaic Augmentation

3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
3D ICONS Project
 
Citizen Science, Geocrowdsourcing and Big Data in Urban Context
Citizen Science, Geocrowdsourcing and Big Data in Urban ContextCitizen Science, Geocrowdsourcing and Big Data in Urban Context
Citizen Science, Geocrowdsourcing and Big Data in Urban Context
Maria Antonia Brovelli
 
Philipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with WikitudePhilipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with Wikitude
AugmentedWorldExpo
 
Pervasive ar environment
Pervasive ar environmentPervasive ar environment
Pervasive ar environment
NAVER Engineering
 
Digital tools for exploring roman mosaic
Digital tools for exploring roman mosaicDigital tools for exploring roman mosaic
Digital tools for exploring roman mosaic
Jorge Cardoso
 
Ar paper 800-innovation with augmented reality to erasmus students
Ar paper 800-innovation with augmented reality to erasmus studentsAr paper 800-innovation with augmented reality to erasmus students
Ar paper 800-innovation with augmented reality to erasmus students
Vitor Gonçalves
 
Mobile AR Lecture 10 - Research Directions
Mobile AR Lecture 10 - Research DirectionsMobile AR Lecture 10 - Research Directions
Mobile AR Lecture 10 - Research Directions
Mark Billinghurst
 
2019 cvpr paper_overview
2019 cvpr paper_overview2019 cvpr paper_overview
2019 cvpr paper_overview
LEE HOSEONG
 
2019 cvpr paper overview by Ho Seong Lee
2019 cvpr paper overview by Ho Seong Lee2019 cvpr paper overview by Ho Seong Lee
2019 cvpr paper overview by Ho Seong Lee
Moazzem Hossain
 
Food Container Catalog AR
Food Container Catalog ARFood Container Catalog AR
Food Container Catalog AR
NURSHAHIRAENDUT
 
Mar general pan hui ppt
Mar general pan hui ppt Mar general pan hui ppt
Mar general pan hui ppt
luruiyang
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
dzubovua
 
The History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual ExperienceThe History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual Experience
C4Media
 
Mobile AR Lecture1-introduction
Mobile AR Lecture1-introductionMobile AR Lecture1-introduction
Mobile AR Lecture1-introduction
Mark Billinghurst
 
Vizerra - innovations in visual communications using games and VR&AR
Vizerra - innovations in visual communications using games and VR&ARVizerra - innovations in visual communications using games and VR&AR
Vizerra - innovations in visual communications using games and VR&AR
Alexander Lavrov
 
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D ReconstructionsWeb-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
Matthias Trapp
 
Strategy for Optimal Documentation of Museum Objects
Strategy for Optimal Documentation of Museum ObjectsStrategy for Optimal Documentation of Museum Objects
Strategy for Optimal Documentation of Museum Objects
Daniel Pletinckx
 
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
Virtual Tourism
 
Making Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDKMaking Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDK
Evren Coşkun
 
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
Zi Siang See
 

Similar to Evaluation of Multi-Platform Mobile AR Frameworks for Roman Mosaic Augmentation (20)

3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
3D ICONS Guidelines and Case Studies, Anthony Corns, Discovery Programme
 
Citizen Science, Geocrowdsourcing and Big Data in Urban Context
Citizen Science, Geocrowdsourcing and Big Data in Urban ContextCitizen Science, Geocrowdsourcing and Big Data in Urban Context
Citizen Science, Geocrowdsourcing and Big Data in Urban Context
 
Philipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with WikitudePhilipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with Wikitude
 
Pervasive ar environment
Pervasive ar environmentPervasive ar environment
Pervasive ar environment
 
Digital tools for exploring roman mosaic
Digital tools for exploring roman mosaicDigital tools for exploring roman mosaic
Digital tools for exploring roman mosaic
 
Ar paper 800-innovation with augmented reality to erasmus students
Ar paper 800-innovation with augmented reality to erasmus studentsAr paper 800-innovation with augmented reality to erasmus students
Ar paper 800-innovation with augmented reality to erasmus students
 
Mobile AR Lecture 10 - Research Directions
Mobile AR Lecture 10 - Research DirectionsMobile AR Lecture 10 - Research Directions
Mobile AR Lecture 10 - Research Directions
 
2019 cvpr paper_overview
2019 cvpr paper_overview2019 cvpr paper_overview
2019 cvpr paper_overview
 
2019 cvpr paper overview by Ho Seong Lee
2019 cvpr paper overview by Ho Seong Lee2019 cvpr paper overview by Ho Seong Lee
2019 cvpr paper overview by Ho Seong Lee
 
Food Container Catalog AR
Food Container Catalog ARFood Container Catalog AR
Food Container Catalog AR
 
Mar general pan hui ppt
Mar general pan hui ppt Mar general pan hui ppt
Mar general pan hui ppt
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
The History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual ExperienceThe History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual Experience
 
Mobile AR Lecture1-introduction
Mobile AR Lecture1-introductionMobile AR Lecture1-introduction
Mobile AR Lecture1-introduction
 
Vizerra - innovations in visual communications using games and VR&AR
Vizerra - innovations in visual communications using games and VR&ARVizerra - innovations in visual communications using games and VR&AR
Vizerra - innovations in visual communications using games and VR&AR
 
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D ReconstructionsWeb-based and Mobile Provisioning of Virtual 3D Reconstructions
Web-based and Mobile Provisioning of Virtual 3D Reconstructions
 
Strategy for Optimal Documentation of Museum Objects
Strategy for Optimal Documentation of Museum ObjectsStrategy for Optimal Documentation of Museum Objects
Strategy for Optimal Documentation of Museum Objects
 
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
Evaluation of the Acceptance of Virtual Worlds in the Tourism Sector: An Ext...
 
Making Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDKMaking Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDK
 
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective...
 

More from Jorge Cardoso

Criação de Ambientes de Realidade Virtual usando A-Frame - CubeCraft Toys -...
Criação de Ambientes  de Realidade Virtual  usando A-Frame - CubeCraft Toys -...Criação de Ambientes  de Realidade Virtual  usando A-Frame - CubeCraft Toys -...
Criação de Ambientes de Realidade Virtual usando A-Frame - CubeCraft Toys -...
Jorge Cardoso
 
Criação de Ambientes de Realidade Virtual usando A-Frame
Criação de Ambientes  de Realidade Virtual  usando A-FrameCriação de Ambientes  de Realidade Virtual  usando A-Frame
Criação de Ambientes de Realidade Virtual usando A-Frame
Jorge Cardoso
 
Journal of Science and Technology of the Arts
Journal of Science and Technology of the ArtsJournal of Science and Technology of the Arts
Journal of Science and Technology of the Arts
Jorge Cardoso
 
Interaction techniques for locomotion in virtual reality
Interaction techniques for locomotion in virtual realityInteraction techniques for locomotion in virtual reality
Interaction techniques for locomotion in virtual reality
Jorge Cardoso
 
Interacção em ambientes de realidade virtual
Interacção em ambientes de realidade virtualInteracção em ambientes de realidade virtual
Interacção em ambientes de realidade virtual
Jorge Cardoso
 
PhD defense presentation
PhD defense presentationPhD defense presentation
PhD defense presentation
Jorge Cardoso
 
Dynamic graphical user interface generation for web-based public display appl...
Dynamic graphical user interface generation for web-based public display appl...Dynamic graphical user interface generation for web-based public display appl...
Dynamic graphical user interface generation for web-based public display appl...
Jorge Cardoso
 
Evaluation of a programming toolkit for interactive public display applications
Evaluation of a programming toolkit for interactive public display applicationsEvaluation of a programming toolkit for interactive public display applications
Evaluation of a programming toolkit for interactive public display applications
Jorge Cardoso
 
Interaction modalities, technologies and tools for interactive art
Interaction modalities, technologies and tools for interactive artInteraction modalities, technologies and tools for interactive art
Interaction modalities, technologies and tools for interactive art
Jorge Cardoso
 
PuReWidgets toolkit
PuReWidgets toolkitPuReWidgets toolkit
PuReWidgets toolkit
Jorge Cardoso
 
PuReWidgets presentation at EICS 2012
PuReWidgets presentation at EICS 2012PuReWidgets presentation at EICS 2012
PuReWidgets presentation at EICS 2012
Jorge Cardoso
 
PuReWidgets toolkit
PuReWidgets toolkit PuReWidgets toolkit
PuReWidgets toolkit
Jorge Cardoso
 
Assessing Feedback for Indirect Shared Interaction
Assessing Feedback for Indirect Shared InteractionAssessing Feedback for Indirect Shared Interaction
Assessing Feedback for Indirect Shared Interaction
Jorge Cardoso
 
Oop java
Oop javaOop java
Oop java
Jorge Cardoso
 
Conceitos fundamentais de_programacao
Conceitos fundamentais de_programacao Conceitos fundamentais de_programacao
Conceitos fundamentais de_programacao
Jorge Cardoso
 
Computer vision techniques for interactive art
Computer vision techniques for interactive artComputer vision techniques for interactive art
Computer vision techniques for interactive art
Jorge Cardoso
 
Introdução à Programacao em Processing
Introdução à Programacao em Processing Introdução à Programacao em Processing
Introdução à Programacao em Processing
Jorge Cardoso
 
Introdução à Programação para iPhone (iOS)
Introdução à Programação para iPhone (iOS)Introdução à Programação para iPhone (iOS)
Introdução à Programação para iPhone (iOS)
Jorge Cardoso
 
Introdução à programação para Android
Introdução à programação para AndroidIntrodução à programação para Android
Introdução à programação para Android
Jorge Cardoso
 
OOP Java
OOP JavaOOP Java
OOP Java
Jorge Cardoso
 

More from Jorge Cardoso (20)

Criação de Ambientes de Realidade Virtual usando A-Frame - CubeCraft Toys -...
Criação de Ambientes  de Realidade Virtual  usando A-Frame - CubeCraft Toys -...Criação de Ambientes  de Realidade Virtual  usando A-Frame - CubeCraft Toys -...
Criação de Ambientes de Realidade Virtual usando A-Frame - CubeCraft Toys -...
 
Criação de Ambientes de Realidade Virtual usando A-Frame
Criação de Ambientes  de Realidade Virtual  usando A-FrameCriação de Ambientes  de Realidade Virtual  usando A-Frame
Criação de Ambientes de Realidade Virtual usando A-Frame
 
Journal of Science and Technology of the Arts
Journal of Science and Technology of the ArtsJournal of Science and Technology of the Arts
Journal of Science and Technology of the Arts
 
Interaction techniques for locomotion in virtual reality
Interaction techniques for locomotion in virtual realityInteraction techniques for locomotion in virtual reality
Interaction techniques for locomotion in virtual reality
 
Interacção em ambientes de realidade virtual
Interacção em ambientes de realidade virtualInteracção em ambientes de realidade virtual
Interacção em ambientes de realidade virtual
 
PhD defense presentation
PhD defense presentationPhD defense presentation
PhD defense presentation
 
Dynamic graphical user interface generation for web-based public display appl...
Dynamic graphical user interface generation for web-based public display appl...Dynamic graphical user interface generation for web-based public display appl...
Dynamic graphical user interface generation for web-based public display appl...
 
Evaluation of a programming toolkit for interactive public display applications
Evaluation of a programming toolkit for interactive public display applicationsEvaluation of a programming toolkit for interactive public display applications
Evaluation of a programming toolkit for interactive public display applications
 
Interaction modalities, technologies and tools for interactive art
Interaction modalities, technologies and tools for interactive artInteraction modalities, technologies and tools for interactive art
Interaction modalities, technologies and tools for interactive art
 
PuReWidgets toolkit
PuReWidgets toolkitPuReWidgets toolkit
PuReWidgets toolkit
 
PuReWidgets presentation at EICS 2012
PuReWidgets presentation at EICS 2012PuReWidgets presentation at EICS 2012
PuReWidgets presentation at EICS 2012
 
PuReWidgets toolkit
PuReWidgets toolkit PuReWidgets toolkit
PuReWidgets toolkit
 
Assessing Feedback for Indirect Shared Interaction
Assessing Feedback for Indirect Shared InteractionAssessing Feedback for Indirect Shared Interaction
Assessing Feedback for Indirect Shared Interaction
 
Oop java
Oop javaOop java
Oop java
 
Conceitos fundamentais de_programacao
Conceitos fundamentais de_programacao Conceitos fundamentais de_programacao
Conceitos fundamentais de_programacao
 
Computer vision techniques for interactive art
Computer vision techniques for interactive artComputer vision techniques for interactive art
Computer vision techniques for interactive art
 
Introdução à Programacao em Processing
Introdução à Programacao em Processing Introdução à Programacao em Processing
Introdução à Programacao em Processing
 
Introdução à Programação para iPhone (iOS)
Introdução à Programação para iPhone (iOS)Introdução à Programação para iPhone (iOS)
Introdução à Programação para iPhone (iOS)
 
Introdução à programação para Android
Introdução à programação para AndroidIntrodução à programação para Android
Introdução à programação para Android
 
OOP Java
OOP JavaOOP Java
OOP Java
 

Recently uploaded

All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
Sérgio Sacani
 
Buy Xanax online now at chemworldstore.net
Buy Xanax online now at chemworldstore.netBuy Xanax online now at chemworldstore.net
Buy Xanax online now at chemworldstore.net
ludasams003
 
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptxellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
muralinath2
 
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
Thane Heins
 
Surface properties of the seas of Titan as revealed by Cassini mission bistat...
Surface properties of the seas of Titan as revealed by Cassini mission bistat...Surface properties of the seas of Titan as revealed by Cassini mission bistat...
Surface properties of the seas of Titan as revealed by Cassini mission bistat...
Sérgio Sacani
 
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
Sérgio Sacani
 
Structure of Sperm / Spermatozoon .pdf
Structure of  Sperm / Spermatozoon  .pdfStructure of  Sperm / Spermatozoon  .pdf
Structure of Sperm / Spermatozoon .pdf
SELF-EXPLANATORY
 
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
Sérgio Sacani
 
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
Dr NEETHU ASOKAN
 
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdfHow Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
Task Train
 
AN EMPIRE ACROSS THE THREE CONTINENTS.pptx
AN EMPIRE ACROSS THE THREE CONTINENTS.pptxAN EMPIRE ACROSS THE THREE CONTINENTS.pptx
AN EMPIRE ACROSS THE THREE CONTINENTS.pptx
kalpnayadav03021986
 
Introduction to Space (Our Solar System)
Introduction to Space (Our Solar System)Introduction to Space (Our Solar System)
Introduction to Space (Our Solar System)
vanshgarg8002
 
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptxSCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
WALTONMARBRUCAL
 
Analytical methods for blue residues characterization - Oana Crina Bujor
Analytical methods for blue residues characterization - Oana Crina BujorAnalytical methods for blue residues characterization - Oana Crina Bujor
Analytical methods for blue residues characterization - Oana Crina Bujor
Faculty of Applied Chemistry and Materials Science
 
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
Faculty of Applied Chemistry and Materials Science
 
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
Sérgio Sacani
 
Lunar Mobility Drivers and Needs - Artemis
Lunar Mobility Drivers and Needs - ArtemisLunar Mobility Drivers and Needs - Artemis
Lunar Mobility Drivers and Needs - Artemis
Sérgio Sacani
 
Plant Kingdom BioHack class 11 neet ....
Plant Kingdom BioHack class 11 neet ....Plant Kingdom BioHack class 11 neet ....
Plant Kingdom BioHack class 11 neet ....
anushkakharat13
 
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptxBIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
alishyt102010
 
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
Sérgio Sacani
 

Recently uploaded (20)

All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
All-domain Anomaly Resolution Office Supplement to Oak Ridge National Laborat...
 
Buy Xanax online now at chemworldstore.net
Buy Xanax online now at chemworldstore.netBuy Xanax online now at chemworldstore.net
Buy Xanax online now at chemworldstore.net
 
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptxellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
ellipticytescausesprognosistreatment-240622051139-23d50b05.pptx
 
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
PART 1 & PART 2 The New Natural Principles of Newtonian Mechanics, Electromec...
 
Surface properties of the seas of Titan as revealed by Cassini mission bistat...
Surface properties of the seas of Titan as revealed by Cassini mission bistat...Surface properties of the seas of Titan as revealed by Cassini mission bistat...
Surface properties of the seas of Titan as revealed by Cassini mission bistat...
 
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
A Strong He II λ1640 Emitter with an Extremely Blue UV Spectral Slope at z=8....
 
Structure of Sperm / Spermatozoon .pdf
Structure of  Sperm / Spermatozoon  .pdfStructure of  Sperm / Spermatozoon  .pdf
Structure of Sperm / Spermatozoon .pdf
 
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
Detection of the elusive dangling OH ice features at ~2.7 μm in Chamaeleon I ...
 
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
Bioconversion of sago waste and oil cakes into biobutanol using Environmental...
 
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdfHow Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
How Does TaskTrain Integrate Workflow and Project Management Efficiently.pdf
 
AN EMPIRE ACROSS THE THREE CONTINENTS.pptx
AN EMPIRE ACROSS THE THREE CONTINENTS.pptxAN EMPIRE ACROSS THE THREE CONTINENTS.pptx
AN EMPIRE ACROSS THE THREE CONTINENTS.pptx
 
Introduction to Space (Our Solar System)
Introduction to Space (Our Solar System)Introduction to Space (Our Solar System)
Introduction to Space (Our Solar System)
 
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptxSCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
SCIENCEgfvhvhvkjkbbjjbbjvhvhvhvjkvjvjvjj.pptx
 
Analytical methods for blue residues characterization - Oana Crina Bujor
Analytical methods for blue residues characterization - Oana Crina BujorAnalytical methods for blue residues characterization - Oana Crina Bujor
Analytical methods for blue residues characterization - Oana Crina Bujor
 
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
End of pipe treatment: Unlocking the potential of RAS waste - Carlos Octavio ...
 
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
Possible Anthropogenic Contributions to the LAMP-observed Surficial Icy Regol...
 
Lunar Mobility Drivers and Needs - Artemis
Lunar Mobility Drivers and Needs - ArtemisLunar Mobility Drivers and Needs - Artemis
Lunar Mobility Drivers and Needs - Artemis
 
Plant Kingdom BioHack class 11 neet ....
Plant Kingdom BioHack class 11 neet ....Plant Kingdom BioHack class 11 neet ....
Plant Kingdom BioHack class 11 neet ....
 
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptxBIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
BIOPHYSICS Interactions of molecules in 3-D space-determining binding and.pptx
 
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
SOFIA/HAWC+ FAR-INFRARED POLARIMETRIC LARGE-AREA CMZ EXPLORATION (FIREPLACE) ...
 

Evaluation of Multi-Platform Mobile AR Frameworks for Roman Mosaic Augmentation

  • 1. Evaluation of Multi-Platform Mobile AR Frameworks for Roman Mosaic Augmentation EUROGRAPHICS Workshop on Graphics and Cultural Heritage (2018) Vienna, Austria, November 12-15, 2018 Jorge C. S. Cardoso, André Belo CISUC/DEI, Universidade de Coimbra
  • 2. Contents 1. “Mosaico - Conímbriga e Sicó” project a. Digital Tools for Exploring Roman Mosaic 2. Prototype AR Application 3. AR Framework Testing 4. Conclusions
  • 4. “Mosaico - Conímbriga e Sicó” Project ● Based on the Roman Mosaic Heritage present in the geographical axis constituted by ○ the Ruins of the Roman city of Conímbriga, ○ the Roman Villa of Rabaçal, and ○ the Monumental Complex of Santiago da Guarda.
  • 5. “Mosaico - Conímbriga e Sicó” Project ● Promotes cultural and creative activities within the museums, interpretative centers and archaeological sites ○ Integrated into the CREATOUR national project as a pilot initiative ● Alternative experiences of sharing knowledge about the Roman Mosaic Heritage ● Mosaic as a modern expression of creativity brought into the present and reinterpreted
  • 6. Digital Tools for Exploring Roman Mosaic In the context of the “Mosaico - Conímbriga e Sicó” project Various planned digital tools to support different activities for exploring roman mosaic
  • 7. Digital Tools for Exploring Roman Mosaic ● Mosaic Editor ○ Support for mosaic workshops for non-professionals ● Programming Environment (Adapted Snap! Environment) ○ Learning computer programming by creating mosaic patterns ● Interactive Sandbox ○ Interactive experiences for kids ○ Simulating uncovering mosaics
  • 8. Augmented Reality Mobile Application An AR application that provides in-place, contextual information about the roman mosaics
  • 9. Augmented Reality Mobile Application for Mosaics ● Purpose ○ Display technical information about the mosaics, for example, when they were uncovered, what was the latest conservation or restoration work, etc. ○ Display image overlays of the conservation or restoration works on mosaics over time. ○ Provide a platform for the visualization of virtual restoration of the existing mosaics. ○ Highlight mosaics with graphical information regarding various motifs ■ geometric patterns, animals, plants, compositions, mythological figures, etc.
  • 10. Types of Augmented Reality Location-based Structured markers “Instant tracking” Natural image features
  • 11. Augmented Reality Mobile Application ● Requirement ○ Multi-platform application (run on Android, iOS, etc.) ■ Single code base ■ Lower development effort ● What AR development frameworks are available for multi-platform mobile development? ● Which AR development frameworks are most suitable for detecting real mosaics?
  • 13. AR Development Frameworks ● We studied multi-platform AR development frameworks and their features ○ With natural image feature detection ● Narrowed down to 3 frameworks: CraftAR, PixLive, Wikitude
  • 14. AR Framework Evaluation ● Real-world evaluation with roman mosaics at Conímbriga ● Targets with different characteristics were captured
  • 15. AR Test Application ● A simple test application was developed using each of the 3 AR frameworks ● Test application overlaid graphical shapes over the targets ○ Simple shapes, easy to verify alignment
  • 16. AR Test Application ● We screen-captured in video the execution of the application over each of the mosaic targets ● Three camera movements: ○ Camera face down, turn up towards the target, then turn left, then right ○ Horizontal pan left/right ○ “Zoom in/out”
  • 17. AR Test Application ● We screen-captured in video the execution of the application over each of the mosaic targets ● We analysed the various videos and extracted 3 metrics ○ Recognition delay ○ Minimum required target area ○ Visual alignment and stability
  • 18. AR Framework Evaluation Results - Overall Recognition ● Not all targets were recognized ○ This was expected ○ Targets were captured from a distance ○ Not much effort in capturing targets ● Wikitude performed very poorly ○ Unexpected ○ Requires further study as to why
  • 19. AR Framework Evaluation Results - Recognition Delay ● CraftAR is faster than PixLive ○ Almost 0.5 seconds faster ● PixLive requires less visible target area
  • 20. AR Framework Evaluation Results - Visual alignment and stability 1. Subjectively rated by the two authors a. -1: bad alignment / stability b. 0: ok alignment / stability c. 1: good alignment / stability
  • 22. Conclusion ● Evaluation in a real scenario setting ○ Compared three frameworks: CraftAR, PixLive, Wikitude ○ Wikitude failed, but more testing is required to dismiss it ● Study allowed us to understand strong and weak points of these AR frameworks ○ AR frameworks’ performance varies greatly depending on the type of image they are recognizing ○ AR frameworks have different performance compromises ■ No single one is best at every performance attribute ● Virtual Heritage application developers should test different frameworks before commiting to one

Editor's Notes

  1. Modern approach to mosaic
  2. Based on coordinates (e.g., GPS) Imprecise, not enough to overlay mosaic details