Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
An Authoring Solution fora Façade-Based AR Platform:  Infrastructure, Annotation       and Visualization              Guil...
MotivationInput Image            Augmented Image                  2
Overall SystemMobile client side                                           RenderingServer side          Façade           ...
Rendering    4
OutlineFaçade ExtractionAuthoring solution • Façade database • 3D annotationVisualizationConclusion, perspectives and disc...
Façade Extraction
Façade ExtractionKey of the authoring solution and visualization • Façades are the frame of references of 3D content • Aug...
Façade Extraction        8
Authoring Solution
Façade DatabaseFor each street, take pictures of façadesAutomatic façade extraction and matching • Geometrical constraint ...
Façade Database       11
Façade DatabaseCandidate selection• GPS coordinates• Bag-of-word description for selecting   candidatesSimilarity constrai...
3D AnnotationExtension of façade to 3D: frame of reference                          13
3D AnnotationDesktop application• Easy and intuitive interface to use for non expert users• Predefined list of 3D models  ...
3D Annotation  Mobile Application (ongoing work)Long Tap to add widgets         Manual Accurate Geolocalisation           ...
Visualization
National University of                National University of   National University of            Ireland Maynooth         ...
Camera Pose Estimation   intrinsics are known   extrinsics are given by the façade extraction algorithm   (homography betw...
Results   19
Conclusion,Perspectives and   Discussion
Conclusion, Perspectives & Discussion Easy and intuitive authoring solution for AR applications based on façade extraction...
AcknowledgmentResearch presented in this paper was funded by a StrategicResearch Cluster grant (07/SRC/I1169) by ScienceFo...
Upcoming SlideShare
Loading in …5
×

An Authoring Solution for a Façade-Based AR Platform: Infrastructure, Annotation and Visualization

1,803 views

Published on

Slides from our presentation at ISMAR 2012 Workshop Authoring Solutions for Augmented Reality

Published in: Technology
  • Be the first to comment

  • Be the first to like this

An Authoring Solution for a Façade-Based AR Platform: Infrastructure, Annotation and Visualization

  1. 1. An Authoring Solution fora Façade-Based AR Platform: Infrastructure, Annotation and Visualization Guillaume GALES Eric MCCLEAN John MCDONALD DEPARTMENT OF COMPUTER SCIENCE NATIONAL UNIVERSITY OF IRELAND MAYNOOTH
  2. 2. MotivationInput Image Augmented Image 2
  3. 3. Overall SystemMobile client side RenderingServer side Façade Widget extraction RetrievalDatabase Authoring client Façade Matching 3
  4. 4. Rendering 4
  5. 5. OutlineFaçade ExtractionAuthoring solution • Façade database • 3D annotationVisualizationConclusion, perspectives and discussion 5
  6. 6. Façade Extraction
  7. 7. Façade ExtractionKey of the authoring solution and visualization • Façades are the frame of references of 3D content • Augment a view with 3D content in urban environment from a single imageInput: image of a façadeOutput: homography between the façade and its imageAdvantages: • Robust matching (invariant to rotation and perspective changes) • Façade normalization (used to build a representation of the environment) • Camera pose estimation (used by the visualization system) 7
  8. 8. Façade Extraction 8
  9. 9. Authoring Solution
  10. 10. Façade DatabaseFor each street, take pictures of façadesAutomatic façade extraction and matching • Geometrical constraint makes matching robust • Invariance to rotation and perspective changes 10
  11. 11. Façade Database 11
  12. 12. Façade DatabaseCandidate selection• GPS coordinates• Bag-of-word description for selecting candidatesSimilarity constraint Figure 2: Database infrastructure for computing planar facade mo- ¸ saics. The individual facades are stitched together into planes to ¸ 12 build a frame of reference for authoring.
  13. 13. 3D AnnotationExtension of façade to 3D: frame of reference 13
  14. 14. 3D AnnotationDesktop application• Easy and intuitive interface to use for non expert users• Predefined list of 3D models 14
  15. 15. 3D Annotation Mobile Application (ongoing work)Long Tap to add widgets Manual Accurate Geolocalisation 15
  16. 16. Visualization
  17. 17. National University of National University of National University of Ireland Maynooth Ireland Data Retrieval Ireland Maynooth Ireland Ireland Maynooth IrelandT horing is an important stage in the workflow of creat-gmented reality applications. In this paper we describesed database infrastructure for authoring and storing 3D use in urban environments. It provides frames of ref- he environment as well as a mechanism to match newh the facades and thus retrieving associated 3D content. ¸ ucture is flexible in that we can add different 3D “lay-tent on top of the facades and hence opens many pos- ¸ augmented reality applications in urban environments. Façade Extractione the system provides a representation suitable for both automatic content authoring. Façade Matchingds: Augmented Reality, Infrastructure, Authoring,ed Database, Content Storing and Retrieving.DUCTION Widget Retrievalmented reality applications provide rich and useful in-o their users about their surrounding environment. Toe augmented reality applications, an efficient infrastruc-red. Such infrastructures involve:ng a map of the environment ;g content ;ving content.aper we propose an infrastructure that makes authoringve and flexible. Our goal is to create a platform for mo- 17
  18. 18. Camera Pose Estimation intrinsics are known extrinsics are given by the façade extraction algorithm (homography between plane and its image decomposed into rotation and translation) 1 ⇥ ⇤ H=K R t 1 H FaçadeCamera 18
  19. 19. Results 19
  20. 20. Conclusion,Perspectives and Discussion
  21. 21. Conclusion, Perspectives & Discussion Easy and intuitive authoring solution for AR applications based on façade extraction Extension to real time computation on mobile • Use of GPU and accelerometer Extension to automatic dynamic authoring • Link with OpenStreetMap through GPS coordinates Collaborative authoring client (and database updates) • HTML5 • Mobile version 21
  22. 22. AcknowledgmentResearch presented in this paper was funded by a StrategicResearch Cluster grant (07/SRC/I1169) by ScienceFoundation Ireland under the National Development Plan.The authors gratefully acknowledge this support.Thank you for your attention 22

×