Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Presentation

784 views

Published on

  • Be the first to comment

  • Be the first to like this

Presentation

  1. 1. The Potential of the 3D Internet in the Cultural Heritage Domain André Stork, Dieter Fellner Fraunhofer IGD http://www.igd.fraunhofer.de GRIS / TU Darmstadt http://www.gris.tu-darmstadt.de© 2012 D. Fellner 1 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  2. 2. Access© 2012 D. Fellner 2 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  3. 3. 3D Cultural Heritage Artifacts • worldwide many hundreds of millions of CH objects 137 million objects© 2012 D. Fellner 3 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  4. 4. 3D Cultural Heritage Artifacts: precious & fragile • Stadtarchiv Köln 30 shelf-km collapse 3/2009 • Herzogin Anna Amalia Bibliothek Weimar© 2012 D. Fellner 4 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  5. 5. 3D Cultural Heritage Artifacts • Cultural heritage exhibits from all over the world • Artifacts dating back 6000 years in human history • More than 175 years of museum history • ~ 6 million artifacts • 120.000 new objects per year© 2012 D. Fellner 5 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  6. 6. 3D Cultural Heritage Artifacts • Let‘s do some calculations … • If we would like to scan only the new objects … • 120.000 / 365 days / 24 h / 60 minutes = • 0,22 obj/min • 4,38 min/object • Houston, we have a problem!© 2012 D. Fellner • Why? … 6 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  7. 7. 3D geometry digitization: state of the art  3D Artifact  Digital Replica© 2012 D. Fellner 7 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  8. 8. 3D material acquisition: state of the art • BTF-Dome (TU Bonn)© 2012 D. Fellner 8 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  9. 9. V&A study: Geometry with texture (no complex materials) [h] 25 20 15 10 5© 2012 D. Fellner Digitization [h] Postprocessing [h] (Study: Victoria & Albert Museum) 9 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  10. 10. 3D Digitization & Documentation The model© 2012 D. Fellner 10 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  11. 11. Time Budget: Geometry & Texture PLUS Material ̶ today Geometry and Material acquisition Postprocessing texture acquisition 12 h 16 h 8h = 36 hours Preparation Return© 2012 D. Fellner11 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  12. 12. 3D Cultural Heritage Artifacts • 3D acquisition challenges: • faster acquisition • optically complicated objects • spatially varying materials • translucent / transparent materials • cost reduction • ease of use • develop and establish workflows • transfer of knowledge and guidelines© 2012 D. Fellner • projects with critical mass 12 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  13. 13. 3D Cultural Heritage Artifacts • technical approaches • fast cameras • faster projectors (even more important) • automation (e.g. scan planning) • post-processing (registration, stitching, cleaning, etc.) • new sensors and sensor fusion • potential organizational solutions • ‚standardized‘ workflows© 2012 D. Fellner • rights management 13 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  14. 14. What to do with all the digital 3D artefacts?© 2012 D. Fellner 14 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  15. 15. Acquisition / Research Digitization Documentation Sales & Shipping Preservation Exhibition PR & Marketing Education Entertainment© 2012 D. Fellner15 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  16. 16. 3D-centered documentation© 2012 D. Fellner16 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  17. 17. 3D-centered documentation • 3D linking with • media data • meta data • provenance data© 2012 D. Fellner17 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  18. 18. 3D-centered documentation Repository© 2012 D. Fellner existing existing resources resources18 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  19. 19. 3D-centered documentation Repository© 2012 D. Fellner existing existing resources resources19 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  20. 20. Annotation tools: state of the art • structured information for describing the intrinsic structure of the digital 3D shape • (Papaleo and De Floriani 2010, Attene et al. 2009).© 2012 D. Fellner 20 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  21. 21. Annotation tools: state of the art • segmenting, and structuring • these are driven by different principles • (Attene at al. 2006, Shamir 2008 and Chen et al. 2009) vs.© 2012 D. Fellner complexity segmentation benchmark (geometry and texture) 21 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  22. 22. 3D documentation • need for more sophisticated 3D annotation and segmentation • requirements • segment object by • shape, texture/material, topology • surface or volume selection • link arbitrary media data (text, pictures, video, audio, …) • establish multi-lateral relationships • easy-to-use© 2012 D. Fellner 22 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  23. 23. Annotation tools: 3D-COFORM IVB • Video© 2012 D. Fellner accepted for EG VAST 2012 23 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  24. 24. Annotation tools • future challenges and potential technical solutions • human-assisted segmentation algorithms • machine learning • steering • improved user interfaces • gestures, drawing metaphors, etc. • crowd sourcing / collaboration • accessibility via 3D internet© 2012 D. Fellner 24 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  25. 25. 3D Internet and Europeana© 2012 D. Fellner 25 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  26. 26. 3D Internet: 3D Information inside the Web • from websites to web applications • increasing interest in 3D for • product presentation • visualization of abstract information (e.g. time lines) • enriching experience of Cultural Heritage • enhancing user experience with more sophisticated visualizations Example 3D-COFORM: • today: Adobe Flash-based sites with videos scanned historic 3D object • tomorrow: Immersive 3D inside browsers26 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  27. 27. 3D Internet: WebGL27 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  28. 28. 3D Internet: X3DOM – Declarative (X)3D in HTML5 • allows utilizing JavaScript and DOM infrastructure for 3D • brings together both worlds • declarative content design as known from web design • “old-school” imperative approaches known from game engine development <html> <body> <h1>Hello X3DOM World</h1> <x3d> <scene> <shape> <box></box> </shape> </scene> </x3d> </body> </html>28 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  29. 29. 3D Internet: X3DOM – Declarative (X)3D in HTML5 • X3DOM := X3D + DOM • DOM-based integration framework for declarative 3D graphics in HTML5 • seamless integration of 3D contents in Web Browser29 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  30. 30. 3D Internet© 2012 D. Fellner http://www.3dcoform.eu/ x3domCatalog/30 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  31. 31. 3D Internet© 2012 D. Fellner http://www.3dcoform.eu/ x3domCatalog/31 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  32. 32. 3D Internet: the way of 3D to Europeana Images Legacy 3D-COFORM© 2012 D. Fellner Integrated Viewer Browser (IVB) 3D model 32 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  33. 33. 3D Internet: the way of 3D to Europeana UUID dc:identifier URI europeana 3D :ty pe … … ESE format 3D-COFORM IVB© 2012 D. Fellner 3D model 33 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  34. 34. 3D Internet: the way of 3D to Europeana© 2012 D. Fellner Europeana 3D Web presentation 34 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  35. 35. 3D Internet • future challenges and potential technical solutions • automation • Internet 3D search engines (shape retrieval) • combined search • meta data, shape, material, … • organizational challenges • rights management • access, use, distribution, …© 2012 D. Fellner 35 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  36. 36. Conclusion • 3D Internet can tremendously affect accessibility to virtual 3D CH artefacts • 3D Internet base technology exists • WebGl, X3D, HTML5 • persisting technical challenges Cloud • economic acquisition Computing • organizational challenges • future synergies • linked open data Mobile 3D • Cloud Computing devices Internet • mobile devices36 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  37. 37. Thank you for your attention Andre.Stork@igd.fraunhofer.de www.igd.fraunhofer.de www.3d-coform.eu http://x3dom.org© 2012 D. Fellner 37 EuroMed, 30.10.2012 – A. Stork / D. Fellner

×