The Potential of the 3D Internet                             in the Cultural Heritage Domain                              ...
Access© 2012 D. Fellner                    2   EuroMed, 30.10.2012 – A. Stork / D. Fellner
3D Cultural Heritage Artifacts                         • worldwide                           many                         ...
3D Cultural Heritage Artifacts: precious & fragile                         • Stadtarchiv Köln                           30...
3D Cultural Heritage Artifacts                                                                      • Cultural heritage ex...
3D Cultural Heritage Artifacts                         • Let‘s do some calculations …                         • If we woul...
3D geometry digitization: state of the art                     3D Artifact  Digital Replica© 2012 D. Fellner            ...
3D material acquisition: state of the art                    • BTF-Dome (TU Bonn)© 2012 D. Fellner             8      Euro...
V&A study: Geometry with texture (no complex materials)      [h]             25             20             15             ...
3D Digitization & Documentation                     The model© 2012 D. Fellner          10        EuroMed, 30.10.2012 – A....
Time Budget: Geometry & Texture PLUS Material ̶ today                                                       Geometry and  ...
3D Cultural Heritage Artifacts                     • 3D acquisition challenges:                              • faster acqu...
3D Cultural Heritage Artifacts                     • technical approaches                              • fast cameras     ...
What to do with all the                                                               digital 3D artefacts?© 2012 D. Felln...
Acquisition /                                                                      Research                      Digitizat...
3D-centered documentation© 2012 D. Fellner16                  EuroMed, 30.10.2012 – A. Stork / D. Fellner
3D-centered documentation                    • 3D linking with                    • media data                    • meta d...
3D-centered documentation                                                                              Repository© 2012 D....
3D-centered documentation                                                                              Repository© 2012 D....
Annotation tools: state of the art                     • structured information for describing the intrinsic structure of ...
Annotation tools: state of the art                     • segmenting, and structuring                     • these are drive...
3D documentation                     • need for more sophisticated 3D annotation and segmentation                     • re...
Annotation tools: 3D-COFORM IVB                     • Video© 2012 D. Fellner                                              ...
Annotation tools                     • future challenges and potential technical solutions                              • ...
3D Internet and Europeana© 2012 D. Fellner        25          EuroMed, 30.10.2012 – A. Stork / D. Fellner
3D Internet: 3D Information inside the Web     • from websites to web applications     • increasing interest in 3D for    ...
3D Internet: WebGL27   EuroMed, 30.10.2012 – A. Stork / D. Fellner
3D Internet: X3DOM – Declarative (X)3D in HTML5     • allows utilizing JavaScript and DOM infrastructure for 3D     • brin...
3D Internet: X3DOM – Declarative (X)3D in HTML5                                                   • X3DOM := X3D + DOM    ...
3D Internet© 2012 D. Fellner                     http://www.3dcoform.eu/                     x3domCatalog/30              ...
3D Internet© 2012 D. Fellner                     http://www.3dcoform.eu/                     x3domCatalog/31              ...
3D Internet: the way of 3D to Europeana                                                 Images                     Legacy ...
3D Internet: the way of 3D to Europeana                                                                                  U...
3D Internet: the way of 3D to Europeana© 2012 D. Fellner                                                   Europeana      ...
3D Internet                     • future challenges and potential technical solutions                              • autom...
Conclusion     • 3D Internet can tremendously affect accessibility to       virtual 3D CH artefacts     • 3D Internet base...
Thank you for your attention                                                                  Andre.Stork@igd.fraunhofer.d...
Upcoming SlideShare
Loading in …5
×

Presentation

731 views
717 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
731
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Presentation

  1. 1. The Potential of the 3D Internet in the Cultural Heritage Domain André Stork, Dieter Fellner Fraunhofer IGD http://www.igd.fraunhofer.de GRIS / TU Darmstadt http://www.gris.tu-darmstadt.de© 2012 D. Fellner 1 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  2. 2. Access© 2012 D. Fellner 2 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  3. 3. 3D Cultural Heritage Artifacts • worldwide many hundreds of millions of CH objects 137 million objects© 2012 D. Fellner 3 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  4. 4. 3D Cultural Heritage Artifacts: precious & fragile • Stadtarchiv Köln 30 shelf-km collapse 3/2009 • Herzogin Anna Amalia Bibliothek Weimar© 2012 D. Fellner 4 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  5. 5. 3D Cultural Heritage Artifacts • Cultural heritage exhibits from all over the world • Artifacts dating back 6000 years in human history • More than 175 years of museum history • ~ 6 million artifacts • 120.000 new objects per year© 2012 D. Fellner 5 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  6. 6. 3D Cultural Heritage Artifacts • Let‘s do some calculations … • If we would like to scan only the new objects … • 120.000 / 365 days / 24 h / 60 minutes = • 0,22 obj/min • 4,38 min/object • Houston, we have a problem!© 2012 D. Fellner • Why? … 6 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  7. 7. 3D geometry digitization: state of the art  3D Artifact  Digital Replica© 2012 D. Fellner 7 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  8. 8. 3D material acquisition: state of the art • BTF-Dome (TU Bonn)© 2012 D. Fellner 8 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  9. 9. V&A study: Geometry with texture (no complex materials) [h] 25 20 15 10 5© 2012 D. Fellner Digitization [h] Postprocessing [h] (Study: Victoria & Albert Museum) 9 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  10. 10. 3D Digitization & Documentation The model© 2012 D. Fellner 10 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  11. 11. Time Budget: Geometry & Texture PLUS Material ̶ today Geometry and Material acquisition Postprocessing texture acquisition 12 h 16 h 8h = 36 hours Preparation Return© 2012 D. Fellner11 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  12. 12. 3D Cultural Heritage Artifacts • 3D acquisition challenges: • faster acquisition • optically complicated objects • spatially varying materials • translucent / transparent materials • cost reduction • ease of use • develop and establish workflows • transfer of knowledge and guidelines© 2012 D. Fellner • projects with critical mass 12 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  13. 13. 3D Cultural Heritage Artifacts • technical approaches • fast cameras • faster projectors (even more important) • automation (e.g. scan planning) • post-processing (registration, stitching, cleaning, etc.) • new sensors and sensor fusion • potential organizational solutions • ‚standardized‘ workflows© 2012 D. Fellner • rights management 13 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  14. 14. What to do with all the digital 3D artefacts?© 2012 D. Fellner 14 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  15. 15. Acquisition / Research Digitization Documentation Sales & Shipping Preservation Exhibition PR & Marketing Education Entertainment© 2012 D. Fellner15 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  16. 16. 3D-centered documentation© 2012 D. Fellner16 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  17. 17. 3D-centered documentation • 3D linking with • media data • meta data • provenance data© 2012 D. Fellner17 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  18. 18. 3D-centered documentation Repository© 2012 D. Fellner existing existing resources resources18 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  19. 19. 3D-centered documentation Repository© 2012 D. Fellner existing existing resources resources19 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  20. 20. Annotation tools: state of the art • structured information for describing the intrinsic structure of the digital 3D shape • (Papaleo and De Floriani 2010, Attene et al. 2009).© 2012 D. Fellner 20 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  21. 21. Annotation tools: state of the art • segmenting, and structuring • these are driven by different principles • (Attene at al. 2006, Shamir 2008 and Chen et al. 2009) vs.© 2012 D. Fellner complexity segmentation benchmark (geometry and texture) 21 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  22. 22. 3D documentation • need for more sophisticated 3D annotation and segmentation • requirements • segment object by • shape, texture/material, topology • surface or volume selection • link arbitrary media data (text, pictures, video, audio, …) • establish multi-lateral relationships • easy-to-use© 2012 D. Fellner 22 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  23. 23. Annotation tools: 3D-COFORM IVB • Video© 2012 D. Fellner accepted for EG VAST 2012 23 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  24. 24. Annotation tools • future challenges and potential technical solutions • human-assisted segmentation algorithms • machine learning • steering • improved user interfaces • gestures, drawing metaphors, etc. • crowd sourcing / collaboration • accessibility via 3D internet© 2012 D. Fellner 24 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  25. 25. 3D Internet and Europeana© 2012 D. Fellner 25 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  26. 26. 3D Internet: 3D Information inside the Web • from websites to web applications • increasing interest in 3D for • product presentation • visualization of abstract information (e.g. time lines) • enriching experience of Cultural Heritage • enhancing user experience with more sophisticated visualizations Example 3D-COFORM: • today: Adobe Flash-based sites with videos scanned historic 3D object • tomorrow: Immersive 3D inside browsers26 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  27. 27. 3D Internet: WebGL27 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  28. 28. 3D Internet: X3DOM – Declarative (X)3D in HTML5 • allows utilizing JavaScript and DOM infrastructure for 3D • brings together both worlds • declarative content design as known from web design • “old-school” imperative approaches known from game engine development <html> <body> <h1>Hello X3DOM World</h1> <x3d> <scene> <shape> <box></box> </shape> </scene> </x3d> </body> </html>28 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  29. 29. 3D Internet: X3DOM – Declarative (X)3D in HTML5 • X3DOM := X3D + DOM • DOM-based integration framework for declarative 3D graphics in HTML5 • seamless integration of 3D contents in Web Browser29 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  30. 30. 3D Internet© 2012 D. Fellner http://www.3dcoform.eu/ x3domCatalog/30 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  31. 31. 3D Internet© 2012 D. Fellner http://www.3dcoform.eu/ x3domCatalog/31 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  32. 32. 3D Internet: the way of 3D to Europeana Images Legacy 3D-COFORM© 2012 D. Fellner Integrated Viewer Browser (IVB) 3D model 32 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  33. 33. 3D Internet: the way of 3D to Europeana UUID dc:identifier URI europeana 3D :ty pe … … ESE format 3D-COFORM IVB© 2012 D. Fellner 3D model 33 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  34. 34. 3D Internet: the way of 3D to Europeana© 2012 D. Fellner Europeana 3D Web presentation 34 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  35. 35. 3D Internet • future challenges and potential technical solutions • automation • Internet 3D search engines (shape retrieval) • combined search • meta data, shape, material, … • organizational challenges • rights management • access, use, distribution, …© 2012 D. Fellner 35 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  36. 36. Conclusion • 3D Internet can tremendously affect accessibility to virtual 3D CH artefacts • 3D Internet base technology exists • WebGl, X3D, HTML5 • persisting technical challenges Cloud • economic acquisition Computing • organizational challenges • future synergies • linked open data Mobile 3D • Cloud Computing devices Internet • mobile devices36 EuroMed, 30.10.2012 – A. Stork / D. Fellner
  37. 37. Thank you for your attention Andre.Stork@igd.fraunhofer.de www.igd.fraunhofer.de www.3d-coform.eu http://x3dom.org© 2012 D. Fellner 37 EuroMed, 30.10.2012 – A. Stork / D. Fellner

×