Bridging Semantic Web and Digital Shapes


Published on

Eurographics, 2007 - Short Paper presentation on be-SMART framework. Bridging Semantic Web and Digital Shapes

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Bridging Semantic Web and Digital Shapes

  1. 1. Bridging Semantic Web and Digital Shapes Laura Papaleo , Leila De Floriani ∗ University of Genova (ITALY) James Hendler † Rensselaer Polytechnic Institute (USA)
  2. 2. Motivations <ul><li>3D objects widely available on the net and used in many disciplines </li></ul><ul><li>We move to organize multimedia content into digital libraries </li></ul><ul><li>Attention turned towards archiving 3D objects in an intelligent way e.g. [1,2,3] </li></ul><ul><li>KEY: extract and maintain embedded knowledge </li></ul>[1] RAZDAN A., et al. (2002) [2] AIM@SHAPE, EC NoE, 2004-2007 [3] MINDSWAP, Univ. Maryland 2000-07
  3. 3. Our Contribution <ul><li>be-SMART [ * ] Semantic Web system for inspecting, structuring and annotating digital shapes </li></ul><ul><li>Goals </li></ul><ul><ul><li>Computation of quantifiable, replicable geometric/topological data </li></ul></ul><ul><ul><li>Extraction of features and regions of interest </li></ul></ul><ul><ul><li>Generation of ontology-driven metadata </li></ul></ul>[*] BE yond S hape M odeling for underst A nding R eal world represen T ations Shape is any object having visual appearance Digital shape: digital representation of real or virtual objects. [AIM@SHAPE NoE, 2004] Extract Organize Reuse-Share Formalize
  4. 4. Advantages <ul><li>Fast and semantic-driven population of digital libraries, for efficient searching and retrieval </li></ul><ul><ul><ul><li>[Example:] </li></ul></ul></ul>Info on the persons, the events, hyper-dimensional connections about concepts 2D Info on models, their geometry, the procedure of creation… hyper-dimensional connections about concepts 3D
  5. 5. be-SMART: the modules (1/3) Graphics World Semantic Web world <ul><li>Java-based </li></ul><ul><li>Platform independent </li></ul><ul><li>Modular and extensible </li></ul><ul><li>Extension of PhotoStuff [1] </li></ul>[1] Photostuff, MindSwap, Univ of Maryland, 2006 Annotator (Ontology & Metadata Mngmt) context-dependent Geometry and Topology Analyzer (GTA) Topological Decomposer (TD) Automatic Segmentation (AS) Manual Segmentation (MS) context-independent
  6. 6. be-SMART: the modules (2/3) <ul><li>GTA & TD extract info and decompose non-manifold models into manifold parts </li></ul><ul><li>be-SMART formalizes the connectivity among the portions in the Decomposition Graph (DG) </li></ul>Decomposition Graph for Shape Annotation <ul><li>a hypergraph H =< N,A > </li></ul><ul><ul><li>N components of the decomposition </li></ul></ul><ul><ul><li>A hyperarcs capturing the connectivity among components </li></ul></ul>armrest1 wire-web armrest2 wire-web back shell seat shell base shell NonManifoldMesh Mesh Geometrical Representation Shape Representation GTA (Populate with instances) Extract geometric info
  7. 7. be-SMART: the modules (3/3) <ul><li>The AS and MS modules perform segmentations on the basis of context-dependent heuristics. </li></ul><ul><ul><li>Both update the Decomposition Graph (DG) </li></ul></ul><ul><li>The DG is the interface with the Semantic Web back-end </li></ul>armrest1 wire-web armrest2 wire-web back shell seat shell base shell cone cylinder Updated Decomposition Graph Install-and-play Extensible and modular the system can be improved adding new services
  8. 8. be-SMART: Semantic web Back-end <ul><li>Multiple ontologies </li></ul><ul><li>Extension on-the-fly of a given ontology </li></ul><ul><ul><li>at schema and instance level </li></ul></ul><ul><li>RDF-OWL generation </li></ul><ul><li>XML transformations and updating (X3D,…) </li></ul>Share and Combine knowledge Improve and Extend knowledge Store knowledge Represent knowledge
  9. 9. Concluding Remarks <ul><li>We are integrating in the system different segmentation procedures </li></ul><ul><li>We are developing an interface to allow editing and manual on-the-fly segmentation of the models </li></ul><ul><li>We are going also to take into consideration proposal for web standards [1] and the semantic framework for the management of 3D data proposed in [2]. </li></ul><ul><li>The last step will be designing and implementing a new module (called iconization module) </li></ul><ul><li>We believe that be-SMART will be an important step towards an actual use of the Semantic Web for multimedia content </li></ul>[1] PITTARELLO & FAVERI (2006) [2] BILASCO et al. (2006)
  10. 10. Conclusion and Future <ul><li>HCI techniques </li></ul><ul><li>For improving the interaction with multi-facets content </li></ul><ul><li>For improving the way to interrogate a digital library and to show/browse results </li></ul><ul><li>CG / GM </li></ul><ul><li>Extend to high-dimensional data (video, volumetric data) </li></ul><ul><li>Improve the techniques for structuring and analyzing </li></ul><ul><li>Develop and iconization module, for building an semantically-enriched iconic representation of a model (also for indexing) </li></ul><ul><li>Semantic Web / Reasoners / Web Services </li></ul><ul><li>Improve the power of the reasoners for OWL </li></ul><ul><li>Towards the definition of semantic web services for reasoning on multimedia content… </li></ul><ul><li>Put in action the system (specific application domain – CH, medial applications, CAD…) </li></ul>
  11. 11. Thanks for your attention!! … QUESTIONS? Laura Papaleo [email_address] <ul><li>Work supported by the European NoE AIM@SHAPE and by Project FIRB SHALOM MIUR </li></ul><ul><li>Many thanks also to Annie Hui, May Huang (University of Maryland) and to the reviewers </li></ul>