A semantic-based framework for managing,
searching and retrieving 3D resources - Part 1. Presentation at VSMM09 Workshop on 3D Knowledge Technologies for Cultural Heritage Applications.
3D searching technology is developing to allow searching of 3D objects and models stored digitally. Researchers at universities like Purdue and Princeton have created 3D search engines that can analyze 3D shapes and structures. The engines convert 3D objects into mathematical representations that describe key features, and then compare new queries to stored objects. This allows searching based on the actual shape rather than text. The technology faces challenges in speed, accuracy, and ease of use, but could help industries search part designs and help professionals analyze medical images.
Three dimensional shape searching refers to the process of shape based retrieval of 3D models from a large database by determining the similarities among 3D shapes. 3D models have become integral component in fields like medicine, Architecture, chemistry and entertainment.This Document wii give a brief introduction about 3d searching.
This document discusses 3D searching and 3D search engines. It begins by introducing 3D searching as a method to search for 3D objects in a database based on a query. It then discusses the need for 3D search engines, the methodology which involves query formulation, search process, and search results. Examples of specific 3D search systems from Purdue and Princeton are provided. The advantages, limitations, and future prospects of 3D searching are outlined before concluding that 3D search engines can help find 3D models online, but their use is currently limited.
The document proposes a 3D password authentication system as an improvement over traditional textual passwords. A 3D password requires a user to navigate a virtual 3D environment and interact with various virtual objects in a specific sequence. This combines multiple authentication factors like recognition, recall, tokens, and biometrics. The document describes examples of virtual objects, implementation details, advantages of the 3D system, and potential applications.
Manual Segmentation and semantic-based hierarchical tagginf od 3d modelsUniversity PARIS-SUD
Today 3D objects have become widely available in different application domains, thus it is becoming fundamental to use, integrate and develop techniques for extracting and maintaining their implicit knowledge. These techniques should be encapsulated in intelligent systems able to semantically annotate the 3D models, thus improving their usability and indexing, especially in innovative web cooperative environments. In our work, we are moving in this direction, by defining and developing data structures, methods and interfaces for structuring and semantically annotating 3D complex models (and scenes), even changing over time, according to ontology-driven metadata. In this paper, we focus on tools and methods for manually segmenting manifold 3D models and on the underline structural representation that we build and manipulate. We present also an interface from which the user can inspect and browse the segmentation, describing also the first prototype of an annotation tool which allows a hierarchical semantic-driven tagging of the segmented model.
FOCUS K3D is a Coordination Action (CA)which aims at promoting the adoption of best-practices for the use of semantics in 3D content modelling and processing. This slide set gives an overview of the Application Working Group (AWG) CAD/CAE and Virtual Product Modelling.
You can download these slides at
http://www.focusk3d.eu/downloads
3D searching technology is developing to allow searching of 3D objects and models stored digitally. Researchers at universities like Purdue and Princeton have created 3D search engines that can analyze 3D shapes and structures. The engines convert 3D objects into mathematical representations that describe key features, and then compare new queries to stored objects. This allows searching based on the actual shape rather than text. The technology faces challenges in speed, accuracy, and ease of use, but could help industries search part designs and help professionals analyze medical images.
Three dimensional shape searching refers to the process of shape based retrieval of 3D models from a large database by determining the similarities among 3D shapes. 3D models have become integral component in fields like medicine, Architecture, chemistry and entertainment.This Document wii give a brief introduction about 3d searching.
This document discusses 3D searching and 3D search engines. It begins by introducing 3D searching as a method to search for 3D objects in a database based on a query. It then discusses the need for 3D search engines, the methodology which involves query formulation, search process, and search results. Examples of specific 3D search systems from Purdue and Princeton are provided. The advantages, limitations, and future prospects of 3D searching are outlined before concluding that 3D search engines can help find 3D models online, but their use is currently limited.
The document proposes a 3D password authentication system as an improvement over traditional textual passwords. A 3D password requires a user to navigate a virtual 3D environment and interact with various virtual objects in a specific sequence. This combines multiple authentication factors like recognition, recall, tokens, and biometrics. The document describes examples of virtual objects, implementation details, advantages of the 3D system, and potential applications.
Manual Segmentation and semantic-based hierarchical tagginf od 3d modelsUniversity PARIS-SUD
Today 3D objects have become widely available in different application domains, thus it is becoming fundamental to use, integrate and develop techniques for extracting and maintaining their implicit knowledge. These techniques should be encapsulated in intelligent systems able to semantically annotate the 3D models, thus improving their usability and indexing, especially in innovative web cooperative environments. In our work, we are moving in this direction, by defining and developing data structures, methods and interfaces for structuring and semantically annotating 3D complex models (and scenes), even changing over time, according to ontology-driven metadata. In this paper, we focus on tools and methods for manually segmenting manifold 3D models and on the underline structural representation that we build and manipulate. We present also an interface from which the user can inspect and browse the segmentation, describing also the first prototype of an annotation tool which allows a hierarchical semantic-driven tagging of the segmented model.
FOCUS K3D is a Coordination Action (CA)which aims at promoting the adoption of best-practices for the use of semantics in 3D content modelling and processing. This slide set gives an overview of the Application Working Group (AWG) CAD/CAE and Virtual Product Modelling.
You can download these slides at
http://www.focusk3d.eu/downloads
Event-driven Model Transformations in Domain-specific Modeling LanguagesIstvan Rath
This PhD thesis by István Ráth focuses on event-driven model transformations in domain-specific modeling languages. The thesis contains 3 parts: 1) developing concepts for event-driven graph transformations based on incremental pattern matching, 2) applying these concepts to provide advanced language engineering features like simulation, and 3) integrating modeling tools using change-driven transformations. The research aims to address challenges in scalability, usability and tool integration for model-driven software engineering.
This document provides an overview of the topics covered in an advanced computer aided design course, including principles of computer graphics, CAD tools, surface modeling, parametric representation of surfaces, geometric modeling in 3D, data exchange formats and standards, and collaborative engineering. The syllabus covers points plotting, lines, Bresenham's circle algorithm, transformations, hidden surface removal, CAD system evaluation criteria, modeling techniques like wireframe, surface and solid modeling, parametric surfaces, solid modeling representations, data exchange formats like IGES and DXF, and collaborative design principles and tools.
Texture features based text extraction from images using DWT and K-means clus...Divya Gera
Text extraction from different kind of images document, caption and scene text images. Discret wavelet transform was used to exract horizontal, vertical and diagonal features and k-means clustering was used to cluster the features into text and background cluster. For simple images k = 2 worked i.e. text and backgroud cluster while for complex images k=3 was used i.e. text cluster, complex background ad simple background.
From file-based production to real-time co-productionMaarten Verwaest
The document discusses how semantic technologies can enable the transition from file-based media production to real-time co-production. It describes some of the issues with current non-integrated production processes and how semantic modeling, linked data, and system integration using semantic technologies can help solve problems around re-use, retrieval and scalability. Examples of applications for semantic technologies in media production workflows from pre-production to archiving are also provided.
A copyright protection technology for 3 d printing models (john choi)MecklerMedia
1. The document discusses copyright protection technologies for 3D printing models, including a clearing center for copyrighted 3D models, feature extraction from 3D models, shape estimation to match models, and THz detection.
2. It describes potential solutions such as encryption of 3D model files, feature extraction for fingerprinting, and using a clearing center to manage licensing and monitor for illegal distribution of copyrighted 3D models.
3. The key technologies proposed are extracting features from 3D models, analyzing model structures through skeleton extraction, and estimating the original model shape based on the skeleton to enable digital forensics of 3D models.
The document discusses object-oriented modeling and design. It describes object-oriented design as planning a system of interacting objects to solve software problems using concepts like data abstraction, polymorphism, and data hiding. It outlines the object-oriented design process, including identifying classes and objects, defining attributes and relationships, and specifying interfaces. The benefits of object-oriented design are its reusability and mapping to real-world entities.
Computer-aided design (CAD) uses computer systems to assist in the creation, modification, analysis, or optimization of designs. CAD outputs are often electronic files used for manufacturing. Computer-aided manufacturing (CAM) uses software to control machine tools for faster, more precise production. 3D modeling software like Rhino can create, edit, and analyze complex NURBS and polygon mesh models. 3D printing started in the 1980s and builds 3D objects by adding layers based on a digital file. It offers advantages like low material waste and energy efficiency over conventional manufacturing. Students will learn CAD, 3D printing, scanning, and laser cutting through assignments applying these techniques to solve design problems.
Dominating set based arbitrary oriented bilingual scene text localizationIJECEIAES
Localizing and recognizing arbitrarily oriented text in natural scene images is the biggest challenge. It is because scene texts are often erratic in shapes. This paper presents a simple and effective graph representational algorithm for detecting arbitrary-oriented text location to smoothen the text recognition process because of its high impact and simplicity of representation. An arbitrarily oriented text can be horizontal, vertical, perspective, curved (diagonal/off-diagonal), or even a combination. As a pre-processing step, image enhancement is performed in the frequency domain to improve the representation of images that are invariant to intensity. It is necessary to draw bounding boxes for each candidate character in the scene images to extract text regions. This step is carried out by utilizing the advantage of the region-based approach called maximally stable extremal regions. A typical problem with curved text localization is that non-text objects may occur within localized text regions. Our method is the first in the literature that searches for dominating sets to solve this problem. This dominating set method outperforms several traditional methods, including deep learning methods used for arbitrary text localization, on challenging datasets like 13 th international conference on document analysis and recognition (ICDAR 2015), multi-script robust reading competition (MRRC), CurvedText 80 (CUTE80), and arbitrary text (ArT).
These slides were shown at EclipseCon 2010: http://www.eclipsecon.org/2010/sessions/sessions?id=1420
DSM (Domain Specific Modeling) allows very usefull tooling but users often requires real life use cases to understand how it could be deployed in their day-to-day work.
GMF is an Eclipse Modeling technology to create new graphical designers. It's very powerfull and allow very ergonomic environment, but it's quite difficult to master and adapt for real life designers.
Some newbies on GMF think this technology doesn't allow them to add rich features such as drag'n drop, lazy modeling, dynamic views, reconnection, validation, ... but it's only because they doesn't know the power of GMF Runtime.
This talk will show several use cases of GMF by doing live demos of killer features on resulted designers:
* designers for Entity of information systems implemented with JavaEE
* designers for real time systems
* designers for requirements
* designers for embedded systems
* designers for SOA
* designers for UML Profil viewpoints
* designers for screens cinematic
This talk will not show how to develop with GMF but will be focus on extended features which can be implemented on top of it with a viewpoint approach for dynamic graphical views.
Reverse Engineering of The Taj Mahal- An Abstract of The Project
The Taj Mahal at Agra, India is one of the wonders of the world. The Taj Mahal is Considered as World Heritage Site. The Taj Mahal is a Symbol of True Love.
SCENE TEXT RECOGNITION IN MOBILE APPLICATION BY CHARACTER DESCRIPTOR AND STRU...Cheriyan K M
In text detection, our
previously proposed algorithms are applied to obtain text regions
from scene image. First, we design a discriminative character
descriptor by combining several state-of-the-art feature detectors
and descriptors. Second, we model character structure at each
character class by designing stroke configuration maps.
The document discusses graphic standards for CAD systems. It covers the components of a CAD database including geometric entities and coordinate points. It emphasizes the need for standards to facilitate data exchange between CAD, analysis, and manufacturing software. Common standards discussed include GKS, PHIGS, DXF, IGES, and STEP files, which allow translation between different CAD packages using neutral file formats. Key geometric transformations like translation, rotation, and scaling are also summarized in the context of how they are used in CAD modeling and animation.
This document provides an introduction to computational design from Pirouz Nourian, a PhD candidate and instructor. It outlines key topics including parametric modeling, computational analysis, performance simulation, and design space exploration. Nourian's research focuses on using these computational design methods for architectural configuration and urban design. The document recommends plugins for structural, climatic, BIM, facade, and architectural design computations in Grasshopper. It concludes with an agenda for upcoming workshops on geometry/topology, algorithms, and performance optimization in computational design.
Text Extraction of Colour Images using Mathematical Morphology & HAAR TransformIOSR Journals
This document summarizes a research paper that proposes a method to extract text from color images using the Haar discrete wavelet transform (DWT) and mathematical morphology. It begins with an introduction to text extraction challenges and prior approaches. The proposed method detects text edges using the Haar DWT and removes non-text edges with thresholding. Morphological dilation is then used to connect isolated candidate text edges. Mathematical morphology and templates are also used to extract characters from images. The simulation was carried out using MATLAB for image processing.
The document discusses the purpose and process of software design. It describes software design as where customer requirements, business needs, and technical considerations come together to formulate a product or system. The design model provides detail about data structures, architecture, interfaces, and components. It can be assessed for quality before implementation. The document outlines the tasks in software design including examining data models, selecting an architecture, partitioning models into subsystems, and designing classes, components, interfaces, data structures, and algorithms. It also discusses the phases, methods, strategies, and importance of quality in software design.
Text detection and recognition in scene images or natural images has applications in computer
vision systems like registration number plate detection, automatic traffic sign detection, image retrieval
and help for visually impaired people. Scene text, however, has complicated background, blur image,
partly occluded text, variations in font-styles, image noise and ranging illumination. Hence scene text
recognition could be a difficult computer vision problem. In this paper connected component method
is used to extract the text from background. In this work, horizontal and vertical projection profiles,
geometric properties of text, image binirization and gap filling method are used to extract the text from
scene images. Then histogram based threshold is applied to separate text background of the images.
Finally text is extracted from images.
Future Trends on Software and Systems ModelingJordi Cabot
Modeling is more popular than ever, even if sometimes hidden behind other names (e.g. low-code). But of course, we can always do better.
In this talk, I'll describe the main technical/social challenges modeling is facing and the key trends that could solve them. We'll even throw some AI, Machine Learning and bots in the mix to show how modeling can be also useful there and even more, benefit from them, to move towards a smarter modeling future.
Spy On Your Models, Standard talk at EclipseCon 2011Hugo Bruneliere
The document discusses MoDisco, an Eclipse modeling project that uses models to represent and manipulate existing software systems. MoDisco aims to help with software modernization tasks like understanding legacy code, performing quality analysis, and migrating to new technologies. It includes a model browser for navigating and querying large and complex models. MoDisco is developed by a joint team from INRIA and Ecole des Mines de Nantes, with contributions from Mia-Software, Obeo, and other Eclipse members.
Virtual Humans in Cultural Heritage discusses adding virtual humans to cultural heritage sites through 3D modeling and animation. It describes creating avatars through 3D modeling pipelines, adding variety through textures and animations, and setting up crowds using brushes. Automatic navigation graphs are generated to guide avatar movement and behavior in smart environments where avatars interact with objects through animated behaviors. The goal is to use virtual humans to provide a more immersive experience for understanding cultural heritage sites.
Event-driven Model Transformations in Domain-specific Modeling LanguagesIstvan Rath
This PhD thesis by István Ráth focuses on event-driven model transformations in domain-specific modeling languages. The thesis contains 3 parts: 1) developing concepts for event-driven graph transformations based on incremental pattern matching, 2) applying these concepts to provide advanced language engineering features like simulation, and 3) integrating modeling tools using change-driven transformations. The research aims to address challenges in scalability, usability and tool integration for model-driven software engineering.
This document provides an overview of the topics covered in an advanced computer aided design course, including principles of computer graphics, CAD tools, surface modeling, parametric representation of surfaces, geometric modeling in 3D, data exchange formats and standards, and collaborative engineering. The syllabus covers points plotting, lines, Bresenham's circle algorithm, transformations, hidden surface removal, CAD system evaluation criteria, modeling techniques like wireframe, surface and solid modeling, parametric surfaces, solid modeling representations, data exchange formats like IGES and DXF, and collaborative design principles and tools.
Texture features based text extraction from images using DWT and K-means clus...Divya Gera
Text extraction from different kind of images document, caption and scene text images. Discret wavelet transform was used to exract horizontal, vertical and diagonal features and k-means clustering was used to cluster the features into text and background cluster. For simple images k = 2 worked i.e. text and backgroud cluster while for complex images k=3 was used i.e. text cluster, complex background ad simple background.
From file-based production to real-time co-productionMaarten Verwaest
The document discusses how semantic technologies can enable the transition from file-based media production to real-time co-production. It describes some of the issues with current non-integrated production processes and how semantic modeling, linked data, and system integration using semantic technologies can help solve problems around re-use, retrieval and scalability. Examples of applications for semantic technologies in media production workflows from pre-production to archiving are also provided.
A copyright protection technology for 3 d printing models (john choi)MecklerMedia
1. The document discusses copyright protection technologies for 3D printing models, including a clearing center for copyrighted 3D models, feature extraction from 3D models, shape estimation to match models, and THz detection.
2. It describes potential solutions such as encryption of 3D model files, feature extraction for fingerprinting, and using a clearing center to manage licensing and monitor for illegal distribution of copyrighted 3D models.
3. The key technologies proposed are extracting features from 3D models, analyzing model structures through skeleton extraction, and estimating the original model shape based on the skeleton to enable digital forensics of 3D models.
The document discusses object-oriented modeling and design. It describes object-oriented design as planning a system of interacting objects to solve software problems using concepts like data abstraction, polymorphism, and data hiding. It outlines the object-oriented design process, including identifying classes and objects, defining attributes and relationships, and specifying interfaces. The benefits of object-oriented design are its reusability and mapping to real-world entities.
Computer-aided design (CAD) uses computer systems to assist in the creation, modification, analysis, or optimization of designs. CAD outputs are often electronic files used for manufacturing. Computer-aided manufacturing (CAM) uses software to control machine tools for faster, more precise production. 3D modeling software like Rhino can create, edit, and analyze complex NURBS and polygon mesh models. 3D printing started in the 1980s and builds 3D objects by adding layers based on a digital file. It offers advantages like low material waste and energy efficiency over conventional manufacturing. Students will learn CAD, 3D printing, scanning, and laser cutting through assignments applying these techniques to solve design problems.
Dominating set based arbitrary oriented bilingual scene text localizationIJECEIAES
Localizing and recognizing arbitrarily oriented text in natural scene images is the biggest challenge. It is because scene texts are often erratic in shapes. This paper presents a simple and effective graph representational algorithm for detecting arbitrary-oriented text location to smoothen the text recognition process because of its high impact and simplicity of representation. An arbitrarily oriented text can be horizontal, vertical, perspective, curved (diagonal/off-diagonal), or even a combination. As a pre-processing step, image enhancement is performed in the frequency domain to improve the representation of images that are invariant to intensity. It is necessary to draw bounding boxes for each candidate character in the scene images to extract text regions. This step is carried out by utilizing the advantage of the region-based approach called maximally stable extremal regions. A typical problem with curved text localization is that non-text objects may occur within localized text regions. Our method is the first in the literature that searches for dominating sets to solve this problem. This dominating set method outperforms several traditional methods, including deep learning methods used for arbitrary text localization, on challenging datasets like 13 th international conference on document analysis and recognition (ICDAR 2015), multi-script robust reading competition (MRRC), CurvedText 80 (CUTE80), and arbitrary text (ArT).
These slides were shown at EclipseCon 2010: http://www.eclipsecon.org/2010/sessions/sessions?id=1420
DSM (Domain Specific Modeling) allows very usefull tooling but users often requires real life use cases to understand how it could be deployed in their day-to-day work.
GMF is an Eclipse Modeling technology to create new graphical designers. It's very powerfull and allow very ergonomic environment, but it's quite difficult to master and adapt for real life designers.
Some newbies on GMF think this technology doesn't allow them to add rich features such as drag'n drop, lazy modeling, dynamic views, reconnection, validation, ... but it's only because they doesn't know the power of GMF Runtime.
This talk will show several use cases of GMF by doing live demos of killer features on resulted designers:
* designers for Entity of information systems implemented with JavaEE
* designers for real time systems
* designers for requirements
* designers for embedded systems
* designers for SOA
* designers for UML Profil viewpoints
* designers for screens cinematic
This talk will not show how to develop with GMF but will be focus on extended features which can be implemented on top of it with a viewpoint approach for dynamic graphical views.
Reverse Engineering of The Taj Mahal- An Abstract of The Project
The Taj Mahal at Agra, India is one of the wonders of the world. The Taj Mahal is Considered as World Heritage Site. The Taj Mahal is a Symbol of True Love.
SCENE TEXT RECOGNITION IN MOBILE APPLICATION BY CHARACTER DESCRIPTOR AND STRU...Cheriyan K M
In text detection, our
previously proposed algorithms are applied to obtain text regions
from scene image. First, we design a discriminative character
descriptor by combining several state-of-the-art feature detectors
and descriptors. Second, we model character structure at each
character class by designing stroke configuration maps.
The document discusses graphic standards for CAD systems. It covers the components of a CAD database including geometric entities and coordinate points. It emphasizes the need for standards to facilitate data exchange between CAD, analysis, and manufacturing software. Common standards discussed include GKS, PHIGS, DXF, IGES, and STEP files, which allow translation between different CAD packages using neutral file formats. Key geometric transformations like translation, rotation, and scaling are also summarized in the context of how they are used in CAD modeling and animation.
This document provides an introduction to computational design from Pirouz Nourian, a PhD candidate and instructor. It outlines key topics including parametric modeling, computational analysis, performance simulation, and design space exploration. Nourian's research focuses on using these computational design methods for architectural configuration and urban design. The document recommends plugins for structural, climatic, BIM, facade, and architectural design computations in Grasshopper. It concludes with an agenda for upcoming workshops on geometry/topology, algorithms, and performance optimization in computational design.
Text Extraction of Colour Images using Mathematical Morphology & HAAR TransformIOSR Journals
This document summarizes a research paper that proposes a method to extract text from color images using the Haar discrete wavelet transform (DWT) and mathematical morphology. It begins with an introduction to text extraction challenges and prior approaches. The proposed method detects text edges using the Haar DWT and removes non-text edges with thresholding. Morphological dilation is then used to connect isolated candidate text edges. Mathematical morphology and templates are also used to extract characters from images. The simulation was carried out using MATLAB for image processing.
The document discusses the purpose and process of software design. It describes software design as where customer requirements, business needs, and technical considerations come together to formulate a product or system. The design model provides detail about data structures, architecture, interfaces, and components. It can be assessed for quality before implementation. The document outlines the tasks in software design including examining data models, selecting an architecture, partitioning models into subsystems, and designing classes, components, interfaces, data structures, and algorithms. It also discusses the phases, methods, strategies, and importance of quality in software design.
Text detection and recognition in scene images or natural images has applications in computer
vision systems like registration number plate detection, automatic traffic sign detection, image retrieval
and help for visually impaired people. Scene text, however, has complicated background, blur image,
partly occluded text, variations in font-styles, image noise and ranging illumination. Hence scene text
recognition could be a difficult computer vision problem. In this paper connected component method
is used to extract the text from background. In this work, horizontal and vertical projection profiles,
geometric properties of text, image binirization and gap filling method are used to extract the text from
scene images. Then histogram based threshold is applied to separate text background of the images.
Finally text is extracted from images.
Future Trends on Software and Systems ModelingJordi Cabot
Modeling is more popular than ever, even if sometimes hidden behind other names (e.g. low-code). But of course, we can always do better.
In this talk, I'll describe the main technical/social challenges modeling is facing and the key trends that could solve them. We'll even throw some AI, Machine Learning and bots in the mix to show how modeling can be also useful there and even more, benefit from them, to move towards a smarter modeling future.
Spy On Your Models, Standard talk at EclipseCon 2011Hugo Bruneliere
The document discusses MoDisco, an Eclipse modeling project that uses models to represent and manipulate existing software systems. MoDisco aims to help with software modernization tasks like understanding legacy code, performing quality analysis, and migrating to new technologies. It includes a model browser for navigating and querying large and complex models. MoDisco is developed by a joint team from INRIA and Ecole des Mines de Nantes, with contributions from Mia-Software, Obeo, and other Eclipse members.
Similar to A semantic-based framework for managing, searching and retrieving 3D resources - Part1 (20)
Virtual Humans in Cultural Heritage discusses adding virtual humans to cultural heritage sites through 3D modeling and animation. It describes creating avatars through 3D modeling pipelines, adding variety through textures and animations, and setting up crowds using brushes. Automatic navigation graphs are generated to guide avatar movement and behavior in smart environments where avatars interact with objects through animated behaviors. The goal is to use virtual humans to provide a more immersive experience for understanding cultural heritage sites.
A semantic-based framework for managing, searching and retrieving 3D resource...Marios Pitikakis
A semantic-based framework for managing,
searching and retrieving 3D resources - Part 2. Presentation at VSMM09 Workshop on 3D Knowledge Technologies for Cultural Heritage Applications.
The e-documentation of the Past in 3D: A Challenge and a Risk for the Present...Marios Pitikakis
The e-documentation of the Past in 3D: A Challenge and a Risk for the Present and the Future. Presentation at VSMM09 Workshop on 3D Knowledge Technologies for Cultural Heritage Applications.
A semantic-based framework for managing, searching and retrieving 3D resources - Part1
1. A semantic-based framework for managing,
searching and retrieving 3D resources
Marios Pitikakis, CERETETH
Chiara Catalano, IMATI-CNR
www.cereteth.gr
2. What’s needed for sharing?
Feature extraction
Indexing
Metadata
While addressed successfully for text and 2D
content, the management of semantic 3D
shapes is still in its infancy
Content-based analysis and retrieval
3. What’s semantics?
Knowledge related to the geometry of the 3D
shape
Knowledge related to the application domain
in which the object is manipulated
Knowledge related to the meaning of the
object represented by the 3D model
4. To turn 3D shapes in semantic shapes
CG KT
o 3D shape analysis & o metadata and standards for
segmentation 3D annotation
o 3D object comparison & o ontologies (broad & narrow
classification domains)
o 3D scene understanding o formalization of workflows,
o smart 3D modelling tools functionalities
o 3D mark-up
3D models representing not only shape but also
semantics
3D media annotation tools (manual, automatic)
intelligent virtual environments
5. Adding semantics to geometry
We have to extract and associate knowledge to
digital content
Shape analysis: extracts implicit info coded
into the geometry
Numerical values (e.g. volume, area, spatial
distribution, curvature)
Shape descriptors (structuring the shape)
Segmentation
geometry structure semantics
6. Semantic-driven segmentations
They captures semantically relevant features
automatically
what is relevant in the cultural heritage context?
IMATI segmentation methods for triangle meshes:
Fitting primitives
Reeb Graphs
Tailor
Plumber
They extract specific kind of knowledge suitable also
for virtual heritage
8. Adding semantics to geometry
We have to extract and associate knowledge to
digital content and its subparts
Shape Annotation: it documents the shape
with contextual knowledge either manually or
automatically
geometry structure semantics
10. ShapeAnnotator: general framework
Shape
A surface mesh
Abstracted
Shape
Shape A segmented mesh
CG Tools
Segmentation Plug-ins Annotator
Domain
An OWL ontology
Instance
Instance
Expert Knowledge Base
11. ShapeAnnotator: multi-segmentation
Pick the interesting features from different
shape segmentations
(b) Morse-based (c) Plumber (d) Fitting primitives