Unlocking the Semantics of Multimedia Presentations in the Web with the Multimedia Metadata Ontology Carsten Saathoff  and...
A SMIL Presentation
A SMIL Presentation
How to … <ul><li>… index multimedia presentations? </li></ul><ul><li>… search and navigate among collections of presentati...
Existing Standards <ul><li>Focus on single media type </li></ul><ul><ul><li>No support for “true” multimedia </li></ul></u...
Embedding Metadata (Example: SMIL) <smil xmlns=&quot;http://www.w3.org/2006/SMIL30/...&quot;> <head> <!-- Metadata --> <me...
Solution Generic and formal modeling framework for representing multimedia metadata. M3O: Multimedia Metadata Ontology
M3O at a glance <ul><li>Covers core features of existing standards </li></ul><ul><li>Based on Semantic Web standards </li>...
Supported Features <ul><li>Information Realization </li></ul><ul><li>Annotation </li></ul><ul><li>Decomposition </li></ul>...
Semantic Web – RDF ex:presentation-nuclear ex:depicts “ Albert Einstein” foaf:name dbpedia:Ulm dbpedia:birthplace dbpedia:...
Core Ontologies <ul><li>Based on ontology design patterns </li></ul><ul><ul><li>Aligned to upper level ontology </li></ul>...
Naïve Approach to Annotation ex:presentation-nuclear m3o:depicts ex:john m3o:creator Reification dbpedia:Albert_Einstein
Annotation in M3O ex:annotation-situation ex:annotation-pattern ex:annotated-concept ex:annotation-concept ex:presentation...
Provenance in M3O ex:applied-method-role ex:creator ex:manual-annotation ex:john ex:annotation-situation ex:annotation-pat...
Annotation Pattern
M3O Patterns Information Realization Annotation Data Value Decomposition
Embedding M3O in SMIL <metadata id=&quot;meta-rdf&quot;> <rdf:RDF  xml:base=&quot;http://example.com/john/nuclear&quot; xm...
Conclusions <ul><li>M3O as guideline for modeling multimedia metadata </li></ul><ul><ul><li>SVG, SMIL, Flash foresee the u...
Backup
Identified Features <ul><li>Identification of Resources </li></ul><ul><li>Information Realization </li></ul><ul><li>Annota...
Features to Support “ Albert Einstein, Times Square” creation-date:01/01/2010 Annotation Annotation Decomposition Achievem...
M3O Patterns D&S Information Realization Annotation Data Value Decomposition
Information Realization dul:realizes dul:InformationRealization dul:InformationObject rdf:type rdf:type
Information Realization Pattern
Problems <ul><li>Single Media </li></ul><ul><ul><li>Only few support multiple media types (e.g. MPEG-7) </li></ul></ul><ul...
Structure of a (SMIL) presentation Images Achievements… Text + Video Albert Einstein spatial temporal sequential, parallel...
 
Existing Standards <ul><li>Most focus on single media type </li></ul><ul><ul><li>No support for “true” multimedia </li></u...
Limited Expressivity <ul><li>Integration of background knowledge </li></ul><ul><ul><li>Refer to existing knowledge (LOD) <...
Naïve Approach to Annotation Albert Einstein depicts “ John” creator Reification Anordnung wie auf naechster Folie
Upcoming SlideShare
Loading in …5
×

Unlocking the Semantics of Multimedia Presentations in the Web with the Multimedia Metadata Ontology

1,357 views

Published on

The semantics of rich multimedia presentations in the web such as SMIL, SVG, and Flash cannot or only to a very limited extend be understood by search engines today.
This hampers the retrieval of such presentations and makes their archival and management a difficult task.
Existing metadata models and metadata standards are either conceptually too narrow, focus on a specific media type only, cannot be used and combined together, or are not practically applicable for the semantic description of rich multimedia presentations.

In this paper, we propose the Multimedia Metadata Ontology (M3O) for annotating rich, structured multimedia presentations.
The M3O provides a generic modeling framework for representing sophisticated multimedia metadata.
It allows for integrating the features provided by the existing metadata models and metadata standards.
Our approach bases on Semantic Web technologies and can be easily integrated with multimedia formats such as the W3C standards SMIL and SVG.
With the M3O, we unlock the semantics of rich multimedia presentations in the web by making the semantics machine-readable and machine-understandable.
The M3O is used with our SemanticMM4U framework for the multi-channel generation of semantically-rich multimedia presentations.

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,357
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
16
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Unlocking the Semantics of Multimedia Presentations in the Web with the Multimedia Metadata Ontology

  1. 1. Unlocking the Semantics of Multimedia Presentations in the Web with the Multimedia Metadata Ontology Carsten Saathoff and Ansgar Scherp
  2. 2. A SMIL Presentation
  3. 3. A SMIL Presentation
  4. 4. How to … <ul><li>… index multimedia presentations? </li></ul><ul><li>… search and navigate among collections of presentations? </li></ul><ul><li>… enable semantic access? </li></ul>Metadata!
  5. 5. Existing Standards <ul><li>Focus on single media type </li></ul><ul><ul><li>No support for “true” multimedia </li></ul></ul><ul><li>No interoperability </li></ul><ul><ul><li>Metadata distributed over numerous formats </li></ul></ul><ul><li>No support for semantics </li></ul><ul><ul><li>No integration with background knowledge </li></ul></ul>
  6. 6. Embedding Metadata (Example: SMIL) <smil xmlns=&quot;http://www.w3.org/2006/SMIL30/...&quot;> <head> <!-- Metadata --> <metadata id=&quot;meta-rdf&quot;> </metadata> <!-- layout --> </head> <body> <!-- Presentation content --> <seq id=&quot;mainPresentation&quot;> <par xml:id=&quot;scientificAchievements&quot;>...</par> <par xml:id=&quot;scientificRisks&quot;>...</par> </seq> </body> </smil> ???
  7. 7. Solution Generic and formal modeling framework for representing multimedia metadata. M3O: Multimedia Metadata Ontology
  8. 8. M3O at a glance <ul><li>Covers core features of existing standards </li></ul><ul><li>Based on Semantic Web standards </li></ul><ul><ul><li>RDF for data representation </li></ul></ul><ul><li>Realized as a core ontology </li></ul><ul><ul><li>Represented in OWL </li></ul></ul>
  9. 9. Supported Features <ul><li>Information Realization </li></ul><ul><li>Annotation </li></ul><ul><li>Decomposition </li></ul><ul><li>Provenance </li></ul><ul><li>Identification of Resources </li></ul>Achievements … Albert Einstein vs.
  10. 10. Semantic Web – RDF ex:presentation-nuclear ex:depicts “ Albert Einstein” foaf:name dbpedia:Ulm dbpedia:birthplace dbpedia:Germany foaf:Person rdf:type dbpedia:locatedIn dbpedia:City dbpedia:Country rdf:type rdf:type ex:Scientist dbpedia:Albert_Einstein
  11. 11. Core Ontologies <ul><li>Based on ontology design patterns </li></ul><ul><ul><li>Aligned to upper level ontology </li></ul></ul><ul><li>Provide </li></ul><ul><ul><li>Rich Axiomatization </li></ul></ul><ul><ul><li>Modularity </li></ul></ul><ul><ul><li>Extensibility </li></ul></ul><ul><ul><li>Reusability </li></ul></ul><ul><ul><li>Separation of Concerns </li></ul></ul><ul><li>Successfully applied to other domains </li></ul><ul><ul><li>Events (F), PIM (X-COSIMO), MPEG-7 (COMM) </li></ul></ul>
  12. 12. Naïve Approach to Annotation ex:presentation-nuclear m3o:depicts ex:john m3o:creator Reification dbpedia:Albert_Einstein
  13. 13. Annotation in M3O ex:annotation-situation ex:annotation-pattern ex:annotated-concept ex:annotation-concept ex:presentation-nuclear defines hasSetting classifies classifies satisfies Description Situation dbpedia:Albert_Einstein
  14. 14. Provenance in M3O ex:applied-method-role ex:creator ex:manual-annotation ex:john ex:annotation-situation ex:annotation-pattern ex:annotated-concept ex:annotation-concept ex:presentation-nuclear classifies classifies satisfies dbpedia:Albert_Einstein classifies classifies defines hasSetting
  15. 15. Annotation Pattern
  16. 16. M3O Patterns Information Realization Annotation Data Value Decomposition
  17. 17. Embedding M3O in SMIL <metadata id=&quot;meta-rdf&quot;> <rdf:RDF xml:base=&quot;http://example.com/john/nuclear&quot; xmlns:dul=&quot;http://www.loa-cnr.it/ontologies/DUL.owl#&quot; xmlns:m3o=&quot;http://m3o.semantic-multimedia.org/ontology/model.owl#&quot;> <m3osmil:SMILFile rdf:about=&quot;http://example.com/john/nuclear.smil&quot;> <dul:realizes rdf:resource=&quot;#presentation-1&quot;/> </m3osmil:SMILFile> <m3osmil:SMILElement rdf:about=&quot; http://example.com/john/nuclear.smil#scientificAchievements &quot;> <dul:realizes rdf:resource=&quot;#part-1&quot;/> </m3osmil:SMILElement> <!-- more, e.g. #part-1, #image-1, ... --> </rdf:RDF> </metadata> <body> <!-- Presentation content --> <seq id=&quot;mainPresentation&quot;> <par xml:id=&quot; scientificAchievements &quot;>...</par> <par xml:id=&quot;scientificRisks&quot;>...</par> </seq> </body> </smil>
  18. 18. Conclusions <ul><li>M3O as guideline for modeling multimedia metadata </li></ul><ul><ul><li>SVG, SMIL, Flash foresee the use of Semantic Web standards </li></ul></ul><ul><li>Formalization provides for interoperability along media process chain </li></ul><ul><li>Integration with the Semantic Web </li></ul><ul><li>http://semantic-multimedia.org/index.php/M3O:Main </li></ul><ul><ul><li>Mapping to MPEG-7 via COMM </li></ul></ul><ul><ul><li>Mapping to Media Ontology (W3C Media Annotations WG) planned </li></ul></ul><ul><ul><li>Link to Java API </li></ul></ul>
  19. 19. Backup
  20. 20. Identified Features <ul><li>Identification of Resources </li></ul><ul><li>Information Realization </li></ul><ul><li>Annotation </li></ul><ul><li>Decomposition </li></ul><ul><li>Provenance </li></ul>
  21. 21. Features to Support “ Albert Einstein, Times Square” creation-date:01/01/2010 Annotation Annotation Decomposition Achievements… Albert Einstein “ John” Information Realization Provenance
  22. 22. M3O Patterns D&S Information Realization Annotation Data Value Decomposition
  23. 23. Information Realization dul:realizes dul:InformationRealization dul:InformationObject rdf:type rdf:type
  24. 24. Information Realization Pattern
  25. 25. Problems <ul><li>Single Media </li></ul><ul><ul><li>Only few support multiple media types (e.g. MPEG-7) </li></ul></ul><ul><ul><li>None supports rich multimedia presentations </li></ul></ul><ul><li>Limited Expressivity </li></ul><ul><ul><li>No integration of “semantics” </li></ul></ul><ul><li>No guidelines for metadata use </li></ul><ul><ul><li>Although SMIL, SVG, Flash foresee metadata and propose standards (RDF) </li></ul></ul>
  26. 26. Structure of a (SMIL) presentation Images Achievements… Text + Video Albert Einstein spatial temporal sequential, parallel, … + Audio
  27. 28. Existing Standards <ul><li>Most focus on single media type </li></ul><ul><ul><li>No support for “true” multimedia </li></ul></ul><ul><li>No interoperability </li></ul><ul><ul><li>Metadata distributed over different standards </li></ul></ul>MPEG-7, ID3, Dublin Core, …
  28. 29. Limited Expressivity <ul><li>Integration of background knowledge </li></ul><ul><ul><li>Refer to existing knowledge (LOD) </li></ul></ul><ul><li>Semantics of Annotation </li></ul><ul><li>Provenance of Metadata </li></ul>Albert Einstein Time Square Nuclear Energy
  29. 30. Naïve Approach to Annotation Albert Einstein depicts “ John” creator Reification Anordnung wie auf naechster Folie

×