RDFa-deployed Multimedia Metadata - Tutorial, Part 2


Published on

Introduction to RDFa-deployed Multimedia Metadata (ramm.x). In the
second part, ramm.x use cases are described and requirements are derived.

Published in: Technology, Education
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

RDFa-deployed Multimedia Metadata - Tutorial, Part 2

  1. 1. Institute of Information Systems & Information Management RDFa-deployed Multimedia Metadata Werner Bailer & Michael Hausenblas Graz, 2007-08-10
  2. 2. Where? Use Cases <ul><li>What constitutes a ramm.x use case? </li></ul><ul><li>Media assets are published on the Web </li></ul><ul><li>Along with the media asset, the multimedia metadata (as MPEG-7, Exif, ID3, etc.) is published </li></ul><ul><li>The metadata itself are neither free-text nor natively represented using an RDF-based vocabulary (as Music Ontology or OntologyX3D ) </li></ul><ul><li>A Semantic Web agent wants to access the multimedia metadata </li></ul>
  3. 3. Use Case: Photo Sharing (1) <ul><li>Exif information contains a lot of useful metadata </li></ul><ul><li>Some photo sharing sites (as Flickr and PBase ) extract & display metadata </li></ul>
  4. 4. Uses Case: Photo Sharing (2) <ul><li>Exif metadata in image is standardized </li></ul><ul><li>But how to get it from a photo sharing site? </li></ul><ul><ul><li>One can scrap the HTML code </li></ul></ul><ul><ul><li>Use a web service, e.g. flickr.photos.getExif , returns proprietary XML: </li></ul></ul><ul><ul><li><photo id=&quot;4424&quot; secret=&quot;06b8e43bc7&quot; server=&quot;2&quot;> </li></ul></ul><ul><ul><li><exif tagspace=&quot;TIFF&quot; tagspaceid=&quot;1&quot; tag=&quot;271&quot; label=&quot;Manufacturer&quot;> </li></ul></ul><ul><ul><li><raw>Canon</raw> </li></ul></ul><ul><ul><li></exif> </li></ul></ul><ul><ul><li><exif tagspace=&quot;GPS&quot; tagspaceid=&quot;3&quot; tag=&quot;4&quot; label=&quot;Longitude&quot;> </li></ul></ul><ul><ul><li><raw>64/1, 42/1, 4414/100</raw> </li></ul></ul><ul><ul><li><clean>64° 42' 44.14&quot;</clean> </li></ul></ul><ul><ul><li></exif> </li></ul></ul><ul><ul><li></photo> </li></ul></ul><ul><li>but no interoperability between different services! </li></ul>
  5. 5. Use Case: Buy Music (1) <ul><li>Online music stores provide little metadata (e.g. iTunes Store ) </li></ul>
  6. 6. Use Case: Buy Music (2) <ul><li>M etadata are available in common formats, as for example ID3 </li></ul><ul><li>Comprehensive online music databases (e.g. http://musicbrainz.org/ ) exist, providing metadata either as proprietary XML or RDF </li></ul><ul><li>Offering music with metadata allows linking with Semantic Web resources </li></ul><ul><ul><li>about artists </li></ul></ul><ul><ul><li>containing reviews </li></ul></ul><ul><ul><li>recommendations </li></ul></ul><ul><ul><li>etc. </li></ul></ul>
  7. 7. Use Case: Describe Video Structure <ul><li>NBA publishes game summaries on YouTube </li></ul><ul><li>Published metadata are very poor </li></ul><ul><li>As content is edited, information about the structure of the clips is available, but YouTube does not support it </li></ul><ul><li>Video structure </li></ul><ul><ul><li>could for example be published as MPEG-7 description </li></ul></ul><ul><ul><li>allows accessing parts of the video, as scenes showing a certain player </li></ul></ul><ul><li>There may be a LOT of metadata, hence a kind of ”streaming” would be useful </li></ul>
  8. 8. Use Case: Publish Professional Content <ul><li>Content providers sell their content increasingly online, for example the BBC Motion Gallery </li></ul><ul><li>Metadata published with content are not accessible for auto- matic processing </li></ul><ul><li>Comprehensive metadata are available in-house in established representations (as SMEF, or EBU P_Meta) </li></ul>
  9. 9. Use Case: Rights Metadata <ul><li>In simple cases, rights metadata are just a link to a well-defined license (as Creative Commons ) </li></ul><ul><li>More complicated rights information are usually available as huge text-only documents (e.g. Getty Images site) </li></ul><ul><li>DRM metadata formats are available, e.g. in MPEG-21, a REL is defined </li></ul>
  10. 10. Requirements <ul><li>Embed references to media assets in existing multimedia metadata formats in (X)HTML </li></ul><ul><ul><li>Describe not only complete (X)HTML pages, but also certain parts of it </li></ul></ul><ul><ul><li>Resulting description must be usable by an Semantic Web agent </li></ul></ul><ul><li>Provide reference to services capable of mapping between a specific multimedia metadata format and RDF (formalisation) </li></ul><ul><li>Several descriptions may be available for a media asset (e.g. in different formats, covering different aspects) and there may be several ways to formalise the description available in a certain format </li></ul><ul><li>Due to amount of metadata, it may be necessary to &quot;stream&quot; the metadata in pieces related to spatio-temporal segments </li></ul>
  11. 11. Institute of Information Systems & Information Management RDFa-deployed Multimedia Metadata Werner Bailer & Michael Hausenblas Graz, 2007-08-10