Interlinking Multimedia: How to Apply Linked Data Principles to Multimedia Fragments Michael Hausenblas, < [email_address] >, Raphaël Troncy , < [email_address] >, Tobias Bürger, < [email_address] >, Yves Raimond, < [email_address] >

Where is the Triumph Arc? http://www.flickr.com/photos/40001315@N00/2705120551 /

Who is Saphira? http://www.flickr.com/photos/mhausenblas/2883727293/ Region-based annotation in Flickr ... but it cannot be taken out of Flickr the flickr note provides a URI for the region, but one needs to access the flickr API to access the region [ CaMiCatzee ]

Region-based annotation in Flickr ... but it cannot be taken out of Flickr

the flickr note provides a URI for the region, but one needs to access the flickr API to access the region [ CaMiCatzee ]

Clinton Laughing with Yeltsin? http://www.youtube.com/watch?v=sxoh1z6s_Cw#t=15s Temporal annotation in YouTube ... but the UA downloads the complete resource and seeks ... and the YouTube syntax is different from Google Video, Vimeo, DailyMotion, etc.

Temporal annotation in YouTube ... but the UA downloads the complete resource and seeks ... and the YouTube syntax is different from Google Video, Vimeo, DailyMotion, etc.

Problems How to address and retrieve parts of multimedia content? region of an image / sequence of a video How to describe parts of multimedia content in the Web of Data? PREFIX foaf: <http://xmlns.com/foaf/0.1/> SELECT ?Clip WHERE { ?Clip foaf:depicts dbpedia:Laughter , yago:PresidentsOfTheRussianFederation , yago:President110468559 . }

How to address and retrieve parts of multimedia content?

region of an image / sequence of a video

How to describe parts of multimedia content in the Web of Data?

Answer abstract queries Find all sequences with a Russian President laughing with another President dbpedia:Boris_Yeltsin rdf:type yago:PresidentsOfTheRussianFederation dbpedia:Vladimir_Putin rdf:type yago:PresidentsOfTheRussianFederation #t=34s #t=15s

Find all sequences with a Russian President laughing with another President

iM: Interlinking Multimedia Apply linked data principles for fine-grained identification and description of multimedia fragments [ W3C Media Fragments WG ] Deploy legacy multimedia metadata formats on the web of data [ ramm.x ] Specialized interlinking methods for multimedia User-contributed interlinking, game-based Collaborative interlinking: MetaVidWiki [ MVW ] (Semi-)Automatic methods: multimedia analysis

Apply linked data principles for fine-grained identification and description of multimedia fragments [ W3C Media Fragments WG ]

Deploy legacy multimedia metadata formats on the web of data [ ramm.x ]

Specialized interlinking methods for multimedia

User-contributed interlinking, game-based

Collaborative interlinking: MetaVidWiki [ MVW ]

(Semi-)Automatic methods: multimedia analysis

W3C Media Fragments WG Provide URI-based mechanisms for uniquely identifying fragments for media objects on the Web, such as video, audio, and images.

Provide URI-based mechanisms for uniquely identifying fragments for media objects on the Web, such as video, audio, and images.

Scenario 1: retrieve the media content User Agent (media fragment conforming) : http:// www.youtube.com/watch?v =sxoh1z6s_Cw#12,21 GET / watch?v =sxoh1z6s_Cw HTTP/1.1 Host: www.youtube.com Accept: video/* Range: seconds=12-21 [ HTTPBis clarification ] Server:

User Agent (media fragment conforming) : http:// www.youtube.com/watch?v =sxoh1z6s_Cw#12,21

GET / watch?v =sxoh1z6s_Cw HTTP/1.1 Host: www.youtube.com Accept: video/* Range: seconds=12-21 [ HTTPBis clarification ]

Server:

Scenario 2: retrieve a semantic representation of the media content User Agent: GET / watch?v =sxoh1z6s_Cw HTTP/1.1 Host: www.youtube.com Accept: application/rdf+xml Range: seconds=12-21 Server:

User Agent:

GET / watch?v =sxoh1z6s_Cw HTTP/1.1 Host: www.youtube.com Accept: application/rdf+xml Range: seconds=12-21

Server:

Discussion Is conneg-ing between rdf+xml and video/* a good behavior? Current configuration of jigsaw [ W3C Photo RDF ] Equivalent: « Content is &quot;equivalent&quot; to other content when both fulfill essentially the same function or purpose upon presentation to the user » [ WAG ] Abuse of content negotiation: what is the sameness of two representations of a resource? How to draw the line? Are an image and its ASCII version close enough to be content negotiated? Is a transcoded media content still a fragment?

Is conneg-ing between rdf+xml and video/* a good behavior?

Current configuration of jigsaw [ W3C Photo RDF ]

Equivalent: « Content is &quot;equivalent&quot; to other content when both fulfill essentially the same function or purpose upon presentation to the user » [ WAG ]

Abuse of content negotiation: what is the sameness of two representations of a resource?

How to draw the line?

Are an image and its ASCII version close enough to be content negotiated?

Is a transcoded media content still a fragment?

More Resources Use Cases and Requirements for Media Fragments http://www.w3.org/TR/media-frags-reqs Interlinking Multimedia http://www.interlinkingmultimedia.info/ Continue the discussion @ LOD http://lists.w3.org/Archives/Public/public-lod/

Use Cases and Requirements for Media Fragments http://www.w3.org/TR/media-frags-reqs

Interlinking Multimedia http://www.interlinkingmultimedia.info/

Continue the discussion @ LOD http://lists.w3.org/Archives/Public/public-lod/