SlideShare a Scribd company logo
Linking Media and Data using
Apache Marmotta
Keynote at LIME 2014 Workshop
Sebastian Schaffert and Thomas Kurz
Contents
➔Motivation: The Red Bull Content Pool
➔Background:
➔ Linked Media Principles
➔ Media Fragments and Media Ontology
➔Implementation: Linked Media Framework
➔ Red Bull Use Case
➔ ConnectMe Use Case
➔Standardising: The Linked Data Platform
➔Introducing Apache Marmotta
➔Querying for Multimedia Fragments: SPARQL-MM
2009
2011
2013
2014
Motivation: The Red Bull Content Pool
Linked Media (2009)
Linked Media = Linked People + Linked Content + Linked Data
Motivation: The Red Bull Content Pool
➔ online archive containing video and image material related to
extreme sports events organised by Red Bull
➔ business-to-business portal where journalists can get material for
further broadcasting (mostly for free)
➔ material comes with metadata in the form of tables in word
documents:
➔ interview transcriptions (with time interval start/end second)
➔ scene descriptions (with time interval start/end second)
➔ music cue sheets (copyright information about background
music tracks)
Motivation: The Red Bull Content Pool (2009)
Motivation: The Red Bull Content Pool
➔Problems:
➔ videos consist of series of scenes with many different
persons
➔ scanning through a video to find a particular scene is a
huge amount of work
➔ metadata is valuable but not really exploited for searching
videos and while playing videos
Can we help Markus?
Name: Markus
Occupation: sports journalist
Company: RegioTV Pinzgau
Objective: create report about cliff diving
Requires: videos, background info, contacts
How can we help Markus?
 efficient and precise search in the Red Bull Content Pool
 compact and relevant display of background information
 contacts (e.g. website,email) of athletes, other journalists, etc.
fast and successful creation of the report
Background: Linked Media Principles
Linked Media Principles (2009)
➔ Linked Data is „read-only“
i.e. focus was on publication of big datasets, not the interaction
with data
 a system for managing media assets needs to be capable of
updating resources and their metadata
➔ Linked Data is „data-only“
i.e. a resource is represented either as RDF metadata for
machines or as HTML tables for humans, but in all cases it is
metadata and not content
 a system for managing media assets needs to be capable of
managing both media content and metadata about that content
Linked Media Principles (2009)
➔ extend Linked Data for updates using REST principles (HTTP):
➔ GET: returns a resource (as in Linked Data)
➔ POST: creates a new resource and uploads content or metadata
➔ PUT: updates content or metadata of a resource
➔ DELETE: removes a resource and all associated information
➔ extend Linked Data for arbitrary media formats using MIME:
➔ controlled by Accept: (in case of GET) and Content-Type: (in case of
PUT/POST) HTTP headers
➔ header value: MIME type (e.g. text/turtle or image/jpeg) and type of
relationship (e.g. rel=content or rel=meta)
➔ accessing a resource with GET or PUT redirects to the actual
representation specified by MIME type and relationship
Linked Media Principles (2009)
➔ Example 1: Retrieve HTML table representation of resource metadata
➔ Example 2: Retrieve HTML content of resource
➔ Example 3: Update resource metadata
GET http://data.redlink.io/resource/1234
Accept: text/html; rel=meta
GET http://data.redlink.io/resource/1234
Accept: text/html; rel=content
PUT http://data.redlink.io/resource/1234
Content-Type: text/turtle; rel=meta
<http://data.redlink.io/resource/1234>
mm:hasFragment <http://data.redlink.io/resource/1234#t=0,10>
Background:
Media Fragments URI &
Ontology for Media Resources
Media Fragments URI
➔ media content currently treated as „black box binary content“
➔ interaction only via plugin or special browser support
➔ linking to a subsequence of a video not possible
➔ Media Fragments URI: use the „fragment“ part of a URI to
encode temporal and spatial subsequences
➔ Examples:
Identify the sequence from second 3 to second 10 of the video:
http://data.redlink.io/resource/cliff_diving.ogg#t=3,10
Identify the spatial box 320x240 at x=160 and y=120 of the video
http://data.redlink.io/resource/cliff_diving.ogg#xywh=160,120,320,240
Ontology for Media Resources
➔ common data model for representing video metadata:
➔ identification
➔ creation (hasCreator, hasPublisher, ...)
➔ content description (hasLanguage, hasGenre, hasKeyword,...)
➔ rights and distribution (hasPermissions, hasTargetAudience, ...)
➔ technical properties (hasCompression, hasFormat, ...)
➔ fragments (hasFragment, hasChapter, ...)
➔ mapping tables from the most popular video metadata formats to
the Ontology for Media Resources (EXIF, MPEG-7, TV-Anytime,
YouTube, ID3)
Combining Media Fragments and Media Ontology
➔ use Media Fragment URIs to uniquely identify fragments of
media content
➔ browser compatibility
➔ Linked Data compatibility
➔ use Ontology for Media Resources to describe these fragments
➔ RDF compatibility
➔ rich description graph with SPARQL querying
Combining Media Fragments and Media Ontology
@prefix ma: <http://www.w3.org/ns/ma-ont#> .
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix foaf: <http://xmlns.com/foaf/0.1/> .
@prefix dct: <http://purl.org/dc/terms/> .
<http://example.org/v1> a ma:MediaResource;
rdfs:label "A sports video";
ma:locator <http://my.videos.org/v1.mp4>;
ma:hasFragment <http://example.org/v1#fragment1>;
ma:hasFragment <http://example.org/v1#fragment2>.
<http://example.org/v1#fragment1> ma:locator
<http://my.videos.org/v1.mp4#xywh=percent:26,20,22,80&t=194,198>;
dct:subject <http://example.org/person/Connor_Macfarlane>.
<http://example.org/v1#fragment2> ma:locator
<http://my.videos.org/v1.mp4#xywh=percent:71,0,29,100&t=193,198>;
dct:subject <http://example.org/person/Lewis_Jones>.
<http://example.org/person/Connor_Macfarlane>
foaf:name "Connor Macfarlane".
<http://example.org/person/Lewis_Jones> foaf:name "Lewis Jones".
Combining Media Fragments and Media Ontology
Implementation:
The Linked Media Framework
Behind the Scenes: Linked Media Framework
 Linked Data Server with updates and uniform management of content and
metadata => particularly well-suited for multimedia content and metadata!
 Linked Media Principles for resource-centric access to content and
metadata
 SPARQL Query and SPARQL Update 1.1 for structural updating and
querying
 Modules for Reasoning, Semantic Search, Linked Data Caching, Versioning,
and Social Media
 Specialised on Linked Media and Linked Enterprise Content
Code, Installer, Screencasts and more:
http://code.google.com/p/lmf/
Linked Media Framework (Architecture)
LMF Semantic Search
 Facetted Search over Content and Metadata with SOLR compatible API
 RDF Path Language for configurable Metadata Indexing
 Multiple Cores with different configurations to adapt to different search
requirements
LMF Reasoning
 Rule-based reasoning over triples in the LMF triple store to represent implicit
knowledge
 Reason maintenance allows to describe justifications for inferences
 adapted version of sKWRL rule language:
 more efficient implementation,
 improved reason maintenance
LMF Linked Data Caching
 transparently retrieves linked resources from the Linked Data cloud when needed
(e.g. LD Path or SPARQL query)
 powerful component for integrating with other information systems exposing their
data as Linked Media or Linked Data
 adapters for services offering their data in proprietary formats (e.g. YouTube, Vimeo,
…)
LMF Classification and Sentiment Analysis
 support for statistical text classification, allows to train different classifiers with sample
texts for arbitrary categories
 suggest most likely category for a text according to similarity with training data
 analyse text for positive or negative sentiment (German and English)
25
LMF Social Media Integration
 allows linking to social media resources, e.g. Facebook or Google accounts, videos,
interests
 allows authentication and data import from selected social media services
(Facebook, YouTube, generic RSS)
LMF Versioning
 keeps history of updates in the Linked Media Framework
 provides information for trust and provenance
of data, e.g. annotations added to the system
Use Case:
Red Bull Semantic Search Prototype
Media Fragment Search
Spatial and Temporal Fragments
Use Case:
LIME Media Player (ConnectMe Project)
LIME Player: Interaction with Fragments
Standardisation:
The Linked Data Platform
Linked Data Platform: Introduction
➔ recommendation draft of the LDP working group at W3C
➔ support for „read/write Linked Data“
➔ support for RDF and non-RDF resources
➔ can be used as an alternative for Linked Media Principles
➔ advantage of standardisation and wide adoption
➔ considerably more complex standard and protocol
➔ URL: http://www.w3.org/TR/ldp/
Linked Data Platform: Concepts
➔ access and interaction according to REST webservice principles
➔ GET: returns description of a resource
➔ POST: creates a new resource
➔ PUT: replaces the description of a resource
➔ DELETE: removes the description of a resource
➔ Linked Data Platform Resources (LDP-R)
➔ RDF resources (LDP-RS): RDF description of a resource
➔ non-RDF resources (LDP-NR): arbitrary (media) content
➔ Linked Data Platform Containers (LDP-C)
➔ collection of LDP resources, e.g. „students“, „professors“, „lectures“
➔ basic container (LDP-BC): simple collection of resources with common URI prefix
➔ direct container (LDP-DC): collection with explicit membership (as triple)
➔ indirect container (LDP-IC): collection with implicit membership (based on content)
LDP Basic Containers (LDP-BC)
➔ collection of LDP resources
➔ identification via common URI prefix, e.g.
http://example.com/container1/a
http://example.com/container1/b
➔ can contain both RDF and non-RDF resources at the same time
➔ container is itself an RDF resource
➔ description as RDF:
@base <http://example.com/container1/>
@prefix dcterms: <http://purl.org/dc/terms/>.
@prefix ldp: <http://www.w3.org/ns/ldp#>.
<>
a ldp:BasicContainer;
dcterms:title "A very simple container";
ldp:contains <a>, <b>, <c>.
Introducing Apache Marmotta
Apache Marmotta
➔ a simplification of the Linked Media Framework taking core
components:
➔ Linked Data Server with SPARQL 1.1
➔ Linked Data Cache
➔ Versioning, Reasoning
➔ no search, no content analysis
➔ reference implementation of the Linked Data Platform and
participation in W3C working group
➔ highly modular and extensible to build custom Linked Data
applications (both client and server)
http://marmotta.apache.org
Apache Marmotta: Architecture
Querying Multimedia Fragments
SPARQL-MM: Introduction
➔ extension of SPARQL with specific multimedia functions and
relations, implemented in Apache Marmotta
RelationFunction Aggregation Function
Spatial mm:rightBeside mm:spatialIntersection
mm:spatialOverlaps mm:spatialBoundingBox
… …
Temporal mm:after mm:temporalIntersection
mm:temoralOverlaps mm:temporalIntermediate
… …
Combined mm:overlaps mm:boundingBox
mm:contains mm:intersection
A list of all functions can be found at:
https://github.com/tkurz/sparql-mm/blob/master/sparql-mm/functions.md
SPARQL-MM: A sample query
Give me the spatio-temporal snippet that shows Lewis Jones
right beside Connor Macfarlane.
PREFIX foaf: <http://xmlns.com/foaf/0.1/>
PREFIX mm: <http://linkedmultimedia.org/sparql-mm/functions#>
PREFIX ma: <http://www.w3.org/ns/ma-ont#>
PREFIX dct: <http://purl.org/dc/terms/>
SELECT (mm:boundingBox(?l1,?l2) AS ?two_guys) WHERE {
?f1 ma:locator ?l1; dct:subject ?p1.
?p1 foaf:name "Lewis Jones".
?f2 ma:locator ?l2; dct:subject ?p2.
?p2 foaf:name "Connor Macfarlane".
FILTER mm:rightBeside(?l1,?l2)
FILTER mm:temporalOverlaps(?l1,?l2)
}
SPARQL-MM: A sample query
mm:boundingBox(?l1,?l2)
SPARQL-MM: Demo
DEMO!
Conclusions
Conclusions
➔ semantic media asset management requires management and
interaction with both content and metadata
➔ Linked Media Principles (2009) were a first approach to extend
Linked Data with support for semantic media asset
management
➔ Linked Data Platform (W3C working draft) supersedes Linked
Media Principles, as it covers the same aspects and more
➔ semantic media asset management requires specific media
access and querying
➔ Media Fragments URI (W3C) to identify media fragments
➔ Ontology for Media Resources (W3C) to describe media
fragments
➔ SPARQL-MM to query media fragment descriptions
Thanks for your Attention!
Dr. Sebastian Schaffert
Chief Technology Officer
Redlink GmbH
sebastian.schaffert@redlink.co

More Related Content

What's hot

Customizing CKAN
Customizing CKANCustomizing CKAN
Customizing CKAN
OKCon2013
 
Tools for Next Generation of CMS: XML, RDF, & GRDDL
Tools for Next Generation of CMS: XML, RDF, & GRDDLTools for Next Generation of CMS: XML, RDF, & GRDDL
Tools for Next Generation of CMS: XML, RDF, & GRDDL
Chimezie Ogbuji
 
Ckan tutorial odw2013 131109
Ckan tutorial odw2013 131109Ckan tutorial odw2013 131109
Ckan tutorial odw2013 131109
Chengjen Lee
 
CKAN as an open-source data management solution for open data
CKAN as an open-source data management solution for open data CKAN as an open-source data management solution for open data
CKAN as an open-source data management solution for open data
AIMS (Agricultural Information Management Standards)
 
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OOVirtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
Paolo Cristofaro
 
HCE project brief
HCE project briefHCE project brief
HCE project brief
Gennady Baranov
 
Open Data and CKAN Data Catalogues
Open Data and CKAN Data CataloguesOpen Data and CKAN Data Catalogues
Open Data and CKAN Data Catalogues
david-read
 
OAISRB
OAISRBOAISRB
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data SourcesVirtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
rumito
 
An Approach for the Incremental Export of Relational Databases into RDF Graphs
An Approach for the Incremental Export of Relational Databases into RDF GraphsAn Approach for the Incremental Export of Relational Databases into RDF Graphs
An Approach for the Incremental Export of Relational Databases into RDF Graphs
Nikolaos Konstantinou
 
Towards a Commons RDF Library - ApacheCon Europe 2014
Towards a Commons RDF Library - ApacheCon Europe 2014Towards a Commons RDF Library - ApacheCon Europe 2014
Towards a Commons RDF Library - ApacheCon Europe 2014
Sergio Fernández
 
PhD Defense
PhD DefensePhD Defense
Linked data tooling XML
Linked data tooling XMLLinked data tooling XML
Linked data tooling XML
FREMEProjectH2020
 
Legislation.gov.uk
Legislation.gov.ukLegislation.gov.uk
Legislation.gov.uk
Jeni Tennison
 
dotNetRDF - A Semantic Web/RDF Library for .Net Developers
dotNetRDF - A Semantic Web/RDF Library for .Net DevelopersdotNetRDF - A Semantic Web/RDF Library for .Net Developers
dotNetRDF - A Semantic Web/RDF Library for .Net Developers
Rob Vesse
 
Open Data Node - Platform and Methodology - 2015-May
Open Data Node - Platform and Methodology - 2015-MayOpen Data Node - Platform and Methodology - 2015-May
Open Data Node - Platform and Methodology - 2015-May
Comsode - FP7 project
 
D2RQ
D2RQD2RQ
Audio MD Metadata Scheme
Audio MD Metadata SchemeAudio MD Metadata Scheme
Audio MD Metadata Scheme
Ariel Hess
 
PERICLES Information Packaging Techniques
PERICLES  Information Packaging TechniquesPERICLES  Information Packaging Techniques
PERICLES Information Packaging Techniques
PERICLES_FP7
 
NIF Data Ingest
NIF Data IngestNIF Data Ingest

What's hot (20)

Customizing CKAN
Customizing CKANCustomizing CKAN
Customizing CKAN
 
Tools for Next Generation of CMS: XML, RDF, & GRDDL
Tools for Next Generation of CMS: XML, RDF, & GRDDLTools for Next Generation of CMS: XML, RDF, & GRDDL
Tools for Next Generation of CMS: XML, RDF, & GRDDL
 
Ckan tutorial odw2013 131109
Ckan tutorial odw2013 131109Ckan tutorial odw2013 131109
Ckan tutorial odw2013 131109
 
CKAN as an open-source data management solution for open data
CKAN as an open-source data management solution for open data CKAN as an open-source data management solution for open data
CKAN as an open-source data management solution for open data
 
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OOVirtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
Virtuoso RDF Triple Store Analysis Benchmark & mapping tools RDF / OO
 
HCE project brief
HCE project briefHCE project brief
HCE project brief
 
Open Data and CKAN Data Catalogues
Open Data and CKAN Data CataloguesOpen Data and CKAN Data Catalogues
Open Data and CKAN Data Catalogues
 
OAISRB
OAISRBOAISRB
OAISRB
 
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data SourcesVirtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
Virtuoso Sponger - RDFizer Middleware for creating RDF from non RDF Data Sources
 
An Approach for the Incremental Export of Relational Databases into RDF Graphs
An Approach for the Incremental Export of Relational Databases into RDF GraphsAn Approach for the Incremental Export of Relational Databases into RDF Graphs
An Approach for the Incremental Export of Relational Databases into RDF Graphs
 
Towards a Commons RDF Library - ApacheCon Europe 2014
Towards a Commons RDF Library - ApacheCon Europe 2014Towards a Commons RDF Library - ApacheCon Europe 2014
Towards a Commons RDF Library - ApacheCon Europe 2014
 
PhD Defense
PhD DefensePhD Defense
PhD Defense
 
Linked data tooling XML
Linked data tooling XMLLinked data tooling XML
Linked data tooling XML
 
Legislation.gov.uk
Legislation.gov.ukLegislation.gov.uk
Legislation.gov.uk
 
dotNetRDF - A Semantic Web/RDF Library for .Net Developers
dotNetRDF - A Semantic Web/RDF Library for .Net DevelopersdotNetRDF - A Semantic Web/RDF Library for .Net Developers
dotNetRDF - A Semantic Web/RDF Library for .Net Developers
 
Open Data Node - Platform and Methodology - 2015-May
Open Data Node - Platform and Methodology - 2015-MayOpen Data Node - Platform and Methodology - 2015-May
Open Data Node - Platform and Methodology - 2015-May
 
D2RQ
D2RQD2RQ
D2RQ
 
Audio MD Metadata Scheme
Audio MD Metadata SchemeAudio MD Metadata Scheme
Audio MD Metadata Scheme
 
PERICLES Information Packaging Techniques
PERICLES  Information Packaging TechniquesPERICLES  Information Packaging Techniques
PERICLES Information Packaging Techniques
 
NIF Data Ingest
NIF Data IngestNIF Data Ingest
NIF Data Ingest
 

Viewers also liked

What Apache Stanbol Can Do for You
What Apache Stanbol Can Do for YouWhat Apache Stanbol Can Do for You
What Apache Stanbol Can Do for You
Fabian Christ
 
Geospatial Querying in Apache Marmotta - Apache Big Data North America 2016
Geospatial Querying in Apache Marmotta -  Apache Big Data North America 2016Geospatial Querying in Apache Marmotta -  Apache Big Data North America 2016
Geospatial Querying in Apache Marmotta - Apache Big Data North America 2016
Sergio Fernández
 
Linking Media and Data using Apache Marmotta (LIME workshop keynote)
Linking Media and Data using Apache Marmotta  (LIME workshop keynote)Linking Media and Data using Apache Marmotta  (LIME workshop keynote)
Linking Media and Data using Apache Marmotta (LIME workshop keynote)
LinkedTV
 
(Enterprise) Linked Data Platform a new standard to manage LOD
(Enterprise) Linked Data Platform a new standard to manage LOD(Enterprise) Linked Data Platform a new standard to manage LOD
(Enterprise) Linked Data Platform a new standard to manage LOD
Diego Valerio Camarda
 
Apache marmotta
Apache marmottaApache marmotta
Apache marmotta
Efren Narváez
 
Introduction to Linked Data Platform (LDP)
Introduction to Linked Data Platform (LDP)Introduction to Linked Data Platform (LDP)
Introduction to Linked Data Platform (LDP)
Hector Correa
 
Linked Data Platform as a novel approach for Enterprise Application Integra...
Linked Data Platform as a novel approach for Enterprise Application Integra...Linked Data Platform as a novel approach for Enterprise Application Integra...
Linked Data Platform as a novel approach for Enterprise Application Integra...
Nandana Mihindukulasooriya
 
LDP Presentation
LDP PresentationLDP Presentation
LDP Presentation
hayelikahn
 
Learning W3C Linked Data Platform with examples
Learning W3C Linked Data Platform with examplesLearning W3C Linked Data Platform with examples
Learning W3C Linked Data Platform with examples
Nandana Mihindukulasooriya
 
Why do they call it Linked Data when they want to say...?
Why do they call it Linked Data when they want to say...?Why do they call it Linked Data when they want to say...?
Why do they call it Linked Data when they want to say...?
Oscar Corcho
 
Semantic Integration with Apache Jena and Stanbol
Semantic Integration with Apache Jena and StanbolSemantic Integration with Apache Jena and Stanbol
Semantic Integration with Apache Jena and Stanbol
All Things Open
 
Introduction to W3C Linked Data Platform
Introduction to W3C Linked Data PlatformIntroduction to W3C Linked Data Platform
Introduction to W3C Linked Data Platform
Nandana Mihindukulasooriya
 

Viewers also liked (12)

What Apache Stanbol Can Do for You
What Apache Stanbol Can Do for YouWhat Apache Stanbol Can Do for You
What Apache Stanbol Can Do for You
 
Geospatial Querying in Apache Marmotta - Apache Big Data North America 2016
Geospatial Querying in Apache Marmotta -  Apache Big Data North America 2016Geospatial Querying in Apache Marmotta -  Apache Big Data North America 2016
Geospatial Querying in Apache Marmotta - Apache Big Data North America 2016
 
Linking Media and Data using Apache Marmotta (LIME workshop keynote)
Linking Media and Data using Apache Marmotta  (LIME workshop keynote)Linking Media and Data using Apache Marmotta  (LIME workshop keynote)
Linking Media and Data using Apache Marmotta (LIME workshop keynote)
 
(Enterprise) Linked Data Platform a new standard to manage LOD
(Enterprise) Linked Data Platform a new standard to manage LOD(Enterprise) Linked Data Platform a new standard to manage LOD
(Enterprise) Linked Data Platform a new standard to manage LOD
 
Apache marmotta
Apache marmottaApache marmotta
Apache marmotta
 
Introduction to Linked Data Platform (LDP)
Introduction to Linked Data Platform (LDP)Introduction to Linked Data Platform (LDP)
Introduction to Linked Data Platform (LDP)
 
Linked Data Platform as a novel approach for Enterprise Application Integra...
Linked Data Platform as a novel approach for Enterprise Application Integra...Linked Data Platform as a novel approach for Enterprise Application Integra...
Linked Data Platform as a novel approach for Enterprise Application Integra...
 
LDP Presentation
LDP PresentationLDP Presentation
LDP Presentation
 
Learning W3C Linked Data Platform with examples
Learning W3C Linked Data Platform with examplesLearning W3C Linked Data Platform with examples
Learning W3C Linked Data Platform with examples
 
Why do they call it Linked Data when they want to say...?
Why do they call it Linked Data when they want to say...?Why do they call it Linked Data when they want to say...?
Why do they call it Linked Data when they want to say...?
 
Semantic Integration with Apache Jena and Stanbol
Semantic Integration with Apache Jena and StanbolSemantic Integration with Apache Jena and Stanbol
Semantic Integration with Apache Jena and Stanbol
 
Introduction to W3C Linked Data Platform
Introduction to W3C Linked Data PlatformIntroduction to W3C Linked Data Platform
Introduction to W3C Linked Data Platform
 

Similar to Linked Media and Data Using Apache Marmotta

A Framework for Self-descriptive RESTful Services
A Framework for Self-descriptive RESTful ServicesA Framework for Self-descriptive RESTful Services
A Framework for Self-descriptive RESTful Services
ruyalarcon
 
Linked Data to Improve the OER Experience
Linked Data to Improve the OER ExperienceLinked Data to Improve the OER Experience
Linked Data to Improve the OER Experience
The Open Education Consortium
 
B08 A3pc 90 Diapo Damy En
B08 A3pc 90 Diapo Damy EnB08 A3pc 90 Diapo Damy En
B08 A3pc 90 Diapo Damy En
Territorial Intelligence
 
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
OpenAIRE
 
Swap For Dummies Rsp 2007 11 29
Swap For Dummies Rsp 2007 11 29Swap For Dummies Rsp 2007 11 29
Swap For Dummies Rsp 2007 11 29
Julie Allinson
 
Spotlight
SpotlightSpotlight
Spotlight
Stefano Lariccia
 
Datalake Architecture
Datalake ArchitectureDatalake Architecture
Interoperability in Digital Libraries
Interoperability in Digital LibrariesInteroperability in Digital Libraries
Interoperability in Digital Libraries
Dept of Library and Information Science Tumkur University
 
Linked Data Tutorial
Linked Data TutorialLinked Data Tutorial
Linked Data Tutorial
Sören Auer
 
Data Portability with SIOC and FOAF
Data Portability with SIOC and FOAFData Portability with SIOC and FOAF
Data Portability with SIOC and FOAF
Uldis Bojars
 
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
National Information Standards Organization (NISO)
 
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
OpenAIRE
 
Linked data MLA 2015
Linked data MLA 2015Linked data MLA 2015
Linked data MLA 2015
Cason Snow
 
Linked Data MLA 2015
Linked Data MLA 2015Linked Data MLA 2015
Linked Data MLA 2015
Cason Snow
 
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
Edward Blurock
 
Web of Data Usage Mining
Web of Data Usage MiningWeb of Data Usage Mining
Web of Data Usage Mining
Markus Luczak-Rösch
 
Usage of Linked Data: Introduction and Application Scenarios
Usage of Linked Data: Introduction and Application ScenariosUsage of Linked Data: Introduction and Application Scenarios
Usage of Linked Data: Introduction and Application Scenarios
EUCLID project
 
Open for Business - Open Archives, OpenURL, RSS and the Dublin Core
Open for Business - Open Archives, OpenURL, RSS and the Dublin CoreOpen for Business - Open Archives, OpenURL, RSS and the Dublin Core
Open for Business - Open Archives, OpenURL, RSS and the Dublin Core
Andy Powell
 
The Social Data Web
The Social Data WebThe Social Data Web
The Social Data Web
George Thomas
 
Gt ea2009
Gt ea2009Gt ea2009
Gt ea2009
George Thomas
 

Similar to Linked Media and Data Using Apache Marmotta (20)

A Framework for Self-descriptive RESTful Services
A Framework for Self-descriptive RESTful ServicesA Framework for Self-descriptive RESTful Services
A Framework for Self-descriptive RESTful Services
 
Linked Data to Improve the OER Experience
Linked Data to Improve the OER ExperienceLinked Data to Improve the OER Experience
Linked Data to Improve the OER Experience
 
B08 A3pc 90 Diapo Damy En
B08 A3pc 90 Diapo Damy EnB08 A3pc 90 Diapo Damy En
B08 A3pc 90 Diapo Damy En
 
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
OpenAIRE guidelines and broker service for repository managers - OpenAIRE #OA...
 
Swap For Dummies Rsp 2007 11 29
Swap For Dummies Rsp 2007 11 29Swap For Dummies Rsp 2007 11 29
Swap For Dummies Rsp 2007 11 29
 
Spotlight
SpotlightSpotlight
Spotlight
 
Datalake Architecture
Datalake ArchitectureDatalake Architecture
Datalake Architecture
 
Interoperability in Digital Libraries
Interoperability in Digital LibrariesInteroperability in Digital Libraries
Interoperability in Digital Libraries
 
Linked Data Tutorial
Linked Data TutorialLinked Data Tutorial
Linked Data Tutorial
 
Data Portability with SIOC and FOAF
Data Portability with SIOC and FOAFData Portability with SIOC and FOAF
Data Portability with SIOC and FOAF
 
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
Chachra, "Improving Discovery Systems Through Post Processing of Harvested Data"
 
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
DCMI webinar - OpenAIRE Guidelines: Promoting Repositories Interoperability a...
 
Linked data MLA 2015
Linked data MLA 2015Linked data MLA 2015
Linked data MLA 2015
 
Linked Data MLA 2015
Linked Data MLA 2015Linked Data MLA 2015
Linked Data MLA 2015
 
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
ChemConnect: Characterizing CombusAon KineAc Data with ontologies and meta-­‐...
 
Web of Data Usage Mining
Web of Data Usage MiningWeb of Data Usage Mining
Web of Data Usage Mining
 
Usage of Linked Data: Introduction and Application Scenarios
Usage of Linked Data: Introduction and Application ScenariosUsage of Linked Data: Introduction and Application Scenarios
Usage of Linked Data: Introduction and Application Scenarios
 
Open for Business - Open Archives, OpenURL, RSS and the Dublin Core
Open for Business - Open Archives, OpenURL, RSS and the Dublin CoreOpen for Business - Open Archives, OpenURL, RSS and the Dublin Core
Open for Business - Open Archives, OpenURL, RSS and the Dublin Core
 
The Social Data Web
The Social Data WebThe Social Data Web
The Social Data Web
 
Gt ea2009
Gt ea2009Gt ea2009
Gt ea2009
 

More from Sebastian Schaffert

Knowledge and Media Technologies at Salzburg Research
Knowledge and Media Technologies at Salzburg ResearchKnowledge and Media Technologies at Salzburg Research
Knowledge and Media Technologies at Salzburg Research
Sebastian Schaffert
 
KiWi - a platform for Semantic Social Software
KiWi - a platform for Semantic Social SoftwareKiWi - a platform for Semantic Social Software
KiWi - a platform for Semantic Social Software
Sebastian Schaffert
 
Semantic Search for Media Portals
Semantic Search for Media PortalsSemantic Search for Media Portals
Semantic Search for Media Portals
Sebastian Schaffert
 
KiWi - Knowledge in a Wiki
KiWi - Knowledge in a WikiKiWi - Knowledge in a Wiki
KiWi - Knowledge in a Wiki
Sebastian Schaffert
 
IkeWiki Tutorial
IkeWiki TutorialIkeWiki Tutorial
IkeWiki Tutorial
Sebastian Schaffert
 
The KiWi Vision
The KiWi VisionThe KiWi Vision
The KiWi Vision
Sebastian Schaffert
 
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
Sebastian Schaffert
 

More from Sebastian Schaffert (7)

Knowledge and Media Technologies at Salzburg Research
Knowledge and Media Technologies at Salzburg ResearchKnowledge and Media Technologies at Salzburg Research
Knowledge and Media Technologies at Salzburg Research
 
KiWi - a platform for Semantic Social Software
KiWi - a platform for Semantic Social SoftwareKiWi - a platform for Semantic Social Software
KiWi - a platform for Semantic Social Software
 
Semantic Search for Media Portals
Semantic Search for Media PortalsSemantic Search for Media Portals
Semantic Search for Media Portals
 
KiWi - Knowledge in a Wiki
KiWi - Knowledge in a WikiKiWi - Knowledge in a Wiki
KiWi - Knowledge in a Wiki
 
IkeWiki Tutorial
IkeWiki TutorialIkeWiki Tutorial
IkeWiki Tutorial
 
The KiWi Vision
The KiWi VisionThe KiWi Vision
The KiWi Vision
 
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
Social Software und Web 2.0: Semantic Wikis, Social Tagging und eLearning 2.0
 

Recently uploaded

Best Skills to Learn for Freelancing.pdf
Best Skills to Learn for Freelancing.pdfBest Skills to Learn for Freelancing.pdf
Best Skills to Learn for Freelancing.pdf
Million-$-Knowledge {Million Dollar Knowledge}
 
Rent remote desktop server mangohost .net
Rent remote desktop server mangohost .netRent remote desktop server mangohost .net
Rent remote desktop server mangohost .net
pdfsubmission50
 
My President is bulletproof t shirts hoodie
My President is bulletproof t shirts hoodieMy President is bulletproof t shirts hoodie
My President is bulletproof t shirts hoodie
exgf28
 
Open Source TCP or Netflow Log Server Using Graylog
Open Source TCP or Netflow Log Server Using GraylogOpen Source TCP or Netflow Log Server Using Graylog
Open Source TCP or Netflow Log Server Using Graylog
Bangladesh Network Operators Group
 
Portugal Dreamin 24 - How to easily use an API with Flows
Portugal Dreamin 24  - How to easily use an API with FlowsPortugal Dreamin 24  - How to easily use an API with Flows
Portugal Dreamin 24 - How to easily use an API with Flows
Thierry TROUIN ☁
 
Mobile SEO India | Mobile SEO Service | Mobile SEO Company
Mobile SEO India | Mobile SEO Service | Mobile SEO CompanyMobile SEO India | Mobile SEO Service | Mobile SEO Company
Mobile SEO India | Mobile SEO Service | Mobile SEO Company
SIB Infotech
 
Digital ethnography of the Polish darknet drug trade community
Digital ethnography of the Polish darknet drug trade communityDigital ethnography of the Polish darknet drug trade community
Digital ethnography of the Polish darknet drug trade community
Piotr Siuda
 
New York Institute of Technology degree Cert diploma offer
New York Institute of Technology degree Cert diploma offerNew York Institute of Technology degree Cert diploma offer
New York Institute of Technology degree Cert diploma offer
ubovu
 
Team Cymru Community Services,Overview of all public services
Team Cymru Community Services,Overview of all public servicesTeam Cymru Community Services,Overview of all public services
Team Cymru Community Services,Overview of all public services
Bangladesh Network Operators Group
 
Saint Louis University diploma
Saint Louis University diplomaSaint Louis University diploma
Saint Louis University diploma
eufdev
 
Enhancing seamless access using TIGERfed
Enhancing seamless access using TIGERfedEnhancing seamless access using TIGERfed
Enhancing seamless access using TIGERfed
Bangladesh Network Operators Group
 
Software Defined Networking, Concepts and Practical Implementations
Software Defined Networking, Concepts and Practical ImplementationsSoftware Defined Networking, Concepts and Practical Implementations
Software Defined Networking, Concepts and Practical Implementations
Bangladesh Network Operators Group
 
Geolocation and Geofeed Implementation bdNOG18
Geolocation and Geofeed Implementation bdNOG18Geolocation and Geofeed Implementation bdNOG18
Geolocation and Geofeed Implementation bdNOG18
Bangladesh Network Operators Group
 
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
QingjieDu1
 
Best CSS Animation Libraries for Web Developers
Best CSS Animation Libraries for Web DevelopersBest CSS Animation Libraries for Web Developers
Best CSS Animation Libraries for Web Developers
Shrestha Raaz
 
University of California, Riverside diploma
University of California, Riverside diplomaUniversity of California, Riverside diploma
University of California, Riverside diploma
eufdev
 
Trump fist pump t shirts Trump fist pump t shirts
Trump fist pump t shirts Trump fist pump t shirtsTrump fist pump t shirts Trump fist pump t shirts
Trump fist pump t shirts Trump fist pump t shirts
exgf28
 
Study of international anticancer research trends.pdf
Study of international anticancer research trends.pdfStudy of international anticancer research trends.pdf
Study of international anticancer research trends.pdf
Preston University
 
Top 50 Telephone Conversation Sample Examples For IT Industries.pdf
Top 50 Telephone Conversation Sample Examples For IT Industries.pdfTop 50 Telephone Conversation Sample Examples For IT Industries.pdf
Top 50 Telephone Conversation Sample Examples For IT Industries.pdf
Krishna L
 
How God led me to DTS? Through many different signs and connections that I c...
How God led me to DTS? Through many different signs and connections that  I c...How God led me to DTS? Through many different signs and connections that  I c...
How God led me to DTS? Through many different signs and connections that I c...
AshishMohan57
 

Recently uploaded (20)

Best Skills to Learn for Freelancing.pdf
Best Skills to Learn for Freelancing.pdfBest Skills to Learn for Freelancing.pdf
Best Skills to Learn for Freelancing.pdf
 
Rent remote desktop server mangohost .net
Rent remote desktop server mangohost .netRent remote desktop server mangohost .net
Rent remote desktop server mangohost .net
 
My President is bulletproof t shirts hoodie
My President is bulletproof t shirts hoodieMy President is bulletproof t shirts hoodie
My President is bulletproof t shirts hoodie
 
Open Source TCP or Netflow Log Server Using Graylog
Open Source TCP or Netflow Log Server Using GraylogOpen Source TCP or Netflow Log Server Using Graylog
Open Source TCP or Netflow Log Server Using Graylog
 
Portugal Dreamin 24 - How to easily use an API with Flows
Portugal Dreamin 24  - How to easily use an API with FlowsPortugal Dreamin 24  - How to easily use an API with Flows
Portugal Dreamin 24 - How to easily use an API with Flows
 
Mobile SEO India | Mobile SEO Service | Mobile SEO Company
Mobile SEO India | Mobile SEO Service | Mobile SEO CompanyMobile SEO India | Mobile SEO Service | Mobile SEO Company
Mobile SEO India | Mobile SEO Service | Mobile SEO Company
 
Digital ethnography of the Polish darknet drug trade community
Digital ethnography of the Polish darknet drug trade communityDigital ethnography of the Polish darknet drug trade community
Digital ethnography of the Polish darknet drug trade community
 
New York Institute of Technology degree Cert diploma offer
New York Institute of Technology degree Cert diploma offerNew York Institute of Technology degree Cert diploma offer
New York Institute of Technology degree Cert diploma offer
 
Team Cymru Community Services,Overview of all public services
Team Cymru Community Services,Overview of all public servicesTeam Cymru Community Services,Overview of all public services
Team Cymru Community Services,Overview of all public services
 
Saint Louis University diploma
Saint Louis University diplomaSaint Louis University diploma
Saint Louis University diploma
 
Enhancing seamless access using TIGERfed
Enhancing seamless access using TIGERfedEnhancing seamless access using TIGERfed
Enhancing seamless access using TIGERfed
 
Software Defined Networking, Concepts and Practical Implementations
Software Defined Networking, Concepts and Practical ImplementationsSoftware Defined Networking, Concepts and Practical Implementations
Software Defined Networking, Concepts and Practical Implementations
 
Geolocation and Geofeed Implementation bdNOG18
Geolocation and Geofeed Implementation bdNOG18Geolocation and Geofeed Implementation bdNOG18
Geolocation and Geofeed Implementation bdNOG18
 
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
SisAi World - Software is AI - Providing AI as Software - Protecting the Inte...
 
Best CSS Animation Libraries for Web Developers
Best CSS Animation Libraries for Web DevelopersBest CSS Animation Libraries for Web Developers
Best CSS Animation Libraries for Web Developers
 
University of California, Riverside diploma
University of California, Riverside diplomaUniversity of California, Riverside diploma
University of California, Riverside diploma
 
Trump fist pump t shirts Trump fist pump t shirts
Trump fist pump t shirts Trump fist pump t shirtsTrump fist pump t shirts Trump fist pump t shirts
Trump fist pump t shirts Trump fist pump t shirts
 
Study of international anticancer research trends.pdf
Study of international anticancer research trends.pdfStudy of international anticancer research trends.pdf
Study of international anticancer research trends.pdf
 
Top 50 Telephone Conversation Sample Examples For IT Industries.pdf
Top 50 Telephone Conversation Sample Examples For IT Industries.pdfTop 50 Telephone Conversation Sample Examples For IT Industries.pdf
Top 50 Telephone Conversation Sample Examples For IT Industries.pdf
 
How God led me to DTS? Through many different signs and connections that I c...
How God led me to DTS? Through many different signs and connections that  I c...How God led me to DTS? Through many different signs and connections that  I c...
How God led me to DTS? Through many different signs and connections that I c...
 

Linked Media and Data Using Apache Marmotta

  • 1. Linking Media and Data using Apache Marmotta Keynote at LIME 2014 Workshop Sebastian Schaffert and Thomas Kurz
  • 2. Contents ➔Motivation: The Red Bull Content Pool ➔Background: ➔ Linked Media Principles ➔ Media Fragments and Media Ontology ➔Implementation: Linked Media Framework ➔ Red Bull Use Case ➔ ConnectMe Use Case ➔Standardising: The Linked Data Platform ➔Introducing Apache Marmotta ➔Querying for Multimedia Fragments: SPARQL-MM 2009 2011 2013 2014
  • 3. Motivation: The Red Bull Content Pool
  • 4. Linked Media (2009) Linked Media = Linked People + Linked Content + Linked Data
  • 5. Motivation: The Red Bull Content Pool ➔ online archive containing video and image material related to extreme sports events organised by Red Bull ➔ business-to-business portal where journalists can get material for further broadcasting (mostly for free) ➔ material comes with metadata in the form of tables in word documents: ➔ interview transcriptions (with time interval start/end second) ➔ scene descriptions (with time interval start/end second) ➔ music cue sheets (copyright information about background music tracks)
  • 6. Motivation: The Red Bull Content Pool (2009)
  • 7. Motivation: The Red Bull Content Pool ➔Problems: ➔ videos consist of series of scenes with many different persons ➔ scanning through a video to find a particular scene is a huge amount of work ➔ metadata is valuable but not really exploited for searching videos and while playing videos
  • 8. Can we help Markus? Name: Markus Occupation: sports journalist Company: RegioTV Pinzgau Objective: create report about cliff diving Requires: videos, background info, contacts How can we help Markus?  efficient and precise search in the Red Bull Content Pool  compact and relevant display of background information  contacts (e.g. website,email) of athletes, other journalists, etc. fast and successful creation of the report
  • 10. Linked Media Principles (2009) ➔ Linked Data is „read-only“ i.e. focus was on publication of big datasets, not the interaction with data  a system for managing media assets needs to be capable of updating resources and their metadata ➔ Linked Data is „data-only“ i.e. a resource is represented either as RDF metadata for machines or as HTML tables for humans, but in all cases it is metadata and not content  a system for managing media assets needs to be capable of managing both media content and metadata about that content
  • 11. Linked Media Principles (2009) ➔ extend Linked Data for updates using REST principles (HTTP): ➔ GET: returns a resource (as in Linked Data) ➔ POST: creates a new resource and uploads content or metadata ➔ PUT: updates content or metadata of a resource ➔ DELETE: removes a resource and all associated information ➔ extend Linked Data for arbitrary media formats using MIME: ➔ controlled by Accept: (in case of GET) and Content-Type: (in case of PUT/POST) HTTP headers ➔ header value: MIME type (e.g. text/turtle or image/jpeg) and type of relationship (e.g. rel=content or rel=meta) ➔ accessing a resource with GET or PUT redirects to the actual representation specified by MIME type and relationship
  • 12. Linked Media Principles (2009) ➔ Example 1: Retrieve HTML table representation of resource metadata ➔ Example 2: Retrieve HTML content of resource ➔ Example 3: Update resource metadata GET http://data.redlink.io/resource/1234 Accept: text/html; rel=meta GET http://data.redlink.io/resource/1234 Accept: text/html; rel=content PUT http://data.redlink.io/resource/1234 Content-Type: text/turtle; rel=meta <http://data.redlink.io/resource/1234> mm:hasFragment <http://data.redlink.io/resource/1234#t=0,10>
  • 13. Background: Media Fragments URI & Ontology for Media Resources
  • 14. Media Fragments URI ➔ media content currently treated as „black box binary content“ ➔ interaction only via plugin or special browser support ➔ linking to a subsequence of a video not possible ➔ Media Fragments URI: use the „fragment“ part of a URI to encode temporal and spatial subsequences ➔ Examples: Identify the sequence from second 3 to second 10 of the video: http://data.redlink.io/resource/cliff_diving.ogg#t=3,10 Identify the spatial box 320x240 at x=160 and y=120 of the video http://data.redlink.io/resource/cliff_diving.ogg#xywh=160,120,320,240
  • 15. Ontology for Media Resources ➔ common data model for representing video metadata: ➔ identification ➔ creation (hasCreator, hasPublisher, ...) ➔ content description (hasLanguage, hasGenre, hasKeyword,...) ➔ rights and distribution (hasPermissions, hasTargetAudience, ...) ➔ technical properties (hasCompression, hasFormat, ...) ➔ fragments (hasFragment, hasChapter, ...) ➔ mapping tables from the most popular video metadata formats to the Ontology for Media Resources (EXIF, MPEG-7, TV-Anytime, YouTube, ID3)
  • 16. Combining Media Fragments and Media Ontology ➔ use Media Fragment URIs to uniquely identify fragments of media content ➔ browser compatibility ➔ Linked Data compatibility ➔ use Ontology for Media Resources to describe these fragments ➔ RDF compatibility ➔ rich description graph with SPARQL querying
  • 17. Combining Media Fragments and Media Ontology @prefix ma: <http://www.w3.org/ns/ma-ont#> . @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> . @prefix foaf: <http://xmlns.com/foaf/0.1/> . @prefix dct: <http://purl.org/dc/terms/> . <http://example.org/v1> a ma:MediaResource; rdfs:label "A sports video"; ma:locator <http://my.videos.org/v1.mp4>; ma:hasFragment <http://example.org/v1#fragment1>; ma:hasFragment <http://example.org/v1#fragment2>. <http://example.org/v1#fragment1> ma:locator <http://my.videos.org/v1.mp4#xywh=percent:26,20,22,80&t=194,198>; dct:subject <http://example.org/person/Connor_Macfarlane>. <http://example.org/v1#fragment2> ma:locator <http://my.videos.org/v1.mp4#xywh=percent:71,0,29,100&t=193,198>; dct:subject <http://example.org/person/Lewis_Jones>. <http://example.org/person/Connor_Macfarlane> foaf:name "Connor Macfarlane". <http://example.org/person/Lewis_Jones> foaf:name "Lewis Jones".
  • 18. Combining Media Fragments and Media Ontology
  • 20. Behind the Scenes: Linked Media Framework  Linked Data Server with updates and uniform management of content and metadata => particularly well-suited for multimedia content and metadata!  Linked Media Principles for resource-centric access to content and metadata  SPARQL Query and SPARQL Update 1.1 for structural updating and querying  Modules for Reasoning, Semantic Search, Linked Data Caching, Versioning, and Social Media  Specialised on Linked Media and Linked Enterprise Content Code, Installer, Screencasts and more: http://code.google.com/p/lmf/
  • 21. Linked Media Framework (Architecture)
  • 22. LMF Semantic Search  Facetted Search over Content and Metadata with SOLR compatible API  RDF Path Language for configurable Metadata Indexing  Multiple Cores with different configurations to adapt to different search requirements
  • 23. LMF Reasoning  Rule-based reasoning over triples in the LMF triple store to represent implicit knowledge  Reason maintenance allows to describe justifications for inferences  adapted version of sKWRL rule language:  more efficient implementation,  improved reason maintenance
  • 24. LMF Linked Data Caching  transparently retrieves linked resources from the Linked Data cloud when needed (e.g. LD Path or SPARQL query)  powerful component for integrating with other information systems exposing their data as Linked Media or Linked Data  adapters for services offering their data in proprietary formats (e.g. YouTube, Vimeo, …)
  • 25. LMF Classification and Sentiment Analysis  support for statistical text classification, allows to train different classifiers with sample texts for arbitrary categories  suggest most likely category for a text according to similarity with training data  analyse text for positive or negative sentiment (German and English) 25
  • 26. LMF Social Media Integration  allows linking to social media resources, e.g. Facebook or Google accounts, videos, interests  allows authentication and data import from selected social media services (Facebook, YouTube, generic RSS)
  • 27. LMF Versioning  keeps history of updates in the Linked Media Framework  provides information for trust and provenance of data, e.g. annotations added to the system
  • 28. Use Case: Red Bull Semantic Search Prototype
  • 30. Spatial and Temporal Fragments
  • 31. Use Case: LIME Media Player (ConnectMe Project)
  • 32. LIME Player: Interaction with Fragments
  • 34. Linked Data Platform: Introduction ➔ recommendation draft of the LDP working group at W3C ➔ support for „read/write Linked Data“ ➔ support for RDF and non-RDF resources ➔ can be used as an alternative for Linked Media Principles ➔ advantage of standardisation and wide adoption ➔ considerably more complex standard and protocol ➔ URL: http://www.w3.org/TR/ldp/
  • 35. Linked Data Platform: Concepts ➔ access and interaction according to REST webservice principles ➔ GET: returns description of a resource ➔ POST: creates a new resource ➔ PUT: replaces the description of a resource ➔ DELETE: removes the description of a resource ➔ Linked Data Platform Resources (LDP-R) ➔ RDF resources (LDP-RS): RDF description of a resource ➔ non-RDF resources (LDP-NR): arbitrary (media) content ➔ Linked Data Platform Containers (LDP-C) ➔ collection of LDP resources, e.g. „students“, „professors“, „lectures“ ➔ basic container (LDP-BC): simple collection of resources with common URI prefix ➔ direct container (LDP-DC): collection with explicit membership (as triple) ➔ indirect container (LDP-IC): collection with implicit membership (based on content)
  • 36. LDP Basic Containers (LDP-BC) ➔ collection of LDP resources ➔ identification via common URI prefix, e.g. http://example.com/container1/a http://example.com/container1/b ➔ can contain both RDF and non-RDF resources at the same time ➔ container is itself an RDF resource ➔ description as RDF: @base <http://example.com/container1/> @prefix dcterms: <http://purl.org/dc/terms/>. @prefix ldp: <http://www.w3.org/ns/ldp#>. <> a ldp:BasicContainer; dcterms:title "A very simple container"; ldp:contains <a>, <b>, <c>.
  • 38. Apache Marmotta ➔ a simplification of the Linked Media Framework taking core components: ➔ Linked Data Server with SPARQL 1.1 ➔ Linked Data Cache ➔ Versioning, Reasoning ➔ no search, no content analysis ➔ reference implementation of the Linked Data Platform and participation in W3C working group ➔ highly modular and extensible to build custom Linked Data applications (both client and server) http://marmotta.apache.org
  • 41. SPARQL-MM: Introduction ➔ extension of SPARQL with specific multimedia functions and relations, implemented in Apache Marmotta RelationFunction Aggregation Function Spatial mm:rightBeside mm:spatialIntersection mm:spatialOverlaps mm:spatialBoundingBox … … Temporal mm:after mm:temporalIntersection mm:temoralOverlaps mm:temporalIntermediate … … Combined mm:overlaps mm:boundingBox mm:contains mm:intersection A list of all functions can be found at: https://github.com/tkurz/sparql-mm/blob/master/sparql-mm/functions.md
  • 42. SPARQL-MM: A sample query Give me the spatio-temporal snippet that shows Lewis Jones right beside Connor Macfarlane. PREFIX foaf: <http://xmlns.com/foaf/0.1/> PREFIX mm: <http://linkedmultimedia.org/sparql-mm/functions#> PREFIX ma: <http://www.w3.org/ns/ma-ont#> PREFIX dct: <http://purl.org/dc/terms/> SELECT (mm:boundingBox(?l1,?l2) AS ?two_guys) WHERE { ?f1 ma:locator ?l1; dct:subject ?p1. ?p1 foaf:name "Lewis Jones". ?f2 ma:locator ?l2; dct:subject ?p2. ?p2 foaf:name "Connor Macfarlane". FILTER mm:rightBeside(?l1,?l2) FILTER mm:temporalOverlaps(?l1,?l2) }
  • 43. SPARQL-MM: A sample query mm:boundingBox(?l1,?l2)
  • 46. Conclusions ➔ semantic media asset management requires management and interaction with both content and metadata ➔ Linked Media Principles (2009) were a first approach to extend Linked Data with support for semantic media asset management ➔ Linked Data Platform (W3C working draft) supersedes Linked Media Principles, as it covers the same aspects and more ➔ semantic media asset management requires specific media access and querying ➔ Media Fragments URI (W3C) to identify media fragments ➔ Ontology for Media Resources (W3C) to describe media fragments ➔ SPARQL-MM to query media fragment descriptions
  • 47. Thanks for your Attention! Dr. Sebastian Schaffert Chief Technology Officer Redlink GmbH sebastian.schaffert@redlink.co