MediaMixer !facilitating media fragments mixing and its rightsmanagement using semantic technologies!!"#$%&"()%*+),-./0$%1...
06/06/13 Slide 2 of 28MediaMixer"Community set-up and networking for the !reMIXing of online MEDIA fragments !•! FP7 Coord...
06/06/13 Slide 3 of 28Introduction!•! The MediaMixer project and community promotethe use of semantic technologies for med...
06/06/13 Slide 4 of 28Coordination. Semantic Web technologies R&DIT solutions for broadcasters (WebTV, EPG,…)Asset Managem...
06/06/13 Slide 5 of 28!"#$%$&!"#$%$&!"#$%$&!"#$%&" (%)*+,-#.&"(&)$*+!,")-%.$"/!"#&/0"!"#$%$&!"#$%$&01,&&2&/.!,")-%&)+(&)$*...
06/06/13 Slide 6 of 28Current Situation!!"!#"$%&()*+",$-./""0"#,122"/$3/4.0"#,-./""0"#,%&()*!"45"6(4$3/4.0"#,%/&67)"/8".49...
06/06/13 Slide 7 of 28Proposals:"Assisted Policy and Agreement Modelling!•! Model policies andagreements!•! Formal model t...
06/06/13 Slide 9 of 28Media Fragments Ingestion!Provider offers mediafragment:!!•! Content: "automatic annotation!•! Detec...
06/06/13 Slide 10 of 28Semantic Annotation!10!•! Transform whole videos to sets of meaningful,indexable and re-usable vide...
06/06/13 Slide 11 of 28Semantic Annotation"Key Technologies!11!•! Temporal video fragmentation to!–! Shots (elementary vid...
06/06/13 Slide 12 of 28Semantic Annotation"Metadata!•! Metadata for semantic annotation:!–!Descriptive metadata for media ...
06/06/13 Slide 13 of 28Conceptual Metadata!• Globally unambiguousidentifiers for anyconcept needed–! Ideally more informati...
06/06/13 Slide 14 of 28Producer Proposed Workflow!!"#$%&"()*+$,-."&(/#""0"1&)*23,"4+"#5+6."5,7(85#0"1&97",:;%")*23,"4,*1&"1...
06/06/13 Slide 15 of 28Implementation!•! Rights, License and Policies "implemented as Classes!–! Reproduction Right, Copy,...
06/06/13 Slide 16 of 28Pattern Building"Actions (“verbs”)!!"#$%"&()%$*+,$"-+)%$%"&.&/01+/-&/2$*+2$"-+)%!"#$%& ()*%$$3&224"...
06/06/13 Slide 17 of 28Pattern Building"Case Roles (from linguistics)!•! Connect verbs to the action participants!–!Exampl...
06/06/13 Slide 18 of 28DDEX Sample-08.04.xml!<Deal>!!<DealTerms>!! !<ValidityPeriod>!! ! !<StartDate>2013-01-01</StartDate...
06/06/13 Slide 19 of 28])R-(3I!-,.15%51.3L),!)G!3!I-(1,F1!*)21I!Reasoning with DDEX
06/06/13 Slide 20 of 28Reasoning with DDEXPolicy #1Agreement #1
06/06/13 Slide 21 of 28!"#$%&"!(&")!"#$%"*&")&()*+!,-./0*++!"#$%&"!,-%#./&0%-%12"$*+34%#.".52$%6788#9,%)-*0"!!20%!2"$+:.."...
06/06/13 Slide 22 of 28@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> .@prefix odrlv: <http://w3....
06/06/13 Slide 23 of 28Creative Commons "BY-SA Model!!"#$% %&()*+,)-% %!"..,/01)-% %213-45161+6-2$21/7-()1)"/!"#$#.$8"*34)...
06/06/13 Slide 24 of 28•! Following Linked Data principles, "starting from just content ID (URI)…!Long term vision…!24!W),...
06/06/13 Slide 25 of 2806/06/13 Slide 25 of 28Linked Data for Worldwide "Copyright Management?!25!W),.1,.!!AKV!W),.1,.AKV!...
06/06/13 Slide 26 of 28Get involved!•! Join MediaMixer community to know more "(http://community.mediamixer.eu):!–! discus...
06/06/13 Slide 27 of 28Get more involved!•! Want to experience semantic technologies?Apply to become core partner"(http://...
More details:http://community.mediamixer.euhttp://rhizomik.net/copyrightonto/Roberto GarcíaUniversitat de Lleida, Spainhtt...
MediaMixer: facilitating media fragments mixing and its rights management using semantic technologies
Upcoming SlideShare
Loading in …5
×

MediaMixer: facilitating media fragments mixing and its rights management using semantic technologies

528 views
442 views

Published on

The MediaMixer project and community promote the use of semantic technologies for media mixing through real use cases and demos that showcase them. A typical MediaMixer demo will involve fragmenting media assets, annotating them using semantic descriptions and exposing these descriptions to customers, for fragment level search and selection. Fragments will be also linked to rights information based on a copyright ontology, which integrates licenses, policies and rights expressions based on existing standards like DDEX, ODRL or MPEG-21.

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
528
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

MediaMixer: facilitating media fragments mixing and its rights management using semantic technologies

  1. 1. MediaMixer !facilitating media fragments mixing and its rightsmanagement using semantic technologies!!"#$%&"()%*+),-./0$%1/&)&2$34$/2),56)/.!"#$%!$&"!"#$%&()**+,-./0*12-3*-41501+6!789!:+,1!;<=>!?@AB!C1,1D3!
  2. 2. 06/06/13 Slide 2 of 28MediaMixer"Community set-up and networking for the !reMIXing of online MEDIA fragments !•! FP7 Coordination Action!–!Started November 2012 !–!Create an European market for mediafragments re-purposing and re-selling!E!#-F.)5/!)G!CH!D-)I1,(1!"J!K1+.15F6!!#$%&FI-21F#3510,1..5),(/38F1*3,L(8*+IL*12-38M1N8(513.183,,).3.18%51F1,.83,28F#3518/)+58*12-3!!
  3. 3. 06/06/13 Slide 3 of 28Introduction!•! The MediaMixer project and community promotethe use of semantic technologies for media mixing!•! Real use cases and demos that showcase thesetechnologies!–! Fragmenting media assets!–! Annotating them using semantic descriptions!–! Exposing these descriptions for fragment level searchand selection!–! Representing rights information using a copyrightontology that integrates licenses, policies and rightsexpressions languages!
  4. 4. 06/06/13 Slide 4 of 28Coordination. Semantic Web technologies R&DIT solutions for broadcasters (WebTV, EPG,…)Asset Management solutionsvideolectures.net academic content platformSemantic multimedia researchSemantic copyright management researchPartners!
  5. 5. 06/06/13 Slide 5 of 28!"#$%$&!"#$%$&!"#$%$&!"#$%&" (%)*+,-#.&"(&)$*+!,")-%.$"/!"#&/0"!"#$%$&!"#$%$&01,&&2&/.!,")-%&)+(&)$*(&)$*+3,*12&/.4"/!$%.Producer checks reused medialicenses vs. internal policies andagreements (with providers andrights holders)!Policy example: “…avoid mediafragments showing violence whenproducing content for children”. !Problems:!1.) Semantic annotation!a) For instance, automatically tag"violent content!2.) Rights Integration!a) Policies and agreements(unstructured documents) !b) Media fragments licenses "(rights expression languages)!3.) Intelligently detect conflicts!Example Use Case!
  6. 6. 06/06/13 Slide 6 of 28Current Situation!!"!#"$%&()*+",$-./""0"#,122"/$3/4.0"#,-./""0"#,%&()*!"45"6(4$3/4.0"#,%/&67)"/8".49:(.;,<$=&6"/%/&>(6"/+"4/);$3/4.0"#,?;")@A"/0<:"<&>"$?&#"(),%/&67)"/8)&#,"#,$04#4."/9Issues:!•! scalability "(mostly a manual process)!•! conflicts detected too late(added costs)!•! missed opportunities "(media already available)!•! …!!
  7. 7. 06/06/13 Slide 7 of 28Proposals:"Assisted Policy and Agreement Modelling!•! Model policies andagreements!•! Formal model that allowsautomatic integration andintelligence support!•! Semantic model based onCopyright Ontology!•! Editor with assistanceguided by the ontology!
  8. 8. 06/06/13 Slide 9 of 28Media Fragments Ingestion!Provider offers mediafragment:!!•! Content: "automatic annotation!•! Detect topics: Violence?Outdoors? Cars?...!•! Rights:"automatic translation ofrights language toCopyright Ontology!•! DDEX, ODRL, MPEG-21,Creative Commons…!
  9. 9. 06/06/13 Slide 10 of 28Semantic Annotation!10!•! Transform whole videos to sets of meaningful,indexable and re-usable video fragments!O15F),B!P,)MB!Q511FB!!@+-I2-,RB!PS-B!T!@3F1N3IIB!Q#5)M-,RB!P%)5.FB!!OI3,.B!K+,,-,RB!T!U-.(#1,B!V,2))5B!W3S1B!T!T!
  10. 10. 06/06/13 Slide 11 of 28Semantic Annotation"Key Technologies!11!•! Temporal video fragmentation to!–! Shots (elementary video segments)!–! Scenes (groups of consecutive shots)!•! Video annotation (to make video fragmentsindexable / searchable)!–! Concept detection!–! Event detection!–! Event recounting!•! Video object re-detection (to create spatio-temporal video fragments)!V,%+.&!),1!*12-3!-.1*!X+.%+.&!F1.!)G!*12-3!G53R*1,.F!V,%+.&!),1!*12-3!-.1*!Y!143*%I1!)G!F)+R#.!)NZ1(.!X+.%+.&!F1.!)G!*12-3!G53R*1,.F!V,%+.&!),1!.1*%)53I!*12-3!G53R*1,.!X+.%+.&!F1.!)G!I3N1IF!"(),(1%.B!1D1,.6!
  11. 11. 06/06/13 Slide 12 of 28Semantic Annotation"Metadata!•! Metadata for semantic annotation:!–!Descriptive metadata for media characteristics!–!Provenance metadata to credit source andspecify rights!–!Conceptual metadata to reflect what media isperceived to represent!
  12. 12. 06/06/13 Slide 13 of 28Conceptual Metadata!• Globally unambiguousidentifiers for anyconcept needed–! Ideally more informationabout the concept itself isavailable via the identifier!–! Use of Web URIsLinked Data conceptspace!–! Would allow for inferenceof concept type andrelationship to otherconcepts!
  13. 13. 06/06/13 Slide 14 of 28Producer Proposed Workflow!!"#$%&"()*+$,-."&(/#""0"1&)*23,"4+"#5+6."5,7(85#0"1&97",:;%")*23,"4,*1&"1&(0515#"6/#""0"1&<=)*+$,-<=9*>-$#7&!"5%*1")*+$,-(512(/#""0"1&(?*2"++$1#(/%%$%&51&."051&$,(?"2$5(!">*%$&*-/#""0"1&(<= @"5+(?"2$5(85#0"1&(<=A1&"12"2(;%")*+$,-(<=?"2$5(85#0"1&<=."051&$,(?"&525&5/++*B"2(3%"%@$%++*B"2(3%"%
  14. 14. 06/06/13 Slide 15 of 28Implementation!•! Rights, License and Policies "implemented as Classes!–! Reproduction Right, Copy, "Copy Pattern for fragment #1,...!•! Uses implemented as Instances!–! u: Peter copies media fragment #1 "in the US on 2013-06-03 using…!•! if u Copy Pattern then"pattern authorises u !ReproductionRightCopyCopyrightCopyPatternu?
  15. 15. 06/06/13 Slide 16 of 28Pattern Building"Actions (“verbs”)!!"#$%"&()%$*+,$"-+)%$%"&.&/01+/-&/2$*+2$"-+)%!"#$%& ()*%$$3&224"*$%"&+"&),%&-*.%/$)-&/2"25/&6")+7")%/"84%+*&59*&59-"#5+/-&/2*&224"*$%+/+%/$)2"%!"#$%&()*%+,-.,/",0&123.,CopyrightEconomicRightsRelatedRightsMoralRightsDistributionRightReproductionRightPublicPerformanceRightFixationRightCommunicationRightAttributionRightTransformationRightIntegrityRightDisclosureRightWithdrawalRightPermorfersRightsProducersRightsBroadcastersRightsRentalRightImportationRightSoundRecordRightMotionPictureRightBroadcastingRightMakingAvailableRightAdaptationRightTranslationRight
  16. 16. 06/06/13 Slide 17 of 28Pattern Building"Case Roles (from linguistics)!•! Connect verbs to the action participants!–!Example: “The dog ate food”!initiator resource goal essenceAction agent, instrument result, patient,effector recipient themeProcess agent, matter result, patient,origin recipient themeTransfer agent, instrument, experiencer, themeorigin medium recipientSpatial origin path destination locationTemporal start duration completion pointInTimeAmbient reason manner aim, conditionconsequenceExample: “The dogP+NZ1(.B!5)I1![3R1,.!food”XNZ1(.B!5)I1![.#1*1!
  17. 17. 06/06/13 Slide 18 of 28DDEX Sample-08.04.xml!<Deal>!!<DealTerms>!! !<ValidityPeriod>!! ! !<StartDate>2013-01-01</StartDate>!! !</ValidityPeriod>!! !<Usage>!! ! !<UseType>!! ! ! !OnDemandStream"! ! !</UseType>!! ! !<DistributionChannelType>!! ! ! !Internet!! ! !</DistributionChannelType>!! !</Usage>!! !<TerritoryCode>ES</TerritoryCode>!! !<TerritoryCode>US</TerritoryCode>!!</DealTerms>!</Deal> !Copyright Ontology Model!<http://media.com/agreement#1> owl:Class;!!co:start "2013-01-01" ;!!owl:intersectionOf (!! !ddex:OnDemandStream !! ![ a owl:Restriction ;!! ! !owl:onProperty co:medium ;"! ! !owl:someValuesFrom ddex:Internet ]!! ![ a owl:Restriction ;!! ! !owl:onProperty co:location ;!! ! !owl:someValuesFrom "! ! ![ a !owl:Class ;!! ! ! !owl:oneOf (territory:ES territory:US) ]!! ![ a owl:Restriction ;!! ! !owl:onProperty co:theme ;!! ! !owl:hasValue!! ! ! !<http://my.tv/video.ogv#t=60,100> ] !!! !]!!) . !DDEX to RDF<http://co:startowl:intersectionOf1</StartDate> ddex:[ a[ a[ a owl:Restriction[ a[ amDistributionChannelType>owl:onPropertyTerritoryCode>TerritoryCode>owl:someValuesFrom[ a[ a owl:Restrictionowl:onPropertyowl:hasValue[ a[ a owl:Restriction[ a
  18. 18. 06/06/13 Slide 19 of 28])R-(3I!-,.15%51.3L),!)G!3!I-(1,F1!*)21I!Reasoning with DDEX
  19. 19. 06/06/13 Slide 20 of 28Reasoning with DDEXPolicy #1Agreement #1
  20. 20. 06/06/13 Slide 21 of 28!"#$%&"!(&")!"#$%"*&")&()*+!,-./0*++!"#$%&"!,-%#./&0%-%12"$*+34%#.".52$%6788#9,%)-*0"!!20%!2"$+:..";,%)-:<%=>!21?0%&0%,%)-!"#$%&"!,-%#.@%-2<>*AB%C0!"#D2&1E&FC,%)-A+!"#$%&"!,-%#.42<"&$"*AGGHIJC#D=-"KLM,LN,%)-A+O$"7(&")1#"*O$"7FPE:AO$"!L7A:A/&G"D#&.C0!"#DA:AE&0"!&"0A:Ahttp://my.tv/video.ogv#t=60,100A:AHCA:A9L76KLNK7QA+!"#$%&"!,-%#.*O$"7+!"$=%&$"(!"#$%&"!,2$F$"@"!D200".*O$"7FPE+=!2&0!"$=%&$"3RO0?%!2$".5?00=5SSD".2#D2;"!,"OS<%=>!21?0S";#D=-"$S#1!""D"&0T7O$"9(&")1#"*O$"9FPE:AO$"!L7A:A/&G"D#&.C0!"#DA:AE&0"!&"0A:Ahttp://my.tv/video.ogv#t=60,100A:AFCA:A9L76KLNK7QA+!"#$%&"!,-%#.*O$"9+!"$=%&$"(!"#$%&"!,2$F$"@"!D200".*O$"9FPE+=!2&0!"$=%&$"3@!%?2U20".5?00=5SSD".2#D2;"!,"OS<%=>!21?0S";#D=-"$S=%-2<>T7License Checking Implementation
  21. 21. 06/06/13 Slide 22 of 28@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> .@prefix odrlv: <http://w3.org/ns/odrl/vocab#> . !@prefix owl: <http://www.w3.org/2002/07/owl#> . !!<http://example.com/policy> a co:Agree ;!co:agent <http://example.com/billie>, <http://example.com/sony> ;!co:theme [ a owl:Class ;!co:end "2012-12-31" ;!co:start "0001-01-01" ;!owl:intersectionOf (![ owl:intersectionOf (!odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ][ a owl:Restriction ;!owl:hasValue <http://example.com/billie> ;owl:onProperty co:agent ][ a owl:Restriction ;owl:hasValue <http://example.com/music> ;owl:onProperty co:theme ] ) ] .!<http://example.com/sony:10> a co:Person .!<http://example.com/music> a co:Creation .!<http://example.com/billie> a co:Person .!ODRL Example from LCCRights Reference Model Spec!()*+$,-./01.)2),+/2$3"14"/.)/."&.5/[F),/!3,2!N-II-1!ER511!.#3.!!N-II-1!%I3/!3,2!,).!*)N-I1!5-,R.),1!!*+F-(0!
  22. 22. 06/06/13 Slide 23 of 28Creative Commons "BY-SA Model!!"#$% %&()*+,)-% %!"..,/01)-% %213-45161+6-2$21/7-()1)"/!"#$#.$8"*34))*+,)-%&()!)&.-!"#$#*#%)+)#!49*--!"#$#&-*5-!"#$#!"#$#:-;21/7-()1)"//-;8"*3*#,-.!),/0)1#,!0!)&21),3#*)40!)&21!"#$% %&()*+,)-% %!"..,/01)-% %213-45161+6-!"#$#!"#$#%&()!)&),/0)1#,!0!)&21! "#
  23. 23. 06/06/13 Slide 24 of 28•! Following Linked Data principles, "starting from just content ID (URI)…!Long term vision…!24!W),.1,.!!AKV!AKV!3!1N+()51&V*3R1!!!!2(.&L.I1![?@A!^_!!!!2(.&()%/5-R#.!678/!!!T!!!!!HTTP GETimage/jpeg
  24. 24. 06/06/13 Slide 25 of 2806/06/13 Slide 25 of 28Linked Data for Worldwide "Copyright Management?!25!W),.1,.!!AKV!W),.1,.AKV!3!1N+()51&V*3R1!!!!2(.&L.I1![?@A!^_!!!!2(.&()%/5-R#.!AKV!!!!T!!!!!HTTPGETER511*1,.!!AKV!ER511*1,.AKV!3!()&ER511*1,.!!!!()&3R1,.!678!!!!()&.#1*1!T/!!!T!!!!!HTTPGETO15F),!!AKV!URI a foaf:Personfoaf:name “…”vcard:address …vcard:country URIHTTPGETER511*1,.ER511*1,.AKVER511*1,.URI a foaf:Personfoaf:name “…”vcard:address …vcard:countryHTTPGET
  25. 25. 06/06/13 Slide 26 of 28Get involved!•! Join MediaMixer community to know more "(http://community.mediamixer.eu):!–! discussions, use cases, demonstrators, tutorials,presentations, software,…!06/06/13 Slide 26 of 28
  26. 26. 06/06/13 Slide 27 of 28Get more involved!•! Want to experience semantic technologies?Apply to become core partner"(http://mediamixer.eu/contact) :!–!Contribute use case, sample data and justsome time…!–!…selected partners get a demo showcasingsemantic technologies for their problem!
  27. 27. More details:http://community.mediamixer.euhttp://rhizomik.net/copyrightonto/Roberto GarcíaUniversitat de Lleida, Spainhttp://rhizomik.net/~robertoThank you for your attention

×