Slimmer zoeken in media dankzij Linked Open Data<br />Future Internet Technologies Workshop<br />23/03/2011<br />Vrt-media...
Vrt-Medialab<br />2<br />MediaLoep<br /><ul><li>Introducing media search
The MediaLoep project
Reusing production documents
Linking to the semantic web</li></li></ul><li>Searching Media: Media ≠ Text!<br />Not self-descriptive -> we need metadata...
Not self-descriptive<br />Video / Audio are continuous media with a time-dimension -> we prefer time-coded metadata<br />S...
Searching Media: Media ≠ Text!<br />35’00”>36’33”<br />Observation by police<br />5<br />
Searching the media archive<br />Basis<br />6<br />Vrt-Medialab<br />
Searching the media archive<br />Ardome<br />7<br />Vrt-Medialab<br />
Not enough detailed annotations available<br />“X spits on the ground after Y makes a goal”<br />The entire dialogue so we...
Vrt-Medialab<br />9<br />MediaLoep<br /><ul><li>Introducing media search
The MediaLoep project
Reusing production documents
Linking to the semantic web</li></li></ul><li>Gather existing information<br />In-house (subtitles, news preparation, EPG,...
Vrt-Medialab<br />12<br />MediaLoep<br /><ul><li>Introducing media search
The MediaLoep project
Reusing production documents
Linking to the semantic web</li></li></ul><li>News Rundown with auto-cue texts, overlay labels, …<br />EPG data contains a...
Vrt-Medialab<br />14<br />An Archived News Clip<br />Manual Annotations<br />keywords<br />textual description<br />other ...
Vrt-Medialab<br />15<br />An Archived News Clip<br />Information added by the news preparation:<br />overlay captions<br /...
Vrt-Medialab<br />16<br />An Archived News Clip<br />Information added by the subtitles:<br />time-coded transcriptof the ...
Vrt-Medialab<br />17<br />Subtitles are used as a transcript<br />
Vrt-Medialab<br />18<br />An example MediaLoep result<br />
Vrt-Medialab<br />19<br />Linking to Promotional Images<br />
Vrt-Medialab<br />20<br />MediaLoep<br /><ul><li>Introducing media search
The MediaLoep project
Reusing production documents
Linking to the semantic web</li></li></ul><li>Vrt-Medialab<br />21<br />The Linked Open Data Cloud<br />Public knowledge b...
Vrt-Medialab<br />22<br />The Linked Open Data Cloud<br />Linksto the same resource in other knowledge bases can be create...
Vrt-Medialab<br />23<br />The Linked Open Data Cloud<br />A network of linked knowledge is created.<br />
Vrt-Medialab<br />24<br />The Linked Open Data Cloud<br />We can leverage this knowledge by linking our metadata to the Li...
Archivistsadd thesaurus keywords to clips<br />Bylinking these keywords to the LOD cloud, we canmake the search system sma...
Example “Gent”<br />label @EN <br />“Ghent”<br />Ghent<br />label @NL <br />“Gent”<br />sameAs<br />2797656<br />longitude...
Example “Devolder, Stijn”<br />Kortrijk<br />Stijn_Devolder<br />birthPlace<br />label @NL <br />“Kortrijk”<br />label @NL...
Vrt-Medialab<br />28<br />How we linked automatically<br />Boonen, Tom<br />
Vrt-Medialab<br />29<br />How we linked automatically<br />Boonen, Tom appears often together with “Wielrennen” & “Cancell...
Information pop-ups<br />Visual search result summaries<br />Structured filters<br />Smart suggestions<br />Multilingual s...
Vrt-Medialab<br />31<br />Information Pop-ups<br />
Upcoming SlideShare
Loading in …5
×

medialoep

1,671 views

Published on

Presentation about semantic search technologies in a search application

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,671
On SlideShare
0
From Embeds
0
Number of Embeds
220
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • By adding metadata, we can search for “raid” and get a pointer to this video.
  • But in a video this is not enough. What is depicted within video changes throughout time. The first minute might contain the actual raid on a shop, the next 5 mins might contain shots from the investigation and so on. So we need to timebox the descriptions, which we call time-coded metadata.
  • But in a video this is not enough. What is depicted within video changes throughout time. The first minute might contain the actual raid on a shop, the next 5 mins might contain shots from the investigation and so on. So we need to timebox the descriptions, which we call time-coded metadata.
  • medialoep

    1. 1. Slimmer zoeken in media dankzij Linked Open Data<br />Future Internet Technologies Workshop<br />23/03/2011<br />Vrt-medialab<br />1<br />Vrt-Medialab<br />
    2. 2. Vrt-Medialab<br />2<br />MediaLoep<br /><ul><li>Introducing media search
    3. 3. The MediaLoep project
    4. 4. Reusing production documents
    5. 5. Linking to the semantic web</li></li></ul><li>Searching Media: Media ≠ Text!<br />Not self-descriptive -> we need metadata<br />Video / Audio are continuous media with a time-dimension<br />Series: Flikken<br />Keywords: violence, robbery<br />Description: Robbery on shop. Attacker hits shop owner with gun.<br />3<br />VRT-medialab<br />
    6. 6. Not self-descriptive<br />Video / Audio are continuous media with a time-dimension -> we prefer time-coded metadata<br />Searching Media: Media ≠ Text!<br />35’00”>36’33”<br />Observation by police<br />01’43”>04’20”<br />Police agent looks worried<br />00’00”>01’43”Robbery on shop<br />4<br />
    7. 7. Searching Media: Media ≠ Text!<br />35’00”>36’33”<br />Observation by police<br />5<br />
    8. 8. Searching the media archive<br />Basis<br />6<br />Vrt-Medialab<br />
    9. 9. Searching the media archive<br />Ardome<br />7<br />Vrt-Medialab<br />
    10. 10. Not enough detailed annotations available<br />“X spits on the ground after Y makes a goal”<br />The entire dialogue so we can search for quotes<br />Labels, locations, links, maps, photographs, …<br />as the creation of these annotations is very time consuming.<br />Vrt-Medialab<br />8<br />Search is a problem<br />
    11. 11. Vrt-Medialab<br />9<br />MediaLoep<br /><ul><li>Introducing media search
    12. 12. The MediaLoep project
    13. 13. Reusing production documents
    14. 14. Linking to the semantic web</li></li></ul><li>Gather existing information<br />In-house (subtitles, news preparation, EPG, …)<br />Semantic web (DBpedia, Geonames, IMDB, …)<br />Combine, Link & Index this information<br />Use it for search<br />Vrt-Medialab<br />10<br />MediaLoep<br />
    15. 15.
    16. 16. Vrt-Medialab<br />12<br />MediaLoep<br /><ul><li>Introducing media search
    17. 17. The MediaLoep project
    18. 18. Reusing production documents
    19. 19. Linking to the semantic web</li></li></ul><li>News Rundown with auto-cue texts, overlay labels, …<br />EPG data contains a summary of the programme, the broadcast dates, …<br />A drama script contains dialogues and actions, …<br />Subtitles ~ transcript of spoken text<br />Promotional Images can be linked<br />The information is out there!<br />13<br />Vrt-Medialab<br />
    20. 20. Vrt-Medialab<br />14<br />An Archived News Clip<br />Manual Annotations<br />keywords<br />textual description<br />other fields<br />
    21. 21. Vrt-Medialab<br />15<br />An Archived News Clip<br />Information added by the news preparation:<br />overlay captions<br />autocue text<br />links to other items inthis news broadcast<br />
    22. 22. Vrt-Medialab<br />16<br />An Archived News Clip<br />Information added by the subtitles:<br />time-coded transcriptof the dialogue<br />
    23. 23. Vrt-Medialab<br />17<br />Subtitles are used as a transcript<br />
    24. 24. Vrt-Medialab<br />18<br />An example MediaLoep result<br />
    25. 25. Vrt-Medialab<br />19<br />Linking to Promotional Images<br />
    26. 26. Vrt-Medialab<br />20<br />MediaLoep<br /><ul><li>Introducing media search
    27. 27. The MediaLoep project
    28. 28. Reusing production documents
    29. 29. Linking to the semantic web</li></li></ul><li>Vrt-Medialab<br />21<br />The Linked Open Data Cloud<br />Public knowledge bases provide information about resources using ‘triples’.<br />country<br />Geneva<br />Switzerland<br />area<br />15.86 km2<br />
    30. 30. Vrt-Medialab<br />22<br />The Linked Open Data Cloud<br />Linksto the same resource in other knowledge bases can be created.<br />country<br />Geneva<br />Switzerland<br />sameAs<br />area<br />15.86 km2<br />Geneva<br />latitude<br />46° 12' 0" N<br />GeoNames<br />
    31. 31. Vrt-Medialab<br />23<br />The Linked Open Data Cloud<br />A network of linked knowledge is created.<br />
    32. 32. Vrt-Medialab<br />24<br />The Linked Open Data Cloud<br />We can leverage this knowledge by linking our metadata to the Linked Open Data Cloud.<br />MediaLoep<br />
    33. 33. Archivistsadd thesaurus keywords to clips<br />Bylinking these keywords to the LOD cloud, we canmake the search system smarter<br />Vrt-Medialab<br />25<br />Enhancing the thesaurus<br />Gent<br />Devolder, Stijn<br />Europe<br />…<br />Gent -> coordinateson a map?<br />Devolder, Stijn -> a picture?<br />…<br />
    34. 34. Example “Gent”<br />label @EN <br />“Ghent”<br />Ghent<br />label @NL <br />“Gent”<br />sameAs<br />2797656<br />longitude<br />E 3° 43' 0''<br />latitude<br />N 51° 3' 0''<br />GeoNames<br />population<br />231493<br />Vrt-Medialab<br />26<br />
    35. 35. Example “Devolder, Stijn”<br />Kortrijk<br />Stijn_Devolder<br />birthPlace<br />label @NL <br />“Kortrijk”<br />label @NL <br />“StijnDevolder”<br />a <br />Person, Athlete, Cyclist, …<br />depiction <br />abstract<br />Stijn Devolder is een Belgische wielrenner. Devolder begon zijn wielercarrière bij de KortrijkseGroeninge Spurters. Na een stage bij de Mapei-wielerploeg, belandde…<br />
    36. 36. Vrt-Medialab<br />28<br />How we linked automatically<br />Boonen, Tom<br />
    37. 37. Vrt-Medialab<br />29<br />How we linked automatically<br />Boonen, Tom appears often together with “Wielrennen” & “Cancellara, Fabian”<br />
    38. 38. Information pop-ups<br />Visual search result summaries<br />Structured filters<br />Smart suggestions<br />Multilingual search<br />Vrt-Medialab<br />30<br />Features <br />
    39. 39. Vrt-Medialab<br />31<br />Information Pop-ups<br />
    40. 40. Previously: limited structure (exception: locations)<br />Now: each keyword has several types, which can be used to create smart filters:Concept > Person > Athlete > Cyclist<br />Vrt-Medialab<br />32<br />Structured Thesaurus<br />
    41. 41. Vrt-Medialab<br />33<br />Visual Search Result Summaries<br />
    42. 42. Vrt-Medialab<br />34<br />Smart Suggestions<br />yvesLeterme<br />opvolger<br />successor<br />-> Ga op zoek naar triples met resource label “Yves Leterme” en property label “successor”<br />
    43. 43. Vrt-Medialab<br />35<br />Smart Suggestions<br />label @NL <br />“Yves Leterme”<br />Yves_Leterme<br />successor <br />…<br />
    44. 44. Multilingual Search<br />label @EN <br />“Antwerp”<br />Antwerp<br />label @NL <br />“Antwerpen”<br />label @FR <br />“Anvers”<br />
    45. 45. Vrt-Medialab<br />37<br />Multilingual Search<br />
    46. 46. Material in the demo<br />All video material produced in 2010<br />Promotional images 2010<br />Metadata based on fixed dumps of subtitles, news production system, EPG, …<br />Vrt-Medialab<br />38<br />MediaLoep Demo<br />
    47. 47. Vrt-Medialab<br />39<br />MediaLoep Demo<br />
    48. 48. http://medialoep.vrtmedialab.be<br />karel.braeckman@vrtmedialab.be<br />Vrt-Medialab<br />40<br />Vragen?<br />

    ×