Building the future of television - Lynda Hardman


Published on

Published in: Education, Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Building the future of television - Lynda Hardman

  1. 1. Television Linked To The Webwww.linkedtv.euBuilding the future of televisionLynda HardmanCentrum Wiskunde & Informatica
  2. 2. Web and TV exist in parallel 86% of TV viewers surf the Web at the same time(Yahoo!, USA) 88% of USA consumers use mobile as secondscreen (Business Insider, May 2013) Manual efforts to link TV program to additionalcontent (Shazam, IntoNow) LinkedTV: interweaving Web and TV into asingle experience Mixing lean back and lean forward Want to maintain immersion while removing fourthwall illusion Works only for certain genres and audiences Does second screen help or hinder?The LinkedTV
  3. 3. 3www.linkedtv.euScenarios and contentEnriched News Professional news contentproduced by RBB for generalaudience local news show rbb Aktuell People, locations and eventscan be linked to previousevents.Antiques Edutainment Program watchedpredominantly by 50+ers AVRO:Tussen Kunst en Kitsch Presenters, locations andobjects provide hooks torelated
  4. 4. 4www.linkedtv.euEnriched link
  5. 5. will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection toconcepts
  6. 6. Object detection in video Face detection Text analysis, keyword extraction Multilingual automatic speech recognition Combining results from different modalityanalyses Speaker identification Object re-detection Output in XML using OpenSource tool:EXMARaLDA“...schilderij van Jan Sluijters....”Video object andword detection
  7. 7. Annotations represented in RDFstored in LinkedTV platform Use existing vocabulariese.g., NERD, LSCOM, DBpedia Named Entity Recognition usingstatistical & knowledge-based approaches Enrichment based on textual and visualanalysesConcept connectionslinkedtv.euConnection
  8. 8. 8www.linkedtv.euLinkedTV metadata conversionWP2 - Linking hypervideos to Web content
  9. 9. Additional information, e.g. biography of artist style of painting Related information, e.g. artists from same period paintings in similar style related stylesConcept selectionlinkedtv.euPaintings by Jan SluijtersSelection ofrelated conceptsJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style
  10. 10. Selection based on context of scene,e.g. system knows which topics appearnext User preferences, e.g.closely related information touninteresting topic is less useful We need to understand userinformation needs (per genre), e.g.don’t miss important news because ofpersonalisation Broadcasters don’t want users to driftaway from programContent selectionlinkedtv.euSelection ofrelated content
  11. 11. 11www.linkedtv.euExample user information needs for newsLinkedTV Berlin, 2013 MORE IN DEPTH SPECIFIC INFORMATIONI was wondering just how expensive it is to make all thosevaccines, you know? I was just wondering if it is a good idea  to even make a lot of it or how hard it is to make.  LOCAL EFFECT OF GLOBAL NEWS – What is the impactin my life?Yes then I would look it up, what is the effect in the Netherlands…(of the bird flu virus) OVERVIEW OF PAST RELATED EVENTSMy search would be something like "South Korea state of war ramp up” (…)I would like to know, what happened two years ago and how they solved it…
  12. 12. 12www.linkedtv.euUser information needs for newsLinkedTV Berlin, 2013 Information about how the story ends Updates when important changes occur More information about the people involved Where is that location? Consult related publications and documentaries Opinions from different experts Access related info selected by experts and suggested by broadcasters
  13. 13. Many users watch TV news during dinner! Use second screen to give user more control retain sense of immersion via TV screen Need to resolve issues of pausing when ingroup situation There is no single best solutionContent displaylinkedtv.euPresentationengine
  14. 14. 14www.linkedtv.euHow will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection
  15. 15. 15www.linkedtv.euHow can LinkedTV help you?
  16. 16. 16www.linkedtv.euLinkedTV platform & playerTV SetLinkedTVServer• Video Analysis• Enrichment• Personalization• DeliveryBrowserCE-HTMLPlatform ClientExternalBroadcastHTTPBrowserVariantHbbTVVariantHTTPRepository• Annotations• Links toexternalResourcesEditorLoDCloudVideosfromScenariosBrowserHTML 5PC / TabletNetworkMaterialselection,AnnotationadjustmentA clearly defined and modularizedplatform architecture, deploymentdecisions made, initial REST APIAn interactive video player based onWeb specifications (HTML5) realisingintuitive interaction & enrichment
  17. 17.
  18. 18. Individual video analysis, annotation, hyperlinking, UI/UX design andpersonalisation components integrated into a LinkedTV platform withend-to-end content workflow Provide player for desktop, TV and second screen Create interactive scenarios (rbbAktuell and Tussen Kunst en Kitsch) toengage with users to further understand their interaction and informationneedsLinkedTV in
  19. 19.
  20. 20.
  21. 21. 21www.linkedtv.eu1. Shot and scene segmentation used for generating Media Fragments W3C Recommendation for temporal and spatial fragments2. Re-use as much as possible common vocabularies in the semantic web, Open Annotations, PROV-O, Ontology for MediaResources FOAF, Dublin Core, NERD, LSCOM, DBpedia Ontology3. Name Entity Recognition Statistical based approaches Knowledge Based Approaches (Wikipedia/DBpedia) Web-based APIs4. Enrichment based on textual and visual analysis Structured data: LOD cloud accessible through structured queries(SPARQL) Search API: REST based query Online content repositories (curated list): Crawling, Wrapping, Indexing and Searching (Lucene/Solr) Web-based and content-based mining approachesLinking hypervideos to Web contentWP2 - Linking hypervideos to Web content
  22. 22. 22www.linkedtv.eulinkedtv.euJan SluijtersJan Sluijters
  23. 23. Specifying how to refer to video fragments Specifying the semantic annotation of mediaresources in LinkedTV Defining the use of Linked Data vocabularies inthe identification of concepts in the annotations Implementing Named Entity Recognition (NER)over WP1 analysis results Defining a Web mining approach to generatelinks from video fragments to related Webcontent via shared conceptual annotationsLinking hypervideo to Web
  24. 24. 24www.linkedtv.eulinkedtv.euhas art styleMondriaanLeo Gestelluminismhas art styleluminismJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style