LinkedTV: Television Linked to the Web, June 2013


Published on

Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.

Published in: Technology, Education
  • Be the first to comment

LinkedTV: Television Linked to the Web, June 2013

  1. 1. Television Linked To The Webwww.linkedtv.euBuilding the future of televisionLynda HardmanCentrum Wiskunde & Informatica
  2. 2. Web and TV exist in parallel 86% of TV viewers surf the Web at the same time(Yahoo!, USA) 88% of USA consumers use mobile as secondscreen (Business Insider, May 2013) Manual efforts to link TV program to additionalcontent (Shazam, IntoNow) LinkedTV: interweaving Web and TV into asingle experience Mixing lean back and lean forward Want to maintain immersion while removing fourthwall illusion Works only for certain genres and audiences Does second screen help or hinder?The LinkedTV
  3. 3. 3www.linkedtv.euScenarios and contentEnriched News Professional news contentproduced by RBB for generalaudience local news show rbb Aktuell People, locations and eventscan be linked to previousevents.Antiques Edutainment Program watchedpredominantly by 50+ers AVRO:Tussen Kunst en Kitsch Presenters, locations andobjects provide hooks torelated
  4. 4. 4www.linkedtv.euEnriched link
  5. 5. will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection toconcepts
  6. 6. Object detection in video Face detection Text analysis, keyword extraction Multilingual automatic speech recognition Combining results from different modalityanalyses Speaker identification Object re-detection Output in XML using OpenSource tool:EXMARaLDA“...schilderij van Jan Sluijters....”Video object andword detection
  7. 7. Annotations represented in RDFstored in LinkedTV platform Use existing vocabulariese.g., NERD, LSCOM, DBpedia Named Entity Recognition usingstatistical & knowledge-based approaches Enrichment based on textual and visualanalysesConcept connectionslinkedtv.euConnection
  8. 8. 8www.linkedtv.euLinkedTV metadata conversionWP2 - Linking hypervideos to Web content
  9. 9. Additional information, e.g. biography of artist style of painting Related information, e.g. artists from same period paintings in similar style related stylesConcept selectionlinkedtv.euPaintings by Jan SluijtersSelection ofrelated conceptsJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style
  10. 10. Selection based on context of scene,e.g. system knows which topics appearnext User preferences, e.g.closely related information touninteresting topic is less useful We need to understand userinformation needs (per genre), e.g.don’t miss important news because ofpersonalisation Broadcasters don’t want users to driftaway from programContent selectionlinkedtv.euSelection ofrelated content
  11. 11. 11www.linkedtv.euExample user information needs for newsLinkedTV Berlin, 2013 MORE IN DEPTH SPECIFIC INFORMATIONI was wondering just how expensive it is to make all thosevaccines, you know? I was just wondering if it is a good idea toeven make a lot of it or how hard it is to make. LOCAL EFFECT OF GLOBAL NEWS – What is the impactin my life?Yes then I would look it up, what is the effect in theNetherlands… (of the bird flu virus) OVERVIEW OF PAST RELATED EVENTSMy search would be something like "South Korea state of warramp up” (…)I would like to know, what happened two years ago and howthey solved it…
  12. 12. 12www.linkedtv.euUser information needs for newsLinkedTV Berlin, 2013 Information about how the story ends Updates when important changes occur More information about the people involved Where is that location? Consult related publications and documentaries Opinions from different experts Access related info selected by experts and suggested by broadcasters
  13. 13. Many users watch TV news during dinner! Use second screen to give user more control retain sense of immersion via TV screen Need to resolve issues of pausing when ingroup situation There is no single best solutionContent displaylinkedtv.euPresentationengine
  14. 14. 14www.linkedtv.euHow will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection
  15. 15. 15www.linkedtv.euHow can LinkedTV help you?
  16. 16. 16www.linkedtv.euLinkedTV platform & playerTV SetLinkedTVServer• Video Analysis• Enrichment• Personalization• DeliveryBrowserCE-HTMLPlatform ClientExternalBroadcastHTTPBrowserVariantHbbTVVariantHTTPRepository• Annotations• Links toexternalResourcesEditorLoDCloudVideosfromScenariosBrowserHTML 5PC / TabletNetworkMaterialselection,AnnotationadjustmentA clearly defined and modularizedplatform architecture, deploymentdecisions made, initial REST APIAn interactive video player based onWeb specifications (HTML5) realisingintuitive interaction & enrichment
  17. 17.
  18. 18. Individual video analysis, annotation, hyperlinking, UI/UX design andpersonalisation components integrated into a LinkedTV platform withend-to-end content workflow Provide player for desktop, TV and second screen Create interactive scenarios (rbbAktuell and Tussen Kunst en Kitsch) toengage with users to further understand their interaction and informationneedsLinkedTV in
  19. 19.