Your SlideShare is downloading. ×
Building the future of television - Lynda Hardman
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Building the future of television - Lynda Hardman

4,412

Published on

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,412
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
8
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Television Linked To The Webwww.linkedtv.euBuilding the future of televisionLynda HardmanCentrum Wiskunde & Informatica
  • 2. 2www.linkedtv.eu Web and TV exist in parallel 86% of TV viewers surf the Web at the same time(Yahoo!, USA) 88% of USA consumers use mobile as secondscreen (Business Insider, May 2013) Manual efforts to link TV program to additionalcontent (Shazam, IntoNow) LinkedTV: interweaving Web and TV into asingle experience Mixing lean back and lean forward Want to maintain immersion while removing fourthwall illusion Works only for certain genres and audiences Does second screen help or hinder?The LinkedTV visionlinkedtv.eu
  • 3. 3www.linkedtv.euScenarios and contentEnriched News Professional news contentproduced by RBB for generalaudience local news show rbb Aktuell People, locations and eventscan be linked to previousevents.Antiques Edutainment Program watchedpredominantly by 50+ers AVRO:Tussen Kunst en Kitsch Presenters, locations andobjects provide hooks torelated materials.linkedtv.eu
  • 4. 4www.linkedtv.euEnriched link demonstrationlinkedtv.eu
  • 5. 5www.linkedtv.eudbpedia.org/resource/Jan_SluytersHow will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection toconcepts
  • 6. 6www.linkedtv.eu Object detection in video Face detection Text analysis, keyword extraction Multilingual automatic speech recognition Combining results from different modalityanalyses Speaker identification Object re-detection Output in XML using OpenSource tool:EXMARaLDAhttp://www.exmaralda.org/Concept Detectionlinkedtv.eu“...schilderij van Jan Sluijters....”Video object andword detection
  • 7. 7www.linkedtv.eu Annotations represented in RDFstored in LinkedTV platform Use existing vocabulariese.g. schema.org, NERD, LSCOM, DBpedia Named Entity Recognition usingstatistical & knowledge-based approaches Enrichment based on textual and visualanalysesConcept connectionslinkedtv.euConnection toconceptsdbpedia.org/resource/Jan_Sluyters
  • 8. 8www.linkedtv.euLinkedTV metadata conversionWP2 - Linking hypervideos to Web contenthttp://linkedtv.eurecom.fr/metadata/
  • 9. 9www.linkedtv.eu Additional information, e.g. biography of artist style of painting Related information, e.g. artists from same period paintings in similar style related stylesConcept selectionlinkedtv.euPaintings by Jan SluijtersSelection ofrelated conceptsJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style
  • 10. 10www.linkedtv.eu Selection based on context of scene,e.g. system knows which topics appearnext User preferences, e.g.closely related information touninteresting topic is less useful We need to understand userinformation needs (per genre), e.g.don’t miss important news because ofpersonalisation Broadcasters don’t want users to driftaway from programContent selectionlinkedtv.euSelection ofrelated content
  • 11. 11www.linkedtv.euExample user information needs for newsLinkedTV Berlin, 2013 MORE IN DEPTH SPECIFIC INFORMATIONI was wondering just how expensive it is to make all thosevaccines, you know? I was just wondering if it is a good idea  to even make a lot of it or how hard it is to make.  LOCAL EFFECT OF GLOBAL NEWS – What is the impactin my life?Yes then I would look it up, what is the effect in the Netherlands…(of the bird flu virus) OVERVIEW OF PAST RELATED EVENTSMy search would be something like "South Korea state of war ramp up” (…)I would like to know, what happened two years ago and how they solved it…
  • 12. 12www.linkedtv.euUser information needs for newsLinkedTV Berlin, 2013 Information about how the story ends Updates when important changes occur More information about the people involved Where is that location? Consult related publications and documentaries Opinions from different experts Access related info selected by experts and suggested by broadcasters
  • 13. 13www.linkedtv.eu Many users watch TV news during dinner! Use second screen to give user more control retain sense of immersion via TV screen Need to resolve issues of pausing when ingroup situation There is no single best solutionContent displaylinkedtv.euPresentationengine
  • 14. 14www.linkedtv.euHow will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection toconceptsdbpedia.org/resource/Jan_Sluyters
  • 15. 15www.linkedtv.euHow can LinkedTV help you?linkedtv.eu
  • 16. 16www.linkedtv.euLinkedTV platform & playerTV SetLinkedTVServer• Video Analysis• Enrichment• Personalization• DeliveryBrowserCE-HTMLPlatform ClientExternalBroadcastHTTPBrowserVariantHbbTVVariantHTTPRepository• Annotations• Links toexternalResourcesEditorLoDCloudVideosfromScenariosBrowserHTML 5PC / TabletNetworkMaterialselection,AnnotationadjustmentA clearly defined and modularizedplatform architecture, deploymentdecisions made, initial REST APIAn interactive video player based onWeb specifications (HTML5) realisingintuitive interaction & enrichment layerslinkedtv.eu
  • 17. 17www.linkedtv.eulinkedtv.eu
  • 18. 18www.linkedtv.eu Individual video analysis, annotation, hyperlinking, UI/UX design andpersonalisation components integrated into a LinkedTV platform withend-to-end content workflow Provide player for desktop, TV and second screen Create interactive scenarios (rbbAktuell and Tussen Kunst en Kitsch) toengage with users to further understand their interaction and informationneedsLinkedTV in 2013linkedtv.eu
  • 19. 19www.linkedtv.eulinkedtv.eu
  • 20. 20www.linkedtv.eulinkedtv.eu
  • 21. 21www.linkedtv.eu1. Shot and scene segmentation used for generating Media Fragments W3C Recommendation for temporal and spatial fragments2. Re-use as much as possible common vocabularies in the semantic web schema.org, Open Annotations, PROV-O, Ontology for MediaResources FOAF, Dublin Core, NERD, LSCOM, DBpedia Ontology3. Name Entity Recognition Statistical based approaches Knowledge Based Approaches (Wikipedia/DBpedia) Web-based APIs4. Enrichment based on textual and visual analysis Structured data: LOD cloud accessible through structured queries(SPARQL) Search API: REST based query Online content repositories (curated list): Crawling, Wrapping, Indexing and Searching (Lucene/Solr) Web-based and content-based mining approachesLinking hypervideos to Web contentWP2 - Linking hypervideos to Web content
  • 22. 22www.linkedtv.eulinkedtv.euJan SluijtersJan Sluijters
  • 23. 23www.linkedtv.eu Specifying how to refer to video fragments Specifying the semantic annotation of mediaresources in LinkedTV Defining the use of Linked Data vocabularies inthe identification of concepts in the annotations Implementing Named Entity Recognition (NER)over WP1 analysis results Defining a Web mining approach to generatelinks from video fragments to related Webcontent via shared conceptual annotationsLinking hypervideo to Web contentlinkedtv.eu
  • 24. 24www.linkedtv.eulinkedtv.euhas art styleMondriaanLeo Gestelluminismhas art styleluminismJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style

×