Your SlideShare is downloading. ×
LinkedTV: Television Linked to the Web, June 2013
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.


Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

LinkedTV: Television Linked to the Web, June 2013


Published on

Television Linked to the Web …

Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.

Published in: Technology, Education

  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide
  • Not just TV, but interaction with online media (archives).
  • (1) Big Q: Do you ever have a question about what you are watching? Would you like related information about something you have seen? Something someone mentioned? One option is to pause the TV, go find your smart phone or pad and start some google search. When you carry out the search, your device doesn't know what you were watching, nor what the specific scene was about. Wouldn't it be nice to have a system that knows what you are watching, knows what you like and that presents links to extra pieces of information to you? Technology only likely to be useful when audience , content and program genre match. (2) slide
  • (1) Currently developing tools using 2 program genres
  • (1) What do we think it will look like? Not like this! Select video. Link to video!
  • Developing individual technologies, using content from 2 program genres, with the aim of creating an end2end prototype. I’ll go through each of these stages. Don’t explain anything about each part.
  • (1) Lower the cost of preparing seed video for enrichment with other content Objects are detected in the video, e.g. painting, face Words are also detected in the speech, or closed captions (2) Slide: Web aspects: using and cnotributing to W3C recommendations, much of the s/w open source
  • Linking object or word to concept (painting, face, painter ) or Named Entity (Jan_Sluijters, Piet_Mondrian ) in Linked Open Data cloud. Each circle is a data set, representing thousands or millions of concepts. Familiar with wikipedia? DBpedia is machine-readable form? RDF is the language used on the web for expressing concepts (similar to XML for document structure)
  • A number of tools are available, e.g. allowing the conversion of different sources of metadata to be converted to RDF, Named Entity Recognition.
  • Once we have the concepts & named entities in the Linked Open Data cloud, we can find other content (web pages or audiovisual material) by tracing paths through this cloud.. Go through the bullets click through the links Could also link to concepts or entities in other sets, such as birthplace in GeoNames.
  • Large numbers of related concepts can be found very quickly. Selection based on connections within video topics and user preferences Need to find suitable video/information sources for users. If suitable material is scarce then can increase complexity of search (length of path in linked open data cloud). Broadcasters need to be sure of high quality sources, e.g., wikipedia, Artcyclopedia Want structure that ensures that user "stays with the program" but has access to related information.
  • Team@CWI is investigating user info needs specific to narrow goals of LinkedTV. Working together with Beeld Geluid on this.
  • Skip if time short
  • Once we have chosen related content, we need to display it to the end user. Explore interaction modalities to browse the enrichment content. We need to understand how involved user wishes to be. Playout of enriched video on multiple devices and cross-device, e.g. second screen Providing requirements for first implementation of the presentation layer based on User Interface mock-ups of scenarios Carrying out user focus groups for second round requirements
  • I hope that this overview of the project makes more sense now!
  • Project is making underlying technology available. Daniel Ockeloen, Noterik, presenting later this afternoon. HTML5 for cross-device Web application development
  • In addition to the technology development, also collecting annotations of resources in project database.
  • Demos are available online
  • What next?!
  • May the links be with you! Thank you.
  • Transcript

    • 1. Television Linked To The Webwww.linkedtv.euBuilding the future of televisionLynda HardmanCentrum Wiskunde & Informatica
    • 2. Web and TV exist in parallel 86% of TV viewers surf the Web at the same time(Yahoo!, USA) 88% of USA consumers use mobile as secondscreen (Business Insider, May 2013) Manual efforts to link TV program to additionalcontent (Shazam, IntoNow) LinkedTV: interweaving Web and TV into asingle experience Mixing lean back and lean forward Want to maintain immersion while removing fourthwall illusion Works only for certain genres and audiences Does second screen help or hinder?The LinkedTV
    • 3. 3www.linkedtv.euScenarios and contentEnriched News Professional news contentproduced by RBB for generalaudience local news show rbb Aktuell People, locations and eventscan be linked to previousevents.Antiques Edutainment Program watchedpredominantly by 50+ers AVRO:Tussen Kunst en Kitsch Presenters, locations andobjects provide hooks torelated
    • 4. 4www.linkedtv.euEnriched link
    • 5. will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection toconcepts
    • 6. Object detection in video Face detection Text analysis, keyword extraction Multilingual automatic speech recognition Combining results from different modalityanalyses Speaker identification Object re-detection Output in XML using OpenSource tool:EXMARaLDA“...schilderij van Jan Sluijters....”Video object andword detection
    • 7. Annotations represented in RDFstored in LinkedTV platform Use existing vocabulariese.g., NERD, LSCOM, DBpedia Named Entity Recognition usingstatistical & knowledge-based approaches Enrichment based on textual and visualanalysesConcept connectionslinkedtv.euConnection
    • 8. 8www.linkedtv.euLinkedTV metadata conversionWP2 - Linking hypervideos to Web content
    • 9. Additional information, e.g. biography of artist style of painting Related information, e.g. artists from same period paintings in similar style related stylesConcept selectionlinkedtv.euPaintings by Jan SluijtersSelection ofrelated conceptsJan Sluijtershas art styleluminismLeo GestelPiet Mondriaanhas art stylehas art style
    • 10. Selection based on context of scene,e.g. system knows which topics appearnext User preferences, e.g.closely related information touninteresting topic is less useful We need to understand userinformation needs (per genre), e.g.don’t miss important news because ofpersonalisation Broadcasters don’t want users to driftaway from programContent selectionlinkedtv.euSelection ofrelated content
    • 11. 11www.linkedtv.euExample user information needs for newsLinkedTV Berlin, 2013 MORE IN DEPTH SPECIFIC INFORMATIONI was wondering just how expensive it is to make all thosevaccines, you know? I was just wondering if it is a good idea toeven make a lot of it or how hard it is to make. LOCAL EFFECT OF GLOBAL NEWS – What is the impactin my life?Yes then I would look it up, what is the effect in theNetherlands… (of the bird flu virus) OVERVIEW OF PAST RELATED EVENTSMy search would be something like "South Korea state of warramp up” (…)I would like to know, what happened two years ago and howthey solved it…
    • 12. 12www.linkedtv.euUser information needs for newsLinkedTV Berlin, 2013 Information about how the story ends Updates when important changes occur More information about the people involved Where is that location? Consult related publications and documentaries Opinions from different experts Access related info selected by experts and suggested by broadcasters
    • 13. Many users watch TV news during dinner! Use second screen to give user more control retain sense of immersion via TV screen Need to resolve issues of pausing when ingroup situation There is no single best solutionContent displaylinkedtv.euPresentationengine
    • 14. 14www.linkedtv.euHow will it work?linkedtv.euPaintings by Jan Sluijters“...schilderij van Jan Sluijters....”Video object andword detectionPresentationengineSelection ofrelated conceptsSelection ofrelated contentConnection
    • 15. 15www.linkedtv.euHow can LinkedTV help you?
    • 16. 16www.linkedtv.euLinkedTV platform & playerTV SetLinkedTVServer• Video Analysis• Enrichment• Personalization• DeliveryBrowserCE-HTMLPlatform ClientExternalBroadcastHTTPBrowserVariantHbbTVVariantHTTPRepository• Annotations• Links toexternalResourcesEditorLoDCloudVideosfromScenariosBrowserHTML 5PC / TabletNetworkMaterialselection,AnnotationadjustmentA clearly defined and modularizedplatform architecture, deploymentdecisions made, initial REST APIAn interactive video player based onWeb specifications (HTML5) realisingintuitive interaction & enrichment
    • 17.
    • 18. Individual video analysis, annotation, hyperlinking, UI/UX design andpersonalisation components integrated into a LinkedTV platform withend-to-end content workflow Provide player for desktop, TV and second screen Create interactive scenarios (rbbAktuell and Tussen Kunst en Kitsch) toengage with users to further understand their interaction and informationneedsLinkedTV in
    • 19.