Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.
LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens EUscreen
'LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens' by Lyndon Nixon (MODUL University, Vienna) and Lotte Belice Baltussen (Sound and Vision, Hilversum) - a presentation held at EUscreenXL Rome Conference 'From Audience to User: Engaging with Audiovisual Heritage Online' (http://blog.euscreen.eu/conference-programme).
Remixing Media on the Semantic Web (ISWC2014 Tutorial) Pt 2 Linked Media: An...LinkedTV
The second session looks at how using Linked Data principles for media fragment annotation publication and retrieval (Linked Media) can enable online media fragment re-use:
Introducing the Linked Media principles
Publishing Linked Media using dedicated multimedia RDF repositories
Retrieval of media resources that illustrate linked data concepts
Using the Linked Data graph to find relevant links between distinct media assets (examples with SPARQL)
Retrieval of links between annotated media to enable topical browsing (using the TVEnricher service)
Examples of Linked Media at scale: VideoLyzard and HyperTED
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
TV newscasts report about the latest event-related facts oc- curring in the world. Relying exclusively on them is, however, insufficient to fully grasp the context of the story being reported. In this paper, we propose an approach that retrieves and analyzes related documents from the Web to automatically generate semantic annotations that provide viewers and experts comprehensive information about the news. Using different Semantic Web and information retrieval techniques, we generate what we call Semantic Snapshot of a Newscast (NSS)
LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens EUscreen
'LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens' by Lyndon Nixon (MODUL University, Vienna) and Lotte Belice Baltussen (Sound and Vision, Hilversum) - a presentation held at EUscreenXL Rome Conference 'From Audience to User: Engaging with Audiovisual Heritage Online' (http://blog.euscreen.eu/conference-programme).
Remixing Media on the Semantic Web (ISWC2014 Tutorial) Pt 2 Linked Media: An...LinkedTV
The second session looks at how using Linked Data principles for media fragment annotation publication and retrieval (Linked Media) can enable online media fragment re-use:
Introducing the Linked Media principles
Publishing Linked Media using dedicated multimedia RDF repositories
Retrieval of media resources that illustrate linked data concepts
Using the Linked Data graph to find relevant links between distinct media assets (examples with SPARQL)
Retrieval of links between annotated media to enable topical browsing (using the TVEnricher service)
Examples of Linked Media at scale: VideoLyzard and HyperTED
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
TV newscasts report about the latest event-related facts oc- curring in the world. Relying exclusively on them is, however, insufficient to fully grasp the context of the story being reported. In this paper, we propose an approach that retrieves and analyzes related documents from the Web to automatically generate semantic annotations that provide viewers and experts comprehensive information about the news. Using different Semantic Web and information retrieval techniques, we generate what we call Semantic Snapshot of a Newscast (NSS)
LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)LinkedTV
A brief introduction to tools from the LinkedTV project which can be used together to build new media applications based on conceptual linking of media fragments.
MICO — Towards Contextual Media AnalysisThomas Kurz
With the tremendous increase in multimedia content on the Web and in corporate intranets, discovering hidden meaning in raw multimedia is becoming one of the biggest challenges. Analysing multimedia content is still in its infancy, requires expert knowledge, and the few available products are associated with excessive price tags, while still not delivering sufficient quality for many tasks. This makes it hard, especially for small and medium-size enterprises, to make use of this technology. Ina addition analysis components typically operate in isolation and do not consider the context (e.g. embedding text) of a media resource. This paper presents how MICO tries to address these problems by providing an Open Source service platform, that allows to analyse media in context and includes various analysis engines for video, images, audio, text, link structure and metadata.
Slides from Gwen Franck, Creative Commons Regional Co-ordinator for Europe at 'Maximising Digital Creativity, Sharing and Innovation', National Gallery of Ireland, January 2014.
Event organised by Creative Commons Ireland and Faculty of Law, University College Cork.
http://www.creativecommonsireland.org
Using semantics to improve interactive information accessLynda Hardman
Talk given at ICSC 2010, Fourth IEEE International Conference on Semantic Computing, http://www.ieee-icsc.org/
Slide design by André Fialho.
Slides also available from http://www.cwi.nl/~lynda/talks/2010/ICSC2010-LyndaHardman.pdf
Fish4Knowledge: large scale coral reef fish monitoring using undersea compute...Lynda Hardman
Talk given at the 9th Indo_Pacific Fish Conference, Okinawa, June 27th 2013
fish4knowledge.eu
pdf available from http://www.cwi.nl/~lynda/talks/2013/Fish4Knowledge130627.pdf
More Women in Informatics Research & Education, Oviedo July 2014Lynda Hardman
Why are there too few women in computer science?
What can we do about it?
Best practices based on Informatics Europe booklet
http://www.informatics-europe.org/images/documents/more-women-in-informatics-research-and-education_2013.pdf
최근 다양한 분야에서의 빅데이터 분석 시스템이 구축되어 활용되고 있으나, 대부분의 대상 데이터들이 텍스트 기반의 데이터를 한정하고 있다. 그러나, 현재 전 산업 분야에서 이미지(비디오) 데이터가 빅데이터의 핵심으로 부상하면서 이를 분석하기 위한 이미지 마이닝 기술에 대한 관심이 고조되고 있다. 이미지 마이닝 기술은 이미지 프로세싱 기술에 대한 연구가 시작된 시점 1960년대 이후인 1970년대부터 연구되기 시작하였다. 이와 관련된 많은 연구들이 의학적인 분야와 국방 분야에서 많이 연구되어 오다, 최근에는 마케팅 분야를 포함한 다양한 분야에서 연구되어 오고 있으며, 일부 산업 분야에서는 상용기술이 개발되어 실제 산업에 적용되고 있다. 이러한 기술들이 최근 빅데이터 기술에 대한 관심이 증가하면서 이미지(비디오) 데이터 분석에 적용하기 위한 연구들이 집중되고 있다. 이에 이에 이미지 마이닝을 위한 기존의 기술들의 연구 동향과 이러한 기술들을 활용하고 있는 산업 분야의 응용에 대한 동향을 조사 분석하고 향후 발전 방향에 대해 살펴보기로 한다.
LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)LinkedTV
A brief introduction to tools from the LinkedTV project which can be used together to build new media applications based on conceptual linking of media fragments.
MICO — Towards Contextual Media AnalysisThomas Kurz
With the tremendous increase in multimedia content on the Web and in corporate intranets, discovering hidden meaning in raw multimedia is becoming one of the biggest challenges. Analysing multimedia content is still in its infancy, requires expert knowledge, and the few available products are associated with excessive price tags, while still not delivering sufficient quality for many tasks. This makes it hard, especially for small and medium-size enterprises, to make use of this technology. Ina addition analysis components typically operate in isolation and do not consider the context (e.g. embedding text) of a media resource. This paper presents how MICO tries to address these problems by providing an Open Source service platform, that allows to analyse media in context and includes various analysis engines for video, images, audio, text, link structure and metadata.
Slides from Gwen Franck, Creative Commons Regional Co-ordinator for Europe at 'Maximising Digital Creativity, Sharing and Innovation', National Gallery of Ireland, January 2014.
Event organised by Creative Commons Ireland and Faculty of Law, University College Cork.
http://www.creativecommonsireland.org
Using semantics to improve interactive information accessLynda Hardman
Talk given at ICSC 2010, Fourth IEEE International Conference on Semantic Computing, http://www.ieee-icsc.org/
Slide design by André Fialho.
Slides also available from http://www.cwi.nl/~lynda/talks/2010/ICSC2010-LyndaHardman.pdf
Fish4Knowledge: large scale coral reef fish monitoring using undersea compute...Lynda Hardman
Talk given at the 9th Indo_Pacific Fish Conference, Okinawa, June 27th 2013
fish4knowledge.eu
pdf available from http://www.cwi.nl/~lynda/talks/2013/Fish4Knowledge130627.pdf
More Women in Informatics Research & Education, Oviedo July 2014Lynda Hardman
Why are there too few women in computer science?
What can we do about it?
Best practices based on Informatics Europe booklet
http://www.informatics-europe.org/images/documents/more-women-in-informatics-research-and-education_2013.pdf
최근 다양한 분야에서의 빅데이터 분석 시스템이 구축되어 활용되고 있으나, 대부분의 대상 데이터들이 텍스트 기반의 데이터를 한정하고 있다. 그러나, 현재 전 산업 분야에서 이미지(비디오) 데이터가 빅데이터의 핵심으로 부상하면서 이를 분석하기 위한 이미지 마이닝 기술에 대한 관심이 고조되고 있다. 이미지 마이닝 기술은 이미지 프로세싱 기술에 대한 연구가 시작된 시점 1960년대 이후인 1970년대부터 연구되기 시작하였다. 이와 관련된 많은 연구들이 의학적인 분야와 국방 분야에서 많이 연구되어 오다, 최근에는 마케팅 분야를 포함한 다양한 분야에서 연구되어 오고 있으며, 일부 산업 분야에서는 상용기술이 개발되어 실제 산업에 적용되고 있다. 이러한 기술들이 최근 빅데이터 기술에 대한 관심이 증가하면서 이미지(비디오) 데이터 분석에 적용하기 위한 연구들이 집중되고 있다. 이에 이에 이미지 마이닝을 위한 기존의 기술들의 연구 동향과 이러한 기술들을 활용하고 있는 산업 분야의 응용에 대한 동향을 조사 분석하고 향후 발전 방향에 대해 살펴보기로 한다.
Linked Television: a HbbTV application for enhancing broadcast TV with relate...LinkedTV
We present a HbbTV smart application called Linked Television which pushes related information and content about concepts and topics in a TV program to viewers using a companion device (or "second screen").
Presentation for the FutureTV session at EuroITV 2013. See http://www.linkedtv.eu/event/futuretv2013/.
Paper presented by Lotte Belice Baltussen of the Netherlands Institute for Sound and Vision.
Lotte Belice Baltussen, Roeland Ordelman, Jaap Blom. VideoHypE: An Editor Tool for Supervised Automatic Video Hyperlinking. In 11th European Interactive TV Conference (EuroITV 2013), June 2013, Como, Italy.
LinkedTV Deliverable 9.3 Final LinkedTV Project ReportLinkedTV
This document comprises the final report of LinkedTV. It includes a publishable summary of the project's scientific results and technological outcomes, a plan for use and dissemination of foreground IP and a list of dissemination activities (publications and events)
Annotating TV programming and linking to related content on the WebLinkedTV
At the D-WERFT conference in Potsdam, November 2014, LinkedTV scientific coordinator Dr Lyndon Nixon spoke about the LinkedTV project experiences in overcoming the challenges of knowing what happens inside TV programming and using that knowledge to automatically link parts of a TV program to related content on the Web.
Personalization on the Web with Semantic Patterns (in LOD)Lora Aroyo
Presentation given at STLab at CNR, Rome
Starting a collaboration for identifying useful knowledge and navigation patterns in LOD to recommend media (TV programs and News) content
20 Sept 2010
http://stlab.istc.cnr.it/stlab/STLab:News/12
LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...LinkedTV
This document presents guidelines on how to setup enriched video experiences.
We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study.
We selected 5 news videos and manually extracted the
candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of
information from Wikipedia about these entities. Analysis of
the results shows that users prefer entities of the type
organization and person and have little interest for entities of the type location. They also indicate that subtitles are not
enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources.
We provide engineering guidelines on how to present,
aggregate and process content for TV program companion
applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Generating a custom Ruby SDK for your web service or Rails API using Smithy
LinkedTV: Television Linked to the Web, June 2013
1. Television Linked To The Web
www.linkedtv.eu
Building the future of television
Lynda Hardman
Centrum Wiskunde & Informatica
2. 2
www.linkedtv.eu
Web and TV exist in parallel
86% of TV viewers surf the Web at the same time
(Yahoo!, USA)
88% of USA consumers use mobile as second
screen (Business Insider, May 2013)
Manual efforts to link TV program to additional
content (Shazam, IntoNow)
LinkedTV: interweaving Web and TV into a
single experience
Mixing lean back and lean forward
Want to maintain immersion while removing fourth
wall illusion
Works only for certain genres and audiences
Does second screen help or hinder?
The LinkedTV vision
linkedtv.eu
3. 3
www.linkedtv.eu
Scenarios and content
Enriched News
Professional news content
produced by RBB for general
audience
local news show rbb Aktuell
People, locations and events
can be linked to previous
events.
Antiques Edutainment
Program watched
predominantly by 50+ers
AVRO:
Tussen Kunst en Kitsch
Presenters, locations and
objects provide hooks to
related materials.
linkedtv.eu
5. 5
www.linkedtv.eu
dbpedia.org/resource/Jan_Sluyters
How will it work?
linkedtv.eu
Paintings by Jan Sluijters
“...schilderij van Jan Sluijters....”
Video object and
word detection
Presentation
engine
Selection of
related concepts
Selection of
related content
Connection to
concepts
6. 6
www.linkedtv.eu
Object detection in video
Face detection
Text analysis, keyword extraction
Multilingual automatic speech recognition
Combining results from different modality
analyses
Speaker identification
Object re-detection
Output in XML using OpenSource tool:
EXMARaLDA
http://www.exmaralda.org/
Concept Detection
linkedtv.eu
“...schilderij van Jan Sluijters....”
Video object and
word detection
7. 7
www.linkedtv.eu
Annotations represented in RDF
stored in LinkedTV platform
Use existing vocabularies
e.g. schema.org, NERD, LSCOM, DBpedia
Named Entity Recognition using
statistical & knowledge-based approaches
Enrichment based on textual and visual
analyses
Concept connections
linkedtv.eu
Connection to
concepts
dbpedia.org/resource/Jan_Sluyters
9. 9
www.linkedtv.eu
Additional information, e.g.
biography of artist
style of painting
Related information, e.g.
artists from same period
paintings in similar style
related styles
Concept selection
linkedtv.eu
Paintings by Jan Sluijters
Selection of
related concepts
Jan Sluijters
has art style
luminism
Leo Gestel
Piet Mondriaan
has art style
has art style
10. 10
www.linkedtv.eu
Selection based on context of scene,
e.g. system knows which topics appear
next
User preferences, e.g.
closely related information to
uninteresting topic is less useful
We need to understand user
information needs (per genre), e.g.
don’t miss important news because of
personalisation
Broadcasters don’t want users to drift
away from program
Content selection
linkedtv.eu
Selection of
related content
11. 11
www.linkedtv.eu
Example user information needs for news
LinkedTV Berlin, 2013
MORE IN DEPTH SPECIFIC INFORMATION
I was wondering just how expensive it is to make all those
vaccines, you know? I was just wondering if it is a good idea to
even make a lot of it or how hard it is to make.
LOCAL EFFECT OF GLOBAL NEWS – What is the impact
in my life?
Yes then I would look it up, what is the effect in the
Netherlands… (of the bird flu virus)
OVERVIEW OF PAST RELATED EVENTS
My search would be something like "South Korea state of war
ramp up” (…)
I would like to know, what happened two years ago and how
they solved it…
12. 12
www.linkedtv.eu
User information needs for news
LinkedTV Berlin, 2013
Information about how the story ends
Updates when important changes occur
More information about the people involved
Where is that location?
Consult related publications and documentaries
Opinions from different experts
Access related info selected by experts and suggested by broadcasters
13. 13
www.linkedtv.eu
Many users watch TV news during dinner!
Use second screen to
give user more control
retain sense of immersion via TV screen
Need to resolve issues of pausing when in
group situation
There is no single best solution
Content display
linkedtv.eu
Presentation
engine
14. 14
www.linkedtv.eu
How will it work?
linkedtv.eu
Paintings by Jan Sluijters
“...schilderij van Jan Sluijters....”
Video object and
word detection
Presentation
engine
Selection of
related concepts
Selection of
related content
Connection to
concepts
dbpedia.org/resource/Jan_Sluyters
16. 16
www.linkedtv.eu
LinkedTV platform & player
TV Set
LinkedTV
Server
• Video Analysis
• Enrichment
• Personalization
• Delivery
Browser
CE-HTML
Platform ClientExternal
Broadcast
HTTP
Browser
Variant
HbbTV
Variant
HTTP
Repository
• Annotations
• Links to
external
Resources
Editor
LoD
Cloud
Videos
from
Scenarios
Browser
HTML 5
PC / Tablet
Network
Material
selection,
Annotation
adjustment
A clearly defined and modularized
platform architecture, deployment
decisions made, initial REST API
An interactive video player based on
Web specifications (HTML5) realising
intuitive interaction & enrichment layers
linkedtv.eu
18. 18
www.linkedtv.eu
Individual video analysis, annotation, hyperlinking, UI/UX design and
personalisation components integrated into a LinkedTV platform with
end-to-end content workflow
Provide player for desktop, TV and second screen
Create interactive scenarios (rbbAktuell and Tussen Kunst en Kitsch) to
engage with users to further understand their interaction and information
needs
LinkedTV in 2013
linkedtv.eu
Not just TV, but interaction with online media (archives).
(1) Big Q: Do you ever have a question about what you are watching? Would you like related information about something you have seen? Something someone mentioned? One option is to pause the TV, go find your smart phone or pad and start some google search. When you carry out the search, your device doesn't know what you were watching, nor what the specific scene was about. Wouldn't it be nice to have a system that knows what you are watching, knows what you like and that presents links to extra pieces of information to you? Technology only likely to be useful when audience , content and program genre match. (2) slide
(1) Currently developing tools using 2 program genres
(1) What do we think it will look like? Not like this! Select video. Link to video!
Developing individual technologies, using content from 2 program genres, with the aim of creating an end2end prototype. I’ll go through each of these stages. Don’t explain anything about each part.
(1) Lower the cost of preparing seed video for enrichment with other content Objects are detected in the video, e.g. painting, face Words are also detected in the speech, or closed captions (2) Slide: Web aspects: using and cnotributing to W3C recommendations, much of the s/w open source
Linking object or word to concept (painting, face, painter ) or Named Entity (Jan_Sluijters, Piet_Mondrian ) in Linked Open Data cloud. Each circle is a data set, representing thousands or millions of concepts. Familiar with wikipedia? DBpedia is machine-readable form? RDF is the language used on the web for expressing concepts (similar to XML for document structure)
A number of tools are available, e.g. allowing the conversion of different sources of metadata to be converted to RDF, Named Entity Recognition.
Once we have the concepts & named entities in the Linked Open Data cloud, we can find other content (web pages or audiovisual material) by tracing paths through this cloud.. Go through the bullets click through the links Could also link to concepts or entities in other sets, such as birthplace in GeoNames.
Large numbers of related concepts can be found very quickly. Selection based on connections within video topics and user preferences Need to find suitable video/information sources for users. If suitable material is scarce then can increase complexity of search (length of path in linked open data cloud). Broadcasters need to be sure of high quality sources, e.g., wikipedia, Artcyclopedia Want structure that ensures that user "stays with the program" but has access to related information.
Team@CWI is investigating user info needs specific to narrow goals of LinkedTV. Working together with Beeld Geluid on this.
Skip if time short
Once we have chosen related content, we need to display it to the end user. Explore interaction modalities to browse the enrichment content. We need to understand how involved user wishes to be. Playout of enriched video on multiple devices and cross-device, e.g. second screen Providing requirements for first implementation of the presentation layer based on User Interface mock-ups of scenarios Carrying out user focus groups for second round requirements
I hope that this overview of the project makes more sense now!
Project is making underlying technology available. Daniel Ockeloen, Noterik, presenting later this afternoon. HTML5 for cross-device Web application development
In addition to the technology development, also collecting annotations of resources in project database.