Implementation of Hyperlinks in videos with HTML5LinkedTV
This presentation was presented by Rolf Fricke, Condat AG, during Xinnovations 2012 in Humboldt University in Berlin on September 11th, 2012.
The main objective of the LinkedTV project is the integration of hyperlinks in videos to open up new possibilities for the interactive, seamless usage of video on the Web. One challenge is the placement of tags and hyperlinks above the video layer, which should be closely associated to the underlying media fragments for persons or objects shown in the video. As the media fragments dynamically appear, move and disappear a precise synchronization of the overlays and related media fragments is needed. We plan to implement these features together with further user interface features on the basis of the HTML5 elements video, CSS3 and web workers. As we target WebTV as well as Broadcast TV, we plan to provide a restricted HbbTV 1.1 implementation for TV-sets, but we finally expect to profit from a HTML5 integration in upcoming HbbTV releases.
How Open Data Can Enhance Interactive TelevisionLinkedTV
The presentation was delivered by Lyndon Nixon, STI International Consulting and Research GmbH, Austria, during the ngnlab.eu Workshop http://ngnlab.eu/index.php/ngnlabeu-workshop, held in Bratislava during September 20th, 2012. The workshop was co-located with the 5th joint IFIP Wireless and Mobile Networking Conference (WMNC 2012 http://wmnc.fiit.stuba.sk.
Purpose of the workshop is bringing together researchers and experts from academia as well as from business which came from Germany, Nederlands, Spain, Austria and Slovakia.
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
LinkedTV - an added value enrichment solution for AV content providersLinkedTV
Linked Television is offering a solution for audiovisual content owners to semi-automatically enrich media with links to additional information and content related to objects and topics in the program and build client applications which access this data and provide new added value services to consumers.
Implementation of Hyperlinks in videos with HTML5LinkedTV
This presentation was presented by Rolf Fricke, Condat AG, during Xinnovations 2012 in Humboldt University in Berlin on September 11th, 2012.
The main objective of the LinkedTV project is the integration of hyperlinks in videos to open up new possibilities for the interactive, seamless usage of video on the Web. One challenge is the placement of tags and hyperlinks above the video layer, which should be closely associated to the underlying media fragments for persons or objects shown in the video. As the media fragments dynamically appear, move and disappear a precise synchronization of the overlays and related media fragments is needed. We plan to implement these features together with further user interface features on the basis of the HTML5 elements video, CSS3 and web workers. As we target WebTV as well as Broadcast TV, we plan to provide a restricted HbbTV 1.1 implementation for TV-sets, but we finally expect to profit from a HTML5 integration in upcoming HbbTV releases.
How Open Data Can Enhance Interactive TelevisionLinkedTV
The presentation was delivered by Lyndon Nixon, STI International Consulting and Research GmbH, Austria, during the ngnlab.eu Workshop http://ngnlab.eu/index.php/ngnlabeu-workshop, held in Bratislava during September 20th, 2012. The workshop was co-located with the 5th joint IFIP Wireless and Mobile Networking Conference (WMNC 2012 http://wmnc.fiit.stuba.sk.
Purpose of the workshop is bringing together researchers and experts from academia as well as from business which came from Germany, Nederlands, Spain, Austria and Slovakia.
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
LinkedTV - an added value enrichment solution for AV content providersLinkedTV
Linked Television is offering a solution for audiovisual content owners to semi-automatically enrich media with links to additional information and content related to objects and topics in the program and build client applications which access this data and provide new added value services to consumers.
Clustering chemical structures alleviates the tedious task of browsing a large set of compounds by grouping individual structures into generic categories. ChemAxon's JKlustor product offers clustering solutions ranging from similarity based non-hierarchical method to a pure graph based technique. This latter exhibits some clear advantages over the more conventional approaches: clusters are more likely to meet human expectations and tangible explanation why certain compounds are grouped together is also produced. And even it is faster. If you 'farm your classes' then it's time to 'MCS your library'!
Latest developments are here: http://www.chemaxon.com/product/jklustor.html
Bibliotheken und Enterprise 2.0: Nutzen und Kosten interner Blogs – Erfahrungen der Universitätsbibliothek Erlangen-Nürnberg. Vortrag auf dem 101. Deutschen Bibliothekartag Hamburg, 23.05.2012
Where Paris english Issue n° 259 edition août 2015 /2015 AugustWhere Paris Editions
Magazine mensuel Where Paris n°259, english edition, daté août 2015 / August 2015, leader sur les touristes premium visitant Paris, The most read monthly magazine by affluent tourists in Paris, Jean-louis Roux-Fouillet.
LinkedTV Deliverable 9.3 Final LinkedTV Project ReportLinkedTV
This document comprises the final report of LinkedTV. It includes a publishable summary of the project's scientific results and technological outcomes, a plan for use and dissemination of foreground IP and a list of dissemination activities (publications and events)
LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...LinkedTV
This document presents guidelines on how to setup enriched video experiences.
We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study.
We selected 5 news videos and manually extracted the
candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of
information from Wikipedia about these entities. Analysis of
the results shows that users prefer entities of the type
organization and person and have little interest for entities of the type location. They also indicate that subtitles are not
enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources.
We provide engineering guidelines on how to present,
aggregate and process content for TV program companion
applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.
HbbTV 2.0 for LinkedTV: specification and gapsLinkedTV
This position paper describes the implementation of Linked Television using HbbTV 1.5, and notes the missing functionalities needed that may be supplied by the new HbbTV 2.0 specification.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
This deliverable presents the LinkedTV Public Demonstrator which will be an online, publicly accessible Website collecting showcases of the key project outputs which form together our LinkedTV solution: the Editor Tool, Platform and Player, complemented by demonstrations of the provision of this solution for the content of two European broadcasters: the LinkedCulture and LinkedNews scenario demonstrators.
Lynx newsletter #3: Webinars special issueLynx Project
Welcome to the Webinar Special Issue of the Lynx Newsletter! During the months of December 2020 to February 2021, we conducted the Lynx Webinar Series, presenting the project and its most outstanding achievements to SMEs, LegalTech companies and the public.
The first webinar provided an overview of and insights in the Lynx project, the Legal Knowledge Graph and its application to Lynx, and the Lynx architecture, services and pilots. The second webinar provided insights into the compliance services related to the three pilots of Lynx and their objectives, requirements and technical solutions in the domains of labour law, contract analysis and management, and geothermal energy compliance recommender. The third webinar focused on a technical audience, providing insights into the overall architecture of the Lynx Services Platform and details and demos of the basic services: document manager, workflow manager, API manager, and authorization & identity management. On top of that, the fourth webinar demonstrated these services: Named Entity Extraction, Relation Extraction, Question-Answering, Machine Translation and Lexicala cross-lingual lexical data.
The Lynx YouTube channel contains all the recordings of the Lynx Webinar Series as well as demos for the Time Extraction and Entity Linking Services. Moreover, the Slideshare channel stores the slide decks used in the four webinars.
The research, final thesis for the MSc in Media Management at Bocconi, aims to define peculiar business models for web TV, still an almost unexplored ground inside the economic theory, despite technological progress and a steady growing audience made it recently so attractive in terms of investments for both entrepreneurs and advertisers.
Clustering chemical structures alleviates the tedious task of browsing a large set of compounds by grouping individual structures into generic categories. ChemAxon's JKlustor product offers clustering solutions ranging from similarity based non-hierarchical method to a pure graph based technique. This latter exhibits some clear advantages over the more conventional approaches: clusters are more likely to meet human expectations and tangible explanation why certain compounds are grouped together is also produced. And even it is faster. If you 'farm your classes' then it's time to 'MCS your library'!
Latest developments are here: http://www.chemaxon.com/product/jklustor.html
Bibliotheken und Enterprise 2.0: Nutzen und Kosten interner Blogs – Erfahrungen der Universitätsbibliothek Erlangen-Nürnberg. Vortrag auf dem 101. Deutschen Bibliothekartag Hamburg, 23.05.2012
Where Paris english Issue n° 259 edition août 2015 /2015 AugustWhere Paris Editions
Magazine mensuel Where Paris n°259, english edition, daté août 2015 / August 2015, leader sur les touristes premium visitant Paris, The most read monthly magazine by affluent tourists in Paris, Jean-louis Roux-Fouillet.
LinkedTV Deliverable 9.3 Final LinkedTV Project ReportLinkedTV
This document comprises the final report of LinkedTV. It includes a publishable summary of the project's scientific results and technological outcomes, a plan for use and dissemination of foreground IP and a list of dissemination activities (publications and events)
LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...LinkedTV
This document presents guidelines on how to setup enriched video experiences.
We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study.
We selected 5 news videos and manually extracted the
candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of
information from Wikipedia about these entities. Analysis of
the results shows that users prefer entities of the type
organization and person and have little interest for entities of the type location. They also indicate that subtitles are not
enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources.
We provide engineering guidelines on how to present,
aggregate and process content for TV program companion
applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.
HbbTV 2.0 for LinkedTV: specification and gapsLinkedTV
This position paper describes the implementation of Linked Television using HbbTV 1.5, and notes the missing functionalities needed that may be supplied by the new HbbTV 2.0 specification.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
This deliverable presents the LinkedTV Public Demonstrator which will be an online, publicly accessible Website collecting showcases of the key project outputs which form together our LinkedTV solution: the Editor Tool, Platform and Player, complemented by demonstrations of the provision of this solution for the content of two European broadcasters: the LinkedCulture and LinkedNews scenario demonstrators.
Lynx newsletter #3: Webinars special issueLynx Project
Welcome to the Webinar Special Issue of the Lynx Newsletter! During the months of December 2020 to February 2021, we conducted the Lynx Webinar Series, presenting the project and its most outstanding achievements to SMEs, LegalTech companies and the public.
The first webinar provided an overview of and insights in the Lynx project, the Legal Knowledge Graph and its application to Lynx, and the Lynx architecture, services and pilots. The second webinar provided insights into the compliance services related to the three pilots of Lynx and their objectives, requirements and technical solutions in the domains of labour law, contract analysis and management, and geothermal energy compliance recommender. The third webinar focused on a technical audience, providing insights into the overall architecture of the Lynx Services Platform and details and demos of the basic services: document manager, workflow manager, API manager, and authorization & identity management. On top of that, the fourth webinar demonstrated these services: Named Entity Extraction, Relation Extraction, Question-Answering, Machine Translation and Lexicala cross-lingual lexical data.
The Lynx YouTube channel contains all the recordings of the Lynx Webinar Series as well as demos for the Time Extraction and Entity Linking Services. Moreover, the Slideshare channel stores the slide decks used in the four webinars.
The research, final thesis for the MSc in Media Management at Bocconi, aims to define peculiar business models for web TV, still an almost unexplored ground inside the economic theory, despite technological progress and a steady growing audience made it recently so attractive in terms of investments for both entrepreneurs and advertisers.
Using IATI datasets for communication: Where can we improve?Marten Schoonman
IATI can have value in many different ways. One of them is to share and pro-actively show the work you are doing publicly.
- How can you do this best?
- How can you make use of the standard’s fields and which information would you like to add and how?
- How can this relate to your existing communication channels (e.g. website) and fundraising?
Marten shares how Akvo’s ‘Really Simple Reporting’ platform is set up and will facilitate an exploration with you how you can make IATI work for your organisation’s communication.
The ATC Innovation Lab carries more than 25 years of expertise in Research and Development.
Our key R&D projects have focused in the areas of the Semantic Web, Social Media, Language Technologies, Cloud Computing and eGovernance, where we have contributed with our technical expertise to cutting edge research in large multi-national consortia.
LinkedTV Deliverable 6.5 - Final evaluation of the LinkedTV ScenariosLinkedTV
The deliverable presents the results of evaluating the final
scenario demonstrators LinkedNews and LinkedCulture in the LinkedTV project. We tested specifically user satisfaction with the enriched TV experience we enabled for cultural heritage and news TV programs. We also supported the evaluation of other aspects of the LinkedTV technologies in the trials, specifically the personalization and content curation.
LinkedTV Deliverable 5.7 - Validation of the LinkedTV ArchitectureLinkedTV
The LinkedTV architecture lays the foundation for the
LinkedTV system. It consists of the integrating platform for the end-to-end functionality, the backend components and the supporting client components. Since the architecture of a software system has a fundamental impact on quality
attributes, it is important to evaluate its design. The document at hand reports on the validation of the LinkedTV architecture.
LinkedTV Deliverable 4.7 - Contextualisation and personalisation evaluation a...LinkedTV
This deliverable covers all the aspects of evaluation of the overall LinkedTV personalization workflow, as well as re-evaluations of techniques where newer technology and / or algorithmic capacity offer new insight into the general performance. The implicit contextualized personalization workflow, the implicit uncontextualized workflow in the premises of the final LinkedTV application, the advances
in context tracking given new technologies emerged and the outlook of video recommendation beyond LinkedTV is measured and analyzed in this document.
LinkedTV Deliverable 2.7 - Final Linked Media Layer and EvaluationLinkedTV
This deliverable presents the evaluation of content annotation and content enrichment systems that are part of the final tool set developed within the LinkedTV consortium. The evaluations were performed on both the Linked News and Linked Culture trial content, as well as on other content annotated for this purpose. The evaluation spans three languages: German (Linked News), Dutch (Linked
Culture) and English. Selected algorithms and tools were also subject to benchmarking in two international contests: MediaEval 2014 and TAC’14. Additionally, the Microposts 2015 NEEL Challenge is being organized with the support of LinkedTV.
LinkedTV Deliverable 1.6 - Intelligent hypervideo analysis evaluation, final ...LinkedTV
This deliverable describes the conducted evaluation activities for assessing the performance of a number of developed methods for intelligent hypervideo analysis and the usability of the implemented Editor Tool for supporting video annotation and enrichment. Based on the performance evaluations reported in D1.4 regarding a set of LinkedTV analysis components, we extended our experiments for assessing the effectiveness of newer versions of these methods as well as of entirely new techniques, concerning the accuracy and the time efficiency
of the analysis. For this purpose, in-house experiments and participations at international benchmarking activities were made, and the outcomes are reported in this deliverable. Moreover, we present the results of user trials regarding the developed Editor Tool, where groups of experts assessed its usability and the supported functionalities, and
evaluated the usefulness and the accuracy of the implemented video segmentation approaches based on the analysis requirements of the LinkedTV scenarios. By this deliverable we complete the reporting of WP1 evaluations that aimed to assess the efficiency of the developed
multimedia analysis methods throughout the project, according to the analysis requirements of the LinkedTV scenarios.
LinkedTV Deliverable 5.5 - LinkedTV front-end: video player and MediaCanvas A...LinkedTV
The LinkedTV media player and API has evolved from a single player and limited API in version 1 to a toolkit to allow rapid development and creation of different kind of applications within the HTML5 / multiscreen space. The main reason for this transition is that during the course of the Linked TV project different partners had different requirements for their scenarios. Instead of trying to fit all these requirements into one player and, most likely, compromise on the functionalities of the scenarios we wanted to offer something that would allow all partners a satisfiable solution.
Therefore the Springfield Multiscreen Toolkit, or short SMT, has been developed. The aim for the SMT was to allow flexibility for developing multiscreen applications. Also from a commercial point of view a toolkit with examples is more interesting than a pure player as it gives the freedom of developing new ideas with the LinkedTV platform.
LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)LinkedTV
A brief introduction to tools from the LinkedTV project which can be used together to build new media applications based on conceptual linking of media fragments.
LinkedTV Deliverable D4.6 Contextualisation solution and implementationLinkedTV
This deliverable presents the WP4 contextualisation final im-plementation. As contextualization has a high impact on all the other modules of WP4 (especially personalization and recom-mendation), the deliverable intends to provide a picture of the final WP4 workflow implementation.
LinkedTV Deliverable D3.7 User Interfaces selected and refined (version 2)LinkedTV
This report describes the LinkedTV user interfaces. Based on the results user studies and the initial evaluation of the year 2 prototype we selected and refined the interfaces. We selected a single screen application that uses HbbTV technology to provide additional information about a TV program as an overlay on the TV broadcast. In addition, we worked towards TV program companion applications that are tailored for two domains: news and cultural heritage. With these applications we demonstrate different types of interaction modes, such as synchronized content on a second screen, and bookmarking chapters combined with the exploration of related content after the program. The interfaces are built on top of the Multiscreen Toolkit. We created a component-based infrastructure that allows us to quickly create tailored companion applications by reusing and configuring interface components. In the final part of the project we finalize this approach and test it by applying it to a new domain.
LinkedTV Deliverable D2.6 LinkedTV Framework for Generating Video Enrichments...LinkedTV
This deliverable describes the final LinkedTV framework that provides a set of possible enrichment resources for seed video content using techniques such as text and web mining, information extraction and information retrieval technologies. The enrichment content is obtained from four type of sources: a) by crawling and indexing web sites described in a white list specified by the content partners,
b) by querying the API or SPARQL endpoint of the Europeana digital library network which is publicly exposed, c) by querying multiple social networking APIs, d) by hyperlinking to other parts of TV programs within the same collection using a Solr index. This deliverable
also describes an additional content annotation functionality, namely labelling enrichment (as well as seed) content with thematic topics, as well as the process of exposing content annotations to this module and to the filtering services of LinkedTV’s personalization workflow. We illustrate the enrichment workflow for the two main scenarios of LinkedTV which have lead to the development of the LinkedCulture and LinkedNews applications, which respectively use the TVEnricher and TVNewsEnricher enrichment services. The original title of this deliverable from the DoW was Advanced concept labelling by complementary Web mining.
LinkedTV Deliverable D1.5 The Editor Tool, final release LinkedTV
This document reports on the design and implementation of the final version of the editor tool (ET) v2.0, where its purpose is to serve the program editing teams of broadcasters that have adopted LinkedTV’s interactive television solution into their workflow. Two of these teams are currently represented in the LinkedTV project, namely the RBB team and the AVROTROS team (formerly known as AVRO).
The main purpose of the ET is to provide a means to correct and curate automatically generated annotations and hyperlinks created by the audiovisual and textual analysis technologies developed in WP 1 and 2 of the LinkedTV project. Without the intervention of human editors to correct this data, there is a reasonable risk of exposing inappropriate, incorrect or irrelevant information to the viewers of a LinkedTV interactive broadcast.
LinkedTV Deliverable D1.4 Visual, text and audio information analysis for hyp...LinkedTV
Having extensively evaluated the performance of the technologies included in the first release of WP1 multimedia analysis tools, using content from the LinkedTV scenarios and by participating in international benchmarking activities, concrete decisions regarding the
appropriateness and the importance of each individual method or combination of methods were made, which, combined with an updated list of information needs for each scenario, led to a new set of analysis requirements that had to be addressed through the release of the final set of analysis techniques of WP1. To this end, coordinated efforts on three directions, including
(a) the improvement of a number of methods in terms of accuracy and time efficiency,
(b) the development of new technologies and (c) the definition of synergies between methods for obtaining new types of information via multimodal processing, resulted in the final bunch of multimedia analysis methods for video hyperlinking. Moreover, the different developed analysis modules have been integrated into a web-based infrastructure, allowing the fully automatic linking of the multitude of WP1 technologies and the overall LinkedTV platform.
LinkedTV D8.6 Market and Product Survey for LinkedTV Services and TechnologyLinkedTV
D8.6 presents the results of the market analysis for LinkedTV products and services and consists of
two parts: an overall analysis of current and future
developments in the TV and digital video market and a specific market analysis of potential LinkedTV customers and competitors. Based on the market analysis it was possible to provide a first rough estimation of the LinkedTV market potential and to position LinkedTV on the market.
LinkedTV Deliverable D6.3 User Trial ResultsLinkedTV
User trials were prepared and conducted in the first quarter of 2014 in order to assess the appropriateness of the innovative functionalities of the second screen demonstrator developed in Y2 of the LinkedTV project. A sample installation of LinkedTV was set up at three different locations: at Rundfunk Berlin Brandenburg (RBB), Sound & Vision (S&V), and at the University of St. Gallen (USG). The LinkedTV installation included a TV showing sample content (“main screen”) and an tablet (“second screen”) showing chapters of the program as well as semi-automaticaly acquired additional information about persons, topics and places depicted in the program on the main screen. In total 24 participants took part in the trial at all three locations (9 at RBB, 5 at S&V and 10 at USG). To assess the appropriateness of the LinkedTV features, the trial participants were provided with a “hands-on” opportunity to use the LinkedTV Application and were observed while using the installation. The participants also filled in a questionnaire at the end of the session.
LinkedTV Deliverable D5.6 Final LinkedTV End-to-End PlatformLinkedTV
This Deliverable describes the final LinkedTV End-to-End Platform, which integrates a whole workflow from video ingestion over video analysis, annotated media fragment generation, content enrichment to personalized playout by a dedicated media player.
This deliverable describes the final LinkedTV scenario demonstrators, which have been implemented with the most recent versions of the LinkedTV technology set. The demonstrators use real broadcaster TV programming (news from RBB and cultural heritage from AVRO) and show the benefits of LinkedTV through providing seamless access during the programme to related information and content from the Internet. They also validate the maturity of the LinkedTV technologies which were used to implement the scenario demonstrators.
Annotating TV programming and linking to related content on the WebLinkedTV
At the D-WERFT conference in Potsdam, November 2014, LinkedTV scientific coordinator Dr Lyndon Nixon spoke about the LinkedTV project experiences in overcoming the challenges of knowing what happens inside TV programming and using that knowledge to automatically link parts of a TV program to related content on the Web.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Newsletter 2013
1. LINKEDTV
NEWSLETTER
NOVEMBER 2013
P.1 The LinkedTV vision
P.2 Summary of progress
P.3 Analysing and annotating TV
See the LinkedTV
demos
P.4 The LinkedTV Platform
P.5 Presenting and personalising
Hyperlinked Documentary
The Hyperlinked Documentary shows the
Dutch TV programme
Tussen Kunst en Kitsch
(similar to Antiques
Roadshow) enriched
with further information
about the objects on
show and topics in
discussion, satisfying
viewers interest.
www.linkedtv.eu/demos
/hyperlinkeddocu
Linked News
The Linked News shows
how local German
broadcaster RBB‘s daily
news programme is
enhanced by links to
relevant information
about the subjects in
the news, even uncovering further details not
mentioned in the programme itself.
www.linkedtv.eu/demos
/linkednews
More demos
See these and 25 other
online LinkedTV demos
of technology &
services at:
www.linkedtv.eu/demos
Linked Television
P.6 The LinkedTV Player
P.7 Main outcomes in the next
What is Linked Television?
Television is changing. In fact, we
think by the end of this decade it will
be radically transformed. Linear,
broadcast channels will be stuff of the
past: influenced by the Web and the
fact TV will be watched on any type of
screen (not just the “TV set“), we will
browse and search our way to the
audiovisual content we want to see.
We won't just consume, we'll interact,
mainly by sharing our experience with
others, but also with dedicated programming we'll be interacting with the
content itself.
Any connected device will access for
us any television or Web content – the
distinction between the two as source
will disappear in any case. The core of
“television“ will survive – the daily
news programme, the live sports
events – but the experience we have
with TV will change. Today, TV and the
Web remain very different experiences. Their integration is weak –
typically no more fine grained than at
the level of the programme itself. Our
Web-enabled televisions could provide us so much more information
about what we see in the TV programme but they don't, because they
don't know what is in the TV programme.
Linked Television is the seamless
interweaving of TV and Web content into a single, integrated experience.
year and selected publications
P.8 A business perspective
on LinkedTV
It's watching the news and getting
background information on the stories
at your fingertips; it's seeing a painting in a TV programme and identifying
the artist and the museum where it
hangs. It's making this possible and
cost-effective for the content owners
and broadcasters by automating the
programme enrichment, and personalising the links to each viewer.
By building on Web and broadcast
specifications and standards, Linked
Television is intended to become a
platform for the whole industry, not a
proprietary fragment. As Web and TV
converge, linking between them will
be not just possible, it will be necessary, in order to provide new, interactive services around audiovisual
material. First demos (see left hand
column) provide early indicators of the
type of new experience we will realise
with Linked Television.
I believe we are only starting to
scrape the surface of the possibilities
here. Let's journey together and see
what the future of Linked Television
will look like!
Lyndon Nixon, MODUL University.
Scientific coordinator.
P.1
2. Summary of progress in LinkedTV
Summary of progress in LinkedTV
After the second year of LinkedTV the project is
already close to its goal to enable a new generation
of online applications which can interweave TV and
the Web.
From a technical point of view a stable basis has
been built by implementing a first integrated version of the LinkedTV platform. The platform triggers
the process of media analysing, annotation, hyperlinking and enrichment of video content, stores the
results and provides access for presentation and
personalisation.
The first step of the process towards the creation
of hypervideo content is the media analysis (page
3). Analysis tasks that are being addressed in
LinkedTV include the (semi)-automatic decomposition of the audiovisual content (e.g. temporal segmentation), the association of content segments
with object and/or scene labels, text and audio
information analysis, and event and instance-based
labelling of content segments. The results of the
media analysis are then transformed into RDF
descriptions following the LinkedTV Core Ontology.
Those annotations on media fragment level are the
basis for the next step, the hyperlinking and
enrichment process (page 3).
It computes for each concept annotated to a media
fragment a set of links to related Web content
(enrichment). Therefore a set of technologies for
retrieving the enrichment content from the Web
was developed and integrated via the LinkedTV
platform, covering social networks as well as
whitelist sites from the content partners (page 4).
Based on an own user model taking implicit and
explicit preferences of the user into account, the
annotations and enrichments are filtered to allow
for a personal user experience. Therefore a
considerable tool set and a dedicated workflow for
extracting, learning and modelling of user
information, usage and behaviour was developed
(page 5).
For the creation of innovative hypervideo applications LinkedTV offers a toolkit that enables
developers to implement HTML5 applications that
run across multiple devices. The toolkit simplifies
the development of multi-screen applications by
abstracting away the low-level details of content
distribution and synchronization among clients
(page 6).
An overview of the achievements is to be found in
this newsletter, but if you are interested in any
aspect, just contact the LinkedTV partners!
Joachim Köhler, Fraunhofer IAIS
Project co-ordinator.
LinkedTV tools and
service ecosystem:
P.2
3. Analysing and annotating video
Analysing video
Annotating video
Automatic multimodal analysis techniques are
combined in a first step after video ingestion to
identify the most salient fragments of the video
material (e.g. shots) and detect concepts in those
fragments, whether exploiting visual classifiers (e.g.
person, outdoors) or looking for named entities
(extraction from text via ASR, OCR or subtitling).
Our analysis also involves further audio processing
(e.g. for performing speaker clustering), face
detection and clustering, event detection and
object re-detection, for extracting additional
information about the video fragments and their
potential similarities.
Results of automated media analysis (see left),
named entity extraction from textual metadata, and
media descriptions (such as TVAnytime in the
broadcasting domain) are combined and transformed into structured, semantic annotations of the
TV programme (using RDF as data model and
conforming to the LinkedTV Core Ontology).
The LinkedTV approach has been evaluated in the
benchmarking activities of TRECVID and
MediaEval, achieving top ranking in the latter‘s
Search and Hyperlinking task in 2013.
Complementing improved accuracy of automated
techniques, an Editor Tool allows human curators
to check, correct and complete the video annotations via an intuitive, Web based GUI.
Contact:
Vasileios Mezaris, CERTH
bmezaris@iti.gr
This permits further machine processing of the
annotations. Particularly concepts annotated to
media fragments are identified using Linked Data
URIs, meaning Web based look-up of associated
information and the ability to expand terms along
their properties (e.g. link a painter to other painters
of the same era or style).
To enable LinkedTV's enrichment of TV with links to
other Web content, we crawl common social
networks and scenario partners' whitelists of websites, and extract online media and the concepts it
is annotated with. We use this to generate automated links between parts of TV programmes and
related Web content, with the Editor Tool (left) used
to check and correct those links before delivery.
Contact:
Raphael Troncy, EURECOM
raphael.troncy@eurecom.fr
P.3
4. LinkedTV Platform
The LinkedTV Platform
The second year was dedicated to setting up a first version of the end-to-end Platform, integrating the
results of all the technical workpackages (see our LinkedTV ecosystem on page 2 for an overview of the
tools and services connected to each other and the LinkedTV Platform).
EXMARaLDA
Tool
Editor Tool
Enriched Play Out
Contextualisation
Viewer Tracking
Personalisation
Analysis
Metadata Conversion
MF URI Generation
Profiling
Enrichment
LinkedTV Platform
Import
Metadata
Repository
Streaming Server
Workflow
Ingestion
Platform Interaction
Thus the LinkedTV Platform at its core is an Application Service Bus which can trigger events across the
individual components and monitor the workflow from video ingestion through to enriched playout. The
workflow encapsulates the four functional steps described here, first analysing new video content (TV
programmes), then annotating it with concepts and links to related Web content, before providing the
annotation data to the LinkedTV Player for enriched playout and integrating the server-side user
personalisation aspects (anonymously; individual-specific personalisation is handled in the Player).
To allow for a flexible, distributed architecture, communication between the platform components and the
platform core is based on the use of RESTful APIs where each functional step itself is encapsulated into a
single, integrated REST API. This means individual implementations of LinkedTV functionalities (e.g. using
different choices of internal services) can be prepared and linked to the Platform as long as they expose
their functionality using the same service interface.
Contact:
Jan Thomsen, CONDAT
jan.thomsen@condat.de
P.4
5. Presentation and personalisation
Presenting Linked Television
Personalising Linked Television
User trials have studied the requirements of
LinkedTV viewers a user interface for seamlessly
interweaved TV and Web. The focus is on not
disrupting the main TV programme and not confusing the viewer between different contents on
different screens.
LinkedTV also has a goal to incorporate the interests of the viewer in order to personalise the
viewing experience.
A companion screen approach is taken, with the
associated content from LinkedTV on a second
screen being synchronized with the TV programme
on the main screen.
The current Player UI (centre left picture) focuses
on ordering the concepts of the TV programme
along common categorizations understood by
viewers: Who, Where, What. Concepts are highlighted as the programme plays within a distinct
fragment which is annotated with that concept.
Viewers can access associated content to that
concept during viewing or mark the concept for
returning to later (e.g. when the programme ends).
Already, mockups are being created for future
improvements on this UI (centre right picture). For
example, for News, viewers expressed very specific information needs – e.g. “for an event, I'd like
to see previous events on a timeline which relate to
it“. UI mock-ups let us visualise how such more
complex enrichments could be presented to a
viewer and ascertain their technical
implementability.
Contact:
Michiel Hildebrand, CWI
michiel.hildebrand@cwi.nl
We can generate a user profile based both on
implicit and explicit cues. If a viewer opts in, we
can use both their player behaviour and their attention to the screen to implicitly build an interest
profile about them. A Web based GUI permits
anytime access to the LinkedTV profile, where a
viewer can correct or complete their interests for
better personalisation.
A specific ontology (LUMO) has been developed in
LinkedTV to richly model the interests of TV viewers and how those interests relate (e.g. interest in
Politics means a related interest in Politicians),
beyond what is currently possible in Web knowledge models like DBPedia.
Personalisation filter components are able to rank
the LinkedTV annotations and enrichments of a TV
programme according to the user‘s interest model.
They do this via semantic concept matching after
mapping the video annotations (and annotations of
the video enrichments) to LUMO terms. This allows
us to ensure the player highlights to viewers concepts and enrichments most of interest to them,
dismissing or giving less visibility to those topics
the viewer shows less interest or disinterest in.
Contact:
Daniel Stein, Fraunhofer IAIS
daniel.stein@iais.fraunhofer.de
P.5
6. Player
The LinkedTV Player
To support viewer access to LinkedTV enrichments, we have developed the Springfield Multiscreen Toolkit (SMT).
Previous model: The app was distributed
server side
New model: The app only resides in the server
server side
NIC
NIC
html5 app
html5
app
html5
app
html5
app
s1
s2
s3
s1
s2
s3
client side
client1
client2
client3
client side
It supports application developers by abstracting away the low-level details of the synchronization and
distribution of content between screens. Developers create a single application that is independent of
how many screens are involved and such an application can dynamically react to changes in the amount
and types of screens attached to it. Applications are developed using standard technologies, such as
HTML5 and Java.
Our first prototype allows companion screens to control video playback on the main screen and synchronise the associated LinkedTV enrichments to the main screen video. Besides touchscreens, we allow
main screens to be controlled by gesture and remote control. This will be expanded in the next year to
function on HbbTV SmartTVs as well as to support richer presentation of enrichments to meet viewers'
more complex information needs.
Contact:
Daniel Ockeloen, Noterik
daniel@noterik.nl
P.6
7. Technical outcomes of LinkedTV
Main outcomes expected in LinkedTV's third
year
In the media analysis work, we continue to extend
and improve our audio-visual analysis techniques.
Not only will combined analyses produce more
accurate results but our work will be specifically
trained for scenario content in German and Dutch.
The LinkedTV Editor Tool will be completed,
allowing human control and overview of enrichments for broadcasters’ editing departments.
In the media annotation and linking work, both
steps continue to be refined and made more accurate. In entity extraction, we expect further improvement in disambiguation of terms and linkage
into domain specific knowledge models (e.g. for
cultural heritage). Enrichment will focus on greater
relevance of the determined links, learning which
Web sources are providing better links and what
are the common characteristics of “more relevant”
links.
In LinkedTV personalisation work, the personalisation tools will be integrated into the Platform and
Player and thus made available to users via the
scenarios. User profiles will be generated by
analysing user behaviour and attention, and used in
filtering LinkedTV enrichments to help viewers
access first and foremost the content they are most
interested in.
Further development on the multiscreen toolkit
used by the LinkedTV Player will address new
iterations on the User Interface for the scenarios,
synchronization of content, cross-device communication as well as porting to other platforms such
as HbbTV 2.0. We will continue to show our scenarios around News and Cultural Heritage on the
latest releases of the player and look forward to the
concepts that will be presented for our Media Arts
scenario.
Don't miss any news from LinkedTV, follow our
RSS feed at linkedtv.eu or Twitter feed @linkedtv
Selected publications in Year 2 of LinkedTV
Sven Buschbeck, Anthony Jameson, Raphaël
Troncy, Houda Khrouf, Osma Suominen and Adrian
Spirescu. A Demonstrator for Parallel Faceted
Browsing. In Proc. Intelligent Exploration of
Semantic Data Workshop (IESD'12), October 8-12,
2012, Galway, Ireland. Winner of the IESD
challenge
Daniel Stein, Evlampios Apostolidis, Vasileios
Mezaris, Nico de Abreu Pereira, Jennifer Müller,
Mathilde Sahuguet, Benoit Huet, Ivo Lasek.
Enrichment of News Show Videos with Multimodal Semi-Automatic Analysis, NEM-Summit,
16-18 October 2012, Istanbul, Turkey.
Houda Khrouf, Vuk Milicic and Raphaël Troncy.
EventMedia Live: Exploring Events Connections
in Real-Time to Enhance Content. In 11th
International Semantic Web Conference (ISWC'12),
Boston, USA, November 11-15, 2012. First Prize
Winner of the Semantic Web Challenge.
Raphaël Troncy, Vuk Milicic, Giuseppe Rizzo and
Josè Luis Redondo Garcia. MediaFinder: Collect,
Enrich and Visualize Media Memes Shared by
the Crowd. In (WWW'13) 2nd International Workshop on Real-Time Analysis and Mining of Social
Streams (RAMSS'13), Rio de Janeiro, Brazil, May
14, 2013.
Michiel Hildebrand, Lynda Hardman. Using Explicit Discourse Rules to Guide Video Enrichment.
In (WWW'13) 1st Worldwide Web Workshop on
Linked Media (LiME'13), Rio de Janeiro, Brazil, May
13, 2013.
Lotte Belice Baltussen, Roeland Ordelman, Jaap
Blom. VideoHypE: An Editor Tool for Supervised
Automatic Video Hyperlinking. In 5th International
Conference on Intelligent Technologies for Interactive Entertainment, July 2013, Mons, Belgium.
Katarina Stanoevska-Slabeva, Veselina Milanova.
Emerging Second Screen Value Networks:
Insights for TV Broadcasters. In 11th European
Interactive TV Conference (EuroITV 2013), June
2013, Como, Italy
Ivo Lašek, Peter Vojtáš. Various Approaches to
Text Representation for Named Entity Disambiguation. In International Journal of Web Information Systems, Emerald, 2013.
All LinkedTV publications are listed at
http://linkedtv.eu/demos-materials/publications
P.7