In this session we will introduce the W3C Media Fragment URI specification, highlighting how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. We will also discuss extensions to these ontologies to more richly link media fragments to the concepts they represent, re-using Linked Data as a Web-wide knowledge graph about concepts. We will briefly demonstrate various approaches to visual, audio and textual analysis in order to generate meaningful media fragments out of a media resource, as well as look at available annotation tools for semantically describing online media. Finally, we show how existing text around media (subtitles, transcripts) can be used for fragment annotation through Named Entity Recognition services (NERD) and a combined approach for generating a semantic description of media from analysis, metadata and entity recognition (TV2RDF).
Remixing Media on the Semantic Web (ISWC2014 Tutorial) Pt 2 Linked Media: An...LinkedTV
The second session looks at how using Linked Data principles for media fragment annotation publication and retrieval (Linked Media) can enable online media fragment re-use:
Introducing the Linked Media principles
Publishing Linked Media using dedicated multimedia RDF repositories
Retrieval of media resources that illustrate linked data concepts
Using the Linked Data graph to find relevant links between distinct media assets (examples with SPARQL)
Retrieval of links between annotated media to enable topical browsing (using the TVEnricher service)
Examples of Linked Media at scale: VideoLyzard and HyperTED
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Media Fragments Indexing using Social MediaLinkedTV
With more and more video shared on the Web, the practice of sharing a video object from a certain time point (deep-linking) has been implemented by many video sharing platforms. With so many media fragments created, annotated and shared, however, indexing video objects on a fine-grained level on the Web scale is still not implemented by major search engines. To solve this problem, this paper proposes Twitter Media Fragment Indexer, which monitors the Tweet text and uses the embedded URLs pointing to video fragments as the media to massively create index for media fragments. Some preliminary evaluation has shown that media fragments can be successfully indexed in large scale using this system.
This is a presentation from the LIME workshop at ESWC2014.
LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens EUscreen
'LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens' by Lyndon Nixon (MODUL University, Vienna) and Lotte Belice Baltussen (Sound and Vision, Hilversum) - a presentation held at EUscreenXL Rome Conference 'From Audience to User: Engaging with Audiovisual Heritage Online' (http://blog.euscreen.eu/conference-programme).
Remixing Media on the Semantic Web (ISWC2014 Tutorial) Pt 2 Linked Media: An...LinkedTV
The second session looks at how using Linked Data principles for media fragment annotation publication and retrieval (Linked Media) can enable online media fragment re-use:
Introducing the Linked Media principles
Publishing Linked Media using dedicated multimedia RDF repositories
Retrieval of media resources that illustrate linked data concepts
Using the Linked Data graph to find relevant links between distinct media assets (examples with SPARQL)
Retrieval of links between annotated media to enable topical browsing (using the TVEnricher service)
Examples of Linked Media at scale: VideoLyzard and HyperTED
Survey of Semantic Media Annotation Tools - towards New Media Applications wi...LinkedTV
Semantic annotation of media resources has been a focus in research since many years, the closing of the "semantic gap" being seen as key to signicant improvements in media retrieval and browsing and
enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and
act as a barrier to wider uptake of semantic annotation of online multimedia.
In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging
toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media
layer of semantic descriptions of online media which can be an enabler to richer future online media services.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Media Fragments Indexing using Social MediaLinkedTV
With more and more video shared on the Web, the practice of sharing a video object from a certain time point (deep-linking) has been implemented by many video sharing platforms. With so many media fragments created, annotated and shared, however, indexing video objects on a fine-grained level on the Web scale is still not implemented by major search engines. To solve this problem, this paper proposes Twitter Media Fragment Indexer, which monitors the Tweet text and uses the embedded URLs pointing to video fragments as the media to massively create index for media fragments. Some preliminary evaluation has shown that media fragments can be successfully indexed in large scale using this system.
This is a presentation from the LIME workshop at ESWC2014.
LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens EUscreen
'LinkedTV. Engaging TV viewers with AudioVisual heritage on second screens' by Lyndon Nixon (MODUL University, Vienna) and Lotte Belice Baltussen (Sound and Vision, Hilversum) - a presentation held at EUscreenXL Rome Conference 'From Audience to User: Engaging with Audiovisual Heritage Online' (http://blog.euscreen.eu/conference-programme).
How Open Data Can Enhance Interactive TelevisionLinkedTV
The presentation was delivered by Lyndon Nixon, STI International Consulting and Research GmbH, Austria, during the ngnlab.eu Workshop http://ngnlab.eu/index.php/ngnlabeu-workshop, held in Bratislava during September 20th, 2012. The workshop was co-located with the 5th joint IFIP Wireless and Mobile Networking Conference (WMNC 2012 http://wmnc.fiit.stuba.sk.
Purpose of the workshop is bringing together researchers and experts from academia as well as from business which came from Germany, Nederlands, Spain, Austria and Slovakia.
LinkedTV: Television Linked to the Web, June 2013Lynda Hardman
Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.
Implementation of Hyperlinks in videos with HTML5LinkedTV
This presentation was presented by Rolf Fricke, Condat AG, during Xinnovations 2012 in Humboldt University in Berlin on September 11th, 2012.
The main objective of the LinkedTV project is the integration of hyperlinks in videos to open up new possibilities for the interactive, seamless usage of video on the Web. One challenge is the placement of tags and hyperlinks above the video layer, which should be closely associated to the underlying media fragments for persons or objects shown in the video. As the media fragments dynamically appear, move and disappear a precise synchronization of the overlays and related media fragments is needed. We plan to implement these features together with further user interface features on the basis of the HTML5 elements video, CSS3 and web workers. As we target WebTV as well as Broadcast TV, we plan to provide a restricted HbbTV 1.1 implementation for TV-sets, but we finally expect to profit from a HTML5 integration in upcoming HbbTV releases.
LinkedTV - an added value enrichment solution for AV content providersLinkedTV
Linked Television is offering a solution for audiovisual content owners to semi-automatically enrich media with links to additional information and content related to objects and topics in the program and build client applications which access this data and provide new added value services to consumers.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
Annotating TV programming and linking to related content on the WebLinkedTV
At the D-WERFT conference in Potsdam, November 2014, LinkedTV scientific coordinator Dr Lyndon Nixon spoke about the LinkedTV project experiences in overcoming the challenges of knowing what happens inside TV programming and using that knowledge to automatically link parts of a TV program to related content on the Web.
Linked Television: a HbbTV application for enhancing broadcast TV with relate...LinkedTV
We present a HbbTV smart application called Linked Television which pushes related information and content about concepts and topics in a TV program to viewers using a companion device (or "second screen").
HbbTV 2.0 for LinkedTV: specification and gapsLinkedTV
This position paper describes the implementation of Linked Television using HbbTV 1.5, and notes the missing functionalities needed that may be supplied by the new HbbTV 2.0 specification.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Av Relaties: Zoeken En Contextualisering In Linkedtv En AxesLinkedTV
The talk was delivered by by Lotte Belice Baltussen, Sound and Vision at the iMMovator Cross Media Café "Uit het lab", 12 February 2013, the Media Park in Hilversum, The Netherlands.
More information please visit: http://bit.ly/10gYc7L
Kurzer Vortrag über ein Konzept zu einem verlinkten Fernsehdienst über HbbTV. Der Dienst wird im Rahmen des EU-geförderten Forschungs- und Entwicklungsprojekt LinkedTV (www.linkedtv.eu) u.a. beim Rundfunk Berlin-Brandenburg, rbb, in Zusammenarbeit mit internationalen Partnern entwickelt und getestet.
How Open Data Can Enhance Interactive TelevisionLinkedTV
The presentation was delivered by Lyndon Nixon, STI International Consulting and Research GmbH, Austria, during the ngnlab.eu Workshop http://ngnlab.eu/index.php/ngnlabeu-workshop, held in Bratislava during September 20th, 2012. The workshop was co-located with the 5th joint IFIP Wireless and Mobile Networking Conference (WMNC 2012 http://wmnc.fiit.stuba.sk.
Purpose of the workshop is bringing together researchers and experts from academia as well as from business which came from Germany, Nederlands, Spain, Austria and Slovakia.
LinkedTV: Television Linked to the Web, June 2013Lynda Hardman
Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.
Implementation of Hyperlinks in videos with HTML5LinkedTV
This presentation was presented by Rolf Fricke, Condat AG, during Xinnovations 2012 in Humboldt University in Berlin on September 11th, 2012.
The main objective of the LinkedTV project is the integration of hyperlinks in videos to open up new possibilities for the interactive, seamless usage of video on the Web. One challenge is the placement of tags and hyperlinks above the video layer, which should be closely associated to the underlying media fragments for persons or objects shown in the video. As the media fragments dynamically appear, move and disappear a precise synchronization of the overlays and related media fragments is needed. We plan to implement these features together with further user interface features on the basis of the HTML5 elements video, CSS3 and web workers. As we target WebTV as well as Broadcast TV, we plan to provide a restricted HbbTV 1.1 implementation for TV-sets, but we finally expect to profit from a HTML5 integration in upcoming HbbTV releases.
LinkedTV - an added value enrichment solution for AV content providersLinkedTV
Linked Television is offering a solution for audiovisual content owners to semi-automatically enrich media with links to additional information and content related to objects and topics in the program and build client applications which access this data and provide new added value services to consumers.
LinkedTV is an EU funded project aiming to seamlessly interlink the TV and Web experiences. This presentation summarizes the results and achievements by the end of the project's second year, covering media analysis, annotation, linking, personalisation and interactive playout, based on two scenarios: Hyperlinked Documentary and Linked News.
For more, visit www.linkedtv.eu
Annotating TV programming and linking to related content on the WebLinkedTV
At the D-WERFT conference in Potsdam, November 2014, LinkedTV scientific coordinator Dr Lyndon Nixon spoke about the LinkedTV project experiences in overcoming the challenges of knowing what happens inside TV programming and using that knowledge to automatically link parts of a TV program to related content on the Web.
Linked Television: a HbbTV application for enhancing broadcast TV with relate...LinkedTV
We present a HbbTV smart application called Linked Television which pushes related information and content about concepts and topics in a TV program to viewers using a companion device (or "second screen").
HbbTV 2.0 for LinkedTV: specification and gapsLinkedTV
This position paper describes the implementation of Linked Television using HbbTV 1.5, and notes the missing functionalities needed that may be supplied by the new HbbTV 2.0 specification.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Av Relaties: Zoeken En Contextualisering In Linkedtv En AxesLinkedTV
The talk was delivered by by Lotte Belice Baltussen, Sound and Vision at the iMMovator Cross Media Café "Uit het lab", 12 February 2013, the Media Park in Hilversum, The Netherlands.
More information please visit: http://bit.ly/10gYc7L
Kurzer Vortrag über ein Konzept zu einem verlinkten Fernsehdienst über HbbTV. Der Dienst wird im Rahmen des EU-geförderten Forschungs- und Entwicklungsprojekt LinkedTV (www.linkedtv.eu) u.a. beim Rundfunk Berlin-Brandenburg, rbb, in Zusammenarbeit mit internationalen Partnern entwickelt und getestet.
TV newscasts report about the latest event-related facts oc- curring in the world. Relying exclusively on them is, however, insufficient to fully grasp the context of the story being reported. In this paper, we propose an approach that retrieves and analyzes related documents from the Web to automatically generate semantic annotations that provide viewers and experts comprehensive information about the news. Using different Semantic Web and information retrieval techniques, we generate what we call Semantic Snapshot of a Newscast (NSS)
An introduction to HbbTV Hybrid Broadcast Broadband TV. What is it? How does it work? Red button and #HbbTV Service examples.
Presented at Thailand's Engineering Expo November 29, 2014 and at Thailand's Set-top box Committee's Public Hearing at Thailand's Engineering Institute (EIT) November 20, 2014.
View our MVNO SERVICE PRESENTATION for an easy read on some of the MVNO services we offer
★ MVNO/MNO NEGOTIATIONS
✓ Negotiation of MVNO wholesale agreement
✓ Negotiation of additional terms
✓ Contract review and advice
★ PRODUCT AND SALES PLANNING
✓ Product/Service Planning
✓ Market Segmentation and data
✓ Market forecasts and modelling
✓ Marketing Planning and costing
★ DEVELOPMENT OF BUSINESS PLAN
✓ Corporate Strategy
✓ Financial planning and modelling
✓ Investment analysis
✓ Operation planning
✓ Product and Marketing
★ LICENSE APPLICATION
✓ Advise and experience in relation to submitting for MVNO license
✓ Business planning and modelling with a focus on the application
✓ Preparation of License Application documentation as required by the telecom regulator
★ MVNO WORKSHOP
For more information please visit: www.yozzo.com
Yozzo's annual free report and info graphic with: Figures, tables, information and statistics about Thailand's Telecom Market end of 2015 ★
✔ Blended MOU
✔ Blended ARPU
✔ MVNO in Thailand
✔ 4G subscribers in Thailand
✔ Mobile Revenue per/minute
✔ AIS Highlights end of 2015
✔ DTAC Highlights end of 2015
✔ True Move Highlights end of 2015
✔ Mobile Internet usage in Thailand
✔ Thailand’s Mobile Subscriber Growth
✔ Smartphone sales in Thailand 2015
✔ Mobile Operator Market Shares 2015
✔ Amount of smartphone users in Thailand
✔ Types of Internet connections in Thailand
✔ Thailand’s Mobile user’s consumption and more…
¹ MVNO Definition: http://www.yozzo.com/mvno-wiki/mvno-definition
² The History of MVNO | http://www.yozzo.com/mvno-wiki/the-history-of-mvno | August 2016 | Yozzo.com
³ Why MVNOs in Thailand have failed: http://www.yozzo.com/news-and-information/mvno-mobile-operator-s/why-mvnos-in-thailand-have-failed
✔ ส่วนแบ่งการตลาดของบริการโทรศัพท์เคลื่อนที่ (ร้อยละ) : MOBILE MARKET SHARE %
✔ จำนวนผู้ใช้บริการโทรศัพท์เคลื่อนที่ (MOBILE SUBSCRIBERS)
✔ สัดส่วนรายรับของผู้ให้บริการในตลาดบริการโทรศัพท์เคลื่อนที่ ( MOBILE REVENUE % )
✔ อัตราการขยายตัวของผู้ใช้บริการโทรศัพท์เคลื่อนที่ (ร้อยละ) : MOBILE GROWTH RATE %
✔ อัตราการเข้าถึง (การใช้) บริการโทรศัพท์เคลื่อนที่ : MOBILE PENETRATION
✔ รายรับเฉลี่ยจากบริการโทรศัพท์เคลื่อนที่โดยรวมการเชื่อมต่อ (บาท/เลขหมาย/เดือน) : MOBILE ARPU EXCLUDED IC
✔ MOBILE MOU (MINUTE/MONTH)
✔ รายรับเฉลี่ยจากการให้บริการโทรศัพท์เคลื่อนที่ต่อนาที : MOBILE REVENUE PER MINUTE (RPM)
✔ สัดส่วนบริการเสียงและไม่ใช่เสียง (Mobile Non-voice/Voice Ratio)
✔ จำนวนผู้ใช้บริการโทรศัพท์ประจำที่ (Fixed Line Subscribers)
✔ สัดส่วนการเข้าถึง (การใช้) บริการโทรศัพท์ประจำที่ต่อจำนวนประชากร (ร้อยละ) : Fixed Line Penetration per Population %
✔ สัดส่วนการเข้าถึง (การใช้) บริการโทรศัพท์ประจำที่ต่อจำนวนครัวเรือน(ร้อยละ) : Fixed Line Penetration per Household %
✔ เปรียบเทียบสัดส่วนจำนวนผู้ใช้บริการระหว่างโทรศัพท์เคลื่อนที่
Remixing Media on the Web: Media Fragment Specification and SemanticsMediaMixerCommunity
Introduce the W3C Media Fragment URI specification. Highlight how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. Extensions to these ontologies to more richly link media fragments to the concepts they represent.
Kurento: a media server architecture and API for WebRTCLuis Lopez
Introducing Kurento for WebRTC Expo 2013 (Paris). Kurento is an Open Source multimedia framework, which provides a Java EE compatible API suitable for adding real-time communication capabilities to any WWW application in a simple and seamless way.
Developing rich multimedia applications with Kurento: a tutorial for JavaScri...Luis Lopez
This presentation was carried out at DevCon5'14 (New York) for introducing the Kurento new JavaScript developer APIs. These APIs make possible to create rich video applications supporting WebRTC and HTTP pseudo-streaming (video tag) and leveraging Kurento Media Server capabilities, which include computer vision, augmented reality, group communications and recording.
Recording and media manipulation of WebRTC streamsLuis Lopez
This presentation introduces Kurento technologies to developers at the WebRTC Conference & Expo 2014 in San Jose. It focuses on Kurento Client APIs and on its capabilities for recording and manipulating the audio and video streams in WebRTC sessions.
FOSDEM 2016 - Creating rich WebRTC Applications with KurentoLuis Lopez
WebRTC is a disruptive media technology bringing real-time multimedia communications to HTML5 standards. WebRTC is currently available for billions of users as a built-in feature of common browsers such as Chrome and Firefox. This makes possible the emergence of a truly open and interoperable technology competing with proprietary conferencing solutions and enabling developers to create specific-purpose WWW peer-to-peer real-time media applications in a simple and seamless manner.
However, WebRTC developers commonly require more than plain peer-to-peer video conferencing. For this, we introduce Kurento (http://www.kurento.org), a Free Open Source Software (FOSS) initiative build on top of GStreamer providing developers a set of high level abstract APIs making possible the creation of HTML5 multimedia-enabled web application. Kurento pushes GStreamer to the limit building a media server with interesting features such as media recording, media mixing for group communications, media adaption and transcoding, media augmentation, integration with computer vision capabilities, etc.
In the talk we will introduce what’s Kurento and how WWW developers can take advantage of it showing the following aspects of the framework:
- First, introducing Kurento Java and JavaScript APIs and we explain how they interact with the signaling plane in an application server. This allows WebRTC application developers to create their application logic using popular technologies such as Java EE or Node.js.
- Second, by presenting a unique media plane written on top of GStreamer. GStreamer is based on the concept of media pipelines, which can be seen as chains of media elements performing operations to a media flow in real-time. Currently there are more than 1000 media elements written for GStreamer implementing many different capabilities such as codecs (e.g. H.264, H.263, VP8, etc.), recorders and players (for storing/recovering media from files), blenders (for augmenting media), filters (i.e. face blurring, face recognition, etc.) and others. Hence, Kurento enables to inject WebRTC streams into a chain of such elements and perform, in real time, the operations the developer wishes.
- Third, introducing and abstraction of all the complexities of signaling, media control and media management through a powerful server-side API that can be used by average developers who do not require particular expertise about multimedia protocols or formats.
The future of multimedia communications and services: Kurento and it's roleLuis Lopez
This is a presentation specifically created for the GSMA interest group on WebRTC. This presentations introduces Kurento from the perspective of operators. Kurento is a multimedia development framework. It has been created to ease the life of multimedia application developers. Using multimedia capabilities such as embedding a video onto your app or establishing a video conferencing link between two clients may be tricky, but there is no rocket science there. However, for applications requiring more advanced features things quickly get unmanageable. If you have been involved in multimedia projects, you probably know that features such as interoperable group communications, different communication roles (e. g.. publishers/viewers), video transforming and transcoding, video storage and tagging, integration into legacy video/voice infrastructures, computer vision, augmented reality, integration with external systems and databases and many others, pose quite a complex challenge, which usually requires huge expertise and effort. Specially when real-time communications are involved. If this is your case, Kurento will help you.
Deep-linking into Media Assets at the Fragment Level SMAM 2013Raphael Troncy
"Deep-linking into Media Assets at the Fragment Level: Specification, Model and Applications" - Keynote Talk given at the International Workshop on Semantic Music and Media (SMAM), 21 October 2013
Implementing the Media Fragments URI SpecificationRaphael Troncy
Implementing the Media Fragments URI Specification - Talk given at the Developer's Track of the 19th World Wide Web Conference (WWW'2010), Raleigh (NC), USA, April 29th 2010
This presentation was used in the context of a FI-WARE webminar for introducing Kurento. Kurento is a framework for building multimedia and streaming applications based on predefined blocks. Send and receive median through RTP, WebRTC, HTTP and RTSP. Use processing for making face detection, plate recognition or object tracking. Use augmented reality, group communications or media mixing and blending among others. During the webminar, we used Kurento APIs for showing how to create media applications for videoconferencing or video streaming in a simple and seamless manner. We also demonstrated how these applications can be enriched with Kurento's advanced processing capabilities.
WebRTC/Kurento/NUBOMEDIA Hackathon at IETF’96Boni García
In this hackathon you will be playing with WebRTC technologies and standards for creating rich real-time communication applications. For this, in addition to using WebRTC clients, we will introduce a WebRTC infrastructure suitable for providing advanced capabilities that include group communications, recording, transcoding and media processing. This infrastructure will be based on NUBOMEDIA: a cloud Platform as a Service where you will be able to deploy, execute and scale your WebRTC applications in a seamless way.
Developing rich multimedia applications with FI-WARE.Luis Lopez
FI-WARE will deliver a novel service infrastructure, building upon elements called Generic Enablers (GEs), which offer reusable and commonly shared functions making it easier to develop Future Internet Applications in multiple sectors. This presentation provides an overview of Kurento: the FI-WARE Generic Enabler that will ease development of advanced multimedia stream processing applications.
Similar to Remixing Media on the Semantic Web (ISWC 2014 Tutorial) Pt 1 Media Fragment Specification and Semantics (20)
LinkedTV Deliverable 9.3 Final LinkedTV Project ReportLinkedTV
This document comprises the final report of LinkedTV. It includes a publishable summary of the project's scientific results and technological outcomes, a plan for use and dissemination of foreground IP and a list of dissemination activities (publications and events)
LinkedTV Deliverable 6.5 - Final evaluation of the LinkedTV ScenariosLinkedTV
The deliverable presents the results of evaluating the final
scenario demonstrators LinkedNews and LinkedCulture in the LinkedTV project. We tested specifically user satisfaction with the enriched TV experience we enabled for cultural heritage and news TV programs. We also supported the evaluation of other aspects of the LinkedTV technologies in the trials, specifically the personalization and content curation.
LinkedTV Deliverable 5.7 - Validation of the LinkedTV ArchitectureLinkedTV
The LinkedTV architecture lays the foundation for the
LinkedTV system. It consists of the integrating platform for the end-to-end functionality, the backend components and the supporting client components. Since the architecture of a software system has a fundamental impact on quality
attributes, it is important to evaluate its design. The document at hand reports on the validation of the LinkedTV architecture.
LinkedTV Deliverable 4.7 - Contextualisation and personalisation evaluation a...LinkedTV
This deliverable covers all the aspects of evaluation of the overall LinkedTV personalization workflow, as well as re-evaluations of techniques where newer technology and / or algorithmic capacity offer new insight into the general performance. The implicit contextualized personalization workflow, the implicit uncontextualized workflow in the premises of the final LinkedTV application, the advances
in context tracking given new technologies emerged and the outlook of video recommendation beyond LinkedTV is measured and analyzed in this document.
LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...LinkedTV
This document presents guidelines on how to setup enriched video experiences.
We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study.
We selected 5 news videos and manually extracted the
candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of
information from Wikipedia about these entities. Analysis of
the results shows that users prefer entities of the type
organization and person and have little interest for entities of the type location. They also indicate that subtitles are not
enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources.
We provide engineering guidelines on how to present,
aggregate and process content for TV program companion
applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.
LinkedTV Deliverable 2.7 - Final Linked Media Layer and EvaluationLinkedTV
This deliverable presents the evaluation of content annotation and content enrichment systems that are part of the final tool set developed within the LinkedTV consortium. The evaluations were performed on both the Linked News and Linked Culture trial content, as well as on other content annotated for this purpose. The evaluation spans three languages: German (Linked News), Dutch (Linked
Culture) and English. Selected algorithms and tools were also subject to benchmarking in two international contests: MediaEval 2014 and TAC’14. Additionally, the Microposts 2015 NEEL Challenge is being organized with the support of LinkedTV.
LinkedTV Deliverable 1.6 - Intelligent hypervideo analysis evaluation, final ...LinkedTV
This deliverable describes the conducted evaluation activities for assessing the performance of a number of developed methods for intelligent hypervideo analysis and the usability of the implemented Editor Tool for supporting video annotation and enrichment. Based on the performance evaluations reported in D1.4 regarding a set of LinkedTV analysis components, we extended our experiments for assessing the effectiveness of newer versions of these methods as well as of entirely new techniques, concerning the accuracy and the time efficiency
of the analysis. For this purpose, in-house experiments and participations at international benchmarking activities were made, and the outcomes are reported in this deliverable. Moreover, we present the results of user trials regarding the developed Editor Tool, where groups of experts assessed its usability and the supported functionalities, and
evaluated the usefulness and the accuracy of the implemented video segmentation approaches based on the analysis requirements of the LinkedTV scenarios. By this deliverable we complete the reporting of WP1 evaluations that aimed to assess the efficiency of the developed
multimedia analysis methods throughout the project, according to the analysis requirements of the LinkedTV scenarios.
LinkedTV Deliverable 5.5 - LinkedTV front-end: video player and MediaCanvas A...LinkedTV
The LinkedTV media player and API has evolved from a single player and limited API in version 1 to a toolkit to allow rapid development and creation of different kind of applications within the HTML5 / multiscreen space. The main reason for this transition is that during the course of the Linked TV project different partners had different requirements for their scenarios. Instead of trying to fit all these requirements into one player and, most likely, compromise on the functionalities of the scenarios we wanted to offer something that would allow all partners a satisfiable solution.
Therefore the Springfield Multiscreen Toolkit, or short SMT, has been developed. The aim for the SMT was to allow flexibility for developing multiscreen applications. Also from a commercial point of view a toolkit with examples is more interesting than a pure player as it gives the freedom of developing new ideas with the LinkedTV platform.
LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)LinkedTV
A brief introduction to tools from the LinkedTV project which can be used together to build new media applications based on conceptual linking of media fragments.
LinkedTV Deliverable D4.6 Contextualisation solution and implementationLinkedTV
This deliverable presents the WP4 contextualisation final im-plementation. As contextualization has a high impact on all the other modules of WP4 (especially personalization and recom-mendation), the deliverable intends to provide a picture of the final WP4 workflow implementation.
LinkedTV Deliverable D3.7 User Interfaces selected and refined (version 2)LinkedTV
This report describes the LinkedTV user interfaces. Based on the results user studies and the initial evaluation of the year 2 prototype we selected and refined the interfaces. We selected a single screen application that uses HbbTV technology to provide additional information about a TV program as an overlay on the TV broadcast. In addition, we worked towards TV program companion applications that are tailored for two domains: news and cultural heritage. With these applications we demonstrate different types of interaction modes, such as synchronized content on a second screen, and bookmarking chapters combined with the exploration of related content after the program. The interfaces are built on top of the Multiscreen Toolkit. We created a component-based infrastructure that allows us to quickly create tailored companion applications by reusing and configuring interface components. In the final part of the project we finalize this approach and test it by applying it to a new domain.
LinkedTV Deliverable D2.6 LinkedTV Framework for Generating Video Enrichments...LinkedTV
This deliverable describes the final LinkedTV framework that provides a set of possible enrichment resources for seed video content using techniques such as text and web mining, information extraction and information retrieval technologies. The enrichment content is obtained from four type of sources: a) by crawling and indexing web sites described in a white list specified by the content partners,
b) by querying the API or SPARQL endpoint of the Europeana digital library network which is publicly exposed, c) by querying multiple social networking APIs, d) by hyperlinking to other parts of TV programs within the same collection using a Solr index. This deliverable
also describes an additional content annotation functionality, namely labelling enrichment (as well as seed) content with thematic topics, as well as the process of exposing content annotations to this module and to the filtering services of LinkedTV’s personalization workflow. We illustrate the enrichment workflow for the two main scenarios of LinkedTV which have lead to the development of the LinkedCulture and LinkedNews applications, which respectively use the TVEnricher and TVNewsEnricher enrichment services. The original title of this deliverable from the DoW was Advanced concept labelling by complementary Web mining.
LinkedTV Deliverable D1.5 The Editor Tool, final release LinkedTV
This document reports on the design and implementation of the final version of the editor tool (ET) v2.0, where its purpose is to serve the program editing teams of broadcasters that have adopted LinkedTV’s interactive television solution into their workflow. Two of these teams are currently represented in the LinkedTV project, namely the RBB team and the AVROTROS team (formerly known as AVRO).
The main purpose of the ET is to provide a means to correct and curate automatically generated annotations and hyperlinks created by the audiovisual and textual analysis technologies developed in WP 1 and 2 of the LinkedTV project. Without the intervention of human editors to correct this data, there is a reasonable risk of exposing inappropriate, incorrect or irrelevant information to the viewers of a LinkedTV interactive broadcast.
LinkedTV Deliverable D1.4 Visual, text and audio information analysis for hyp...LinkedTV
Having extensively evaluated the performance of the technologies included in the first release of WP1 multimedia analysis tools, using content from the LinkedTV scenarios and by participating in international benchmarking activities, concrete decisions regarding the
appropriateness and the importance of each individual method or combination of methods were made, which, combined with an updated list of information needs for each scenario, led to a new set of analysis requirements that had to be addressed through the release of the final set of analysis techniques of WP1. To this end, coordinated efforts on three directions, including
(a) the improvement of a number of methods in terms of accuracy and time efficiency,
(b) the development of new technologies and (c) the definition of synergies between methods for obtaining new types of information via multimodal processing, resulted in the final bunch of multimedia analysis methods for video hyperlinking. Moreover, the different developed analysis modules have been integrated into a web-based infrastructure, allowing the fully automatic linking of the multitude of WP1 technologies and the overall LinkedTV platform.
LinkedTV D8.6 Market and Product Survey for LinkedTV Services and TechnologyLinkedTV
D8.6 presents the results of the market analysis for LinkedTV products and services and consists of
two parts: an overall analysis of current and future
developments in the TV and digital video market and a specific market analysis of potential LinkedTV customers and competitors. Based on the market analysis it was possible to provide a first rough estimation of the LinkedTV market potential and to position LinkedTV on the market.
This deliverable presents the LinkedTV Public Demonstrator which will be an online, publicly accessible Website collecting showcases of the key project outputs which form together our LinkedTV solution: the Editor Tool, Platform and Player, complemented by demonstrations of the provision of this solution for the content of two European broadcasters: the LinkedCulture and LinkedNews scenario demonstrators.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
May Marketo Masterclass, London MUG May 22 2024.pdfAdele Miller
Can't make Adobe Summit in Vegas? No sweat because the EMEA Marketo Engage Champions are coming to London to share their Summit sessions, insights and more!
This is a MUG with a twist you don't want to miss.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Remixing Media on the Semantic Web (ISWC 2014 Tutorial) Pt 1 Media Fragment Specification and Semantics
1. Re-Using Media on the (Semantic) Web
Raphaël Troncy <raphael.troncy@eurecom.fr> with contributions from:
Giuseppe Rizzo, José Luis Redondo Garcia, Mariella Sabatino, Pasquale Lisena
@rtroncy
2. Agenda
Session 1: Media fragment specification and semantics
Summary: Introduce the W3C Media Fragment URI specification and the Open Annotation model. Highlight how media fragments can be annotated using NER tools.
Session 2: Linked Media principles
Summary: Introduce the Linked Media principles, how to publish linked media in RDF and how to retrieve media enrichments. illustration with Linked Media applications.
Session 3: User experience driven design of Linked Media applications
Summary: Present the Web and TV convergence. Describe LinkedTV experience via two innovative applications.
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 2
3. Once upon a time …
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 3
4. … leading to sharing Media Fragments
Publishing status message containing a Media Fragment URI
Use a ‘#’ !
Highlight a video sequence
Highlight a region to pay attention to
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 4
5. W3C Video on the Web Workshop - 2007
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 5
6. Key topics
Addressing: having global identifiers for identifying spatial and temporal clips (for deep linking, bookmarking, caching and indexing)
Metadata: searching and discovering video is difficult with the volume of online video
Video codec: recommending a baseline (open) video codec for the World Wide Web
Content protection: managing digital rights associated with the media is key: W3C should look into metadata for digital rights
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 6
7. Making video a "first class citizen"
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 7
8. Flickr Notes
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 8
http://www.flickr.com/photos/mhausenblas/2883727293/
9. YouTube Temporal Addressing (Sept 2008)
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 9
10. Twitter bot monitoring usage of video sharing
Loose media fragments parser: https://github.com/yunjiali/Media-Fragments-URI-Loose
50 hours monitoring of the Twitter stream (22 December 2013 – 24 December 2013)
5,8 million tweets analyzed containing a video URL
32,754 tweets contain a valid media fragment URI (0.6%)
99% from YouTube, 0.3% from Dailymotion, 0.1% from Vimeo
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 10
11. t
0
20
35
temporal media fragment
spatial media fragment
track media fragment
named media fragment
“Scared Scene”
What are Media Fragments?
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 11
12. Media Fragments (temporal)
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 12
Fragment beginning
Fragment end
Playback progress
Original resource length
13. Media Fragments (spatial)
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 13
semi-opaque overlay
highlighted fragment
http://ninsuna.elis.ugent.be/MFPlayer/html5
14. Media Fragments URIs
Bookmark / Share parts (fragments) of audio/video content
Annotate media fragments
Search for media fragments
Develop Mash-ups/Collage
Conserve bandwidth
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 14
http://www.w3.org/TR/media-frags-reqs/
http://www.w3.org/TR/media-frags/
15. URI Scheme
Using URI query part:
Using URI fragment part:
Mixing both:
http://www.example.org/video.ogv?t=60,100
http://www.example.org/video.ogv#t=60,100
http://www.example.org/video.ogv?t=60,100#t=10,15
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 15
16. Media Fragments Resolution
For the URI query part:
The media file is only processed on server side
The UA receives a new video file
For the URI fragment part:
Smart UA will strip out the fragment definition and encode it into custom http headers (Range header)
(Media) Servers will handle the request, slice the media content and serve just the fragment (corresponding byte ranges) … while old ones will serve the whole resource
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 16
17. Media Fragments Resolution
2 ways handshake
4 ways handshake
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 17
18. Influence of Media Formats
Fragment extraction needs to be expressible in terms of byte ranges
Requirements for the different axes
temporal: presence of intra-coded frames (i.e., random access points)
spatial: presence of independently coded spatial regions
track: need to be identifiable by a name
Conclusion: temporal and track axes are realistic, spatial fragments can hardly be expressed in terms of byte ranges
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 18
19. Clients Video Sharing Platforms
TEMPORAL
NPT (hh:mm:ss)
SMPTE - Clock
SPATIAL 20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 19
State of the art
Only start Not standard syntax
20. State of the art
MEDIAFRAGMENT.JS
MediaFragments.parse( "http://www.example.com/video.ogv ?t=1:00:00#t=npt:10,20 &xywh=percent:25,25,50,50" );
{
"query":{
"t":[
{
"value":"1:00:00",
"unit":"npt",
"start":"1:00:00",
"end":"",
"startNormalized":3600,
"endNormalized":""
}
]
},
"hash":{
"t":[
{
"value":"npt:10,20",
"unit":"npt",
Alignment to specification Controls for percent spatial frags Node.JS module
https://github.com/tomayac/Media-Fragments-URI/ 20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 20
21. State of the art
CLIENT IMPLEMENTATIONS
SYNOTE MEDIA FRAGMENT PLAYER
•
Cross-browser (Flash fallback)
•
HTML5, YouTube, Dailymotion, Vimeo support
•
HTML5-like interface
https://github.com/pasqLisena/Media-Fragment-Player 20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 21
22. State of the art
CLIENT IMPLEMENTATIONS
NINSUNA MEDIA FRAGMENT PLAYER
http://ninsuna.elis.ugent.be/MediaFragmentsPlayer 20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 22
23. State of the art
SERVER IMPLEMENTATIONS
NINSUNA MEDIA FRAGMENT SERVER
RAFAEL
•
Preliminary process of media resources
•
Structural metadata stored in a RDF triplestore
•
Annotation system
•
Media adaptation and binarization
•
Support for Time range request
•
Fragment extraction on the fly
•
Java lib mp4parser
•
Fragment stored on filesystem
•
Support only for query fragments
http://ninsuna.elis.ugent.be/MediaFragmentsServer
https://github.com/Noterik/Rafael
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 23
24. MAFFIN: node-js Media Fragment Server
Query Fragment
•
Time (npt)
•
Track (video/audio)
•
Xywh (?)
Hash fragment
•
Range request (npt) 20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 24
26. Fragment Extraction
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 26
FRAGMENT QUERY
FFMPEG OPTION
NOTE
t=10
-ss 10
t=,20
-to 20
t=10,20
-ss 10 -to 20
track=video
-an
no audio
track=audio
-vn
no video
xywh=10,10,50,60
-filter:v "crop=50:60:10:10"
require transcoding
xywh=percent:10,10,50,60
-filter:v "crop=in_w*50/100:in_h*60/100:in_w*10/ 100:in_h*10/100"
require transcoding
ffmpeg -i C:/video/video.mp4 -ss 10 -to 20 C:/video/out/video_10-20_.mp4
27. Issuing HTTP (Time) Range Requests
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 27
28. A Chrome extension
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
- 28
Range: t:npt=10-20;
include-setup
#t=10,20
mediafragment.js
29. Issuing HTTP (Time) Range Requests
REQUEST
RESPONSE
GET /video.ogv HTTP/1.1 Host: www.example.com Accept: video/* Range: t:npt=10-20;
include-setup
HTTP/1.1 206 Partial Content
Accept-Ranges: bytes, t, id Content-Length: 3795 Content-Type: video/ogg
Content-Range-Mapping:
{ t:npt 9.85-21.16/0.0-653.79;include-setup } =
{ bytes 0-52,19147-22880/35614993 }
Content-type: multipart/byteranges; boundary=BOUNDARY Etag: "b7a60-21f7111-46f3219476580"
--BOUNDARY
Content-type: video/ogg
Content-Range: bytes 0-52/35614993
{binary data}
--BOUNDARY
Content-type: video/ogg
Content-Range: bytes 19147-22880/35614993
{binary data}
---BOUNDARY--
METADATA:
Bytes until first
frame
DATA:
Byte range built
with ffprobe
- 29
20/10/2014 -
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
31. Media Fragment Semantic Annotation
Media Fragment creation: localize a region (person)
Media Fragment annotation (tagging) = interpretation Winston Churchill, UK Prime Minister, Allied Forces, WWII
Media Fragment semantic annotation :Reg1 foaf:depicts dbpedia:WinstonChurchill. dbpedia:Churchill rdfs:label "Winston Churchill"; rdf:type foaf:Person dbprop:order dbpedia:Prime_Minister_(UK).
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 31
The "Big Three" at the Yalta Conference (Wikipedia)
Reg1
33. RDF 1.1 Primer (http://www.w3.org/TR/rdf-primer/)
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 33
34.
Things, not strings! http://googleblog.blogspot.fr/2012/05/introducing-knowledge- graph-things-not.html
Use knowledge bases (LOD)
Use common vocabularies (LOV)
Follow the 4 Linked Data principles
Refine the 4 Linked Media principles
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 34
Media Fragment Semantic Annotation
35. Open Annotation Data Model
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 35
Specification developed in the W3C Open Annotation Community Group now Working Group http://www.openannotation.org/spec/core/
Core model
OWL vocabulary for representing and sharing annotation of digital resources (and their fragment) … in RDF
A body is related to a target
Nature of the annotation changes according to intention (motivation)
How to annotate this image?
36. Semantic Annotation of an Image
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 36
http://www.w3.org/community/openannotation/wiki/ SE_Semantically_Tagging_an_Image
37. Open Video: Annotation Project
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 37
http://openvideoannotation.org/
38. YouTube Annotations
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 38
Annotations are clickable text overlays on YouTube videos
Annotations are used to boost engagement, give more information, and aid in navigation
39. YouTube Annotations: How To
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 39
41. ... and enrichment for hypervideos
Cubism
Expressionism
Fauvism
FACETS / PROPERTIES OF CONCEPT
CONCEPT IN PLAYER
CONTENT ENRICHMENT
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 41
42. LinkedTV Core Ontology
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 42
http://data.linkedtv.eu/ontologies/core
43. Media Fragments and Annotations
nerd:Location Cafe Rick
nerd:Person H. Bogart
nerd:Person
I. Bergman
nerd:Location Casablanca
Media Fragment URI 1.0
Chapters
Scenes
Shots
etc…
http://data.linkedtv.eu/media/e2899e7f#t=14,15
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 43
44. Enrichment and Hypervideos
nerd:Location Cafe Rick
Nerd:Person H. Bogart
Nerd:Person
I. Bergman
nerd:Location Casablanca
Nerd:Person
E. Tierney
nerd:Location China
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 44
46. What is a Named Entity recognition task?
A task that aims to locate and classify the name of a person or an organization, a location, a brand, a product, a numeric expression including time, date, money and percent in a textual document
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 46
47. Example
“ I want to book a room in an hotel located in the heart of Paris, just a stone’s throw from the Eiffel Tower ”
Eric Charton, “Named Entity Detection and Entity Linking in the Context of Semantic Web: Exploring the ambiguity question”
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 47
48. Part of Speech
I PRP want VBP to TO book VB a DT room NN in IN … … Paris NNP
NER: What is Paris? NEL: Which Paris are we talking about?
Giuseppe Rizzo, “Learning with the Web: Structuring data to ease machine understanding”
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 48
49. What is Paris? Type Ambiguity
03/09/2014 - - 49
Giuseppe Rizzo, “Learning with the Web: Structuring data to ease machine understanding”
dbpedia-owl:Asteroid
schema:City
schema:Movie dbpedia-owl:Film
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
50. Named Entity Recognition (NER)
I PRP O want VBP O to TO O book VB O a DT O room NN O in IN O … … … Paris NNP LOC
03/09/2014 - - 50
Giuseppe Rizzo, “Learning with the Web: Structuring data to ease machine understanding”
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
51. What is Paris? Name Ambiguity
03/09/2014 - - 51
Giuseppe Rizzo, “Learning with the Web: Structuring data to ease machine understanding”
Paris, Kentucky
Paris, Maine
Paris, Tennessee
Paris, France
Paris, Idaho
Paris, Ontario
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
52. Named Entity Linking (NEL)
I PRP O O want VBP O O to TO O O book VB O O a DT O O room NN O O in IN O O … … … … Paris NNP LOC http://dbpedia.org/resource/Paris
03/09/2014 - - 52
Giuseppe Rizzo, “Learning with the Web: Structuring data to ease machine understanding”
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
53. NER Tools and Web APIs
Standalone software
GATE
Stanford CoreNLP
Temis
Web APIs
http://nerd.eurecom.fr/
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 53
54. NERD User Interface
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 54
55. Problem: Generating Hypervideos
1) Semantic Graph of MediaResources
2) Main citizen: MediaFragments
MF Annotation
3) Anchors: Named Entities
LOD Cloud
Links to LOD
Hyperlink to other Media Content
Levels of Granularity
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 55
56. Edward Snowden asks for asylum in Russia (04 / 07 / 2013)
Problem: User Perspective
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 56
57. In which Russian airport is he exactly?
LSCOM:Face
LSCOM:Building
?
Problem: Technological Perspective
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 57
58. List of Relevant Named Entities
(1) Named Entity
(2) Filtering and Ranking
b) Expanded Entities
b) Re-ranked Entities
a) Entities from Video
Approach
03/09/2014 -
- 58
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
59. Named Entity Expansion
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 59
60. REST API2
ontology1
UI3
1 http://nerd.eurecom.fr/ontology 2 http://nerd.eurecom.fr/api/application.wadl 3 http://nerd.eurecom.fr
Named Entity Expansion: step 1
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 60
61.
Five W´s * Four W´s
Who: nerd:Person, nerd:Organization
What: nerd:Event, nerd:Function, nerd:Product
Where: nerd:Location
When: news program metadata
Entity Ranking and Selection:
Ranking according extractor’s confidence
Relative confidence falls in the upper quarter interval
Final Query:
Concatenate Labels of the selected entities in Who, What, Where, for a time t
(*) J. Li and L. Fei-Fei. What, where and who? classifying events by scene and object recognition
Named Entity Expansion: step 2
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 61
62. Named Entity Expansion: step 3
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 62
63.
Entity clustering:
Centroid-based approach
Distance metric:
Strict string similarity over the URL’s
Jaro-Winkler string distance over labels
Entity re-ranking according to:
Relative frequency in the transcripts
Relative frequency over the additional documents
Average confidence score from the extractors
Output:
Frequent entities are promoted
Entities not disambiguated can be identified with a URL by transitivity
Same happens with erroneous labels
Relevant but non-spotted entities arise (example: N)
Named Entity Expansion: step 4
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 63
64. Named Entity
✚
✚
✚
✚
✚
✚
✚
Named Entity Expansion: Results
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 64
65. List of Relevant Named Entities
(1) Named Entity
(2) Filtering and Ranking
b) Expanded Entities
b) Re-ranked Entities
a) Entities from Video
Approach
03/09/2014 -
- 65
Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014
66. For each pair of results: Iteratively generate DBpedia paths using the EiCE engine [1]
[1] http://github.com/mmlab/eice
: Barack_Obama
:Vladimir_Putin
Refining via EiCE
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 66
67. NE Expansion
DBPedia Connectivity
(2) Ranking
Refining via EiCE: Results
03/09/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 67
68. Gathering Related Content for Enrichment
Knowledge Graphs (information cards)
Reverse engineering the GKG https://github.com/ahmadassaf/kbe
Web documents
https://www.google.com/cse/
Social Media
Media Collector https://github.com/vuknje/media-server
03/09/2014 - France - Taiwan Multimedia Workshop @ EURECOM - 68
69. Take Away Summary
Video is a first class citizen on the Web
Annotations: Ontology and API for Media Resources, Open Annotation Data Model
Access: Media Fragments URI
NERD platform for extracting key information from textual resources including video subtitles and microposts
Embrace the Linked Media vision
Publish, re-use, re-purpose and remix media descriptions
Develop links between (part of) media items via their descriptions
20/10/2014 - Reusing Media on the (Semantic) Web - Tutorial @ ISWC 2014 - 69