"Deep-linking into Media Assets at the Fragment Level: Specification, Model and Applications" - Keynote Talk given at the International Workshop on Semantic Music and Media (SMAM), 21 October 2013
MediaFinder: Collect, Enrich and Visualize Media Memes Shared by the CrowdRaphael Troncy
"MediaFinder: Collect, Enrich and Visualize Media Memes Shared by the Crowd", talk given at the 2nd Real Time Analysis and Mining of Social Streams Workshop (RAMSS) colocated with WWW 2013, Rio de Janeiro, Brazil
MediaFinder: Collect, Enrich and Visualize Media Memes Shared by the CrowdRaphael Troncy
"MediaFinder: Collect, Enrich and Visualize Media Memes Shared by the Crowd", talk given at the 2nd Real Time Analysis and Mining of Social Streams Workshop (RAMSS) colocated with WWW 2013, Rio de Janeiro, Brazil
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Social Media for Business, October 2013: Twitter, Facebook, Pinterest, YouTube Resourceful Nonprofit
Everything you need to know to jump-start a social media strategy! Detailed information on how to use social media for business as of late 2013. Includes social media demographics, infographics, tutorials, a list of resources, social media trends, social media case studies, and social media examples for business. Dive deeper into the big ones: Facebook for business, Twitter for business, Pinterest for business, YouTube and video for business.
Learn 10 questions you should ask before starting a social media plan. See video clips that exemplify what social media means. Learn about the humanity of social media marketing for business, and how to be more engaging on social media. All social media statistics are updated for 2013, including social media usage statistics as of October, 2013.
Also mentioned are LinkedIn (great for B2B social media), Google Plus aka G+, Instagram for business, and why social media is important for SEO (Search Engine Optimization.)
Presented by Amy Neumann, Director SEO/SEM/SMO of the Northeast Ohio Media Group on October 25, 2013, for the COSE Small Business Convention in Cleveland, Ohio.
Remixing Media on the Semantic Web (ISWC 2014 Tutorial) Pt 1 Media Fragment S...LinkedTV
In this session we will introduce the W3C Media Fragment URI specification, highlighting how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. We will also discuss extensions to these ontologies to more richly link media fragments to the concepts they represent, re-using Linked Data as a Web-wide knowledge graph about concepts. We will briefly demonstrate various approaches to visual, audio and textual analysis in order to generate meaningful media fragments out of a media resource, as well as look at available annotation tools for semantically describing online media. Finally, we show how existing text around media (subtitles, transcripts) can be used for fragment annotation through Named Entity Recognition services (NERD) and a combined approach for generating a semantic description of media from analysis, metadata and entity recognition (TV2RDF).
Remixing Media on the Web: Media Fragment Specification and SemanticsMediaMixerCommunity
Introduce the W3C Media Fragment URI specification. Highlight how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. Extensions to these ontologies to more richly link media fragments to the concepts they represent.
[MM2023] Ducho: A Unified Framework for the Extraction of Multimodal Features...Daniele Malitesta
Slides for the paper "Ducho: A Unified Framework for the Extraction of Multimodal Features in Recommendation", accepted and presented at the 31st ACM International Conference on Multimedia (MM'23).
Paper: https://dl.acm.org/doi/10.1145/3581783.3613458
Code: https://github.com/sisinflab/Ducho
Linked Data: the Entry Point for Worldwide Media Fragments Re-use and Copyrig...Roberto García
One of the biggest barriers for the uptake of a Web of Media is the availability of easy ways to reuse media fragments and manage their copyright. Existing proposals provide limited solutions or find it difficult to scale to the Web. MediaMixer contributes state of the art techniques for media fragment detection and semantic annotation.
This is complemented with copyright management integrated into the Web fabric, using Linked Data principles and reasoning based on a Copyright Ontology. Altogether, it can make possible to navigate the Web retrieving the metadata describing a piece of content to be reused, linked to the agreement about its copyright, the parties that will share the revenue, etc.
A typical MediaMixer demo involves:
* Fragmenting media assets
* Annotating them using semantic descriptions
* Modeling licenses, policies,... using the Copyright Ontology
* Exposing them for fragment level retrieval and re-use, including copyright reasoning
Implementing the Media Fragments URI SpecificationRaphael Troncy
Implementing the Media Fragments URI Specification - Talk given at the Developer's Track of the 19th World Wide Web Conference (WWW'2010), Raleigh (NC), USA, April 29th 2010
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...lindlar
Presentation of the DURAARK project at the final seminar of the DEDICATE project ("Design's Digital Curation for Architecture") held in Glasgow on October 21st, 2013.
http://architecturedigitalcuration.blogspot.de/
The objective of MediaMixer is to set up and sustain a community of video producers, hosters, and redistributors who will be supported in the adoption of semantic multimedia technology in their systems and workflows to build a European market for media fragment re-purposing and re-selling. Networking with the community will ensure that research results and technology development truly meets the industry requirements and reflects real world use cases. Demonstrators in media production, news reporting and e-learning will highlight the technology value, with a wider impact achieved through the support of media industry experts and associations to present these results to their members. A number of events will be organised to network the industry members with the research experts of MediaMixer and facilitate technology transfer (by information days and training), and an online portal will drive the geographically distributed community and act as a central access point to tools, materials, use cases, demos and presentations.
Authors/Presenters: Vasileios Mezaris and Benoit Huet.
Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.
Social Media for Business, October 2013: Twitter, Facebook, Pinterest, YouTube Resourceful Nonprofit
Everything you need to know to jump-start a social media strategy! Detailed information on how to use social media for business as of late 2013. Includes social media demographics, infographics, tutorials, a list of resources, social media trends, social media case studies, and social media examples for business. Dive deeper into the big ones: Facebook for business, Twitter for business, Pinterest for business, YouTube and video for business.
Learn 10 questions you should ask before starting a social media plan. See video clips that exemplify what social media means. Learn about the humanity of social media marketing for business, and how to be more engaging on social media. All social media statistics are updated for 2013, including social media usage statistics as of October, 2013.
Also mentioned are LinkedIn (great for B2B social media), Google Plus aka G+, Instagram for business, and why social media is important for SEO (Search Engine Optimization.)
Presented by Amy Neumann, Director SEO/SEM/SMO of the Northeast Ohio Media Group on October 25, 2013, for the COSE Small Business Convention in Cleveland, Ohio.
Remixing Media on the Semantic Web (ISWC 2014 Tutorial) Pt 1 Media Fragment S...LinkedTV
In this session we will introduce the W3C Media Fragment URI specification, highlighting how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. We will also discuss extensions to these ontologies to more richly link media fragments to the concepts they represent, re-using Linked Data as a Web-wide knowledge graph about concepts. We will briefly demonstrate various approaches to visual, audio and textual analysis in order to generate meaningful media fragments out of a media resource, as well as look at available annotation tools for semantically describing online media. Finally, we show how existing text around media (subtitles, transcripts) can be used for fragment annotation through Named Entity Recognition services (NERD) and a combined approach for generating a semantic description of media from analysis, metadata and entity recognition (TV2RDF).
Remixing Media on the Web: Media Fragment Specification and SemanticsMediaMixerCommunity
Introduce the W3C Media Fragment URI specification. Highlight how media fragments can be incorporated into known media description schema, with a focus on the W3C Media Ontology and the Open Annotation Model. Extensions to these ontologies to more richly link media fragments to the concepts they represent.
[MM2023] Ducho: A Unified Framework for the Extraction of Multimodal Features...Daniele Malitesta
Slides for the paper "Ducho: A Unified Framework for the Extraction of Multimodal Features in Recommendation", accepted and presented at the 31st ACM International Conference on Multimedia (MM'23).
Paper: https://dl.acm.org/doi/10.1145/3581783.3613458
Code: https://github.com/sisinflab/Ducho
Linked Data: the Entry Point for Worldwide Media Fragments Re-use and Copyrig...Roberto García
One of the biggest barriers for the uptake of a Web of Media is the availability of easy ways to reuse media fragments and manage their copyright. Existing proposals provide limited solutions or find it difficult to scale to the Web. MediaMixer contributes state of the art techniques for media fragment detection and semantic annotation.
This is complemented with copyright management integrated into the Web fabric, using Linked Data principles and reasoning based on a Copyright Ontology. Altogether, it can make possible to navigate the Web retrieving the metadata describing a piece of content to be reused, linked to the agreement about its copyright, the parties that will share the revenue, etc.
A typical MediaMixer demo involves:
* Fragmenting media assets
* Annotating them using semantic descriptions
* Modeling licenses, policies,... using the Copyright Ontology
* Exposing them for fragment level retrieval and re-use, including copyright reasoning
Implementing the Media Fragments URI SpecificationRaphael Troncy
Implementing the Media Fragments URI Specification - Talk given at the Developer's Track of the 19th World Wide Web Conference (WWW'2010), Raleigh (NC), USA, April 29th 2010
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...lindlar
Presentation of the DURAARK project at the final seminar of the DEDICATE project ("Design's Digital Curation for Architecture") held in Glasgow on October 21st, 2013.
http://architecturedigitalcuration.blogspot.de/
The objective of MediaMixer is to set up and sustain a community of video producers, hosters, and redistributors who will be supported in the adoption of semantic multimedia technology in their systems and workflows to build a European market for media fragment re-purposing and re-selling. Networking with the community will ensure that research results and technology development truly meets the industry requirements and reflects real world use cases. Demonstrators in media production, news reporting and e-learning will highlight the technology value, with a wider impact achieved through the support of media industry experts and associations to present these results to their members. A number of events will be organised to network the industry members with the research experts of MediaMixer and facilitate technology transfer (by information days and training), and an online portal will drive the geographically distributed community and act as a central access point to tools, materials, use cases, demos and presentations.
Semantic Interoperability at Europeana - MultilingualDSIs2018Antoine Isaac
Presentation on general interoperability and multilinguality issues at Europeana, for a workshop on Semantic Interoperability for Multilingual DSIs (https://ec.europa.eu/cefdigital/wiki/display/ETCOMMUNITY/Semantic+Interoperability+for+Multilingual+DSIs)
Similar to Deep-linking into Media Assets at the Fragment Level SMAM 2013 (20)
Location Embeddings for Next Trip RecommendationRaphael Troncy
Joint work wih Amadeus presenting a recommender system for your next destination using knowledge graphs and deep learning network, presented at the LocWeb 2019 Workshop colocated with TheWebConf 2019 (San Francisco, USA)
NERD: an open source platform for extracting and disambiguating named entitie...Raphael Troncy
"NERD: an open source platform for extracting and disambiguating named entities in very diverse documents" - Keynote Talk given at the NLP&DBpedia International Workshop (NLP&DBpedia), 22 October 2013
Semantics at the multimedia fragment level SSSW 2013Raphael Troncy
"Semantics at the multimedia fragment level or how enabling the remixing of online media" - Invited Talk given at the Semantic Web Summer School (SSSW), 12 July 2013
EventMedia Live: Exploring Events Connections in Real-Time to Enhance ContentRaphael Troncy
"EventMedia Live: Exploring Events Connections in Real-Time to Enhance Content" presented at the Semantic Web Challenge, Open Track, of the 11th International Semantic Web Conference, Boston, USA, November 2012
ShareIt: Mining SocialMedia Activities for Detecting EventsRaphael Troncy
ShareIt: Mining #SocialMedia Activities for Detecting #Events, Talk given at the 2nd Summer School on Social Media Retrieval (S3MR), June 2011, Antalya, Turkey
Experiencing Events through User-Generated MediaRaphael Troncy
Experiencing Events through User-Generated Media. Talk given at the 1st International Workshop on Consuming Linked Data (COLD), November 2010, Shanghai , China
Linking Events with Media. Talk given at the 6th International Conference on Semantic Systems (I-SEMANTICS), Triplification Challenge, September 2010, Graz, Austria
Multimedia Semantics: Metadata, Analysis and Interaction. Lecture Talk at the 5th Summer School on Multimedia Semantics (SSMS), August 2010, Amsterdam, The Netherlands
LODE: Une Ontologie pour representer des evenements dans le Web de DonneesRaphael Troncy
LODE: Une Ontologie pour représenter des événements dans le Web de Données - Talk given at the 21st Journées Francophones d'Ingénierie des Connaissances (IC'2010), Nîmes, France, June 9th 2010
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
3. Once upon a time …
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-3
4. … leading to sharing Media Fragments
Publishing status message containing
a Media Fragment URI
Use a ‘#’ !
Highlight a
video
sequence
Highlight a
region
to pay
attention to
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-4
5. W3C Video on the Web Workshop - 2007
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-5
6. Key topics
Addressing: having global identifiers for identifying
spatial and temporal clips (for deep linking,
bookmarking, caching and indexing)
Metadata: searching and discovering video is
difficult with the volume of online video
Video codec: recommending a baseline (open)
video codec for the World Wide Web
Content protection: managing digital rights
associated with the media is key: W3C should look
into metadata for digital rights
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-6
7. Making video a "first class citizen"
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-7
9. YouTube Temporal Addressing (Sept 2008)
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
-9
10. Media Fragments Use Cases
Bookmark / Share parts (fragments) of
audio/video content
Annotate media fragments
Search for media fragments
Develop Mash-ups/Collage
Conserve bandwidth
http://www.w3.org/TR/media-frags-reqs/
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 10
11. What are Media Fragments?
0
20
“Scared Scene”
t
35
temporal media fragment
named media fragment
spatial media fragment
track media fragment
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 11
12. Media Fragments Dimensions
r01: Temporal fragments:
a clipping along the time dimension from a start to an end time that
are within the duration of the media resource
r02: Spatial fragments:
a clipping of an image region, only consider rectangular regions
r03: Track fragments:
a track as exposed by a container format of the media resource
r04: Named fragments:
A temporal media fragment that has been given a name through
some sort of annotation mechanism
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 12
13. Media Fragments (temporal)
Original resource
length
Fragment beginning
21/10/2013 -
Playback progress
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
Fragment end
- 13
15. URI Scheme
Using URI query part:
http://www.example.org/video.ogv?t=60,100
Using URI fragment part:
http://www.example.org/video.ogv#t=60,100
Mixing both:
http://www.example.org/video.ogv?t=60,100
#t=10,15
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 15
16. URI Fragments vs. URI Queries
#t=20,30
?t=20,30
secondary resource,
primary resource,
notion of context
no notion of context
extraction needs to be no adaptation restrictions
expressible in byte ranges
key-value pairs are sent to
no provisions for
the server
communi-cating
fragments to the server
potentially cacheable
not cacheable
The media fragment URI syntax can be used
for URI queries
We will focus on URI fragments
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 16
17. Media Fragments Resolution
For the URI query part:
The media file is only processed on server side
The UA receives a new video file
For the URI fragment part:
Smart UA will strip out the fragment definition and
encode it into custom http headers (Range header)
(Media) Servers will handle the request, slice the media
content and serve just the fragment (corresponding byte
ranges)
… while old ones will serve the whole resource
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 17
18. Media Fragments Resolution
2 ways
handshake
4 ways
handshake
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 18
19. Influence of Media Formats
Fragment extraction needs to be expressible in
terms of byte ranges
Requirements for the different axes
temporal: presence of intra-coded frames
(i.e., random access points)
spatial: presence of independently coded spatial regions
track: need to be identifiable by a name
Conclusion: temporal and track axes are
realistic, spatial fragments can hardly be
expressed in terms of byte ranges
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 19
20. Media Fragment Clients
Web Browsers
Firefox (since version 9, now version 23)
Safari (since Jan 2012, announcement)
Chrome (since Jan 2012, announcement)
Library (or Polyfill)
mediafragment.js:
https://github.com/tomayac/Media-Fragments-URI
xywh.js: https://github.com/tomayac/xywh.js
Custom Players:
Ligne de Temps: http://ldt.iri.centrepompidou.fr/ldtplatform/ldt/
Synote: http://smfplayer.synote.org/smfplayer/
Noterik, Condat, JSI, etc.
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 20
21. Media Fragment Servers
Ninsuna: http://ninsuna.elis.ugent.be/MediaFragmentsServer
Southampton-Eurecom: node.js based
implementation
YouTube: partial support, syntax difference
Dailymotion: partial support, syntax difference
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 21
23. Media Fragment Semantic Annotation
Reg1
The "Big Three" at the Yalta
Conference (Wikipedia)
Media Fragment creation: localize a region (person)
Media Fragment annotation (tagging) = interpretation
Winston Churchill, UK Prime Minister, Allied Forces, WWII
Media Fragment semantic annotation
:Reg1 foaf:depicts dbpedia:WinstonChurchill.
dbpedia:Churchill rdfs:label "Winston Churchill";
rdf:type foaf:Person
dbprop:order dbpedia:Prime_Minister_(UK).
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 23
25. Media Fragment Semantic Annotation
Things, not strings!
http://googleblog.blogspot.fr/2012/05/introducing-knowledgegraph-things-not.html
Use knowledge bases (LOD)
Use common
vocabularies (LOV)
Follow the 4
Linked Data principles
Refine the 4 Linked Media principles
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 25
26. Open Annotation Data Model
Specification developed in the W3C Open Annotation
Community Group
http://www.openannotation.org/spec/core/
Core model
OWL vocabulary for representing
and sharing annotation of digital
resources (and their fragment) … in RDF
A body is related to a target
Nature of the annotation changes
according to intention (motivation)
How to annotate
this image?
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 26
27. Semantic Annotation of an Image
http://www.w3.org/community/openannotation/wiki/
SE_Semantically_Tagging_an_Image
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 27
29. Open Video: Annotation Project
http://openvideoannotation.org/
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 29
30. YouTube Annotations
Annotations are clickable text overlays on YouTube videos
Annotations are used to boost engagement, give more
information, and aid in navigation
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 30
31. YouTube Annotations: How To
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 31
33. ... and enrichment for hypervideos
CONCEPT IN
PLAYER
Cubism
Expressionism
Fauvism
FACETS / PROPERTIES OF CONCEPT
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
CONTENT ENRICHMENT
- 33
34. Media Fragments and Annotations
http://data.linkedtv.eu/medi
a/e2899e7f#t=840,900
nerd:Location
Casablanca
nerd:Location
Cafe Rick
nerd:Person
H. Bogart
nerd:Person
I. Bergman
Media Fragment URI 1.0
21/10/2013 -
Chapters
Scenes
Shots
etc…
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 34
37. NER Tools and Web APIs
Standalone software
GATE
Stanford CoreNLP
Temis
http://nerd.eurecom.fr/
Web APIs
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 37
38. NERD: Named Entity Recognition and
Disambiguation
Compare performances of
NER and NEL tools
Understand strengths and weaknesses of different Web APIs
Adapt NER processing to different context
(Learn how to) Combine NER (/ NEL) tools
What is NERD?
ontology1
REST API2
UI3
1
2
21/10/2013 -
http://nerd.eurecom.fr/ontology
http://nerd.eurecom.fr/api/application.wadl
3 http://nerd.eurecom.fr
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 38
40. Media Fragment + Open Annotation + NERD
Locator
MediaResource
Annotation
MediaFragment
Entity
Type
URL (hyperlink)
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 40
42. Linking pieces of knowledge
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 42
43. Linking pieces of knowledge
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 43
44. Towards a Linked Media Layer
Enriching media with media from a closed collection
(e.g. BBC archive)
The MediaEval scenario (~ 1697 hours of archived BBC video)
http://www.multimediaeval.org/mediaeval2013/hyper2013/
Enriching media with content from the open web
LinkedTV scenarios: white listed web sites for each program
Media Collector for Social Media
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 44
45. Media Collector
Composition of media item extractors (12 SNs)
Rely on search APIs (+ a fix 30s timeout window to provide results)
Fallback on screen scraping when necessary (Twitter ecosystem)
Implemented as a NodeJS server
Serialize results in a common schema (JSON)
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 45
47. Media Collector + White List web sites
Q:http://ir.lmcloud.vse.cz:8080/irapi/mediaserver?q=img_title:*Merkel*
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 47
48. Seed video enriched with web content
rbbaktuell_20120809
nerd:Location
Brandenburg
oa
49. Enrichments are Annotations too
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 49
51. TV + Kinect + Web experience
http://www.youtube.com/watch?v=4mSC685AG7k
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 51
52. Take Away Summary
Video is a first class citizen on the Web
Annotations: Ontology and API for Media Resources,
Open Annotation Data Model
Access: Media Fragments URI
NERD platform for extracting key information from textual
resources including video subtitles and microposts
Embrace the Linked Media vision
Publish, re-use, re-purpose and remix media descriptions
Develop links between (part of) media items via their
descriptions
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 52
54. Credits
Giuseppe Rizzo, Vuk Milicic, José Luis Redondo Garcia (EURECOM)
Thomas Steiner (Google Inc.), Yunjia Li (University of Southampton)
Marieke van Erp (Free University of Amsterdam)
Erik Mannens, Davy ven Deursen (iMinds, Uni. Ghent)
Paolo Ciccarese, Robert Sanderson, Herbert Van de Sompel and all
the members of the W3C Open Annotation Community Group
… and many other students
21/10/2013 -
International Workshop on Semantic Music and Media (SMAM) @ISWC 2013
- 54