HyperTED is a web application able to browse through media fragments of TED Talks and recommend them thanks to Semantic Entities extracted from their subtitles. HyperTED was a teamwork project that I developed during my Erasmus Internship in Eurecom (Sophia Antipolis, France) in order to write my Master Thesis.

1. MARIELLA SABATINO GO!
insert a candidate
Master Degree course in
Cinema and Media Enginereeng
Fulvio Corno Raphaël Troncy
Josè Luis Redondo García

2. 2
1984
2006
2014
.com
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

3. 3
Users
overwhelmed
with audio-visual
content
Which are the
relevant
fragments for the
user?
How can users easily find
related documents which
complement the video?
Can the video
be divided into
meaningful
fragments?
How can those
fragments be
properly
described?
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

4. Hyperlinking
Hyperlinking
Hyperlinking
4
Media Fragment
support
Media Fragment
annotation
Hyperlinking
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

5. 5
how to recommend related media fragments within the same video collection
1 2 3
detecting segments
of interest within a
video
recommending
related media
fragments within the
same video collection
design a web
application that
provides a rich
environment for
exploring a video
collection
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

6. Hyperlinking
6
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
Sections along the time
dimension of the media
resource with a start and an
end point.
A specific part of a
multimedia object.
http://www.w3.org/TR/media-frags/

7. 7
TED Talks provide paragraphs:
a human-made subdivision of subtitles.
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

8. 8
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
locating and classifying
elements of textual
documents into
pre-defined categories
2 31
assigning a specific
linguistic meaning
between many
possibilities

9. 9
“This is Nikita, a security guard from one of the bars
in St. Petersburg.” NER
PERSON
FUNCTION
LOCATION
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

10. 10
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
St. Petersburg, Russia St. Petersburg, Florida
St. Petersburg, Pennsylvania St. Petersburg, Missouri (fictional)
NLP

11. Hyperlinking
Web Tools that expose
NER algorithms.
11
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
Combines different NER tools available on Web
Unifies NER extractors in a common output
http://nerd.eurecom.fr/

12. 2 31
10
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
30 TED Talks fraction of retrieved
documents that are relevant
10
Selection of the meaningful
concepts on the subtitles;
Run of each extractor;
Comparison of the results.
fraction of relevant
documents that are retrieved
level of accuracy
considering both

13. 13
AlchemyAPI 0,20 0,08 0,113
DataTXT 0,19 0,34 0,241
DBpedia Spotlight 0,14 0,33 0,192
OpenCalais 0,32 0,11 0,169
Saplo 0,00 0,00 -
TextRazor 0,17 0,36 0,228
THD 0,15 0,08 0,106
Yahoo! Content Analysis 0,31 0,05 0,086
Zemanta 0,41 0,10 0,155
Combined 0,12 0,45 0,195
2 31
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
Relevance score
Disambiguation URL
Abstract
Topics

14. 14
“I'm wearing a camera, just a simple webcam, a portable, battery-powered
projection system with a little mirror. These components communicate to my cell
phone in my pocket which acts as the communication and computation device.
And in the video here we see my student Pranav Mistry, who's really the genius
who's been implementing and designing this whole system...”
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

15. 15
2 31
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
Clustering of consecutive Chapters with
similar annotations
Ordering based on relevance
Filtering the 1st quarter of relevance score

16. 16
how to recommend related media fragments within the same video collection
1 2 3
detecting segments
of interest within a
video
recommending
related media
fragments within the
same video collection
design a web
application that
provides a rich
environment for
exploring a video
collection
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

17. 17
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
Open-source search engine
Document oriented
Comparable to a Relational DB
Query DSL based on JSON

18. 18
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
Topics and Entities
timing references
UUID of the resource
Relevance
Meaning of the Talk
Chapter

19. 17
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31
Topics
Courses about the same thematic
Entities
Too specific
Open Courseware
Open University

20. 20
Interlinking through
chapters and
topic
Interlinking to
openCourseware
and
openUniversity
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

21. 21
how to recommend related media fragments within the same video collection
1 2 3
detecting segments
of interest within a
video
recommending
related media
fragments within the
same video collection
design a web
application that
provides a rich
environment for
exploring a video
collection
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

22. 22
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

23. 23
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
2 31

24. 24
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
Detection of chapters working with TED APIs
Evaluation of some of the main NER Extractors
Hyperlinking between chapters and topics using elasticsearch
Building of a Responsive and Web compliant UI
LinkedUp Vici Competition top ten of the submissions.
Redondo García, Sabatino, Lisena and Troncy, Detecting Hot Spots in
Web Videos. In ISWC’14, Demo Track, Riva del Garda, Italy, 2014.
http://ceur-ws.org/Vol-1272/paper_111.pdf

25. 25
Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks