Tagasauris is building AI for analyzing video content. They combine human computation, semantics and AI to decompose and describe video content, including schemas, vocabularies and semantics. This information is then stored and can be queried via APIs. The descriptions are continuously enriched through machine learning, expert input and user feedback. One project, called HyperTED, uses these techniques to allow searching and browsing of TED Talks by topic by identifying relevant video segments.

1. HELLO, WE’RE
TAGASAURISWE’RE BUILDING A.I. FOR VIDEO.

2. Users upload 432,000 hours of YouTube video every day,
Source: YouTube

3. ?
EASY. HARD.

4. “Visual” is the new cultural vernacular and that technology can
bridge the gap between people and the overwhelming amount
of content that surrounds their interests and passions, online.
WE BELIEVE …

5. We combine human computation,
semantics and AI in a converged,
cloud-bases platform that provides:
A smart way to decompose and
describe image and video content that
includes schema, vocabularies and
semantics.
A smart way to store the descriptions of
the content including querying and
reasoning via hypermedia APIs.
A process that allows us to
capture consolidated machine,
expert and end user perspectives
for the continuous enrichment
and improvement of the
descriptions of the underlying
content.
HOW DO WE DO THIS?
HUMAN
COMPUTATION
SEMANTICS
AI

6. HyperTED is a research collaboration between Tagasauris, Eurecom and the European MediaMixer and LinkedTV
Projects for Searching and Browsing TED Talks.
WHAT IS HYPERTED?
José Luis Redondo García, Mariella Sabatino, Pasquale Lisena, Raphaël Troncy

7. Searching for the relevant portion of a video by subject or topic is nearly impossible. HyperTED allows us to build an
experience that serves up the relevant portions a TED Talk based on a deep view of the video’s content.
HYPERTED

8. // Media Fragment Specification
// Media Fragment Creation
// Media Fragment Description
CORE TECH

9. // Automatic video scene, shot and concept detection
// An open source media fragments player.
// A node.js media fragments server, named MaFFiN.
CORE TECH

10. LIGHTING UP TED TALKS

11. ANNOTATION MEDIA FRAGMENTS

12. HOT SPOTS: HIGHLIGHTING IMPORTANT FRAGMENTS

13. HYPERLINKING: TED CHAPTERS

14. HYPERLINKING: ONLINE COURSES

15. HyperTED is the technical foundation for next generation digital content owners and media networks. ShopYouTube
demonstrates the impact potential of digital first media by turning YouTube into the Home Shopping Channel.
FUTURE DIRECTION:

16. ANY QUESTIONS?
THANK YOU.
-