Media Distillery Live monitoring van radio en TV
Founded by Geert Vos and Joost de Wit
Media Distillery is part of tech incubator YES!Delft
MKB Innovation Top 100, 2015
Placed 14th
LiveWIRE Award 2015
Top 8
Sprout Startup of the Year 2014
Top 5
Accenture Innovation Awards 2014
Top 10
New Venture
Top 10 in round 1 and 2
There’s more and more video content
Source: http://www.youtube.com/yt/press/statistics.html
100 hours of video are uploaded to
YouTube every minute
300.000.000views / year
Source: http://www-assets.npo.nl/uploads/media_item/media_item/99/13/Jaarverslag_2014-1435691079.pdf
Video already ‘consumes’ 2/3 of the Internet traffic
VideoOther
Source: http://www.cisco.com/c/en/us/solutions/service-provider/visual-networking-index-vni/index.html#~complete-forecast
200
min /
day
Source: https://kijkonderzoek.nl/images/SKO_Jaarrapport/SKO_jaarrapport_2014.pdf
But we still can’t search in video content!
Adding metadata used to be manual labour
Until now…
We use advanced data mining to analyse video
Both broadcast & on-line sources
Teletext
Speech
Subtitles
Logos
Faces
Being developed
Analyze
Live
metadata
Search in live
TV & radio
Create archive
Search Keep
Media Monitoring Content Owners
Brand Monitoring
!
Competitor Monitoring
!
Crisis Monitoring
!
Campaign Monitoring
Enhanced metadata
!
Advanced content
search
!
Quality content
recommendations
26 Dutch radio and TV channels
Both national and regional
150 news and newsreel programs / day
“Voedselverpakkingen van gerecycled karton zijn gevaarlijk,
er kunnen resten van olie in zitten.”
27-10-2015 14:00
RTL Z Nieuws
Dieselschandaal Volkswagen
Ook in de 3-liter motor
blijkt sjoemelsoftware te zitten
Ook in Europa blijkt Volkswagen te sjoemelen
met de uitstoot van hun dieselmotoren
Volkswagen geeft toe dat ze testresultaten
hebben beïnvloed in de VS
Alle dieselauto’s met sjoemelsoftware moeten
verplicht worden teruggehaald
75% of the content watched by users was
recommended to them
Source: http://www.mckinsey.com/insights/consumer_and_retail/how_retailers_can_keep_up_with_consumers
Suggested content accounts for about 60% of
all video clicks
Source:http://stuyresearch.googlecode.com/hg-history/.../blake/resources/p293-davidson.pdf
Watskeburt?! — Koppensnellen voor video
Blueprint plaatje
Blueprint of a large scale video search platform
Rich metadata
NOS JournaalEPG
Speech
Logo
Topic
Het Nederlands elftal is voor een
Het Nederlands elftal is voor een
ING
Voetbal
1 + 1 = 3
Content

Service
Notification
Service
Search

Service
Metadata

Service
Media Distillery

Dashboard
BNR
Trends &
Tagcloud

Service
Large Scale 

Video Storage
Video Search
Engine
Teletext

Extractor
Speech

Recognizer
Subtitle

Extractor
Logo

Recognizer
Face

Recognizer
Uitzending

Gezocht
ingest
search index
video cluster
backup server
image processing
speech recognition
VM’s
ROI selection
Text extraction
OCR
Utterance detection
Garbage detection
Sasha
Obama
Challenges
Realtime constraint
Quality Cost
de NS > Dennis Artis > Wacht’s
Dialect Generieke merken
Future developments
Case: Logo Recognition using ‘conventional’ SIFT
MatchSelectDescribe
Case: Logo Recognition using ‘conventional’ SIFT
Time
0
25
50
75
100
#logo’s
0 25 50 75 100
Deep Learning Logo Recognition
• KPN
• Jumbo
• ING
• Philips
• Shell
• Volkswagen
• AEGON
• …
New
Face Recognition
Text in the wild
Ad Detection
!
Improve
Speech Recognition
Subtitle Extraction
Logo Recognition
Any questions?
Joost de Wit
06-50983893
joost@mediadistillery.tv
Geert Vos
06-41554428
geert@mediadistillery.tv

Master Minds on Data Science - Joost de Wit