SAMT 2009 Johan Oomen

Johan Oomen Netherlands Institute for Sound and Vision [email_address] Netherlands Institute for Sound and Vision: how users help multimedia IR (and vice versa)

5 december 2009 5 december 2009 Nederlands Instituut voor Beeld en Geluid

5 december 2009 5 december 2009

Images for the Future To optimize the availability of the audiovisual heritage. By developing innovative services and applications, education, the public and the creative sector will be offered a vast improvement in their possibility to profit from the various values of the audiovisual heritage Target groups
Education
Public
Creative Industry

Images for the Future Consortium

6 partners Mass digitisation
Images for the future is digitising:
137.200 hrs video
22.510 hrs film
123.900 hrs audio
2.900.000 photographs
Total costs:
€ 173 million in 7 year

<1,5 petabyte annually

(import) metadata (import) content metadata (conversions) content (encoding) Digital Archive Digital Born 15.000 hours of video 40.000 hours of radio Legacy Asset management Education Exhibitions Public Web Acces User generated content and metadata Broadcast Professional

Educational media platform (www.ed-it.nu)

Open Images (www.openimages.eu)

Video Active (www.videoactive.eu)

Footage sales platform (www.dutchfootage.com)

July 09, 09 5

Query Log Analyses
18 November 2008 t/m 15 May 2009
46.437 visits
290.429 queries
315.601 result clicks
27.246 ordered items
Bouke Huurnink, Laura Holling, Wietske van den Heuvel. The Search Behavior of Media Professionals at an Audiovisual Archive: A Transaction Log Analysis. Published in 2010 Netherlands Institute for Sound and Vision

What do people search for?
96% free text
23% date filter
9% thesaurus terms
Netherlands Institute for Sound and Vision

21/09/09 What do people search for (cont.)? Netherlands Institute for Sound and Vision

21/09/09 Types of ordes Netherlands Institute for Sound and Vision

Some statistics In: Huurnink, Hollink, van Den Heuvel 2009 (submitted)

People are looking for fragmenrs
… but the metadata is only covering whole programmes…
… from observations: in-video search is time consuming…

1. Speech to text

New technlogies
21/09/09 2. Video Labeling Game

Time-related metadata
Social tagging ( bridging the semantic gap )
Interaction between the archive /broadcaster and the public
Added value

Netherlands Institute for Sound and Vision (project management, content, research)
KRO (concept, content, PR)
VU (research within PrestoPRIME)
Q42 (developer)
Project partners

The goal of the game is consensus between players (which also works as filter)
Fun and competition as motivation
Almost 600 hours of material / 2.400+ items
Set-up

How does it work? Players can choose from four ‘channels’ that contain different programmes

How does it work? In the game channel players enter tags that decribe what they see and hear

How does it work?
Scoring:
Basic rule – players score points when their tag exactly matches the tag entered by another player within 10 seconds
Multiple other scoring mechanisms to create various tag incentives

Experiences
Since the launch in May 2009:
39.134 pageviews
10.926 visits ( 3+ min online)
404 registered players (but thousands of anonymous players!)
602 tagged items / 160k tags
Many matches between the thesaurus of Sound and Vision and Dutch WordNet

Generating a constant flow of traffic is a challenge ! But recently: great boost through Farmer seeks a Wife website

Waisda? Retieval interface
Inholland screenshot

3. Visual Concept detectors
Hollands Glorie op Pinkpop

[email_address]
Twitter: johanoomen

SAMT 2009 Johan Oomen

by Johan Oomen on Dec 05, 2009

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 6

Statistics

SAMT 2009 Johan Oomen — Presentation Transcript