What can users do for multimedia?

What can users do for multimedia? Lora Aroyo 5 June 2009 Crete, Greece 7 th International Workshop on Content-Based Multimedia Indexing (CBMI 2009): Practitioner Session: Multimedia Content Access

Semantics for Multimedia Access
Semantic & annotation search in enriched museum collections
incompleteness, inconsistencies, duplicates
multinlingual search, alternative spelling, synonyms, link to background knowledge
User involvement in video tagging
multinlingual tags, spelling, synonyms, related tags
Semantic recommendations of enriched TV content and advertisements

Big Picture: Metadata

Step 1a: Metadata & Enrichment
E-Culture: ClioPatria Open Source
http://e-culture.multimedian.nl/software/ClioPatria.shtml http://e-culture.multimedian.nl/resources/datacloud/

Step 1b: Metadata & Enrichment
NoTube vocabularies:
VU event ontology, BBC event ontology, OntoMedia
FOAF, World of Trust, SKOS
IMDB, BBC Music Ontology, BBC Program Ontology
XMLTV, TVAnytime
PrestoPrime vocabularies:
Sound & Vision GTAA
BBC lonclass

 BBC MMVIII

Big Picture: Tagging

Waisda? Video Tagging Game teachOf/ studentOf Accuracy Serendipity Frequency

www.waisda.nl

www.waisda.nl most used tags discovered tags highest scored tags

Big Picture: Annotations

Annotation with multiple thesauri
Rijksmuseum Amsterdam
Print Room Online
700.000 prints, drawings, photographs

Issues of annotation with multiple vocabularies
vocabularies are : large, heterogenous and overlap ( semantic interoperability required )
interface is challenged for: large coverage & effective presentation of results
images vs videos :
videos segmentation
annotation per segment
aggregate all the annotations together
previous segments (context for suggestions and disambiguation)

Big Picture: Recommendations

Personalized semantic news
Personalized TV guide with adaptive advertising
Internet TV in the Social Web

Contextualized Content Selection

SKOS, FOAF & Dublin Core

iFanzy: enriched Web TV guide www.ifanzy.nl

iFanzy: enriched STB TV guide www.ifanzy.nl

Internet TV in Social Web Friends following this event Friends following this event Friends following this event Friends following this event That was never a corner.. Billy Friends following this event

Internet TV in Social Web Friends following this event That was never a corner.. Billy Friends following this event Tom Full screen Friends following this event

Bean counter & Recommender

Recommendation Explanations

Acknowledgements
Kamil Afsar
Pieter Bellekens
Dan Brickley
Maarten Brinkerink
Rahul Choudhury
Annelies van Ees
Michiel Hildebrandt
Geert-Jan Houben
Peter Gorgels
Riste Gligorov
Annelies Kaptein
Johan Oomen
Jacco van Ossenbruggen
Guus Schreiber
Natalia Stash
Just Vervaart
Yiwen Wang

for more info
http://notube.tv
http://e-culture.multimedian.nl/demo
http://prestoprime.eu
http://waisda.nl
[email_address]
Lora Aroyo

What can users do for multimedia?

by Lora Aroyo on Jun 09, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

What can users do for multimedia? — Presentation Transcript