What can users do for multimedia? Lora Aroyo 5 June 2009 Crete, Greece 7 th  International Workshop on Content-Based Multi...
Semantics for Multimedia Access <ul><li>Semantic & annotation search  in enriched museum collections </li></ul><ul><ul><li...
Big Picture: Metadata
Step 1a: Metadata & Enrichment <ul><li>E-Culture: ClioPatria  Open Source </li></ul>http://e-culture.multimedian.nl/softwa...
Step 1b: Metadata & Enrichment <ul><li>NoTube  vocabularies: </li></ul><ul><ul><li>VU event ontology, BBC event ontology, ...
   BBC MMVIII
Big Picture: Tagging
Waisda? Video Tagging Game teachOf/ studentOf Accuracy Serendipity Frequency
www.waisda.nl
www.waisda.nl
www.waisda.nl most used tags discovered tags highest scored tags
Big Picture: Annotations
Annotation with multiple thesauri <ul><li>Rijksmuseum Amsterdam </li></ul><ul><li>Print Room Online </li></ul><ul><li>700....
 
 
 
 
 
Issues of annotation with multiple vocabularies <ul><li>vocabularies  are :  large, heterogenous and overlap ( semantic in...
Big Picture: Recommendations
<ul><li>Personalized semantic news </li></ul><ul><li>Personalized TV guide  with adaptive advertising </li></ul><ul><li>In...
 
Contextualized Content Selection
 
 
SKOS, FOAF & Dublin Core
iFanzy: enriched  Web  TV guide www.ifanzy.nl
iFanzy: enriched  STB  TV guide www.ifanzy.nl
Internet TV in Social Web  Friends following this event Friends following this event Friends following this event Friends ...
Internet TV in Social Web  Friends following this event That was never a corner.. Billy Friends following this event Tom F...
Bean counter & Recommender
Recommendation Explanations
Acknowledgements <ul><li>Kamil Afsar </li></ul><ul><li>Pieter Bellekens </li></ul><ul><li>Dan Brickley </li></ul><ul><li>M...
for more info <ul><li>http://notube.tv </li></ul><ul><li>http://e-culture.multimedian.nl/demo </li></ul><ul><li>http://pre...
Upcoming SlideShare
Loading in …5
×

What can users do for multimedia?

2,477 views

Published on

This is an invited presentation at the Content-based Multimedia Indexing (CBMI) workshop 2009, in Chania, Greece, June 2009

http://www.cbmi2009.org/practitioner

It focusses on the results of the PrestoPrime and NoTube projects

Published in: Technology, Education
  • Be the first to comment

What can users do for multimedia?

  1. 1. What can users do for multimedia? Lora Aroyo 5 June 2009 Crete, Greece 7 th International Workshop on Content-Based Multimedia Indexing (CBMI 2009): Practitioner Session: Multimedia Content Access
  2. 2. Semantics for Multimedia Access <ul><li>Semantic & annotation search in enriched museum collections </li></ul><ul><ul><li>incompleteness, inconsistencies, duplicates </li></ul></ul><ul><ul><li>multinlingual search, alternative spelling, synonyms, link to background knowledge </li></ul></ul><ul><li>User involvement in video tagging </li></ul><ul><ul><li>multinlingual tags, spelling, synonyms, related tags </li></ul></ul><ul><li>Semantic recommendations of enriched TV content and advertisements </li></ul>
  3. 3. Big Picture: Metadata
  4. 4. Step 1a: Metadata & Enrichment <ul><li>E-Culture: ClioPatria Open Source </li></ul>http://e-culture.multimedian.nl/software/ClioPatria.shtml http://e-culture.multimedian.nl/resources/datacloud/
  5. 5. Step 1b: Metadata & Enrichment <ul><li>NoTube vocabularies: </li></ul><ul><ul><li>VU event ontology, BBC event ontology, OntoMedia </li></ul></ul><ul><ul><li>FOAF, World of Trust, SKOS </li></ul></ul><ul><ul><li>IMDB, BBC Music Ontology, BBC Program Ontology </li></ul></ul><ul><ul><li>XMLTV, TVAnytime </li></ul></ul><ul><li>PrestoPrime vocabularies: </li></ul><ul><ul><li>Sound & Vision GTAA </li></ul></ul><ul><ul><li>BBC lonclass </li></ul></ul>
  6. 6.  BBC MMVIII
  7. 7. Big Picture: Tagging
  8. 8. Waisda? Video Tagging Game teachOf/ studentOf Accuracy Serendipity Frequency
  9. 9. www.waisda.nl
  10. 10. www.waisda.nl
  11. 11. www.waisda.nl most used tags discovered tags highest scored tags
  12. 12. Big Picture: Annotations
  13. 13. Annotation with multiple thesauri <ul><li>Rijksmuseum Amsterdam </li></ul><ul><li>Print Room Online </li></ul><ul><li>700.000 prints, drawings, photographs </li></ul>
  14. 19. Issues of annotation with multiple vocabularies <ul><li>vocabularies are : large, heterogenous and overlap ( semantic interoperability required ) </li></ul><ul><li>interface is challenged for: large coverage & effective presentation of results </li></ul><ul><li>images vs videos : </li></ul><ul><ul><li>videos segmentation </li></ul></ul><ul><ul><li>annotation per segment </li></ul></ul><ul><ul><li>aggregate all the annotations together </li></ul></ul><ul><ul><li>previous segments (context for suggestions and disambiguation) </li></ul></ul>
  15. 20. Big Picture: Recommendations
  16. 21. <ul><li>Personalized semantic news </li></ul><ul><li>Personalized TV guide with adaptive advertising </li></ul><ul><li>Internet TV in the Social Web </li></ul>
  17. 23. Contextualized Content Selection
  18. 26. SKOS, FOAF & Dublin Core
  19. 27. iFanzy: enriched Web TV guide www.ifanzy.nl
  20. 28. iFanzy: enriched STB TV guide www.ifanzy.nl
  21. 29. Internet TV in Social Web Friends following this event Friends following this event Friends following this event Friends following this event That was never a corner.. Billy Friends following this event
  22. 30. Internet TV in Social Web Friends following this event That was never a corner.. Billy Friends following this event Tom Full screen Friends following this event
  23. 31. Bean counter & Recommender
  24. 32. Recommendation Explanations
  25. 33. Acknowledgements <ul><li>Kamil Afsar </li></ul><ul><li>Pieter Bellekens </li></ul><ul><li>Dan Brickley </li></ul><ul><li>Maarten Brinkerink </li></ul><ul><li>Rahul Choudhury </li></ul><ul><li>Annelies van Ees </li></ul><ul><li>Michiel Hildebrandt </li></ul><ul><li>Geert-Jan Houben </li></ul><ul><li>Peter Gorgels </li></ul><ul><li>Riste Gligorov </li></ul><ul><li>Annelies Kaptein </li></ul><ul><li>Johan Oomen </li></ul><ul><li>Jacco van Ossenbruggen </li></ul><ul><li>Guus Schreiber </li></ul><ul><li>Natalia Stash </li></ul><ul><li>Just Vervaart </li></ul><ul><li>Yiwen Wang </li></ul>
  26. 34. for more info <ul><li>http://notube.tv </li></ul><ul><li>http://e-culture.multimedian.nl/demo </li></ul><ul><li>http://prestoprime.eu </li></ul><ul><li>http://waisda.nl </li></ul><ul><li>[email_address] </li></ul><ul><li>Lora Aroyo </li></ul>

×