use cases withsemantics & userinteraction inTV &cultural heritagecollectionsLora Aroyo@laroyoHUMANS & MACHINES TOGETHERFri...
Time-consuming:5 time the video durationCoarse grained:refer to entire videoProfessional vocabulary:experts use a specific ...
People request fragments:broadcast (33%), stories (17%),fragments (49%)Finding fragments longer:stories (2x), fragment (3x...
Improve support forfragment searchtime-based annotationsbridging vocabularygap between searcher& cataloguercrowdsourcing?O...
CULTURAL HERITAGE WITHINVOLVED CONSUMERS &PROVIDERSdata: open, shared & accessibleinfrastructures: interoperablesmart serv...
http://chip-project.orghttp://agora.cs.vu.nlRijksmuseumAmsterdamFriday, May 17, 13
http://openimages.euhttp://academia.nlMUNCH projectCHOICE projectNetherlands Institutefor Sound & VisionFriday, May 17, 13
EuropeanaCultural Searchhttp://e-culture.multimedian.nlhttp://europeana.eu/portal/thoughtlab.htmlhttp://europeana.euFriday...
How to use the CrowdFriday, May 17, 13
http://waisda.nlhttp://www.prestoprime.org/@waisdaFriday, May 17, 13
Friday, May 17, 13
Friday, May 17, 13
Friday, May 17, 13
Friday, May 17, 13
Two PilotsPilot I Pilot IImonths 8 2videos 612 1544players 2000 438tags 420000 172000Friday, May 17, 13
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2...
time-basedbernhardjust “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conf...
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googleobjects (57%)westminsterabbeyabbeypries...
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlepersons (31%)bernhardjulianaobjects (57...
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)engelandpersons (31%)obje...
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)persons (31%)objects (57%...
just “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledg...
hye park just “tags”typosOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conferen...
just “tags”typosno unique referencesbernhardOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al....
just “tags”typosno unique referencesbeefeaterno synonymsOn the Role of User-Generated Metadata in A/V CollectionsRiste Gli...
THE QUALITY OF TAGS?Friday, May 17, 13
Tag gardeningannotations for video, fragments & scenesadding types & roles to user tagsmapping tags to concepts, disambigu...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedi...
Friday, May 17, 13
Friday, May 17, 13
Friday, May 17, 13
Install Your Own Waisda?Friday, May 17, 13
TVWITH INVOLVEDCONSUMERS & PROVIDERS42% UK adults discuss/comment onTV programswhile watching (YouGov Deloitte report,Aug ...
but ...© VickyBuser, BBCFriday, May 17, 13
lost in space© RedBee Slides at MIPCube2012Friday, May 17, 13
demand for new experienceFriday, May 17, 13
http://notube.tvhttp://www.slideshare.net/NoTubeProject@notubeproject© Dan BrickleyFriday, May 17, 13
NoTube’s N-ScreenN-Screendrag & drop, sharing & TV controldrag & drop, shuffle, sharing & TV controlFriday, May 17, 13
NoTube’s User ActivitiesaggregateFriday, May 17, 13
NoTube’s User InterestsprofileFriday, May 17, 13
NoTube’s Beancounteraggregate, analyze & profileFriday, May 17, 13
Recommendations in NoTube• surface interesting, new & relevant programs to individual and group users• combine in a comple...
• access to basic metadata about programs• links are the basic currency of social media• URIs for the things you watch• li...
• The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behav...
Michiel HildebrandLotte Belice BaltussenJacco van OssenbruggenMarteen BrinkerinkJohan OomenGuus SchreiberRiste GligorovLor...
THE TEAMFriday, May 17, 13
• http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org• @waisda• @prestoce...
Upcoming SlideShare
Loading in...5
×

Humans & Machines Together

1,124

Published on

Keynote at FIAT/IFTA MMC 2013

Published in: Education, Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,124
On Slideshare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
11
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Transcript of "Humans & Machines Together"

  1. 1. use cases withsemantics & userinteraction inTV &cultural heritagecollectionsLora Aroyo@laroyoHUMANS & MACHINES TOGETHERFriday, May 17, 13
  2. 2. Time-consuming:5 time the video durationCoarse grained:refer to entire videoProfessional vocabulary:experts use a specific vocabularythat is unknown to generalaudiencesOBSERVATION I:VIDEO ANNOTATIONSFriday, May 17, 13
  3. 3. People request fragments:broadcast (33%), stories (17%),fragments (49%)Finding fragments longer:stories (2x), fragment (3x)Not finding:35% of clicked resultsnot found by title or termOBSERVATION II:SEARCH BEHAVIORFriday, May 17, 13
  4. 4. Improve support forfragment searchtime-based annotationsbridging vocabularygap between searcher& cataloguercrowdsourcing?OBSERVATION III:CHANGE NEEDEDFriday, May 17, 13
  5. 5. CULTURAL HERITAGE WITHINVOLVED CONSUMERS &PROVIDERSdata: open, shared & accessibleinfrastructures: interoperablesmart services: relevantcontent in right contextPART IFriday, May 17, 13
  6. 6. http://chip-project.orghttp://agora.cs.vu.nlRijksmuseumAmsterdamFriday, May 17, 13
  7. 7. http://openimages.euhttp://academia.nlMUNCH projectCHOICE projectNetherlands Institutefor Sound & VisionFriday, May 17, 13
  8. 8. EuropeanaCultural Searchhttp://e-culture.multimedian.nlhttp://europeana.eu/portal/thoughtlab.htmlhttp://europeana.euFriday, May 17, 13
  9. 9. How to use the CrowdFriday, May 17, 13
  10. 10. http://waisda.nlhttp://www.prestoprime.org/@waisdaFriday, May 17, 13
  11. 11. Friday, May 17, 13
  12. 12. Friday, May 17, 13
  13. 13. Friday, May 17, 13
  14. 14. Friday, May 17, 13
  15. 15. Two PilotsPilot I Pilot IImonths 8 2videos 612 1544players 2000 438tags 420000 172000Friday, May 17, 13
  16. 16. On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  17. 17. time-basedbernhardjust “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  18. 18. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googleobjects (57%)westminsterabbeyabbeypriestergeestelijkenhekpaardentochtaankomstkoetskroningmensenmassaparadekroonregenOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  19. 19. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlepersons (31%)bernhardjulianaobjects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  20. 20. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)engelandpersons (31%)objects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  21. 21. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)persons (31%)objects (57%) no eventsno scenesOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  22. 22. just “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  23. 23. hye park just “tags”typosOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  24. 24. just “tags”typosno unique referencesbernhardOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  25. 25. just “tags”typosno unique referencesbeefeaterno synonymsOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  26. 26. THE QUALITY OF TAGS?Friday, May 17, 13
  27. 27. Tag gardeningannotations for video, fragments & scenesadding types & roles to user tagsmapping tags to concepts, disambiguationspelling correctionssingle & batch tags/video editingFriday, May 17, 13
  28. 28. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  29. 29. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012group by type(faceted)Friday, May 17, 13
  30. 30. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  31. 31. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012conceptsuniquelyidentifiedFriday, May 17, 13
  32. 32. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  33. 33. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012backgroundinfoFriday, May 17, 13
  34. 34. Friday, May 17, 13
  35. 35. Friday, May 17, 13
  36. 36. Friday, May 17, 13
  37. 37. Install Your Own Waisda?Friday, May 17, 13
  38. 38. TVWITH INVOLVEDCONSUMERS & PROVIDERS42% UK adults discuss/comment onTV programswhile watching (YouGov Deloitte report,Aug 2010)49% of UKTwitter users useTwitter regularly whenwatchingTV (BBC Audience Research Twitter survey,Aug 2010)PART IIFriday, May 17, 13
  39. 39. but ...© VickyBuser, BBCFriday, May 17, 13
  40. 40. lost in space© RedBee Slides at MIPCube2012Friday, May 17, 13
  41. 41. demand for new experienceFriday, May 17, 13
  42. 42. http://notube.tvhttp://www.slideshare.net/NoTubeProject@notubeproject© Dan BrickleyFriday, May 17, 13
  43. 43. NoTube’s N-ScreenN-Screendrag & drop, sharing & TV controldrag & drop, shuffle, sharing & TV controlFriday, May 17, 13
  44. 44. NoTube’s User ActivitiesaggregateFriday, May 17, 13
  45. 45. NoTube’s User InterestsprofileFriday, May 17, 13
  46. 46. NoTube’s Beancounteraggregate, analyze & profileFriday, May 17, 13
  47. 47. Recommendations in NoTube• surface interesting, new & relevant programs to individual and group users• combine in a complementary way different statistical & semantic approaches• define metrics for, e.g. serendipity, diversity, relevance© Dan BrickleyFriday, May 17, 13
  48. 48. • access to basic metadata about programs• links are the basic currency of social media• URIs for the things you watch• links to related Web entities• even a small amount of metadata enables interesting appsOpen Web Standards & DataFriday, May 17, 13
  49. 49. • The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behavior & video streams• combine them with enhanced EPG as input for a holistic live-stream data mining analysis• generate a high-quality linked open dataset (LOD) describing live TV programming• market research on viewing behaviorFriday, May 17, 13
  50. 50. Michiel HildebrandLotte Belice BaltussenJacco van OssenbruggenMarteen BrinkerinkJohan OomenGuus SchreiberRiste GligorovLora AroyoTHE TEAM@lottebelice@johanoomen@mbrinkerink@laroyo@jrvosse@GuusSchreiber@McHildebrandFriday, May 17, 13
  51. 51. THE TEAMFriday, May 17, 13
  52. 52. • http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org• @waisda• @prestocenter• @notubeproject• @vistatv• @laroyoQuestionsFriday, May 17, 13

×