Humans & Machines Together

  • 1,002 views
Uploaded on

Keynote at FIAT/IFTA MMC 2013

Keynote at FIAT/IFTA MMC 2013

More in: Education , Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,002
On Slideshare
0
From Embeds
0
Number of Embeds
5

Actions

Shares
Downloads
11
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. use cases withsemantics & userinteraction inTV &cultural heritagecollectionsLora Aroyo@laroyoHUMANS & MACHINES TOGETHERFriday, May 17, 13
  • 2. Time-consuming:5 time the video durationCoarse grained:refer to entire videoProfessional vocabulary:experts use a specific vocabularythat is unknown to generalaudiencesOBSERVATION I:VIDEO ANNOTATIONSFriday, May 17, 13
  • 3. People request fragments:broadcast (33%), stories (17%),fragments (49%)Finding fragments longer:stories (2x), fragment (3x)Not finding:35% of clicked resultsnot found by title or termOBSERVATION II:SEARCH BEHAVIORFriday, May 17, 13
  • 4. Improve support forfragment searchtime-based annotationsbridging vocabularygap between searcher& cataloguercrowdsourcing?OBSERVATION III:CHANGE NEEDEDFriday, May 17, 13
  • 5. CULTURAL HERITAGE WITHINVOLVED CONSUMERS &PROVIDERSdata: open, shared & accessibleinfrastructures: interoperablesmart services: relevantcontent in right contextPART IFriday, May 17, 13
  • 6. http://chip-project.orghttp://agora.cs.vu.nlRijksmuseumAmsterdamFriday, May 17, 13
  • 7. http://openimages.euhttp://academia.nlMUNCH projectCHOICE projectNetherlands Institutefor Sound & VisionFriday, May 17, 13
  • 8. EuropeanaCultural Searchhttp://e-culture.multimedian.nlhttp://europeana.eu/portal/thoughtlab.htmlhttp://europeana.euFriday, May 17, 13
  • 9. How to use the CrowdFriday, May 17, 13
  • 10. http://waisda.nlhttp://www.prestoprime.org/@waisdaFriday, May 17, 13
  • 11. Friday, May 17, 13
  • 12. Friday, May 17, 13
  • 13. Friday, May 17, 13
  • 14. Friday, May 17, 13
  • 15. Two PilotsPilot I Pilot IImonths 8 2videos 612 1544players 2000 438tags 420000 172000Friday, May 17, 13
  • 16. On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 17. time-basedbernhardjust “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 18. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googleobjects (57%)westminsterabbeyabbeypriestergeestelijkenhekpaardentochtaankomstkoetskroningmensenmassaparadekroonregenOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 19. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlepersons (31%)bernhardjulianaobjects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 20. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)engelandpersons (31%)objects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 21. user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)persons (31%)objects (57%) no eventsno scenesOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 22. just “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 23. hye park just “tags”typosOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 24. just “tags”typosno unique referencesbernhardOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 25. just “tags”typosno unique referencesbeefeaterno synonymsOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • 26. THE QUALITY OF TAGS?Friday, May 17, 13
  • 27. Tag gardeningannotations for video, fragments & scenesadding types & roles to user tagsmapping tags to concepts, disambiguationspelling correctionssingle & batch tags/video editingFriday, May 17, 13
  • 28. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • 29. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012group by type(faceted)Friday, May 17, 13
  • 30. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • 31. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012conceptsuniquelyidentifiedFriday, May 17, 13
  • 32. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • 33. Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012backgroundinfoFriday, May 17, 13
  • 34. Friday, May 17, 13
  • 35. Friday, May 17, 13
  • 36. Friday, May 17, 13
  • 37. Install Your Own Waisda?Friday, May 17, 13
  • 38. TVWITH INVOLVEDCONSUMERS & PROVIDERS42% UK adults discuss/comment onTV programswhile watching (YouGov Deloitte report,Aug 2010)49% of UKTwitter users useTwitter regularly whenwatchingTV (BBC Audience Research Twitter survey,Aug 2010)PART IIFriday, May 17, 13
  • 39. but ...© VickyBuser, BBCFriday, May 17, 13
  • 40. lost in space© RedBee Slides at MIPCube2012Friday, May 17, 13
  • 41. demand for new experienceFriday, May 17, 13
  • 42. http://notube.tvhttp://www.slideshare.net/NoTubeProject@notubeproject© Dan BrickleyFriday, May 17, 13
  • 43. NoTube’s N-ScreenN-Screendrag & drop, sharing & TV controldrag & drop, shuffle, sharing & TV controlFriday, May 17, 13
  • 44. NoTube’s User ActivitiesaggregateFriday, May 17, 13
  • 45. NoTube’s User InterestsprofileFriday, May 17, 13
  • 46. NoTube’s Beancounteraggregate, analyze & profileFriday, May 17, 13
  • 47. Recommendations in NoTube• surface interesting, new & relevant programs to individual and group users• combine in a complementary way different statistical & semantic approaches• define metrics for, e.g. serendipity, diversity, relevance© Dan BrickleyFriday, May 17, 13
  • 48. • access to basic metadata about programs• links are the basic currency of social media• URIs for the things you watch• links to related Web entities• even a small amount of metadata enables interesting appsOpen Web Standards & DataFriday, May 17, 13
  • 49. • The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behavior & video streams• combine them with enhanced EPG as input for a holistic live-stream data mining analysis• generate a high-quality linked open dataset (LOD) describing live TV programming• market research on viewing behaviorFriday, May 17, 13
  • 50. Michiel HildebrandLotte Belice BaltussenJacco van OssenbruggenMarteen BrinkerinkJohan OomenGuus SchreiberRiste GligorovLora AroyoTHE TEAM@lottebelice@johanoomen@mbrinkerink@laroyo@jrvosse@GuusSchreiber@McHildebrandFriday, May 17, 13
  • 51. THE TEAMFriday, May 17, 13
  • 52. • http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org• @waisda• @prestocenter• @notubeproject• @vistatv• @laroyoQuestionsFriday, May 17, 13