• Save
Humans & Machines Together
Upcoming SlideShare
Loading in...5
×
 

Humans & Machines Together

on

  • 1,289 views

Keynote at FIAT/IFTA MMC 2013

Keynote at FIAT/IFTA MMC 2013

Statistics

Views

Total Views
1,289
Views on SlideShare
650
Embed Views
639

Actions

Likes
2
Downloads
11
Comments
0

8 Embeds 639

http://lora-aroyo.net 576
http://loraaroyo.wordpress.com 56
http://www.google.com 2
http://lora-aroyo.org 1
http://www.slimbedrijvenvinden.nl&_=1385110417149 HTTP 1
http://www.slimbedrijvenvinden.nl&_=1385110569261 HTTP 1
https://www.google.com 1
https://loraaroyo.wordpress.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Humans & Machines Together Humans & Machines Together Presentation Transcript

  • use cases withsemantics & userinteraction inTV &cultural heritagecollectionsLora Aroyo@laroyoHUMANS & MACHINES TOGETHERFriday, May 17, 13
  • Time-consuming:5 time the video durationCoarse grained:refer to entire videoProfessional vocabulary:experts use a specific vocabularythat is unknown to generalaudiencesOBSERVATION I:VIDEO ANNOTATIONSFriday, May 17, 13
  • People request fragments:broadcast (33%), stories (17%),fragments (49%)Finding fragments longer:stories (2x), fragment (3x)Not finding:35% of clicked resultsnot found by title or termOBSERVATION II:SEARCH BEHAVIORFriday, May 17, 13 View slide
  • Improve support forfragment searchtime-based annotationsbridging vocabularygap between searcher& cataloguercrowdsourcing?OBSERVATION III:CHANGE NEEDEDFriday, May 17, 13 View slide
  • CULTURAL HERITAGE WITHINVOLVED CONSUMERS &PROVIDERSdata: open, shared & accessibleinfrastructures: interoperablesmart services: relevantcontent in right contextPART IFriday, May 17, 13
  • http://chip-project.orghttp://agora.cs.vu.nlRijksmuseumAmsterdamFriday, May 17, 13
  • http://openimages.euhttp://academia.nlMUNCH projectCHOICE projectNetherlands Institutefor Sound & VisionFriday, May 17, 13
  • EuropeanaCultural Searchhttp://e-culture.multimedian.nlhttp://europeana.eu/portal/thoughtlab.htmlhttp://europeana.euFriday, May 17, 13
  • How to use the CrowdFriday, May 17, 13
  • http://waisda.nlhttp://www.prestoprime.org/@waisdaFriday, May 17, 13
  • Friday, May 17, 13
  • Friday, May 17, 13
  • Friday, May 17, 13
  • Friday, May 17, 13
  • Two PilotsPilot I Pilot IImonths 8 2videos 612 1544players 2000 438tags 420000 172000Friday, May 17, 13
  • On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • time-basedbernhardjust “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googleobjects (57%)westminsterabbeyabbeypriestergeestelijkenhekpaardentochtaankomstkoetskroningmensenmassaparadekroonregenOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlepersons (31%)bernhardjulianaobjects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)engelandpersons (31%)objects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)persons (31%)objects (57%) no eventsno scenesOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • just “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • hye park just “tags”typosOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • just “tags”typosno unique referencesbernhardOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • just “tags”typosno unique referencesbeefeaterno synonymsOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
  • THE QUALITY OF TAGS?Friday, May 17, 13
  • Tag gardeningannotations for video, fragments & scenesadding types & roles to user tagsmapping tags to concepts, disambiguationspelling correctionssingle & batch tags/video editingFriday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012group by type(faceted)Friday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012conceptsuniquelyidentifiedFriday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
  • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012backgroundinfoFriday, May 17, 13
  • Friday, May 17, 13
  • Friday, May 17, 13
  • Friday, May 17, 13
  • Install Your Own Waisda?Friday, May 17, 13
  • TVWITH INVOLVEDCONSUMERS & PROVIDERS42% UK adults discuss/comment onTV programswhile watching (YouGov Deloitte report,Aug 2010)49% of UKTwitter users useTwitter regularly whenwatchingTV (BBC Audience Research Twitter survey,Aug 2010)PART IIFriday, May 17, 13
  • but ...© VickyBuser, BBCFriday, May 17, 13
  • lost in space© RedBee Slides at MIPCube2012Friday, May 17, 13
  • demand for new experienceFriday, May 17, 13
  • http://notube.tvhttp://www.slideshare.net/NoTubeProject@notubeproject© Dan BrickleyFriday, May 17, 13
  • NoTube’s N-ScreenN-Screendrag & drop, sharing & TV controldrag & drop, shuffle, sharing & TV controlFriday, May 17, 13
  • NoTube’s User ActivitiesaggregateFriday, May 17, 13
  • NoTube’s User InterestsprofileFriday, May 17, 13
  • NoTube’s Beancounteraggregate, analyze & profileFriday, May 17, 13
  • Recommendations in NoTube• surface interesting, new & relevant programs to individual and group users• combine in a complementary way different statistical & semantic approaches• define metrics for, e.g. serendipity, diversity, relevance© Dan BrickleyFriday, May 17, 13
  • • access to basic metadata about programs• links are the basic currency of social media• URIs for the things you watch• links to related Web entities• even a small amount of metadata enables interesting appsOpen Web Standards & DataFriday, May 17, 13
  • • The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behavior & video streams• combine them with enhanced EPG as input for a holistic live-stream data mining analysis• generate a high-quality linked open dataset (LOD) describing live TV programming• market research on viewing behaviorFriday, May 17, 13
  • Michiel HildebrandLotte Belice BaltussenJacco van OssenbruggenMarteen BrinkerinkJohan OomenGuus SchreiberRiste GligorovLora AroyoTHE TEAM@lottebelice@johanoomen@mbrinkerink@laroyo@jrvosse@GuusSchreiber@McHildebrandFriday, May 17, 13
  • THE TEAMFriday, May 17, 13
  • • http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org• @waisda• @prestocenter• @notubeproject• @vistatv• @laroyoQuestionsFriday, May 17, 13