• Save
Humans & Machines Together
Upcoming SlideShare
Loading in...5
×
 

Humans & Machines Together

on

  • 1,245 views

Keynote at FIAT/IFTA MMC 2013

Keynote at FIAT/IFTA MMC 2013

Statistics

Views

Total Views
1,245
Views on SlideShare
618
Embed Views
627

Actions

Likes
2
Downloads
11
Comments
0

7 Embeds 627

http://lora-aroyo.net 576
http://loraaroyo.wordpress.com 45
http://www.google.com 2
http://lora-aroyo.org 1
http://www.slimbedrijvenvinden.nl&_=1385110417149 HTTP 1
http://www.slimbedrijvenvinden.nl&_=1385110569261 HTTP 1
https://www.google.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Humans & Machines Together Humans & Machines Together Presentation Transcript

    • use cases withsemantics & userinteraction inTV &cultural heritagecollectionsLora Aroyo@laroyoHUMANS & MACHINES TOGETHERFriday, May 17, 13
    • Time-consuming:5 time the video durationCoarse grained:refer to entire videoProfessional vocabulary:experts use a specific vocabularythat is unknown to generalaudiencesOBSERVATION I:VIDEO ANNOTATIONSFriday, May 17, 13
    • People request fragments:broadcast (33%), stories (17%),fragments (49%)Finding fragments longer:stories (2x), fragment (3x)Not finding:35% of clicked resultsnot found by title or termOBSERVATION II:SEARCH BEHAVIORFriday, May 17, 13
    • Improve support forfragment searchtime-based annotationsbridging vocabularygap between searcher& cataloguercrowdsourcing?OBSERVATION III:CHANGE NEEDEDFriday, May 17, 13
    • CULTURAL HERITAGE WITHINVOLVED CONSUMERS &PROVIDERSdata: open, shared & accessibleinfrastructures: interoperablesmart services: relevantcontent in right contextPART IFriday, May 17, 13
    • http://chip-project.orghttp://agora.cs.vu.nlRijksmuseumAmsterdamFriday, May 17, 13
    • http://openimages.euhttp://academia.nlMUNCH projectCHOICE projectNetherlands Institutefor Sound & VisionFriday, May 17, 13
    • EuropeanaCultural Searchhttp://e-culture.multimedian.nlhttp://europeana.eu/portal/thoughtlab.htmlhttp://europeana.euFriday, May 17, 13
    • How to use the CrowdFriday, May 17, 13
    • http://waisda.nlhttp://www.prestoprime.org/@waisdaFriday, May 17, 13
    • Friday, May 17, 13
    • Friday, May 17, 13
    • Friday, May 17, 13
    • Friday, May 17, 13
    • Two PilotsPilot I Pilot IImonths 8 2videos 612 1544players 2000 438tags 420000 172000Friday, May 17, 13
    • On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • time-basedbernhardjust “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googleobjects (57%)westminsterabbeyabbeypriestergeestelijkenhekpaardentochtaankomstkoetskroningmensenmassaparadekroonregenOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlepersons (31%)bernhardjulianaobjects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)engelandpersons (31%)objects (57%)On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Googlelocations (7%)persons (31%)objects (57%) no eventsno scenesOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • just “tags”On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • hye park just “tags”typosOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • just “tags”typosno unique referencesbernhardOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • just “tags”typosno unique referencesbeefeaterno synonymsOn the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011Friday, May 17, 13
    • THE QUALITY OF TAGS?Friday, May 17, 13
    • Tag gardeningannotations for video, fragments & scenesadding types & roles to user tagsmapping tags to concepts, disambiguationspelling correctionssingle & batch tags/video editingFriday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012group by type(faceted)Friday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012conceptsuniquelyidentifiedFriday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012Friday, May 17, 13
    • Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012backgroundinfoFriday, May 17, 13
    • Friday, May 17, 13
    • Friday, May 17, 13
    • Friday, May 17, 13
    • Install Your Own Waisda?Friday, May 17, 13
    • TVWITH INVOLVEDCONSUMERS & PROVIDERS42% UK adults discuss/comment onTV programswhile watching (YouGov Deloitte report,Aug 2010)49% of UKTwitter users useTwitter regularly whenwatchingTV (BBC Audience Research Twitter survey,Aug 2010)PART IIFriday, May 17, 13
    • but ...© VickyBuser, BBCFriday, May 17, 13
    • lost in space© RedBee Slides at MIPCube2012Friday, May 17, 13
    • demand for new experienceFriday, May 17, 13
    • http://notube.tvhttp://www.slideshare.net/NoTubeProject@notubeproject© Dan BrickleyFriday, May 17, 13
    • NoTube’s N-ScreenN-Screendrag & drop, sharing & TV controldrag & drop, shuffle, sharing & TV controlFriday, May 17, 13
    • NoTube’s User ActivitiesaggregateFriday, May 17, 13
    • NoTube’s User InterestsprofileFriday, May 17, 13
    • NoTube’s Beancounteraggregate, analyze & profileFriday, May 17, 13
    • Recommendations in NoTube• surface interesting, new & relevant programs to individual and group users• combine in a complementary way different statistical & semantic approaches• define metrics for, e.g. serendipity, diversity, relevance© Dan BrickleyFriday, May 17, 13
    • • access to basic metadata about programs• links are the basic currency of social media• URIs for the things you watch• links to related Web entities• even a small amount of metadata enables interesting appsOpen Web Standards & DataFriday, May 17, 13
    • • The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behavior & video streams• combine them with enhanced EPG as input for a holistic live-stream data mining analysis• generate a high-quality linked open dataset (LOD) describing live TV programming• market research on viewing behaviorFriday, May 17, 13
    • Michiel HildebrandLotte Belice BaltussenJacco van OssenbruggenMarteen BrinkerinkJohan OomenGuus SchreiberRiste GligorovLora AroyoTHE TEAM@lottebelice@johanoomen@mbrinkerink@laroyo@jrvosse@GuusSchreiber@McHildebrandFriday, May 17, 13
    • THE TEAMFriday, May 17, 13
    • • http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org• @waisda• @prestocenter• @notubeproject• @vistatv• @laroyoQuestionsFriday, May 17, 13