• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Personalizing Media Interaction on the (Semantic & Social) Web
 

Personalizing Media Interaction on the (Semantic & Social) Web

on

  • 626 views

This presentation was given at IBM Research, NY, 3 Oct 2012

This presentation was given at IBM Research, NY, 3 Oct 2012

Statistics

Views

Total Views
626
Views on SlideShare
626
Embed Views
0

Actions

Likes
0
Downloads
14
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Personalizing Media Interaction on the (Semantic & Social) Web Personalizing Media Interaction on the (Semantic & Social) Web Presentation Transcript

    • © Kierstin Shaylee Personalizing Media Interaction on the Web Lora AroyoWednesday, October 3, 12 1
    • “interface is the message” Aaron Koblin: Artfully visualizing our humanity, TED Talk, 2011 Lora Aroyo twitter: @laroyoWednesday, October 3, 12 2
    • it’s complicated Lora Aroyo twitter: @laroyoWednesday, October 3, 12 3
    • HCI challenges semantics user data pe int rs er on ac tio ali n za tio n Lora Aroyo twitter: @laroyo Flickr: elkabongWednesday, October 3, 12 4
    • semantic HCI challenge • explicit semantics (often from open sources, e.g. LOD) used for system decisions and results • use facetted presentation, searching and browsing of information • use typically classifications, typologies or other structures of concepts • integrate & aggregate data from different sources Lora Aroyo twitter: @laroyoWednesday, October 3, 12 5
    • Wednesday, October 3, 12 6
    • Wednesday, October 3, 12 6
    • Wednesday, October 3, 12 6
    • user data HCI challenge Lora Aroyo twitter: @laroyoWednesday, October 3, 12 7
    • interaction HCI challenge • search, e.g. keyword, faceted • browse, story lines, narratives through collections • annotations of multimedia, e.g. (collaborative) tagging, professional annotation of text, images and video, tagging games • explanations, hints, user feedback, e.g. explanation of recommendation results, explanation of autocompletion suggestions Lora Aroyo twitter: @laroyoWednesday, October 3, 12 8
    • interaction with semantics Lora Aroyo twitter: @laroyoWednesday, October 3, 12 9
    • http://twitpic.com/il1w/full ©  BBC  MMVIIIWednesday, October 3, 12 10
    • http://www.bbc.co.uk/programmes/b00c06n2.rdf Lora Aroyo twitter: @laroyoWednesday, October 3, 12 11
    • personalization challenge • data challenges multiply with Web openness • social recommendations are preferred • it is not about (single) algorithms any more • it is about the metrics Lora Aroyo twitter: @laroyoWednesday, October 3, 12 12
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 13
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 14
    • Wednesday, October 3, 12 15
    • Wednesday, October 3, 12 15
    • Wednesday, October 3, 12 15
    • Wednesday, October 3, 12 15
    • applicationsWednesday, October 3, 12 16
    • personalized TV © Ugli. on the Walls of BBC LondonWednesday, October 3, 12 17
    • User Perspective • what is the role of social recommendations? • how do people watch TV together? • how devices influence watching? • what are perceived trade-offs for privacy vs. personalization?Wednesday, October 3, 12 18
    • Technology Perspective • what is the role of metadata in TV & Apps? • what are ways to share information in real time? • what are ways to sync TV & other metadata? • what is an easy way for devices to find & talk to each other?Wednesday, October 3, 12 19
    • © VickyBuser, BBC choices, choices ...Wednesday, October 3, 12 20
    • © RedBee Slides at MIPCube2012 lost in spaceWednesday, October 3, 12 21
    • © RedBee Slides at MIPCube2012 always missing somethingWednesday, October 3, 12 22
    • demand for experienceWednesday, October 3, 12 23
    • © RedBee Slides at MIPCube2012Wednesday, October 3, 12 24
    • © Ericsson ComsumerLab: TV & Web Consumer Trends 2011 Social RecommendationsWednesday, October 3, 12 25
    • I usually find NEW programmes to watch by: © NoTube Studies @ BBC RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012 Social RecommendationsWednesday, October 3, 12 26
    • I usually find NEW programmes to watch by: © NoTube Studies @ BBC Social TV RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012 RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012 Social RecommendationsWednesday, October 3, 12 26
    • Wednesday, October 3, 12 27
    • Wednesday, October 3, 12 27
    • Wednesday, October 3, 12 27
    • Wednesday, October 3, 12 27
    • Wednesday, October 3, 12 27
    • interface explorationsWednesday, October 3, 12 28
    • Wednesday, October 3, 12 29
    • Wednesday, October 3, 12 29
    • Wednesday, October 3, 12 30
    • Wednesday, October 3, 12 30
    • Linking Web Data to User ProfilesWednesday, October 3, 12 31
    • TV Preferences • Inferred from the Social Web • tweets, FB likes, last.fm listened, etc. • weighted interests • Represented using Linked Data web identifiers • record-linkage: facebook.com/pages/ dbpedia.org/ • NLP: #littlebritain http://dbpedia.org/resource/Matt_Lucas http://dbpedia.org/resource/David_WalliamsWednesday, October 3, 12 32
    • TV Preferences • Inferred from the Social Web • tweets, FB likes, last.fm listened, etc. • weighted interests • Represented using Linked Data web identifiers • record-linkage: facebook.com/pages/ dbpedia.org/ • NLP: #littlebritain Brilliant british humor by Matt Lucas & David Walliams - whole range of facinating characters portraying diversity of british society http://dbpedia.org/resource/Matt_Lucas http://dbpedia.org/resource/David_WalliamsWednesday, October 3, 12 32
    • http://xmlns.notu.be/aair/Wednesday, October 3, 12 33
    • http://xmlns.notu.be/aair/Wednesday, October 3, 12 33
    • http://xmlns.notu.be/wiWednesday, October 3, 12 33
    • http://xmlns.notu.be/wiWednesday, October 3, 12 33
    • Wednesday, October 3, 12 34
    • Semantic Content Semantic Patterns for Pattern-based TV Programs Recommendation EPG Metadata TV Program Strategy (BBC) Enrichment RDF Graph Statistical TV Recommendation Similarity-based Programs Service Recommendation Strategy User Ratings & Demographics User Data Similarity (BBC EPG Analysis Clusters Hybrid Data) of Programs Recommendation Strategy End End-Users UsersWednesday, October 3, 12 35
    • NoTube’s Beancounter aggregate, analyze & profileWednesday, October 3, 12 36
    • NoTube’s User Activities aggregateWednesday, October 3, 12 37
    • NoTube’s User Interests profileWednesday, October 3, 12 38
    • NoTube’s User Interests analyzeWednesday, October 3, 12 39
    • NoTube’s User Explanations controlWednesday, October 3, 12 40
    • Recommendations in NoTube © Dan Brickley • surface interesting, new & relevant programs to individual and group users • combine in a complementary way different statistical & semantic approaches • define metrics for, e.g. serendipity, diversity, relevanceWednesday, October 3, 12 41
    • From Predictability to SerendipityWednesday, October 3, 12 42
    • From Predictability to Serendipity Secret Paul Merton Gardens looks at Alfred Hitchcock Make ‘em laughWednesday, October 3, 12 42
    • From Predictability to Serendipity format at documentary Secret form form Paul Merton at Gardens looks at Alfred Hitchcock Make ‘em laughWednesday, October 3, 12 42
    • From Predictability to Serendipity at documentary format Secret Basic patterns form form Paul Merton at Gardens genre looks at art culture ge genre nr Alfred Hitchcock aw and the media e ard Make ‘em award laugh Grammy Awards homes and gardensWednesday, October 3, 12 42
    • From Predictability to Serendipity at documentary format Secret Basic patterns form form Paul Merton genre at Gardens Homogeneous patterns looks at art culture ge genre nr Alfred Hitchcock aw and the media e ard Make ‘em an award laugh Grammy Awards homes and ch or gardens Paul Merton pa rtn er Caroline Quentin ac to r ge Life of nr e Riley comedyWednesday, October 3, 12 42
    • From Predictability to Serendipity at documentary format Secret Basic patterns form form Paul Merton genre at Gardens Homogeneous patterns looks at art culture ge genre nr Alfred Hitchcock aw and the media e ard Make ‘em an award laugh Grammy Awards homes and ch or gardens Paul Merton infl uen ce pa rtn er Spike act Milligan or The adventures Caroline of Barry Quentin McKenzie ac to r ge nre Life of nr form e ge Riley at comedy filmWednesday, October 3, 12 42
    • From Predictability to Serendipity at documentary format Secret Basic patterns form form Paul Merton genre at Gardens Homogeneous patterns looks at art culture ge Alfred Hitchcock aw and the media genre nr e Heterogeneous patterns ard Make ‘em an award laugh Grammy Awards homes and ch or gardens synopsis influence Charlie enrichment Paul Merton infl uen Chaplin Shanghai pa ce Knights rtn er Spike gen act re at Milligan or The adventures form Caroline of Barry action and Quentin ac McKenzie adventure ac to to r r ge nre Life of nr form e ge Riley at comedy Jackie Chan filmWednesday, October 3, 12 42
    • From Predictability to Serendipity at documentary format Secret Basic patterns form form Paul Merton genre at Gardens Homogeneous patterns looks at art culture ge Alfred Hitchcock aw and the media genre nr e Heterogeneous patterns ard Make ‘em an award laugh Grammy Awards homes and ch synopsis or gardens enrichment synopsis influence Charlie enrichment Paul Merton infl uen Chaplin Shanghai pa ce Knights Alfred rtn er Spike gen Hitchcock act re at Milligan or The adventures form Caroline of Barry action and director Quentin ac McKenzie adventure ac to to r r ge nre Life of nr form Suspicion e ge Riley at d comedy Jackie ar ge form Chan aw at nre Academy film Awards ThrillerWednesday, October 3, 12 42
    • Weak Semantics & Strong StatisticsWednesday, October 3, 12 43
    • Weak Semantics & Strong Statistics Paul Merton looks at anchor Paul partner Alfred Hitchcock Merton Caroline Quentin or act at form ge nre Life of Riley documentary art culture and the mediaWednesday, October 3, 12 43
    • Weak Semantics & Strong Statistics Paul Merton woman looks at anchor User Alfred Hitchcock Paul partner Caroline 25 years old Merton profile Quentin 1 child or act at form ge nre Life of Riley documentary art culture and the mediaWednesday, October 3, 12 43
    • Weak Semantics & Strong Statistics Paul Merton woman looks at anchor User Alfred Hitchcock Paul partner Caroline 25 years old Merton profile Quentin 1 child or act at form ge nre Life of Riley documentary art culture and the media 25 year old women with 1 childWednesday, October 3, 12 43
    • Weak Semantics & Strong Statistics Paul Merton woman looks at anchor User Alfred Hitchcock Paul partner Caroline 25 years old Merton profile Quentin 1 child or act at form ge nre Life of Riley Similar users documentary art culture and the media 25 year old women with 1 childWednesday, October 3, 12 43
    • NoTube’s N-Screen drag & drop, shuffle, sharing & TV control N-Screen drag & drop, sharing & TV controlWednesday, October 3, 12 44
    • NoTube’s N-Screen similar programsWednesday, October 3, 12 45
    • NoTube’s N-Screen random selection • means of surfacing content buried in the video collection • when users might reach a dead-end with the recommendations • adds an extra element of serendipityWednesday, October 3, 12 46
    • NoTube’s N-Screen explanations • depending on recommendation strategies • depending on the user’s taskWednesday, October 3, 12 47
    • Focus Groups http://notube.tvWednesday, October 3, 12 48
    • finding INTERESTING PROGRAMMES sharing them ♥ suggestions activities your past Social Web based on ♥ suggestions based on programmes others have watched linking programmes by guests, actors, ♥ drag & drop ✔ presenters etc. ✔ shuffle option for programme selection ♥ ♥ swapping suggestions with specific friends ? explaining recommendations ? sharing suggestions with others in the same room ? sharing to watch immediately controlling the TV ♥ drag & drop to change whats playing on TV watching with friends ✔ watching together apart in different locations ✘ changing programmes on someone elses TVWednesday, October 3, 12 49
    • connected heritage data: open, shared & accessible infrastructures: interoperable smart services: relevant content in right contextWednesday, October 3, 12 50
    • enriching collections Lora Aroyo twitter: @laroyoWednesday, October 3, 12 51
    • discovering links mili<a place:  Amsterdam,   1625  to  1650 studentOf:   Pieter  Lastman   self-­‐portrait teacherOf:   style:  Baroque Gerrit  Dou The  Night  Watch http://chip-project.org Lora Aroyo twitter: @laroyoWednesday, October 3, 12 52
    • enriching with events Lora Aroyo twitter: @laroyoWednesday, October 3, 12 53
    • discovering links Lora Aroyo twitter: @laroyoWednesday, October 3, 12 54
    • personalized experienceWednesday, October 3, 12 55
    • Wednesday, October 3, 12 56
    • Wednesday, October 3, 12 57
    • Lora Aroyo twitter: @laroyoWednesday, October 3, 12 58
    • http://chip-project.orgWednesday, October 3, 12 59
    • http://chip-project.orgWednesday, October 3, 12 59
    • http://agora.cs.vu.nl Lora Aroyo twitter: @laroyoWednesday, October 3, 12 60
    • http://agora.cs.vu.nl Lora Aroyo twitter: @laroyoWednesday, October 3, 12 60
    • Wednesday, October 3, 12 61
    • Yiwen Wang Natalia Roxane Stash Segers Iina Hellsten Chiel van den Akker Geertje Jacobs Frank de Bakker Marteen Brinkerink Bibiana Armenta Piek Vossen Thomas Johan Chris Welty Michiel Guus Schreiber Ploeger Oomen Hildebrand Riste Gligorov Marieke Lourens van Susan Jacco van Geert-Jan Lotte Belice van Erp der Meij Legêne Ossenbruggen Houben BaltussenWednesday, October 3, 12 62
    • Questions? @laroyo http://lora-aroyo.orgWednesday, October 3, 12 63