• Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,551
On Slideshare
0
From Embeds
0
Number of Embeds
4

Actions

Shares
Downloads
18
Comments
0
Likes
4

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaMUSICDISCOBERRY the bittersweet high-hanging fruit Òscar Celma
  • 2. “The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)
  • 3. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHelp! I’m stuck in the headThe limited reach of music recommendation Popularity 48% of recommendations 0% of recommendations 52% of recommendations 83 Artists 6,659 Artists 239,798 Artists Sales Rank Last.fm similar artists
  • 4. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 5. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 6. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  • 7. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  • 8. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen
  • 9. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  • 10. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  • 11. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  • 12. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen ...as well asRhythm: beat detection, BPMs loudness danceability studio vs. liveTimbre (MFCC) structure (ABABCA) genre (pop) mood (euphoric, energetic)Harmony (Chromagram)
  • 13. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) Rhythm (beat detection, BPMs)Timbre (MFCC) Timbre (MFCC)Harmony (Chromagram) Harmony (Chromagram)
  • 14. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) sim(Song1, Song2) = ??? Rhythm (beat detection, BPMs) EMD & k-means KL & GMMTimbre (MFCC) L2 & PCA (MFCC) Timbre Adhoc ...Harmony (Chromagram) Harmony (Chromagram)
  • 15. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaAudio Content-Based Similarity
  • 16. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  • 17. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Usage-Based● Collaborative filtering ● “people who listen to X also listen to Y”● Matrix Factorization ● SVD, NMF, ...
  • 18. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
  • 19. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
  • 20. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches how many clicks?
  • 21. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches ● Audio Content-Based similarity – 2 clicks ● Usage-Based (last.fm) – 5 clicks (!) (yet, perceived quality is higher for usage-based)
  • 22. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  • 23. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Social-BasedContent Reviews Blogs Social Tags Bios Playlists thrash heavy metal Weird Edgy concert gothic 90s rock Loud
  • 24. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
  • 25. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
  • 26. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
  • 27. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
  • 28. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag???
  • 29. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Taghttp://www.last.fm/bestof/10years/artists/tag/black+metal
  • 30. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  • 31. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Hybrid● Weighted (linear combination) ● E.g Usage * 0.4 + Social * 0.4 + Content * 0.2● Cascade ● E.g 1st apply Social, then reorder by Content-Based● (...)
  • 32. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHybrid Music Similarity
  • 33. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  • 34. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  • 35. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  • 36. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 37. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 38. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists“If you like Radiohead you might like this article” (Celma & Lamere). AI Magazine, 2011
  • 39. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists? ? ? Social-Based: Using Artist Tags Content-Based: Audio Similarity (artist top tracks) Usage-Based: CFUsing Last.fm-360K dataset (google: oscar celma datasets)
  • 40. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists
  • 41. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation“People who like Radiohead also like X” vs.“Paul likes Radiohead, so he might also like Y”
  • 42. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation● To whom are we recommending? Phoenix-2. UK (2006)
  • 43. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm
  • 44. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm● Clustering lamere top-20 artists (using tags)
  • 45. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm● Clustering lamere top-20 artists (using tags)
  • 46. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9
  • 47. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  • 48. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  • 49. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  • 50. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  • 51. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists... Novel & Relevant music for Paul
  • 52. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 53. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 54. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 55. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 56. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 57. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 58. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  • 59. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance Emitt Rhodes
  • 60. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  • 61. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  • 62. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  • 63. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  • 64. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceSIMILAR ARTISTS: SIMILAR ARTISTS: SIMILAR ARTISTS:The Roulettes The Idle Race Emitt RhodesThe Fourmost The Flower Pot Men Hotlegs
  • 65. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 66. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE ? Emitt Rhodes
  • 67. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  • 68. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  • 69. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  • 70. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  • 71. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  • 72. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  • 73. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  • 74. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context ● Working ● Driving ● Workout ● Studying ● Relaxing● How to get users attention?
  • 75. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  • 76. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma The Whole Picture
  • 77. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma The Whole Picture
  • 78. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma
  • 79. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @ocelma http://ocelma.netMUSICDISCOBERRY the bittersweet high-hanging fruit