0
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaMUSICDISCOBERRY     the bittersweet high-hanging fruit             ...
“The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHelp! I’m stuck in the headThe limited reach of music recommendatio...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Music Similarity●   Content-based●   Usage-bas...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Music Similarity●   Content-based●   Usage-bas...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma      Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly R...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma      Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly R...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaAudio Content-Based Similarity
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Music Similarity●   Content-based●   Usage-bas...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                        Usage-Based●   Collaborative filtering    ●...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                Long Tail in Music●   From Hits to Niches          ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                        Long Tail in Music●   From Hits to Niches  ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Music Similarity●   Content-based●   Usage-bas...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Social-BasedContent     Reviews        Blogs  ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag???
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Taghttp://www.last.fm/bestof/10years/artis...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                     Music Similarity●   Content-based●   Usage-bas...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                               Hybrid●   Weighted (linear combinati...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHybrid Music Similarity
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Consider all music includin...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Consider all music includin...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Consider all music includin...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                  Radiohead similar artists“If you like Radiohead y...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma           Radiohead similar artists?                           ?  ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma   Radiohead similar artists
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             Recommendation“People who like Radiohead also like X” ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                 Recommendation●   To whom are we recommending? Pho...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma       lamere @ last.fm
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                   lamere @ last.fm●   Clustering lamere top-20 art...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                   lamere @ last.fm●   Clustering lamere top-20 art...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  @lamere - Radiohead                                              ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma          @lamere - Radiohead                                      ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma          @lamere - Radiohead                                      ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma          @lamere - Radiohead                                      ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma          @lamere - Radiohead                                      ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma          @lamere - Radiohead                                      ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  Novelty & Relevance                                          Emit...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     Novelty & RelevanceWHY as important as WHAT
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     Novelty & RelevanceWHY as important as WHAT
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     Novelty & RelevanceWHY as important as WHAT
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     Novelty & RelevanceWHY as important as WHAT
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                   Novelty & RelevanceSIMILAR ARTISTS:             ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  WHAT WHO WHY WHEN WHERE                        ?                 ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  WHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  WHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  WHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma  WHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Listener’s context
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Listener’s context
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma             WHAT WHO WHY WHEN WHERE●   Listener’s context
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma                  WHAT WHO WHY WHEN WHERE●   Listener’s context    ...
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     The Whole Picture
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma     The Whole Picture
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma
recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma              @ocelma          http://ocelma.netMUSICDISCOBERRY    ...
Upcoming SlideShare
Loading in...5
×

MusicDiscoBerry: the bittersweet high-hanging fruit

1,683

Published on

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,683
On Slideshare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
22
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Transcript of "MusicDiscoBerry: the bittersweet high-hanging fruit"

  1. 1. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaMUSICDISCOBERRY the bittersweet high-hanging fruit Òscar Celma
  2. 2. “The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)
  3. 3. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHelp! I’m stuck in the headThe limited reach of music recommendation Popularity 48% of recommendations 0% of recommendations 52% of recommendations 83 Artists 6,659 Artists 239,798 Artists Sales Rank Last.fm similar artists
  4. 4. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  5. 5. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  6. 6. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  7. 7. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  8. 8. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen
  9. 9. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  10. 10. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  11. 11. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)
  12. 12. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen ...as well asRhythm: beat detection, BPMs loudness danceability studio vs. liveTimbre (MFCC) structure (ABABCA) genre (pop) mood (euphoric, energetic)Harmony (Chromagram)
  13. 13. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) Rhythm (beat detection, BPMs)Timbre (MFCC) Timbre (MFCC)Harmony (Chromagram) Harmony (Chromagram)
  14. 14. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) sim(Song1, Song2) = ??? Rhythm (beat detection, BPMs) EMD & k-means KL & GMMTimbre (MFCC) L2 & PCA (MFCC) Timbre Adhoc ...Harmony (Chromagram) Harmony (Chromagram)
  15. 15. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaAudio Content-Based Similarity
  16. 16. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  17. 17. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Usage-Based● Collaborative filtering ● “people who listen to X also listen to Y”● Matrix Factorization ● SVD, NMF, ...
  18. 18. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
  19. 19. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example
  20. 20. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches how many clicks?
  21. 21. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches ● Audio Content-Based similarity – 2 clicks ● Usage-Based (last.fm) – 5 clicks (!) (yet, perceived quality is higher for usage-based)
  22. 22. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  23. 23. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Social-BasedContent Reviews Blogs Social Tags Bios Playlists thrash heavy metal Weird Edgy concert gothic 90s rock Loud
  24. 24. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
  25. 25. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example
  26. 26. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
  27. 27. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag
  28. 28. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag???
  29. 29. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Taghttp://www.last.fm/bestof/10years/artists/tag/black+metal
  30. 30. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)
  31. 31. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Hybrid● Weighted (linear combination) ● E.g Usage * 0.4 + Social * 0.4 + Content * 0.2● Cascade ● E.g 1st apply Social, then reorder by Content-Based● (...)
  32. 32. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHybrid Music Similarity
  33. 33. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  34. 34. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  35. 35. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular
  36. 36. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  37. 37. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  38. 38. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists“If you like Radiohead you might like this article” (Celma & Lamere). AI Magazine, 2011
  39. 39. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists? ? ? Social-Based: Using Artist Tags Content-Based: Audio Similarity (artist top tracks) Usage-Based: CFUsing Last.fm-360K dataset (google: oscar celma datasets)
  40. 40. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists
  41. 41. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation“People who like Radiohead also like X” vs.“Paul likes Radiohead, so he might also like Y”
  42. 42. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation● To whom are we recommending? Phoenix-2. UK (2006)
  43. 43. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm
  44. 44. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm● Clustering lamere top-20 artists (using tags)
  45. 45. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm● Clustering lamere top-20 artists (using tags)
  46. 46. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9
  47. 47. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  48. 48. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  49. 49. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  50. 50. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...
  51. 51. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists... Novel & Relevant music for Paul
  52. 52. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  53. 53. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  54. 54. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  55. 55. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  56. 56. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  57. 57. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  58. 58. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance
  59. 59. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance Emitt Rhodes
  60. 60. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  61. 61. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  62. 62. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  63. 63. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT
  64. 64. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceSIMILAR ARTISTS: SIMILAR ARTISTS: SIMILAR ARTISTS:The Roulettes The Idle Race Emitt RhodesThe Fourmost The Flower Pot Men Hotlegs
  65. 65. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  66. 66. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE ? Emitt Rhodes
  67. 67. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  68. 68. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  69. 69. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  70. 70. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE
  71. 71. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  72. 72. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  73. 73. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context
  74. 74. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context ● Working ● Driving ● Workout ● Studying ● Relaxing● How to get users attention?
  75. 75. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE
  76. 76. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma The Whole Picture
  77. 77. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma The Whole Picture
  78. 78. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma
  79. 79. recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @ocelma http://ocelma.netMUSICDISCOBERRY the bittersweet high-hanging fruit
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×