MusicDiscoBerry: the bittersweet high-hanging fruit

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaMUSICDISCOBERRY the bittersweet high-hanging fruit Òscar Celma

“The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHelp! I’m stuck in the headThe limited reach of music recommendation Popularity 48% of recommendations 0% of recommendations 52% of recommendations 83 Artists 6,659 Artists 239,798 Artists Sales Rank Last.fm similar artists

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaWHAT WHO WHY WHEN WHERE

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Music Similarity● Content-based● Usage-based● Social-based● Hybrid (combination)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae JepsenRhythm: beat detection, BPMsTimbre (MFCC)Harmony (Chromagram)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen ...as well asRhythm: beat detection, BPMs loudness danceability studio vs. liveTimbre (MFCC) structure (ABABCA) genre (pop) mood (euphoric, energetic)Harmony (Chromagram)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) Rhythm (beat detection, BPMs)Timbre (MFCC) Timbre (MFCC)Harmony (Chromagram) Harmony (Chromagram)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen Song 2Rhythm (beat detection, BPMs) sim(Song1, Song2) = ??? Rhythm (beat detection, BPMs) EMD & k-means KL & GMMTimbre (MFCC) L2 & PCA (MFCC) Timbre Adhoc ...Harmony (Chromagram) Harmony (Chromagram)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaAudio Content-Based Similarity

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Usage-Based● Collaborative filtering ● “people who listen to X also listen to Y”● Matrix Factorization ● SVD, NMF, ...

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaUsage-Based The Beatles Example

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches how many clicks?

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Long Tail in Music● From Hits to Niches ● Audio Content-Based similarity – 2 clicks ● Usage-Based (last.fm) – 5 clicks (!) (yet, perceived quality is higher for usage-based)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Social-BasedContent Reviews Blogs Social Tags Bios Playlists thrash heavy metal Weird Edgy concert gothic 90s rock Loud

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based The Beatles Example

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Tag???

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaSocial-Based Black Metal Taghttp://www.last.fm/bestof/10years/artists/tag/black+metal

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Hybrid● Weighted (linear combination) ● E.g Usage * 0.4 + Social * 0.4 + Content * 0.2● Cascade ● E.g 1st apply Social, then reorder by Content-Based● (...)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelmaHybrid Music Similarity

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Consider all music including new, and not-so popular

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists“If you like Radiohead you might like this article” (Celma & Lamere). AI Magazine, 2011

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists? ? ? Social-Based: Using Artist Tags Content-Based: Audio Similarity (artist top tracks) Usage-Based: CFUsing Last.fm-360K dataset (google: oscar celma datasets)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Radiohead similar artists

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation“People who like Radiohead also like X” vs.“Paul likes Radiohead, so he might also like Y”

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Recommendation● To whom are we recommending? Phoenix-2. UK (2006)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma lamere @ last.fm● Clustering lamere top-20 artists (using tags)

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists...

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @lamere - Radiohead 9vs. Radiohead similar artists... Novel & Relevant music for Paul

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & Relevance Emitt Rhodes

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceWHY as important as WHAT

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma Novelty & RelevanceSIMILAR ARTISTS: SIMILAR ARTISTS: SIMILAR ARTISTS:The Roulettes The Idle Race Emitt RhodesThe Fourmost The Flower Pot Men Hotlegs

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE ? Emitt Rhodes

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma WHAT WHO WHY WHEN WHERE● Listener’s context ● Working ● Driving ● Workout ● Studying ● Relaxing● How to get users attention?

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma The Whole Picture

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma @ocelma http://ocelma.netMUSICDISCOBERRY the bittersweet high-hanging fruit

http://recommenders.de	369
https://twitter.com	7
http://lanyrd.com	4
https://twimg0-a.akamaihd.net	1
http://www.linkedin.com	1

MusicDiscoBerry: the bittersweet high-hanging fruit

by Oscar Celma on Dec 23, 2012

Accessibility

Upload Details

Usage Rights

5 Embeds 382

Statistics

MusicDiscoBerry: the bittersweet high-hanging fruit Presentation Transcript