Data Mining Music

Data Mining Music Paul Lamere March 11, 2012#SXMusicData

Digital music revolution continues I’ve got 10 million songs in my pocket. Now what?#SXMusicData

10 Easy Pieces Mining Data about music Mining music itself • Artist names • Finding a better drummer • Artist relationships • The Loudness War • Fan Passion • Looking for the slow build • Better recommendations • Automatic music visualization • Frog-based playlisting • Data-driven music remixing#SXMusicData

Tale of Two Datasets#SXMusicData

MusicBrainz • Basic metadata • 645K Artists • 1M Releases • 10M Recordings • And more ... Let’s have some fun with MusicBrainz data#SXMusicData

Have band names been getting longer?#SXMusicData

Have band names been getting longer? let’s use the some data to ﬁnd out • Collect the top 500 artists for each 5 year window (via Echo Nest or Musicbrainz) • Calculate the average name length for period.#SXMusicData

Have artist names been getting longer? Let’s ﬁnd out with big data! (well, really not that big) • Collect the top 500 artists for each 5 year window • Calculate the average name length for period. The code is shorter than Zach’s answer#SXMusicData

Have band names been getting longer?#SXMusicData

Have band names been getting longer? NO Year Average name length The average length of artist names peaked in the period from 1955-1959. Average name length was 2 characters longer in 1955 than in 2012#SXMusicData

Band names from 1955-1959 44 Van McCoy & The Soul City Symphony Orchestra 35 Academy of St. Martin in the Fields 33 The Clancy Brothers & Tommy Makem 33 Cliff Bennett & The Rebel Rousers 32 Maurice Williams and The Zodiacs 31 Herb Alpert & The Tijuana Brass 30 Smokey Robinson & The Miracles 30 Little Anthony & The Imperials 29 Van Morrison & The Chieftains 29 Nelson Riddle & His Orchestra 29 George Clinton and Parliament 29 Frankie Lymon & The Teenagers 29 Clancy Brothers & Tommy Makem#SXMusicData

Longest band names 51 2010 Tim and Sam’s Tim and the Sam Band with Tim and Sam 48 1994 ...And You Will Know Us By The Trail Of The Dead 47 1967 Charles Wright & The Watts 103rd St Rhythm Band 46 1993 The Presidents of the United States of America 44 1959 Van McCoy & The Soul City Symphony Orchestra 43 2000 Richard Cheese & Lounge Against The Machine 43 1950 Benedictine Monks of Santo Domingo de Silos 41 1981 Emir Kusturica & The No Smoking Orchestra 39 1972 Afrika Bambaataa & The Soul Sonic Force 37 2010 Antoine Dodson & The Gregory Brothers 37 2005 Edward Sharpe and the Magnetic Zeroes 37 1999 Someone Still Loves You Boris Yeltsin 36 1977 Gloria Estefan & Miami Sound Machine#SXMusicData

More fun with MusicBrainz Artist relationship data#SXMusicData

Woah! We can build an Oracle of Kevin Bacon for music#SXMusicData

How many steps from Eric Clapton to Justin Bieber? Eric Phil Justin Clapton Usher Performed Collins Bieber Composed Who on track You’ll be in performed I wish it my Heart on First would Rain performed Dance with with Phil by Usher Justin Bieber Collins 1 2 3#SXMusicData

Six Degrees of Black Sabbath http://labs.echonest.com/SixDegrees/?start=eric+clapton&end=justin+bieber#SXMusicData

The Million Song Data Set • Core Data: Echo Nest analysis for a million songs • Complimentary Data • Second Hand Songs - 20K cover songs • MusixMatch - 237K bucket-of-words lyric sets • Last.fm tags - song level tags for 500K tracks. plus 57 million sim. track pairs • Echo Nest Taste proﬁle subset - 1M users, 48M user/song/play count triples http://labrosa.ee.columbia.edu/millionsong/#SXMusicData

Data mining listener data Who are the most passionate fans? Dubstep Fan Metal heads#SXMusicData

Passion Index High plays per listener#SXMusicData

Passion Index Low plays per listener#SXMusicData

Who has the most passionate fans?#SXMusicData

Who has the most passionate fans? Average 115 plays per fan#SXMusicData

Passion Index passionate Metal heads are passionate music fans#SXMusicData

Passion Index Who has the least passionate fans?#SXMusicData

Passion Index Who has the least passionate fans? Average only 5 plays per ‘fan’#SXMusicData

Better Recommendations People who listen to the Beatles also listen to: That’s pretty boring#SXMusicData

Better Recommendations People who bought Sgt Pepper’s also bought: That’s pretty irrelevant#SXMusicData

If you like The Beatles you might like

Going beyond user data• Top ‘terms’ for an artist• Artist popularity• Artist familiarity• Artist relations• Years of activity• Fan Passion

Beatles near neighbor graph tuned for discovery The Beatles Bob Dylan Emitt Rhodes Pink Floyd Bee Gees Elvis Presley The Beau Brummels The Hollies Harry Nilsson Duncan Browne The WhoThe Grass Roots Moby Grape The Lovin Spoonful Badﬁnger The Left Banke The Byrds Todd Rundgren The Zombies Buffalo Springﬁeld

If you like The Beatles you might like The Beatles Bob Dylan Emitt Rhodes Pin The Beau Brummels The Hollies Harry Nilsson Duncss Roots Moby Grape The Lovin Spoonful Badﬁnger The Left Ba The Byrds Todd Rundgren The Zombie Buffalo Springﬁeld

More fun with artist similarity graphs http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html#SXMusicData

Finding a path from the smooth jazz of Kenny G To the brutal death metal of Nile#SXMusicData

Finding a path from the smooth jazz of Kenny Kenny Gee John Tesh Kim Waters David Sanborn David Foster Gerald Albright Dave Koz George Howard Jan Hammer Jay Graydon Michael Kamen Stephen Bishop Jennifer Warnes Dan Hill Andrew Gold Art Garfunkel Christopher Cross Bread Ambrosia Benny Mardones Little River Band P To the brutal death metal of Nile Kenny Loggins #SXMusicData

opl Christopher Cross Dan Fogelberg Barry Manilow Little River Band Michael McDonald Captain & Tennille Peter Cetera Paul Carrack James Ingram Hall & Oates Kenny Loggins Culture Club The Doobie Brothers The Righteous Brothers Phil Collins Billy Labi Siffre Richard Marx Elton John Rod Stewart Fleetwood Mac Paul McCartney Joe Cocker The Rolling Stones Lindsey Buckingham Chicken Shack Peter Frampton Dance Yourself to Death Mott The Hoople Pat Travers Band Eric Clapton Bob Seger Dire Straits Gary Moore Jimmy Page Alvin Lee Jimi Hendrix John Mayall & The Bluesbreakers #SXMusicData

Rod Stewart Fleetwood Mac Paul McCartney Joe Cocker Neil Sedakaolling Stones Lindsey Buckingham Chicken Shack Peter Frampton Dance Yourself to Death Stevie Nicks Mott The Hoople Pat Travers Band Eric Clapton Bob Segers Gary Moore Jimmy Page Alvin Lee Jimi Hendrix John Mayall & The Bluesbreakers Michael Burks Jefferson Airplane The Doors Haale Led Zeppelin John Frusciante Janis Joplin Ace Frehley Eric Gale Dave Navarro Beck Chad Smith The Mars Volta Slash Ataxia Prize Fighter Inferno Sparta Free Moral Agents The Dillinger Escape Plan The Stiletto Formal Omar A. Rodrigue Benea Reach Car Bomb Spitﬁre Ephel Duath Meshuggah The Number Twelve Looks Like You HORS Synthetic Breed Zero Hour TesseracT Gojira Carcass Periphery Forbidden Strapping Young Lad Lamb of God Nile Mastodon Septic Flesh Textures #SXMusicData

Boil the Frog#SXMusicData

Music is data too#SXMusicData

The Beat HierarchySectionsBarsBeatsTatumsSegments

#SXMusicData http://labs.echonest.com/click/

#SXMusicData

Fun with Loudness data#SXMusicData

Why does today’s music sound like crap? Dave Brubeck’s Take Five - released in 1959 20 dB of dynamic range#SXMusicData http://musicmachinery.com/2009/03/23/the-loudness-war/

Why does today’s music sound like crap? Metallica’s Cyanide - released in 2008 3 dB of dynamic range#SXMusicData http://musicmachinery.com/2009/03/23/the-loudness-war/

The Loudness wars#SXMusicData http://musicmachinery.com/2009/03/23/the-loudness-war/

Fun with Loudness Info Looking for the slow build#SXMusicData http://musicmachinery.com/2011/09/18/looking-for-the-slow-build/

Fun with Loudness Info Looking for the slow build#SXMusicData

Timbre and Pitch Data#SXMusicData

Fun with Timbre info Bohemian Rhapsichord http://static.echonest.com/BohemianRhapsichord/index.html#SXMusicData

Fun with Pitch info MIDEM Music Machine http://static.echonest.com/MidemMusicMachine/index.html#SXMusicData

Data-driven music manipulations Turning music into silly putty

Data-driven music remixing Once you have precise information on all of the musical events in a song, you can use this info to algorithmically remix the song#SXMusicData

Tristan’s The Swinger Makes any song swing#SXMusicData

Tristan’s Waltzify Turns a 4/4 song into a Waltz#SXMusicData

I’ve got 10 million songs in my pocket. Now what? Tools and techniques that help us better understand the world of music will be increasingly important#SXMusicData

A cautionary note Taste is irrational Music Music I Like You Like Music I Used To Like#SXMusicData Get this t-shirt at dieselsweeties.com

More like this http://musicmachinery.com/#SXMusicData

More like this http://blog.last.fm/category/Trends-and-Data/#SXMusicData

Data Mining Music Questions? Paul Lamere paul@echonest.com @plamere musicmachinery.com#SXMusicData

http://musicmachinery.com	4968
http://datasciencelondon.org	1468
http://blog.echonest.com	830
http://lanyrd.com	16
http://translate.googleusercontent.com	8
https://twitter.com	5
http://bo.lt	4
http://sxswi.bo.lt	2
http://www.newsblur.com	2
http://webcache.googleusercontent.com	2
http://www.hanrss.com	1
http://127.0.0.1	1
https://abs.twimg.com	1

Data Mining Music

by Paul Lamere

Accessibility

Categories

Upload Details

Usage Rights

13 Embeds 7,308

Statistics

Data Mining Music Presentation Transcript