Finding Music With Pictures: Using Visualization for Discovery

Finding Music With Pictures:Data Visualization for DiscoveryPaul Lamere The Echo Nest #musicviz

Music Discovery Challenge 2

Music Discovery Challenge Listener Study Listeners 5,000 Average Songs 3,500 Per User Percent of songs 65% never listened to 3

Ishkur’s Guide to Electronic Dance Music 4

Why Visualize?Visualizations can engage our pattern-matching brain 5

Human rendered visualizations 6

Visualizations as a tree1939 7

The greatest visualization ever? 8

ng underground Visualizations as a Maphart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helpedplausiblery of 20thndon ed by t Simonhe tubemous reat Bear, em all linko find an. But forhange had musicalof coloured ed to-, but the e quickly op inter- that had to usic for the here, Docklandsouple ofone after- almost allost of thestations lecticost impor-e signifi- most de-ey never he next to writing t (sorry, nyrd), ago- , asking vice for in- nd swear- , there ys. It justbe objec- nd are in early logy wher-wed it. Eachgenre: rock sychedelia ondon; mden, into If I was re- oed theury & Is- ily Stone. d flaws.yrinthine be imper- s pop stop draw a de- unk? These ed record and they’re ut I thinkable givenwith omis-ple, that s in tan- r Metro- room forinogue and so pointm explod- tern, pre-music. necessi-d’s under- sive refer-tack. For xception to rd. ive historyo see if onelaid on ae elegancegn – its sections,anting tan-all suckedtle of thether con-ain’s innate cture. Plus journalisms should map at send atndrew d. Dorian Lynskey - The Guardian Music History as a London Tube Map 9

Genre MapBen Discoe http://www.washedashore.com/music/genremap.html 10

Map of Metal http://mapofmetal.comFinding music with pictures - SXSW 2011 11

Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12

Visualizations as a graph http://www.homeofmetal.com/ 13

Seattle Band Map http://www.seattlebandmap.com/ 14

Seattle Band Map http://www.seattlebandmap.com/ 15

Hybrid visualizationSchool of rock franksreelreviews.com 16

Other types of visualizations 17

Computer rendered visualizations 22

Time SeriesFinding music with pictures - SXSW 2011 23

Visualizing Listening History http://www.leebyron.com/what/lastfm/ - Lee ByronFinding music with pictures - SXSW 2011 24

Maps and GraphsFinding music with pictures - SXSW 2011 25

The World Of Music http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang zFinding music with pictures - SXSW 2011 26

The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-ResearchFinding music with pictures - SXSW 2011 27

Islands of Music self-organizing maps http://playground.last.fm/iom - Islands of Music - Elias PampalkFinding music with pictures - SXSW 2011 28

nepTune http://www.cp.jku.at/projects/nepTune/Finding music with pictures - SXSW 2011 29

Last.fm Artist Map http://sixdegrees.hu/last.fm/index.htmlFinding music with pictures - SXSW 2011 30

Building an artist map The Goal - build an artist graph suitable for music exploration Problem: The artist space is very complexFinding music with pictures - SXSW 2011 31

Making a good graph • Minimize edge crossings, bends and curves Good Bad • Maximize angular resolution, symmetry Good BadCognitive measurements of graph aesthetics, Ware Purchase Colpoys McGill , , , 32

Graphing the Beatles Neighborhood digraph { "The Beatles" -> "Electric Light Orchestra"; "The Beatles" -> "The Rutles"; "The Beatles" -> "The Dave Clark Five"; "The Beatles" -> "The Tremeloes"; "The Beatles" -> "Manfred Mann"; "The Beatles" -> "The Lovin Spoonful"; "The Beatles" -> "The Rolling Stones"; "The Beatles" -> "Creedence Clearwater Revival"; "The Beatles" -> "Bee Gees"; "The Beatles" -> "the Hollies"; "The Beatles" -> "Badfinger"; "The Beatles" -> "Paul McCartney"; "The Beatles" -> "Julian Lennon"; "The Beatles" -> "George Harrison"; "The Beatles" -> "John Lennon"; } http://www.graphviz.org/ 33Finding music with pictures - SXSW 2011

Artist map - level 1 outFinding music with pictures - SXSW 2011 Already interconnections start to overwhelm 34

Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35

Artist map - level 2 116 artists and 665 edges. We are totally overwhelmed.Finding music with pictures - SXSW 2011 36

Simplifying the graph Eliminate the edges and use spring force embedding to position the artistsFinding music with pictures - SXSW 2011 37

Reducing the edges Attach artists to only one most similar artistFinding music with pictures - SXSW 2011 38

Reducing the edges Attach artists to only one most similar artist wtf?Finding music with pictures - SXSW 2011 38

Putting ELO II in its place Attach artists to the most similar artist that has greater familiarityFinding music with pictures - SXSW 2011 39

One more problem ... Graph is not 100% connected.Finding music with pictures - SXSW 2011 40

Making the graph connected Build a minimum spanning tree from the graphFinding music with pictures - SXSW 2011 41

2K artists A browsing network for music discoveryFinding music with pictures - SXSW 2011 42

Interactive Mirrored Radio dial - by thomwatsonFinding music with pictures - SXSW 2011 43

The SXSW Music MazeFinding music with pictures - SXSW 2011 http://static.echonest.com/SxswMusicMaze/SxswMusicMaze.html 44

liveplasmahttp://liveplasma.com 45

Flow ListFinding music with pictures - SXSW 2011 http://bowr.de/ﬂowlist/ﬂowlist.html 46

MoodLogicFinding music with pictures - SXSW 2011 47

Mr. Emo: Music Retrieval in the Emotional Plane http://mpac.ee.ntu.edu.tw/~yihsuan/pub/MM08_MrEmo.pdfFinding music with pictures - SXSW 2011 48

Music BoxFinding music with pictures - SXSW 2011 http://thesis.ﬂyingpudding.com/ - Anita Lillie 49

3D Track similarity The Muﬁn PlayerFinding music with pictures - SXSW 2011 50

DiscovrFinding music with pictures - SXSW 2011 51

Hitlantis www.hitlantis.comFinding music with pictures - SXSW 2011 52

SongExplorer SongExplorer: Exploring Large Musical Databases Using a Tabletop Interface Carles F. Julià - Music Technology Group - Universitat Pompeu FabraFinding music with pictures - SXSW 2011 53

Search Inside the Music http://mediacast.sun.com/share/plamere/sitm_ﬁnal.pdf - Lamere, EckFinding music with pictures - SXSW 2011 54

http://musicmachinery.com	2386
http://www.inventinginteractive.com	85
http://www.talk2.com.br	69
http://marianarrpp.com	16
http://getbiglittlekid.posterous.com	9
http://view-project.posterous.com	5
http://signalkrem.tumblr.com	4
http://translate.googleusercontent.com	4
http://gayadas2010.blogspot.com	4
http://localhost	3
http://u4vmcssitweb1.aus.amer.dell.com:90	3
url_unknown	3
http://paper.li	2
http://posterous.com	2
http://edicolaeuropea.blogspot.com	2
http://geoffk.im	2
http://yiah.tumblr.com	2
http://formacion.mestreacasa.gva.es	2
http://nuevascosillas.blogspot.com	1
http://endovascular.blogscomb.cat	1
http://www.talkinteractive.com.br	1
http://alexsander-alex.blogspot.com	1
http://gayadas2010.blogspot.mx	1
http://danielalfon.soup.io	1
http://danielalfon.parasoup.de	1
http://www.tumblr.com	1

Finding Music With Pictures: Using Visualization for Discovery

by Paul Lamere

Accessibility

Categories

Upload Details

Usage Rights

26 Embeds 2,611

Statistics

Finding Music With Pictures: Using Visualization for Discovery Presentation Transcript