Finding Music With Pictures:Data Visualization for DiscoveryPaul Lamere   The Echo Nest        #musicviz
Music Discovery Challenge                            2
Music Discovery Challenge                    Listener Study              Listeners         5,000            Average Songs ...
Ishkur’s Guide to Electronic Dance Music                                           4
Why Visualize?Visualizations can engage our pattern-matching brain                                                       5
Human rendered visualizations                                6
Visualizations as a tree1939                              7
Visualizations as a tree1939                              7
Visualizations as a tree1939                              7
The greatest visualization ever?                                   8
ng underground                                                         Visualizations as a Maphart the branches and connec...
ng underground                                                         Visualizations as a Maphart the branches and connec...
Genre MapBen Discoe   http://www.washedashore.com/music/genremap.html   10
Map of Metal                                               http://mapofmetal.comFinding music with pictures - SXSW 2011   ...
Visualization as a Time Series     Genealogy of Pop and Rock Music - Reebee Garofalo                                      ...
Visualization as a Time Series     Genealogy of Pop and Rock Music - Reebee Garofalo                                      ...
Visualization as a Time Series     Genealogy of Pop and Rock Music - Reebee Garofalo                                      ...
Visualization as a Time Series     Genealogy of Pop and Rock Music - Reebee Garofalo                                      ...
Visualizations as a graph               http://www.homeofmetal.com/   13
Seattle Band Map                   http://www.seattlebandmap.com/   14
Seattle Band Map    http://www.seattlebandmap.com/   15
Hybrid visualizationSchool of rock                          franksreelreviews.com   16
Hybrid visualizationSchool of rock                          franksreelreviews.com   16
Hybrid visualizationSchool of rock                          franksreelreviews.com   16
Other types of visualizations                                17
Other types of visualizations                                18
Other types of visualizations                                19
Other types of visualizations                                20
Other types of visualizations                                21
Computer rendered visualizations                                   22
Time SeriesFinding music with pictures - SXSW 2011             23
Visualizing Listening History                              http://www.leebyron.com/what/lastfm/ - Lee ByronFinding music w...
Visualizing Listening History                              http://www.leebyron.com/what/lastfm/ - Lee ByronFinding music w...
Maps and GraphsFinding music with pictures - SXSW 2011       25
The World Of Music                 http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html                  ...
The World Of Music                 http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html                  ...
The Landscape of Music                                          The Landscape of Music                                    ...
The Landscape of Music                                          The Landscape of Music                                    ...
The Landscape of Music                                          The Landscape of Music                                    ...
The Landscape of Music                                          The Landscape of Music                                    ...
Islands of Music                                      self-organizing maps                       http://playground.last.fm...
nepTune                                      http://www.cp.jku.at/projects/nepTune/Finding music with pictures - SXSW 2011...
Last.fm Artist Map                                      http://sixdegrees.hu/last.fm/index.htmlFinding music with pictures...
Last.fm Artist Map                                      http://sixdegrees.hu/last.fm/index.htmlFinding music with pictures...
Building an artist map                    The Goal - build an artist graph suitable for music exploration                 ...
Building an artist map                    The Goal - build an artist graph suitable for music exploration                 ...
Making a good graph         • Minimize edge crossings, bends and curves                              Good                 ...
Graphing the Beatles Neighborhood   digraph {        "The Beatles" ->   "Electric Light Orchestra";        "The Beatles" -...
Artist map - level 1 outFinding music with pictures - SXSW 2011                                          Already interconn...
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 1 in/outFinding music with pictures - SXSW 2011                     35
Artist map - level 2                            116 artists and 665 edges. We are totally overwhelmed.Finding music with p...
Artist map - level 2                            116 artists and 665 edges. We are totally overwhelmed.Finding music with p...
Simplifying the graph                  Eliminate the edges and use spring force embedding to position the artistsFinding m...
Simplifying the graph                  Eliminate the edges and use spring force embedding to position the artistsFinding m...
Reducing the edges                                          Attach artists to only one most similar artistFinding music wi...
Reducing the edges                                          Attach artists to only one most similar artistFinding music wi...
Reducing the edges                                          Attach artists to only one most similar artistFinding music wi...
Reducing the edges                                          Attach artists to only one most similar artist                ...
Putting ELO II in its place                      Attach artists to the most similar artist that has greater familiarityFin...
Putting ELO II in its place                      Attach artists to the most similar artist that has greater familiarityFin...
Putting ELO II in its place                      Attach artists to the most similar artist that has greater familiarityFin...
One more problem ...                                          Graph is not 100% connected.Finding music with pictures - SX...
One more problem ...                                          Graph is not 100% connected.Finding music with pictures - SX...
Making the graph connected                                 Build a minimum spanning tree from the graphFinding music with ...
Making the graph connected                                 Build a minimum spanning tree from the graphFinding music with ...
2K artists                                    A browsing network for music discoveryFinding music with pictures - SXSW 201...
2K artists                                    A browsing network for music discoveryFinding music with pictures - SXSW 201...
Interactive                                      Mirrored Radio dial - by thomwatsonFinding music with pictures - SXSW 201...
The SXSW Music MazeFinding music with pictures - SXSW 2011   http://static.echonest.com/SxswMusicMaze/SxswMusicMaze.html  ...
liveplasmahttp://liveplasma.com                                     45
Flow ListFinding music with pictures - SXSW 2011        http://bowr.de/flowlist/flowlist.html   46
MoodLogicFinding music with pictures - SXSW 2011               47
Mr. Emo: Music Retrieval in the Emotional Plane                          http://mpac.ee.ntu.edu.tw/~yihsuan/pub/MM08_MrEmo...
Music BoxFinding music with pictures - SXSW 2011      http://thesis.flyingpudding.com/ - Anita Lillie   49
3D Track similarity                                          The Mufin PlayerFinding music with pictures - SXSW 2011       ...
DiscovrFinding music with pictures - SXSW 2011             51
Hitlantis                                          www.hitlantis.comFinding music with pictures - SXSW 2011               ...
SongExplorer                 SongExplorer: Exploring Large Musical Databases Using a Tabletop Interface                   ...
Search Inside the Music                     http://mediacast.sun.com/share/plamere/sitm_final.pdf - Lamere, EckFinding musi...
Upcoming SlideShare
Loading in …5
×

Finding Music With Pictures: Using Visualization for Discovery

18,910 views

Published on

Slides from my SXSW 2011 talk. Here's the abstract:

With so much music available, finding new music that you like can be like finding a needle in a haystack. We need new tools to help us to explore the world of music, tools that can help us separate the wheat from the chaff. In this panel we will look at how visualizations can be used to help people explore the music space and discover new, interesting music that they will like. We will look at a wide range of visualizations, from hand drawn artist maps, to highly interactive, immersive 3D environments. We'll explore a number of different visualization techniques including graphs, trees, maps, timelines and flow diagrams and we'll examine different types of music data that can contribute to a visualization. Using numerous examples drawn from commercial and research systems we'll show how visualizations are being used now to enhance music discovery and we'll demonstrate some new visualization techniques coming out of the labs that we'll find in tomorrow's music discovery applications.

Published in: Technology

Finding Music With Pictures: Using Visualization for Discovery

  1. Finding Music With Pictures:Data Visualization for DiscoveryPaul Lamere The Echo Nest #musicviz
  2. Music Discovery Challenge 2
  3. Music Discovery Challenge Listener Study Listeners 5,000 Average Songs 3,500 Per User Percent of songs 65% never listened to 3
  4. Ishkur’s Guide to Electronic Dance Music 4
  5. Why Visualize?Visualizations can engage our pattern-matching brain 5
  6. Human rendered visualizations 6
  7. Visualizations as a tree1939 7
  8. Visualizations as a tree1939 7
  9. Visualizations as a tree1939 7
  10. The greatest visualization ever? 8
  11. ng underground Visualizations as a Maphart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helpedplausiblery of 20thndon ed by t Simonhe tubemous reat Bear, em all linko find an. But forhange had musicalof coloured ed to-, but the e quickly op inter- that had to usic for the here, Docklandsouple ofone after- almost allost of thestations lecticost impor-e signifi- most de-ey never he next to writing t (sorry, nyrd), ago- , asking vice for in- nd swear- , there ys. It justbe objec- nd are in early logy wher-wed it. Eachgenre: rock sychedelia ondon; mden, into If I was re- oed theury & Is- ily Stone. d flaws.yrinthine be imper- s pop stop draw a de- unk? These ed record and they’re ut I thinkable givenwith omis-ple, that s in tan- r Metro- room forinogue and so pointm explod- tern, pre-music. necessi-d’s under- sive refer-tack. For xception to rd. ive historyo see if onelaid on ae elegancegn – its sections,anting tan-all suckedtle of thether con-ain’s innate cture. Plus journalisms should map at send atndrew d. Dorian Lynskey - The Guardian Music History as a London Tube Map 9
  12. ng underground Visualizations as a Maphart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helpedplausiblery of 20thndon ed by t Simonhe tubemous reat Bear, em all linko find an. But forhange had musicalof coloured ed to-, but the e quickly op inter- that had to usic for the here, Docklandsouple ofone after- almost allost of thestations lecticost impor-e signifi- most de-ey never he next to writing t (sorry, nyrd), ago- , asking vice for in- nd swear- , there ys. It justbe objec- nd are in early logy wher-wed it. Eachgenre: rock sychedelia ondon; mden, into If I was re- oed theury & Is- ily Stone. d flaws.yrinthine be imper- s pop stop draw a de- unk? These ed record and they’re ut I thinkable givenwith omis-ple, that s in tan- r Metro- room forinogue and so pointm explod- tern, pre-music. necessi-d’s under- sive refer-tack. For xception to rd. ive historyo see if onelaid on ae elegancegn – its sections,anting tan-all suckedtle of thether con-ain’s innate cture. Plus journalisms should map at send atndrew d. Dorian Lynskey - The Guardian Music History as a London Tube Map 9
  13. Genre MapBen Discoe http://www.washedashore.com/music/genremap.html 10
  14. Map of Metal http://mapofmetal.comFinding music with pictures - SXSW 2011 11
  15. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  16. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  17. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  18. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  19. Visualizations as a graph http://www.homeofmetal.com/ 13
  20. Seattle Band Map http://www.seattlebandmap.com/ 14
  21. Seattle Band Map http://www.seattlebandmap.com/ 15
  22. Hybrid visualizationSchool of rock franksreelreviews.com 16
  23. Hybrid visualizationSchool of rock franksreelreviews.com 16
  24. Hybrid visualizationSchool of rock franksreelreviews.com 16
  25. Other types of visualizations 17
  26. Other types of visualizations 18
  27. Other types of visualizations 19
  28. Other types of visualizations 20
  29. Other types of visualizations 21
  30. Computer rendered visualizations 22
  31. Time SeriesFinding music with pictures - SXSW 2011 23
  32. Visualizing Listening History http://www.leebyron.com/what/lastfm/ - Lee ByronFinding music with pictures - SXSW 2011 24
  33. Visualizing Listening History http://www.leebyron.com/what/lastfm/ - Lee ByronFinding music with pictures - SXSW 2011 24
  34. Maps and GraphsFinding music with pictures - SXSW 2011 25
  35. The World Of Music http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang zFinding music with pictures - SXSW 2011 26
  36. The World Of Music http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang zFinding music with pictures - SXSW 2011 26
  37. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-ResearchFinding music with pictures - SXSW 2011 27
  38. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-ResearchFinding music with pictures - SXSW 2011 27
  39. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-ResearchFinding music with pictures - SXSW 2011 27
  40. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-ResearchFinding music with pictures - SXSW 2011 27
  41. Islands of Music self-organizing maps http://playground.last.fm/iom - Islands of Music - Elias PampalkFinding music with pictures - SXSW 2011 28
  42. nepTune http://www.cp.jku.at/projects/nepTune/Finding music with pictures - SXSW 2011 29
  43. Last.fm Artist Map http://sixdegrees.hu/last.fm/index.htmlFinding music with pictures - SXSW 2011 30
  44. Last.fm Artist Map http://sixdegrees.hu/last.fm/index.htmlFinding music with pictures - SXSW 2011 30
  45. Building an artist map The Goal - build an artist graph suitable for music exploration Problem: The artist space is very complexFinding music with pictures - SXSW 2011 31
  46. Building an artist map The Goal - build an artist graph suitable for music exploration Problem: The artist space is very complexFinding music with pictures - SXSW 2011 31
  47. Making a good graph • Minimize edge crossings, bends and curves Good Bad • Maximize angular resolution, symmetry Good BadCognitive measurements of graph aesthetics, Ware Purchase Colpoys McGill , , , 32
  48. Graphing the Beatles Neighborhood digraph { "The Beatles" -> "Electric Light Orchestra"; "The Beatles" -> "The Rutles"; "The Beatles" -> "The Dave Clark Five"; "The Beatles" -> "The Tremeloes"; "The Beatles" -> "Manfred Mann"; "The Beatles" -> "The Lovin Spoonful"; "The Beatles" -> "The Rolling Stones"; "The Beatles" -> "Creedence Clearwater Revival"; "The Beatles" -> "Bee Gees"; "The Beatles" -> "the Hollies"; "The Beatles" -> "Badfinger"; "The Beatles" -> "Paul McCartney"; "The Beatles" -> "Julian Lennon"; "The Beatles" -> "George Harrison"; "The Beatles" -> "John Lennon"; } http://www.graphviz.org/ 33Finding music with pictures - SXSW 2011
  49. Artist map - level 1 outFinding music with pictures - SXSW 2011 Already interconnections start to overwhelm 34
  50. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  51. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  52. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  53. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  54. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  55. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  56. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  57. Artist map - level 1 in/outFinding music with pictures - SXSW 2011 35
  58. Artist map - level 2 116 artists and 665 edges. We are totally overwhelmed.Finding music with pictures - SXSW 2011 36
  59. Artist map - level 2 116 artists and 665 edges. We are totally overwhelmed.Finding music with pictures - SXSW 2011 36
  60. Simplifying the graph Eliminate the edges and use spring force embedding to position the artistsFinding music with pictures - SXSW 2011 37
  61. Simplifying the graph Eliminate the edges and use spring force embedding to position the artistsFinding music with pictures - SXSW 2011 37
  62. Reducing the edges Attach artists to only one most similar artistFinding music with pictures - SXSW 2011 38
  63. Reducing the edges Attach artists to only one most similar artistFinding music with pictures - SXSW 2011 38
  64. Reducing the edges Attach artists to only one most similar artistFinding music with pictures - SXSW 2011 38
  65. Reducing the edges Attach artists to only one most similar artist wtf?Finding music with pictures - SXSW 2011 38
  66. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarityFinding music with pictures - SXSW 2011 39
  67. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarityFinding music with pictures - SXSW 2011 39
  68. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarityFinding music with pictures - SXSW 2011 39
  69. One more problem ... Graph is not 100% connected.Finding music with pictures - SXSW 2011 40
  70. One more problem ... Graph is not 100% connected.Finding music with pictures - SXSW 2011 40
  71. Making the graph connected Build a minimum spanning tree from the graphFinding music with pictures - SXSW 2011 41
  72. Making the graph connected Build a minimum spanning tree from the graphFinding music with pictures - SXSW 2011 41
  73. 2K artists A browsing network for music discoveryFinding music with pictures - SXSW 2011 42
  74. 2K artists A browsing network for music discoveryFinding music with pictures - SXSW 2011 42
  75. Interactive Mirrored Radio dial - by thomwatsonFinding music with pictures - SXSW 2011 43
  76. The SXSW Music MazeFinding music with pictures - SXSW 2011 http://static.echonest.com/SxswMusicMaze/SxswMusicMaze.html 44
  77. liveplasmahttp://liveplasma.com 45
  78. Flow ListFinding music with pictures - SXSW 2011 http://bowr.de/flowlist/flowlist.html 46
  79. MoodLogicFinding music with pictures - SXSW 2011 47
  80. Mr. Emo: Music Retrieval in the Emotional Plane http://mpac.ee.ntu.edu.tw/~yihsuan/pub/MM08_MrEmo.pdfFinding music with pictures - SXSW 2011 48
  81. Music BoxFinding music with pictures - SXSW 2011 http://thesis.flyingpudding.com/ - Anita Lillie 49
  82. 3D Track similarity The Mufin PlayerFinding music with pictures - SXSW 2011 50
  83. DiscovrFinding music with pictures - SXSW 2011 51
  84. Hitlantis www.hitlantis.comFinding music with pictures - SXSW 2011 52
  85. SongExplorer SongExplorer: Exploring Large Musical Databases Using a Tabletop Interface Carles F. Julià - Music Technology Group - Universitat Pompeu FabraFinding music with pictures - SXSW 2011 53
  86. Search Inside the Music http://mediacast.sun.com/share/plamere/sitm_final.pdf - Lamere, EckFinding music with pictures - SXSW 2011 54

×