SlideShare a Scribd company logo
1 of 86
Download to read offline
Finding Music With Pictures:
Data Visualization for Discovery
Paul Lamere   The Echo Nest        #musicviz
Music Discovery Challenge




                            2
Music Discovery Challenge
                    Listener Study

              Listeners         5,000

            Average Songs
                                3,500
              Per User

           Percent of songs
                                65%
           never listened to




                                        3
Ishkur’s Guide to Electronic Dance Music




                                           4
Why Visualize?
Visualizations can engage our pattern-matching brain




                                                       5
Human rendered visualizations




                                6
Visualizations as a tree




1939                              7
Visualizations as a tree




1939                              7
Visualizations as a tree




1939                              7
The greatest visualization ever?




                                   8
ng underground
                                                         Visualizations as a Map
hart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helped
plausible
ry of 20th
ndon
 ed by
 t Simon
he tube
mous
 reat Bear,
 em all link
o find a
n. But for
hange had
 musical

of coloured
  ed to-
, but the
 e quickly
  op inter-
  that had to
 usic for the
 here,
 Docklands
ouple of
one after-
  almost all
ost of the
stations
 lectic
ost impor-
e signifi-
  most de-
ey never

 he next
 to writing
 t (sorry,
 nyrd), ago-
 , asking
 vice for in-
 nd swear-
 , there
 ys. It just

be objec-
 nd are in
 early
 logy wher-
wed it. Each
genre: rock
 sychedelia
  ondon;
 mden, into
  If I was re-
  oed the
ury & Is-
  ily Stone.
 d flaws.
yrinthine
  be imper-
  s pop stop
  draw a de-
 unk? These
 ed record
 and they’re
  ut I think
able given

with omis-
ple, that
 s in tan-
 r Metro-
 room for
inogue and
 so point
m explod-
 tern, pre-
music.
 necessi-
d’s under-
 sive refer-
tack. For
 xception to
 rd.
 ive history
o see if one
laid on a
e elegance
gn – its
 sections,
anting tan-
all sucked
tle of the
ther con-
ain’s innate
 cture. Plus
 journalism
s should


 map at



 send at
ndrew
 d.




                 Dorian Lynskey - The Guardian
                                                                Music History as a London Tube Map                                                                             9
ng underground
                                                         Visualizations as a Map
hart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helped
plausible
ry of 20th
ndon
 ed by
 t Simon
he tube
mous
 reat Bear,
 em all link
o find a
n. But for
hange had
 musical

of coloured
  ed to-
, but the
 e quickly
  op inter-
  that had to
 usic for the
 here,
 Docklands
ouple of
one after-
  almost all
ost of the
stations
 lectic
ost impor-
e signifi-
  most de-
ey never

 he next
 to writing
 t (sorry,
 nyrd), ago-
 , asking
 vice for in-
 nd swear-
 , there
 ys. It just

be objec-
 nd are in
 early
 logy wher-
wed it. Each
genre: rock
 sychedelia
  ondon;
 mden, into
  If I was re-
  oed the
ury & Is-
  ily Stone.
 d flaws.
yrinthine
  be imper-
  s pop stop
  draw a de-
 unk? These
 ed record
 and they’re
  ut I think
able given

with omis-
ple, that
 s in tan-
 r Metro-
 room for
inogue and
 so point
m explod-
 tern, pre-
music.
 necessi-
d’s under-
 sive refer-
tack. For
 xception to
 rd.
 ive history
o see if one
laid on a
e elegance
gn – its
 sections,
anting tan-
all sucked
tle of the
ther con-
ain’s innate
 cture. Plus
 journalism
s should


 map at



 send at
ndrew
 d.




                 Dorian Lynskey - The Guardian
                                                                Music History as a London Tube Map                                                                             9
Genre Map




Ben Discoe   http://www.washedashore.com/music/genremap.html   10
Map of Metal




                                               http://mapofmetal.com
Finding music with pictures - SXSW 2011                                11
Visualization as a Time Series




     Genealogy of Pop and Rock Music - Reebee Garofalo
                                                         12
Visualization as a Time Series




     Genealogy of Pop and Rock Music - Reebee Garofalo
                                                         12
Visualization as a Time Series




     Genealogy of Pop and Rock Music - Reebee Garofalo
                                                         12
Visualization as a Time Series




     Genealogy of Pop and Rock Music - Reebee Garofalo
                                                         12
Visualizations as a graph




               http://www.homeofmetal.com/   13
Seattle Band Map




                   http://www.seattlebandmap.com/   14
Seattle Band Map




    http://www.seattlebandmap.com/   15
Hybrid visualization




School of rock                          franksreelreviews.com   16
Hybrid visualization




School of rock                          franksreelreviews.com   16
Hybrid visualization




School of rock                          franksreelreviews.com   16
Other types of visualizations




                                17
Other types of visualizations




                                18
Other types of visualizations




                                19
Other types of visualizations




                                20
Other types of visualizations




                                21
Computer rendered visualizations




                                   22
Time Series




Finding music with pictures - SXSW 2011             23
Visualizing Listening History




                              http://www.leebyron.com/what/lastfm/ - Lee Byron
Finding music with pictures - SXSW 2011                                          24
Visualizing Listening History




                              http://www.leebyron.com/what/lastfm/ - Lee Byron
Finding music with pictures - SXSW 2011                                          24
Maps and Graphs




Finding music with pictures - SXSW 2011       25
The World Of Music




                 http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html
                        David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang
  z
Finding music with pictures - SXSW 2011                                                  26
The World Of Music




                 http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html
                        David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang
  z
Finding music with pictures - SXSW 2011                                                  26
The Landscape of Music




                                          The Landscape of Music
                                           by Gansner, Hu, Kobourov and Volinsky
  AT&T Labs-Research

Finding music with pictures - SXSW 2011                                            27
The Landscape of Music




                                          The Landscape of Music
                                           by Gansner, Hu, Kobourov and Volinsky
  AT&T Labs-Research

Finding music with pictures - SXSW 2011                                            27
The Landscape of Music




                                          The Landscape of Music
                                           by Gansner, Hu, Kobourov and Volinsky
  AT&T Labs-Research

Finding music with pictures - SXSW 2011                                            27
The Landscape of Music




                                          The Landscape of Music
                                           by Gansner, Hu, Kobourov and Volinsky
  AT&T Labs-Research

Finding music with pictures - SXSW 2011                                            27
Islands of Music




                                      self-organizing maps
                       http://playground.last.fm/iom - Islands of Music - Elias Pampalk
Finding music with pictures - SXSW 2011                                                   28
nepTune




                                      http://www.cp.jku.at/projects/nepTune/
Finding music with pictures - SXSW 2011                                        29
Last.fm Artist Map




                                      http://sixdegrees.hu/last.fm/index.html
Finding music with pictures - SXSW 2011                                         30
Last.fm Artist Map




                                      http://sixdegrees.hu/last.fm/index.html
Finding music with pictures - SXSW 2011                                         30
Building an artist map
                    The Goal - build an artist graph suitable for music exploration




                             Problem: The artist space is very complex
Finding music with pictures - SXSW 2011                                               31
Building an artist map
                    The Goal - build an artist graph suitable for music exploration




                             Problem: The artist space is very complex
Finding music with pictures - SXSW 2011                                               31
Making a good graph

         • Minimize edge crossings, bends and curves
                              Good                                     Bad


         • Maximize angular resolution, symmetry
                              Good                                     Bad




Cognitive measurements of graph aesthetics, Ware Purchase Colpoys McGill
                                                        ,     ,    ,


                                                                             32
Graphing the Beatles Neighborhood

   digraph {
        "The Beatles" ->   "Electric Light Orchestra";
        "The Beatles" ->   "The Rutles";
        "The Beatles" ->   "The Dave Clark Five";
        "The Beatles" ->   "The Tremeloes";
        "The Beatles" ->   "Manfred Mann";
        "The Beatles" ->   "The Lovin' Spoonful";
        "The Beatles" ->   "The Rolling Stones";
        "The Beatles" ->   "Creedence Clearwater Revival";
        "The Beatles" ->   "Bee Gees";
        "The Beatles" ->   "the Hollies";
        "The Beatles" ->   "Badfinger";
        "The Beatles" ->   "Paul McCartney";
        "The Beatles" ->   "Julian Lennon";
        "The Beatles" ->   "George Harrison";
        "The Beatles" ->   "John Lennon";
   }




  http://www.graphviz.org/
                                                             33
Finding music with pictures - SXSW 2011
Artist map - level 1 out




Finding music with pictures - SXSW 2011
                                          Already interconnections start to overwhelm   34
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 1 in/out




Finding music with pictures - SXSW 2011                     35
Artist map - level 2




                            116 artists and 665 edges. We are totally overwhelmed.
Finding music with pictures - SXSW 2011                                              36
Artist map - level 2




                            116 artists and 665 edges. We are totally overwhelmed.
Finding music with pictures - SXSW 2011                                              36
Simplifying the graph




                  Eliminate the edges and use spring force embedding to position the artists
Finding music with pictures - SXSW 2011                                                        37
Simplifying the graph




                  Eliminate the edges and use spring force embedding to position the artists
Finding music with pictures - SXSW 2011                                                        37
Reducing the edges


                                          Attach artists to only one most similar artist




Finding music with pictures - SXSW 2011                                                    38
Reducing the edges


                                          Attach artists to only one most similar artist




Finding music with pictures - SXSW 2011                                                    38
Reducing the edges


                                          Attach artists to only one most similar artist




Finding music with pictures - SXSW 2011                                                    38
Reducing the edges


                                          Attach artists to only one most similar artist




                                                                           wtf?




Finding music with pictures - SXSW 2011                                                    38
Putting ELO II in its place




                      Attach artists to the most similar artist that has greater familiarity
Finding music with pictures - SXSW 2011                                                        39
Putting ELO II in its place




                      Attach artists to the most similar artist that has greater familiarity
Finding music with pictures - SXSW 2011                                                        39
Putting ELO II in its place




                      Attach artists to the most similar artist that has greater familiarity
Finding music with pictures - SXSW 2011                                                        39
One more problem ...




                                          Graph is not 100% connected.
Finding music with pictures - SXSW 2011                                  40
One more problem ...




                                          Graph is not 100% connected.
Finding music with pictures - SXSW 2011                                  40
Making the graph connected




                                 Build a minimum spanning tree from the graph
Finding music with pictures - SXSW 2011                                         41
Making the graph connected




                                 Build a minimum spanning tree from the graph
Finding music with pictures - SXSW 2011                                         41
2K artists




                                    A browsing network for music discovery
Finding music with pictures - SXSW 2011                                      42
2K artists




                                    A browsing network for music discovery
Finding music with pictures - SXSW 2011                                      42
Interactive




                                      Mirrored Radio dial - by thomwatson
Finding music with pictures - SXSW 2011                                     43
The SXSW Music Maze




Finding music with pictures - SXSW 2011   http://static.echonest.com/SxswMusicMaze/SxswMusicMaze.html   44
liveplasma




http://liveplasma.com
                                     45
Flow List




Finding music with pictures - SXSW 2011        http://bowr.de/flowlist/flowlist.html   46
MoodLogic




Finding music with pictures - SXSW 2011               47
Mr. Emo: Music Retrieval in the Emotional Plane




                          http://mpac.ee.ntu.edu.tw/~yihsuan/pub/MM08_MrEmo.pdf
Finding music with pictures - SXSW 2011                                           48
Music Box




Finding music with pictures - SXSW 2011      http://thesis.flyingpudding.com/ - Anita Lillie   49
3D Track similarity




                                          The Mufin Player
Finding music with pictures - SXSW 2011                     50
Discovr




Finding music with pictures - SXSW 2011             51
Hitlantis




                                          www.hitlantis.com
Finding music with pictures - SXSW 2011                       52
SongExplorer




                 SongExplorer: Exploring Large Musical Databases Using a Tabletop Interface
                    Carles F. Julià - Music Technology Group - Universitat Pompeu Fabra
Finding music with pictures - SXSW 2011                                                       53
Search Inside the Music




                     http://mediacast.sun.com/share/plamere/sitm_final.pdf - Lamere, Eck
Finding music with pictures - SXSW 2011                                                   54

More Related Content

What's hot

Short ride
Short rideShort ride
Short rideRSNO
 
Grade 10 Music q1 New and electronic music
Grade 10 Music q1 New and electronic musicGrade 10 Music q1 New and electronic music
Grade 10 Music q1 New and electronic musicJoseph John Patitico
 
History of music
History of musicHistory of music
History of musicUdesss11
 
Prelude 6 - Modernism
Prelude 6 - ModernismPrelude 6 - Modernism
Prelude 6 - ModernismLaura Riddle
 
Musica del siglo xx artistas)
Musica del siglo xx artistas)Musica del siglo xx artistas)
Musica del siglo xx artistas)Melisa Gette
 
A2 Media Studies Genre Convention of Rock Music Video
A2 Media Studies Genre Convention of Rock Music VideoA2 Media Studies Genre Convention of Rock Music Video
A2 Media Studies Genre Convention of Rock Music Videonikoletawu
 
Intro to music history
Intro to music historyIntro to music history
Intro to music historyConlon111
 
Filipino hiphop presentation
Filipino hiphop presentationFilipino hiphop presentation
Filipino hiphop presentationElaine Lee
 
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative music
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative musicPHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative music
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative musicMony Romana
 
Dance 2 jazz powerpoint evolution
Dance 2 jazz powerpoint evolution Dance 2 jazz powerpoint evolution
Dance 2 jazz powerpoint evolution tbrand3
 
The history of_music_senior_project_do_not_delete_v3[1]
The history of_music_senior_project_do_not_delete_v3[1]The history of_music_senior_project_do_not_delete_v3[1]
The history of_music_senior_project_do_not_delete_v3[1]patrickst123
 
Music Through The Ages Power Point
Music Through The Ages Power PointMusic Through The Ages Power Point
Music Through The Ages Power Pointhudelsor
 
Chicos presentation4
Chicos presentation4Chicos presentation4
Chicos presentation4fyivibes
 

What's hot (20)

Short ride
Short rideShort ride
Short ride
 
Grade 10 Music q1 New and electronic music
Grade 10 Music q1 New and electronic musicGrade 10 Music q1 New and electronic music
Grade 10 Music q1 New and electronic music
 
20th century1900
20th century190020th century1900
20th century1900
 
History of music
History of musicHistory of music
History of music
 
Prelude 6 - Modernism
Prelude 6 - ModernismPrelude 6 - Modernism
Prelude 6 - Modernism
 
Musica del siglo xx artistas)
Musica del siglo xx artistas)Musica del siglo xx artistas)
Musica del siglo xx artistas)
 
A2 Media Studies Genre Convention of Rock Music Video
A2 Media Studies Genre Convention of Rock Music VideoA2 Media Studies Genre Convention of Rock Music Video
A2 Media Studies Genre Convention of Rock Music Video
 
Intro to music history
Intro to music historyIntro to music history
Intro to music history
 
Filipino hiphop presentation
Filipino hiphop presentationFilipino hiphop presentation
Filipino hiphop presentation
 
Jass music
Jass musicJass music
Jass music
 
Musical genres
Musical genresMusical genres
Musical genres
 
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative music
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative musicPHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative music
PHILIPPINE CONTEMPORARY POPULAR MUSIC 90s alternative music
 
2006raport 4muzyka
2006raport 4muzyka2006raport 4muzyka
2006raport 4muzyka
 
Dance 2 jazz powerpoint evolution
Dance 2 jazz powerpoint evolution Dance 2 jazz powerpoint evolution
Dance 2 jazz powerpoint evolution
 
What is musicology 2013
What is musicology 2013What is musicology 2013
What is musicology 2013
 
a brief History of music
a brief History of musica brief History of music
a brief History of music
 
The history of_music_senior_project_do_not_delete_v3[1]
The history of_music_senior_project_do_not_delete_v3[1]The history of_music_senior_project_do_not_delete_v3[1]
The history of_music_senior_project_do_not_delete_v3[1]
 
Music Through The Ages Power Point
Music Through The Ages Power PointMusic Through The Ages Power Point
Music Through The Ages Power Point
 
Presentation #2
Presentation #2Presentation #2
Presentation #2
 
Chicos presentation4
Chicos presentation4Chicos presentation4
Chicos presentation4
 

Similar to Finding Music With Pictures: Using Visualization for Discovery

Music homework final copy
Music homework final copyMusic homework final copy
Music homework final copyRoom23BBI
 
How Music Changed The Era Of Popular Music
How Music Changed The Era Of Popular MusicHow Music Changed The Era Of Popular Music
How Music Changed The Era Of Popular MusicAmanda Burkett
 
презентация Music
презентация Musicпрезентация Music
презентация MusicGlory21
 
Performance practice 2013– performance as discipline
Performance practice 2013– performance as disciplinePerformance practice 2013– performance as discipline
Performance practice 2013– performance as disciplineheatherseelbach
 
Session 7 Zappa Presentation 1
Session 7 Zappa Presentation 1Session 7 Zappa Presentation 1
Session 7 Zappa Presentation 1Paul Carr
 
Session 7 zappa presentation 1
Session 7 zappa presentation 1Session 7 zappa presentation 1
Session 7 zappa presentation 1Paul Carr
 
Task 2 genre research- conventions and history
Task 2  genre research- conventions and historyTask 2  genre research- conventions and history
Task 2 genre research- conventions and historymediageek5
 
Genre research media
Genre research mediaGenre research media
Genre research mediaMsiscar76
 
PHMF_catalog_digital-print
PHMF_catalog_digital-printPHMF_catalog_digital-print
PHMF_catalog_digital-printGail Heidel
 

Similar to Finding Music With Pictures: Using Visualization for Discovery (13)

Music homework final copy
Music homework final copyMusic homework final copy
Music homework final copy
 
How Music Changed The Era Of Popular Music
How Music Changed The Era Of Popular MusicHow Music Changed The Era Of Popular Music
How Music Changed The Era Of Popular Music
 
презентация Music
презентация Musicпрезентация Music
презентация Music
 
Performance practice 2013– performance as discipline
Performance practice 2013– performance as disciplinePerformance practice 2013– performance as discipline
Performance practice 2013– performance as discipline
 
Twentieth Century Music
Twentieth Century MusicTwentieth Century Music
Twentieth Century Music
 
Session 7 Zappa Presentation 1
Session 7 Zappa Presentation 1Session 7 Zappa Presentation 1
Session 7 Zappa Presentation 1
 
LED Essay
LED EssayLED Essay
LED Essay
 
Session 7 zappa presentation 1
Session 7 zappa presentation 1Session 7 zappa presentation 1
Session 7 zappa presentation 1
 
A project about music
A project about musicA project about music
A project about music
 
Task 2 genre research- conventions and history
Task 2  genre research- conventions and historyTask 2  genre research- conventions and history
Task 2 genre research- conventions and history
 
Genre research media
Genre research mediaGenre research media
Genre research media
 
Twentieth Century Music
Twentieth Century MusicTwentieth Century Music
Twentieth Century Music
 
PHMF_catalog_digital-print
PHMF_catalog_digital-printPHMF_catalog_digital-print
PHMF_catalog_digital-print
 

More from Paul Lamere

How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015Paul Lamere
 
Sxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to musicSxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to musicPaul Lamere
 
Beyond the Play Button - The future of listening
Beyond the Play Button - The future of listeningBeyond the Play Button - The future of listening
Beyond the Play Button - The future of listeningPaul Lamere
 
Echo nest-api-boston-2012
Echo nest-api-boston-2012Echo nest-api-boston-2012
Echo nest-api-boston-2012Paul Lamere
 
I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what? I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what? Paul Lamere
 
Data Mining Music
Data Mining MusicData Mining Music
Data Mining MusicPaul Lamere
 
The Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack DayThe Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack DayPaul Lamere
 
Using Visualizations for Music Discovery
Using Visualizations for Music DiscoveryUsing Visualizations for Music Discovery
Using Visualizations for Music DiscoveryPaul Lamere
 
Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.Paul Lamere
 
Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)Paul Lamere
 
Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)Paul Lamere
 

More from Paul Lamere (11)

How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015
 
Sxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to musicSxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to music
 
Beyond the Play Button - The future of listening
Beyond the Play Button - The future of listeningBeyond the Play Button - The future of listening
Beyond the Play Button - The future of listening
 
Echo nest-api-boston-2012
Echo nest-api-boston-2012Echo nest-api-boston-2012
Echo nest-api-boston-2012
 
I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what? I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what?
 
Data Mining Music
Data Mining MusicData Mining Music
Data Mining Music
 
The Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack DayThe Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack Day
 
Using Visualizations for Music Discovery
Using Visualizations for Music DiscoveryUsing Visualizations for Music Discovery
Using Visualizations for Music Discovery
 
Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.
 
Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)
 
Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)
 

Recently uploaded

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 

Recently uploaded (20)

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 

Finding Music With Pictures: Using Visualization for Discovery

  • 1. Finding Music With Pictures: Data Visualization for Discovery Paul Lamere The Echo Nest #musicviz
  • 3. Music Discovery Challenge Listener Study Listeners 5,000 Average Songs 3,500 Per User Percent of songs 65% never listened to 3
  • 4. Ishkur’s Guide to Electronic Dance Music 4
  • 5. Why Visualize? Visualizations can engage our pattern-matching brain 5
  • 7. Visualizations as a tree 1939 7
  • 8. Visualizations as a tree 1939 7
  • 9. Visualizations as a tree 1939 7
  • 11. ng underground Visualizations as a Map hart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helped plausible ry of 20th ndon ed by t Simon he tube mous reat Bear, em all link o find a n. But for hange had musical of coloured ed to- , but the e quickly op inter- that had to usic for the here, Docklands ouple of one after- almost all ost of the stations lectic ost impor- e signifi- most de- ey never he next to writing t (sorry, nyrd), ago- , asking vice for in- nd swear- , there ys. It just be objec- nd are in early logy wher- wed it. Each genre: rock sychedelia ondon; mden, into If I was re- oed the ury & Is- ily Stone. d flaws. yrinthine be imper- s pop stop draw a de- unk? These ed record and they’re ut I think able given with omis- ple, that s in tan- r Metro- room for inogue and so point m explod- tern, pre- music. necessi- d’s under- sive refer- tack. For xception to rd. ive history o see if one laid on a e elegance gn – its sections, anting tan- all sucked tle of the ther con- ain’s innate cture. Plus journalism s should map at send at ndrew d. Dorian Lynskey - The Guardian Music History as a London Tube Map 9
  • 12. ng underground Visualizations as a Map hart the branches and connections of 100 years of music using the London Underground map? Dorian Lynskey explains how a box of coloured crayons and a lot of swearing helped plausible ry of 20th ndon ed by t Simon he tube mous reat Bear, em all link o find a n. But for hange had musical of coloured ed to- , but the e quickly op inter- that had to usic for the here, Docklands ouple of one after- almost all ost of the stations lectic ost impor- e signifi- most de- ey never he next to writing t (sorry, nyrd), ago- , asking vice for in- nd swear- , there ys. It just be objec- nd are in early logy wher- wed it. Each genre: rock sychedelia ondon; mden, into If I was re- oed the ury & Is- ily Stone. d flaws. yrinthine be imper- s pop stop draw a de- unk? These ed record and they’re ut I think able given with omis- ple, that s in tan- r Metro- room for inogue and so point m explod- tern, pre- music. necessi- d’s under- sive refer- tack. For xception to rd. ive history o see if one laid on a e elegance gn – its sections, anting tan- all sucked tle of the ther con- ain’s innate cture. Plus journalism s should map at send at ndrew d. Dorian Lynskey - The Guardian Music History as a London Tube Map 9
  • 13. Genre Map Ben Discoe http://www.washedashore.com/music/genremap.html 10
  • 14. Map of Metal http://mapofmetal.com Finding music with pictures - SXSW 2011 11
  • 15. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  • 16. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  • 17. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  • 18. Visualization as a Time Series Genealogy of Pop and Rock Music - Reebee Garofalo 12
  • 19. Visualizations as a graph http://www.homeofmetal.com/ 13
  • 20. Seattle Band Map http://www.seattlebandmap.com/ 14
  • 21. Seattle Band Map http://www.seattlebandmap.com/ 15
  • 22. Hybrid visualization School of rock franksreelreviews.com 16
  • 23. Hybrid visualization School of rock franksreelreviews.com 16
  • 24. Hybrid visualization School of rock franksreelreviews.com 16
  • 25. Other types of visualizations 17
  • 26. Other types of visualizations 18
  • 27. Other types of visualizations 19
  • 28. Other types of visualizations 20
  • 29. Other types of visualizations 21
  • 31. Time Series Finding music with pictures - SXSW 2011 23
  • 32. Visualizing Listening History http://www.leebyron.com/what/lastfm/ - Lee Byron Finding music with pictures - SXSW 2011 24
  • 33. Visualizing Listening History http://www.leebyron.com/what/lastfm/ - Lee Byron Finding music with pictures - SXSW 2011 24
  • 34. Maps and Graphs Finding music with pictures - SXSW 2011 25
  • 35. The World Of Music http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang z Finding music with pictures - SXSW 2011 26
  • 36. The World Of Music http://www.stanford.edu/~dgleich/demos/worldofmusic/WorldOfMusic.html David Gleich, Matt Rasmussen, Leonid Zhukov, and Kevin Lang z Finding music with pictures - SXSW 2011 26
  • 37. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-Research Finding music with pictures - SXSW 2011 27
  • 38. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-Research Finding music with pictures - SXSW 2011 27
  • 39. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-Research Finding music with pictures - SXSW 2011 27
  • 40. The Landscape of Music The Landscape of Music by Gansner, Hu, Kobourov and Volinsky AT&T Labs-Research Finding music with pictures - SXSW 2011 27
  • 41. Islands of Music self-organizing maps http://playground.last.fm/iom - Islands of Music - Elias Pampalk Finding music with pictures - SXSW 2011 28
  • 42. nepTune http://www.cp.jku.at/projects/nepTune/ Finding music with pictures - SXSW 2011 29
  • 43. Last.fm Artist Map http://sixdegrees.hu/last.fm/index.html Finding music with pictures - SXSW 2011 30
  • 44. Last.fm Artist Map http://sixdegrees.hu/last.fm/index.html Finding music with pictures - SXSW 2011 30
  • 45. Building an artist map The Goal - build an artist graph suitable for music exploration Problem: The artist space is very complex Finding music with pictures - SXSW 2011 31
  • 46. Building an artist map The Goal - build an artist graph suitable for music exploration Problem: The artist space is very complex Finding music with pictures - SXSW 2011 31
  • 47. Making a good graph • Minimize edge crossings, bends and curves Good Bad • Maximize angular resolution, symmetry Good Bad Cognitive measurements of graph aesthetics, Ware Purchase Colpoys McGill , , , 32
  • 48. Graphing the Beatles Neighborhood digraph { "The Beatles" -> "Electric Light Orchestra"; "The Beatles" -> "The Rutles"; "The Beatles" -> "The Dave Clark Five"; "The Beatles" -> "The Tremeloes"; "The Beatles" -> "Manfred Mann"; "The Beatles" -> "The Lovin' Spoonful"; "The Beatles" -> "The Rolling Stones"; "The Beatles" -> "Creedence Clearwater Revival"; "The Beatles" -> "Bee Gees"; "The Beatles" -> "the Hollies"; "The Beatles" -> "Badfinger"; "The Beatles" -> "Paul McCartney"; "The Beatles" -> "Julian Lennon"; "The Beatles" -> "George Harrison"; "The Beatles" -> "John Lennon"; } http://www.graphviz.org/ 33 Finding music with pictures - SXSW 2011
  • 49. Artist map - level 1 out Finding music with pictures - SXSW 2011 Already interconnections start to overwhelm 34
  • 50. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 51. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 52. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 53. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 54. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 55. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 56. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 57. Artist map - level 1 in/out Finding music with pictures - SXSW 2011 35
  • 58. Artist map - level 2 116 artists and 665 edges. We are totally overwhelmed. Finding music with pictures - SXSW 2011 36
  • 59. Artist map - level 2 116 artists and 665 edges. We are totally overwhelmed. Finding music with pictures - SXSW 2011 36
  • 60. Simplifying the graph Eliminate the edges and use spring force embedding to position the artists Finding music with pictures - SXSW 2011 37
  • 61. Simplifying the graph Eliminate the edges and use spring force embedding to position the artists Finding music with pictures - SXSW 2011 37
  • 62. Reducing the edges Attach artists to only one most similar artist Finding music with pictures - SXSW 2011 38
  • 63. Reducing the edges Attach artists to only one most similar artist Finding music with pictures - SXSW 2011 38
  • 64. Reducing the edges Attach artists to only one most similar artist Finding music with pictures - SXSW 2011 38
  • 65. Reducing the edges Attach artists to only one most similar artist wtf? Finding music with pictures - SXSW 2011 38
  • 66. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarity Finding music with pictures - SXSW 2011 39
  • 67. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarity Finding music with pictures - SXSW 2011 39
  • 68. Putting ELO II in its place Attach artists to the most similar artist that has greater familiarity Finding music with pictures - SXSW 2011 39
  • 69. One more problem ... Graph is not 100% connected. Finding music with pictures - SXSW 2011 40
  • 70. One more problem ... Graph is not 100% connected. Finding music with pictures - SXSW 2011 40
  • 71. Making the graph connected Build a minimum spanning tree from the graph Finding music with pictures - SXSW 2011 41
  • 72. Making the graph connected Build a minimum spanning tree from the graph Finding music with pictures - SXSW 2011 41
  • 73. 2K artists A browsing network for music discovery Finding music with pictures - SXSW 2011 42
  • 74. 2K artists A browsing network for music discovery Finding music with pictures - SXSW 2011 42
  • 75. Interactive Mirrored Radio dial - by thomwatson Finding music with pictures - SXSW 2011 43
  • 76. The SXSW Music Maze Finding music with pictures - SXSW 2011 http://static.echonest.com/SxswMusicMaze/SxswMusicMaze.html 44
  • 78. Flow List Finding music with pictures - SXSW 2011 http://bowr.de/flowlist/flowlist.html 46
  • 79. MoodLogic Finding music with pictures - SXSW 2011 47
  • 80. Mr. Emo: Music Retrieval in the Emotional Plane http://mpac.ee.ntu.edu.tw/~yihsuan/pub/MM08_MrEmo.pdf Finding music with pictures - SXSW 2011 48
  • 81. Music Box Finding music with pictures - SXSW 2011 http://thesis.flyingpudding.com/ - Anita Lillie 49
  • 82. 3D Track similarity The Mufin Player Finding music with pictures - SXSW 2011 50
  • 83. Discovr Finding music with pictures - SXSW 2011 51
  • 84. Hitlantis www.hitlantis.com Finding music with pictures - SXSW 2011 52
  • 85. SongExplorer SongExplorer: Exploring Large Musical Databases Using a Tabletop Interface Carles F. Julià - Music Technology Group - Universitat Pompeu Fabra Finding music with pictures - SXSW 2011 53
  • 86. Search Inside the Music http://mediacast.sun.com/share/plamere/sitm_final.pdf - Lamere, Eck Finding music with pictures - SXSW 2011 54