Music data is
scary & beautiful & exciting

Brian Whitman
@bwhitman

co-Founder & CTO, The Echo Nest
@echonest
1995          2006          2011?




1999   2004          2009
care




       nice
25
                                                                                                                                      4



                        auditory spectrogram
                                                                                                                                  x 10
                                               20
                                                                                                                             2
                                               15

auditory spectrogram                           10
                                                                                                                             1

                                                                                                                             0
                                                   5


                                                   1
                                                                                                                           ! -1
                                                                                                                                                                                                beat markers
                                                    0        0.5       1            1.5             2 sec.
                                                1

                                                                                                                           ! -2
                                               0.8
                                                                                                                               0               5    10         15         20         25
                        segmentation




                                               0.6
                                                                                                                           240
           segments                            0.4                                                                         190

                                               0.2                                                                         143

                                                0                                                                          114
                                               B
                                                     0       0.5       1            1.5             2 sec.
                                                                                                                            96                                                                   tempogram
                                               A#
                                               A
                                                                                                                           72
                        pitch features




                                               G#
                                               G
                                                                                                                            60
       pitch features                                                                                                             0            5    10         15         20         25
                                               F#
                                               F
                                               E                                                                             1
                                               D#
                                               D
                                               C#                                                                          0.8
                                               C
                                                     0       0.5       1            1.5             2 sec.
                                                                                                                           0.6
                                               25


                                               20
                                                                                                                           0.4                                                                  tempo spectrum
                        timbre features




                                               15
                                                                                                                           0.2
     timbre features                           10                                                                            0
                                                                                                                              60          72       96    114        143        190        240
                                                5


                                                1
                                                         2   4     6       8   10         12   14            16 segments
The industry is always watching.
They make invisible decisions from invented data.
A 5MB song unpacks 100MB of information about itself
Music Acquisition (2001-)
The unintended power of APIs
Music Hack Days
Developers are the future of music
006          2011




      2009          201X...
Brian Whitman - Music data is scary & beautiful & exciting

Brian Whitman - Music data is scary & beautiful & exciting

  • 1.
    Music data is scary& beautiful & exciting Brian Whitman @bwhitman co-Founder & CTO, The Echo Nest @echonest
  • 6.
    1995 2006 2011? 1999 2004 2009
  • 7.
    care nice
  • 9.
    25 4 auditory spectrogram x 10 20 2 15 auditory spectrogram 10 1 0 5 1 ! -1 beat markers 0 0.5 1 1.5 2 sec. 1 ! -2 0.8 0 5 10 15 20 25 segmentation 0.6 240 segments 0.4 190 0.2 143 0 114 B 0 0.5 1 1.5 2 sec. 96 tempogram A# A 72 pitch features G# G 60 pitch features 0 5 10 15 20 25 F# F E 1 D# D C# 0.8 C 0 0.5 1 1.5 2 sec. 0.6 25 20 0.4 tempo spectrum timbre features 15 0.2 timbre features 10 0 60 72 96 114 143 190 240 5 1 2 4 6 8 10 12 14 16 segments
  • 14.
    The industry isalways watching. They make invisible decisions from invented data.
  • 15.
    A 5MB songunpacks 100MB of information about itself
  • 22.
  • 24.
  • 25.
  • 33.
    Developers are thefuture of music
  • 34.
    006 2011 2009 201X...