SlideShare a Scribd company logo
The Echo Nest Solution
understanding music content and consumers

                  Rich Music Data




        content                     culture




  12 years of R&D at MIT, Columbia and Berkeley


         Our API is our product
Our API

Our API is our product. Everything a
customer can do so can you.

developer.echonest.com
Artist API
          2 million artists
• Search             • News
• Similar            • Reviews
• Familiarity        • Images
• Hottttnesss        • Video
• Bios               • Location
• Blogs              • Suggest
• Terms              • Extract
SIMILAR ARTISTS IN 2 LINES OF CODE
for a in artist.similar(names=['lady gaga']):           print
a.name




    MadonnaChristina AguileraBritney SpearsKylie MinogueKaty
    PerryScissor SistersRihannaBeyoncéAshley TisdaleLivvi FrancLa
    RouxParis HiltonShe Wants RevengeThe Pussycat DollsMarina and
    The Diamonds
Top recent news stories for Adele
 adele = artist.Artist('Adele')for news in adele.news:                    print
 news['date_posted'], news['name']




2012-02-06T17:37:00 Grammys: Who Should Win the Major Categories2012-02-06T00:00:00
Noel Gallagher: Adele's Music Career Won't Last2012-02-06T00:00:00 Noel Gallagher Admits
He Feels Sorry For Adele2012-02-06T00:00:00 Dave Grohl's Grammy pride2012-02-
06T00:00:00 British Artists Dominate 2011 Market: Adele, Jessie J2012-02-06T00:00:00 Adele
called 'too fat'
Song API
              30 million songs
• Search                 • Segments
• Similar Songs          • Timbre
• Tempo                  • Pitch
• Key & Mode             • Loudness
• Time Signature         • Energy
• Beats                  • Danceability
• Downbeats              • Speechiness
Track Analysis and Remix Summary
Song I/O
  • Upload to analyze tracks
  • Render audio and video
                                       auditory spectrogram

Song search
  • Search for songs
                                                   segments

Song analysis
  • Tempo, Key, Mode, Time Signature
Song Hierarchy                                 pitch features

  • Section, Bars, Beats, Tatums
Segments
  • Timbre, Pitch, Loudness                   timbre features


  Manipulations
  • Rearranging, blending, time stretching,
    pitch shifting, video, looping,                             It turns music into silly putty
  • fade-ins, fade-outs, crossfades, find
    similar, sorting
Song API example


Find the loudest songs by thrash artists
  song/search?sort=loudness-desc&description=thrash



Find indie songs for jogging
  song/search?min_tempo=120&style=indie&max_tempo=125


Find hottest songs by Lady Gaga
 song/search?sort=hotttnesss-desc&artist=lady+gaga
Audio properties in a few lines of code

results = song.search(artist='Michael Jackson', title='billie jean')if
len(results) > 0: print 'tempo', results[0].audio_summary['tempo']
   print 'dance', results[0].audio_summary['danceability']     print
'energy', results[0].audio_summary['energy']



           tempo 117.128dance 0.97energy 0.47
More APIs!

• Taste Profiles for personalization
• Advanced Playlisting
• Song identification
Plus, client libraries for popular platforms:
     Python Java Ruby iOS Android etc
ARTIST RADIO IN 2 LINES OF CODE

for song in playlist.static(type='artist-radio', artist='weezer'):          print son
song.artist_name




              Island In The Sun by Weezer1979 by The Smashing PumpkinsWalk by
              Foo FightersDance, Dance by Fall Out BoyBlast Off! by Rivers
              CuomoOh Me, Oh My by Nerf HerderBirdhouse in Your Soul by They
              Might Be GiantsSmells Like Teen Spirit by NirvanaAlison by Elvis
              CostelloGirl, You'll Be a Woman Soon by Urge OverkillStacy's Mom by
              Fountains of WayneThe Middle by Jimmy Eat WorldWorry A Lot by The
              Like Young1985 by Bowling for SoupDo You Realize?? by The Flaming
              Lips
Our playlist engine powers the listening
experience for millions of music listeners
The Playlist API

• Fine grained control over:
 • artist selection, variety
    • hotttness, familiarity, location
 • song selection
    • Any musical attributes (e.g. tempo range, key)
 • song ordering
    • Artist or song attributes (e.g. loudness)
Some examples


• Play tracks by Weezer and Radiohead
  playlist/static?&artist=weezer&artist=radiohead&results=20&type=artist


• Weezer artist radio
  playlist/static?&artist=weezer&artist=radiohead&type=artist-radio


• Playlist of music by pop divas ordered by tempo
  playlist/static?&description=pop&description=diva&type=artist-
  description&artist_min_familiarity=.9&sort=tempo-asc
Audio Fingerprinter


• Identify songs based upon audio
• Fingerprinter executables and libraries for
  Windows, Mac and Linux
• Song ID typically in less than a second per song
• Currently in beta
• More info at:
http://groups.google.com/group/enmfp
Easy Integration
•   7Digital             •   Deezer
•   Spotify              •   Discogs
•   Rhapsody             •   EMI
•   Lyricfind            •   Jambase
•   Seatwave             •   MusixMatch
•   Rdio                 •   SongMeanings
•   Free Music Archive   •   Twitter
•   Facebook             •   Songkick
•   MusicBrainz
Open EMI
• Dozens of artist sandboxes
• Audio
• Video
• Images
• More ...
Content Available
                Audio (inc metadata)   Video                Imagery       Promo Tools     Web Tools

    Selection       2,000 tracks

                Over 10,000 tracks
                       + artwork


                      70 tracks

                                                                                        Web banners
                     41 albums            135          86 Image assets
                                                       27 Photosessions
                                                                              26        Games
                       + artwork       (coming soon)
                                                                                        Screensavers

                     71 albums            180          26 Image assets                  Web banners
                                                       8 Photosessions
                                                                              35        Games
                       + artwork       (coming soon)



                     24 albums             32          Logos
                                                       2 Photosessions
                                                                              16
                       + artwork       (coming soon)



                     11 albums             49          Logos
                                                       4 Photosessions
                                                                               9
                       + artwork       (coming soon)




                     13 albums             31          Logos
                                                       Photosession
                                                                              12
                       + artwork       (coming soon)



                     14 albums             27          Logos
                                                       5 Photosessions
                                                                              11
                       + artwork       (coming soon)



                     10 albums             23          Logo
                                                       {hotosession
                                                                               9
                       + artwork       (coming soon)
                                                                                                       19
Get ready for Christmas!
Constrain song searches and playlists to songs that match a
given ‘song type’


Example:     Justin Bieber Christmas Radio


http://developer.echonest.com/api/v4/playlist/static?api_key=key&art
song_type=christmas



      Demo: http://static.echo
nest.com/demo/xmas.html
Some cool things people have built
   with The Echo Nest API
The Music Maze
Map of Music Styles
Roadtrip Mixtape
Playlist demos
Bipolar Radio - one button steering
Playlist demos
Boil the frog - path finding through the artist space
Stewart Copeland




#SXMusicData   http://labs.echonest.com/click/
The Machine




#SXMusicData
MIDEM Music Machine




             QuickTime™ and a
           H.264 decompressor
     are needed to see this picture.
Bangarang Boomerang




http://static.echonest.com/BohemianRhapsichord/index.html
http://static.echonest.com/BohemianRhapsichord/index.html
The Infinite Jukebox
The Infinite Jukebox




     infinitejuke.com
Echo Nest Remix




Turns music into silly putty
With remix you can
             chop sound into:
Sections

Bars

Beats
                              And then
                          programmatically
Tatums                   manipulate all of the
                           bits and pieces
Segments
slicing and dicing
   Create a remix from beat one of every bar
   Create a remix from beat one of every bar




    bars = audiofile.analysis.bars    collect =
[]    for bar in bars:
collect.append(bar.children()[0])    out =
audio.getpieces(audiofile, collect)
out.encode(output_filename)
 audio.getpieces(audiofile, collect)
out.encode(output_filename)
beat reversing




    beats = audiofile.analysis.beats   collec
= []
    beats.reverse()    for beat in beats:
 collect.append(beat)    out =
audio.getpieces(audiofile, collect)
out.encode(output_filename)
 audio.getpieces(audiofile, collect)
out.encode(output_filename)
 audio.getpieces(audiofile, collect)
remix video
Tristan’s The Swinger
               Makes any song swing
               Makes any song swing




#MusicData
Echo Nest Remix




http://echonest.github.com/remix/
How can I get started?

Get a key & check out our api docs -
developer.echonest.com
Get a wrapper for your language - C,
iOS, Python, Java, Ruby, PHP, more
If you want to make music get Remix
from our GitHub: github.com/echonest/
Talk to us!
      paul@echonest.com
developer.echonest.com




     paul@echonest.com

More Related Content

What's hot

楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索
台灣資料科學年會
 
machine learning x music
machine learning x musicmachine learning x music
machine learning x music
Yi-Hsuan Yang
 
20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir
Yi-Hsuan Yang
 
Understanding Music Playlists
Understanding Music PlaylistsUnderstanding Music Playlists
Understanding Music Playlists
Keunwoo Choi
 
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR TechniquesLearning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Yi-Hsuan Yang
 
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
Yi-Hsuan Yang
 
I've got key to your API, now what?
I've got key to your API, now what?I've got key to your API, now what?
I've got key to your API, now what?
Javaun Moradi
 
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
Public Broadcasting Service
 
social web music
social web musicsocial web music
social web music
claudio b
 
Teaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology ResourcesTeaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology Resourcesbradfordswanson
 
The effects of noisy labels on deep convolutional neural networks for music t...
The effects of noisy labels on deep convolutional neural networks for music t...The effects of noisy labels on deep convolutional neural networks for music t...
The effects of noisy labels on deep convolutional neural networks for music t...
Keunwoo Choi
 
Artificial intelligence and Music
Artificial intelligence and MusicArtificial intelligence and Music
Artificial intelligence and Music
Jehoshaphat Abu
 
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Oscar Celma
 
Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)
Paul Lamere
 
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
Gilberto Bernardes
 
Digital Music distribution: Streaming
Digital Music distribution: StreamingDigital Music distribution: Streaming
Digital Music distribution: Streaming
Andy Richards
 
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
Keunwoo Choi
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)
Adam Sporka
 
Flat plan digipak
Flat plan digipakFlat plan digipak
Flat plan digipak
myajade
 

What's hot (20)

楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索
 
machine learning x music
machine learning x musicmachine learning x music
machine learning x music
 
20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir
 
Understanding Music Playlists
Understanding Music PlaylistsUnderstanding Music Playlists
Understanding Music Playlists
 
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR TechniquesLearning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
 
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
 
I've got key to your API, now what?
I've got key to your API, now what?I've got key to your API, now what?
I've got key to your API, now what?
 
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
 
social web music
social web musicsocial web music
social web music
 
Teaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology ResourcesTeaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology Resources
 
The effects of noisy labels on deep convolutional neural networks for music t...
The effects of noisy labels on deep convolutional neural networks for music t...The effects of noisy labels on deep convolutional neural networks for music t...
The effects of noisy labels on deep convolutional neural networks for music t...
 
Artificial intelligence and Music
Artificial intelligence and MusicArtificial intelligence and Music
Artificial intelligence and Music
 
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
 
Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)Social Tags and Music Information Retrieval (Part I)
Social Tags and Music Information Retrieval (Part I)
 
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
The Creative Process Behind Dialogismos I: Theoretical and Technical Consider...
 
Digital Music distribution: Streaming
Digital Music distribution: StreamingDigital Music distribution: Streaming
Digital Music distribution: Streaming
 
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)
 
Music example
Music exampleMusic example
Music example
 
Flat plan digipak
Flat plan digipakFlat plan digipak
Flat plan digipak
 

Viewers also liked

Followmusic Presentation
Followmusic PresentationFollowmusic Presentation
Followmusic Presentation
Christian Gabriel
 
CANVAS MODEL_MBA_Group 2. ICT
CANVAS MODEL_MBA_Group 2. ICTCANVAS MODEL_MBA_Group 2. ICT
CANVAS MODEL_MBA_Group 2. ICTAumkar Navare
 
Songkick Product Discovery FOWA (Michelle You)
Songkick Product Discovery FOWA (Michelle You)Songkick Product Discovery FOWA (Michelle You)
Songkick Product Discovery FOWA (Michelle You)
Michelle You
 
Dan Crow - Becoming a Data Driven Company LEANCONF 2013
Dan Crow - Becoming a Data Driven Company LEANCONF 2013Dan Crow - Becoming a Data Driven Company LEANCONF 2013
Dan Crow - Becoming a Data Driven Company LEANCONF 2013
Leanconf
 
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
eMarketer
 
Music data is scary, beautiful and exciting
Music data is scary, beautiful and excitingMusic data is scary, beautiful and exciting
Music data is scary, beautiful and exciting
Brian Whitman
 
Cut Bait - 10 Years of Dorkbot
Cut Bait - 10 Years of DorkbotCut Bait - 10 Years of Dorkbot
Cut Bait - 10 Years of Dorkbot
Brian Whitman
 
The echo nest-music_discovery(1)
The echo nest-music_discovery(1)The echo nest-music_discovery(1)
The echo nest-music_discovery(1)Sophia Yeiji Shin
 
The Echo Nest at Music and Bits, October 21 2009
The Echo Nest at Music and Bits, October 21 2009The Echo Nest at Music and Bits, October 21 2009
The Echo Nest at Music and Bits, October 21 2009
Brian Whitman
 
The future music platform
The future music platformThe future music platform
The future music platform
Brian Whitman
 
The Echo Nest Remix at Dorkbot NYC, March 4 2009
The Echo Nest Remix at Dorkbot NYC, March 4 2009The Echo Nest Remix at Dorkbot NYC, March 4 2009
The Echo Nest Remix at Dorkbot NYC, March 4 2009
Brian Whitman
 
ML+Hadoop at NYC Predictive Analytics
ML+Hadoop at NYC Predictive AnalyticsML+Hadoop at NYC Predictive Analytics
ML+Hadoop at NYC Predictive Analytics
Erik Bernhardsson
 
Luigi future
Luigi futureLuigi future
Luigi future
Erik Bernhardsson
 
Luigi Presentation at OSCON 2013
Luigi Presentation at OSCON 2013Luigi Presentation at OSCON 2013
Luigi Presentation at OSCON 2013
Erik Bernhardsson
 
Recommendation at Netflix Scale
Recommendation at Netflix ScaleRecommendation at Netflix Scale
Recommendation at Netflix Scale
Justin Basilico
 
Luigi presentation NYC Data Science
Luigi presentation NYC Data ScienceLuigi presentation NYC Data Science
Luigi presentation NYC Data Science
Erik Bernhardsson
 
Approximate nearest neighbor methods and vector models – NYC ML meetup
Approximate nearest neighbor methods and vector models – NYC ML meetupApproximate nearest neighbor methods and vector models – NYC ML meetup
Approximate nearest neighbor methods and vector models – NYC ML meetup
Erik Bernhardsson
 
Collaborative Filtering with Spark
Collaborative Filtering with SparkCollaborative Filtering with Spark
Collaborative Filtering with Spark
Chris Johnson
 
Algorithmic Music Recommendations at Spotify
Algorithmic Music Recommendations at SpotifyAlgorithmic Music Recommendations at Spotify
Algorithmic Music Recommendations at Spotify
Chris Johnson
 
Music Recommendations at Scale with Spark
Music Recommendations at Scale with SparkMusic Recommendations at Scale with Spark
Music Recommendations at Scale with Spark
Chris Johnson
 

Viewers also liked (20)

Followmusic Presentation
Followmusic PresentationFollowmusic Presentation
Followmusic Presentation
 
CANVAS MODEL_MBA_Group 2. ICT
CANVAS MODEL_MBA_Group 2. ICTCANVAS MODEL_MBA_Group 2. ICT
CANVAS MODEL_MBA_Group 2. ICT
 
Songkick Product Discovery FOWA (Michelle You)
Songkick Product Discovery FOWA (Michelle You)Songkick Product Discovery FOWA (Michelle You)
Songkick Product Discovery FOWA (Michelle You)
 
Dan Crow - Becoming a Data Driven Company LEANCONF 2013
Dan Crow - Becoming a Data Driven Company LEANCONF 2013Dan Crow - Becoming a Data Driven Company LEANCONF 2013
Dan Crow - Becoming a Data Driven Company LEANCONF 2013
 
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
eMarketer Webinar: Mobile Messaging Trends—Tapping into SMS, Mobile Email and...
 
Music data is scary, beautiful and exciting
Music data is scary, beautiful and excitingMusic data is scary, beautiful and exciting
Music data is scary, beautiful and exciting
 
Cut Bait - 10 Years of Dorkbot
Cut Bait - 10 Years of DorkbotCut Bait - 10 Years of Dorkbot
Cut Bait - 10 Years of Dorkbot
 
The echo nest-music_discovery(1)
The echo nest-music_discovery(1)The echo nest-music_discovery(1)
The echo nest-music_discovery(1)
 
The Echo Nest at Music and Bits, October 21 2009
The Echo Nest at Music and Bits, October 21 2009The Echo Nest at Music and Bits, October 21 2009
The Echo Nest at Music and Bits, October 21 2009
 
The future music platform
The future music platformThe future music platform
The future music platform
 
The Echo Nest Remix at Dorkbot NYC, March 4 2009
The Echo Nest Remix at Dorkbot NYC, March 4 2009The Echo Nest Remix at Dorkbot NYC, March 4 2009
The Echo Nest Remix at Dorkbot NYC, March 4 2009
 
ML+Hadoop at NYC Predictive Analytics
ML+Hadoop at NYC Predictive AnalyticsML+Hadoop at NYC Predictive Analytics
ML+Hadoop at NYC Predictive Analytics
 
Luigi future
Luigi futureLuigi future
Luigi future
 
Luigi Presentation at OSCON 2013
Luigi Presentation at OSCON 2013Luigi Presentation at OSCON 2013
Luigi Presentation at OSCON 2013
 
Recommendation at Netflix Scale
Recommendation at Netflix ScaleRecommendation at Netflix Scale
Recommendation at Netflix Scale
 
Luigi presentation NYC Data Science
Luigi presentation NYC Data ScienceLuigi presentation NYC Data Science
Luigi presentation NYC Data Science
 
Approximate nearest neighbor methods and vector models – NYC ML meetup
Approximate nearest neighbor methods and vector models – NYC ML meetupApproximate nearest neighbor methods and vector models – NYC ML meetup
Approximate nearest neighbor methods and vector models – NYC ML meetup
 
Collaborative Filtering with Spark
Collaborative Filtering with SparkCollaborative Filtering with Spark
Collaborative Filtering with Spark
 
Algorithmic Music Recommendations at Spotify
Algorithmic Music Recommendations at SpotifyAlgorithmic Music Recommendations at Spotify
Algorithmic Music Recommendations at Spotify
 
Music Recommendations at Scale with Spark
Music Recommendations at Scale with SparkMusic Recommendations at Scale with Spark
Music Recommendations at Scale with Spark
 

More from Paul Lamere

How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015
Paul Lamere
 
Sxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to musicSxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to music
Paul Lamere
 
Beyond the Play Button - The future of listening
Beyond the Play Button - The future of listeningBeyond the Play Button - The future of listening
Beyond the Play Button - The future of listening
Paul Lamere
 
I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what? I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what?
Paul Lamere
 
Data Mining Music
Data Mining MusicData Mining Music
Data Mining Music
Paul Lamere
 
Finding Music With Pictures: Using Visualization for Discovery
Finding Music With Pictures: Using Visualization for DiscoveryFinding Music With Pictures: Using Visualization for Discovery
Finding Music With Pictures: Using Visualization for Discovery
Paul Lamere
 
The Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack DayThe Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack Day
Paul Lamere
 
Using Visualizations for Music Discovery
Using Visualizations for Music DiscoveryUsing Visualizations for Music Discovery
Using Visualizations for Music Discovery
Paul Lamere
 
Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.
Paul Lamere
 
Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)
Paul Lamere
 

More from Paul Lamere (10)

How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015How We Listen to Music - SXSW 2015
How We Listen to Music - SXSW 2015
 
Sxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to musicSxsw 2015 - How we listen to music
Sxsw 2015 - How we listen to music
 
Beyond the Play Button - The future of listening
Beyond the Play Button - The future of listeningBeyond the Play Button - The future of listening
Beyond the Play Button - The future of listening
 
I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what? I've got 10 million songs in my pocket. Now what?
I've got 10 million songs in my pocket. Now what?
 
Data Mining Music
Data Mining MusicData Mining Music
Data Mining Music
 
Finding Music With Pictures: Using Visualization for Discovery
Finding Music With Pictures: Using Visualization for DiscoveryFinding Music With Pictures: Using Visualization for Discovery
Finding Music With Pictures: Using Visualization for Discovery
 
The Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack DayThe Echo Nest workshop for Boston Music Hack Day
The Echo Nest workshop for Boston Music Hack Day
 
Using Visualizations for Music Discovery
Using Visualizations for Music DiscoveryUsing Visualizations for Music Discovery
Using Visualizations for Music Discovery
 
Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.Help! My iPod thinks I'm emo.
Help! My iPod thinks I'm emo.
 
Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)Social Tags and Music Information Retrieval (Part II)
Social Tags and Music Information Retrieval (Part II)
 

Recently uploaded

Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
Vlad Stirbu
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 

Recently uploaded (20)

Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 

Echo nest-api-boston-2012

  • 1.
  • 2. The Echo Nest Solution understanding music content and consumers Rich Music Data content culture 12 years of R&D at MIT, Columbia and Berkeley Our API is our product
  • 3. Our API Our API is our product. Everything a customer can do so can you. developer.echonest.com
  • 4. Artist API 2 million artists • Search • News • Similar • Reviews • Familiarity • Images • Hottttnesss • Video • Bios • Location • Blogs • Suggest • Terms • Extract
  • 5. SIMILAR ARTISTS IN 2 LINES OF CODE for a in artist.similar(names=['lady gaga']): print a.name MadonnaChristina AguileraBritney SpearsKylie MinogueKaty PerryScissor SistersRihannaBeyoncéAshley TisdaleLivvi FrancLa RouxParis HiltonShe Wants RevengeThe Pussycat DollsMarina and The Diamonds
  • 6. Top recent news stories for Adele adele = artist.Artist('Adele')for news in adele.news: print news['date_posted'], news['name'] 2012-02-06T17:37:00 Grammys: Who Should Win the Major Categories2012-02-06T00:00:00 Noel Gallagher: Adele's Music Career Won't Last2012-02-06T00:00:00 Noel Gallagher Admits He Feels Sorry For Adele2012-02-06T00:00:00 Dave Grohl's Grammy pride2012-02- 06T00:00:00 British Artists Dominate 2011 Market: Adele, Jessie J2012-02-06T00:00:00 Adele called 'too fat'
  • 7. Song API 30 million songs • Search • Segments • Similar Songs • Timbre • Tempo • Pitch • Key & Mode • Loudness • Time Signature • Energy • Beats • Danceability • Downbeats • Speechiness
  • 8. Track Analysis and Remix Summary Song I/O • Upload to analyze tracks • Render audio and video auditory spectrogram Song search • Search for songs segments Song analysis • Tempo, Key, Mode, Time Signature Song Hierarchy pitch features • Section, Bars, Beats, Tatums Segments • Timbre, Pitch, Loudness timbre features Manipulations • Rearranging, blending, time stretching, pitch shifting, video, looping, It turns music into silly putty • fade-ins, fade-outs, crossfades, find similar, sorting
  • 9. Song API example Find the loudest songs by thrash artists song/search?sort=loudness-desc&description=thrash Find indie songs for jogging song/search?min_tempo=120&style=indie&max_tempo=125 Find hottest songs by Lady Gaga song/search?sort=hotttnesss-desc&artist=lady+gaga
  • 10. Audio properties in a few lines of code results = song.search(artist='Michael Jackson', title='billie jean')if len(results) > 0: print 'tempo', results[0].audio_summary['tempo'] print 'dance', results[0].audio_summary['danceability'] print 'energy', results[0].audio_summary['energy'] tempo 117.128dance 0.97energy 0.47
  • 11. More APIs! • Taste Profiles for personalization • Advanced Playlisting • Song identification Plus, client libraries for popular platforms: Python Java Ruby iOS Android etc
  • 12. ARTIST RADIO IN 2 LINES OF CODE for song in playlist.static(type='artist-radio', artist='weezer'): print son song.artist_name Island In The Sun by Weezer1979 by The Smashing PumpkinsWalk by Foo FightersDance, Dance by Fall Out BoyBlast Off! by Rivers CuomoOh Me, Oh My by Nerf HerderBirdhouse in Your Soul by They Might Be GiantsSmells Like Teen Spirit by NirvanaAlison by Elvis CostelloGirl, You'll Be a Woman Soon by Urge OverkillStacy's Mom by Fountains of WayneThe Middle by Jimmy Eat WorldWorry A Lot by The Like Young1985 by Bowling for SoupDo You Realize?? by The Flaming Lips
  • 13. Our playlist engine powers the listening experience for millions of music listeners
  • 14. The Playlist API • Fine grained control over: • artist selection, variety • hotttness, familiarity, location • song selection • Any musical attributes (e.g. tempo range, key) • song ordering • Artist or song attributes (e.g. loudness)
  • 15. Some examples • Play tracks by Weezer and Radiohead playlist/static?&artist=weezer&artist=radiohead&results=20&type=artist • Weezer artist radio playlist/static?&artist=weezer&artist=radiohead&type=artist-radio • Playlist of music by pop divas ordered by tempo playlist/static?&description=pop&description=diva&type=artist- description&artist_min_familiarity=.9&sort=tempo-asc
  • 16. Audio Fingerprinter • Identify songs based upon audio • Fingerprinter executables and libraries for Windows, Mac and Linux • Song ID typically in less than a second per song • Currently in beta • More info at: http://groups.google.com/group/enmfp
  • 17. Easy Integration • 7Digital • Deezer • Spotify • Discogs • Rhapsody • EMI • Lyricfind • Jambase • Seatwave • MusixMatch • Rdio • SongMeanings • Free Music Archive • Twitter • Facebook • Songkick • MusicBrainz
  • 18. Open EMI • Dozens of artist sandboxes • Audio • Video • Images • More ...
  • 19. Content Available Audio (inc metadata) Video Imagery Promo Tools Web Tools Selection 2,000 tracks Over 10,000 tracks + artwork 70 tracks Web banners 41 albums 135 86 Image assets 27 Photosessions 26 Games + artwork (coming soon) Screensavers 71 albums 180 26 Image assets Web banners 8 Photosessions 35 Games + artwork (coming soon) 24 albums 32 Logos 2 Photosessions 16 + artwork (coming soon) 11 albums 49 Logos 4 Photosessions 9 + artwork (coming soon) 13 albums 31 Logos Photosession 12 + artwork (coming soon) 14 albums 27 Logos 5 Photosessions 11 + artwork (coming soon) 10 albums 23 Logo {hotosession 9 + artwork (coming soon) 19
  • 20. Get ready for Christmas! Constrain song searches and playlists to songs that match a given ‘song type’ Example: Justin Bieber Christmas Radio http://developer.echonest.com/api/v4/playlist/static?api_key=key&art song_type=christmas Demo: http://static.echo nest.com/demo/xmas.html
  • 21. Some cool things people have built with The Echo Nest API
  • 23. Map of Music Styles
  • 25. Playlist demos Bipolar Radio - one button steering
  • 26. Playlist demos Boil the frog - path finding through the artist space
  • 27. Stewart Copeland #SXMusicData http://labs.echonest.com/click/
  • 29. MIDEM Music Machine QuickTime™ and a H.264 decompressor are needed to see this picture.
  • 32. The Infinite Jukebox The Infinite Jukebox infinitejuke.com
  • 33. Echo Nest Remix Turns music into silly putty
  • 34. With remix you can chop sound into: Sections Bars Beats And then programmatically Tatums manipulate all of the bits and pieces Segments
  • 35. slicing and dicing Create a remix from beat one of every bar Create a remix from beat one of every bar bars = audiofile.analysis.bars collect = [] for bar in bars: collect.append(bar.children()[0]) out = audio.getpieces(audiofile, collect) out.encode(output_filename) audio.getpieces(audiofile, collect) out.encode(output_filename)
  • 36. beat reversing beats = audiofile.analysis.beats collec = [] beats.reverse() for beat in beats: collect.append(beat) out = audio.getpieces(audiofile, collect) out.encode(output_filename) audio.getpieces(audiofile, collect) out.encode(output_filename) audio.getpieces(audiofile, collect)
  • 38. Tristan’s The Swinger Makes any song swing Makes any song swing #MusicData
  • 40. How can I get started? Get a key & check out our api docs - developer.echonest.com Get a wrapper for your language - C, iOS, Python, Java, Ruby, PHP, more If you want to make music get Remix from our GitHub: github.com/echonest/ Talk to us! paul@echonest.com
  • 41. developer.echonest.com paul@echonest.com

Editor's Notes

  1. AUDIO “albums” = multi track singles + different territory releases + clean/explicit versions VIDEO = official (+ 30sec clips of official) + EPKs + interviews + documentaries + teasers + clean/explicit versions of each where appropriate - full vid + 30 sec clips are considered separate assets (therefore number of full vid approx = half of vid assets listed) IMAGERY = posters + print ads + photosessions + logos + wallpapers etc. PROMO TOOLS = biographies + press releases