The Echo Nest Remix at Dorkbot NYC, March 4 2009

2,426 views

Published on

Brian Whitman from The Echo Nest presents The Echo Nest Remix API to Dorkbot NYC, March 4 2009.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,426
On SlideShare
0
From Embeds
0
Number of Embeds
802
Actions
Shares
0
Downloads
5
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

The Echo Nest Remix at Dorkbot NYC, March 4 2009

  1. 1. THE ECHO NEST REMIX API Hello dorkbot nyc! I am Brian Whitman a co-founder of The Echo Nest Corporation, a music intelligence concern based in Somerville, MA, USA. The Remix API is/was developed by our lovely employees and well-wishers: Ben Lacker, co-founders Tristan Jehan & myself, Josh Lif-ton, Rob Ochsorn, Adam Lindsay http://code.google.com/p/echo-nest-remix
  2. 2. THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO
  3. 3. THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO THINGS WE MAKE MONEY DOING
  4. 4. REMIX THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO THINGS WE MAKE MONEY DOING
  5. 5. REMIX something to do with hall & oates THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO THINGS WE MAKE MONEY DOING
  6. 6. WHAT THE ECHO NEST REMIX API DOES
  7. 7. 25 auditory spectrogram 20 15 auditory spectrogram 10 5 1 0 0.5 1 1.5 2 sec. 1 0.8 segmentation 0.6 segments 0.4 0.2 0 0 0.5 1 1.5 2 sec. B A# A pitch features G# G pitch features F# F E D# D C# C 0 0.5 1 1.5 2 sec. 25 20 timbre features 15 timbre features 10 5 1 2 4 6 8 10 12 14 16 segments JEHAN STYLE
  8. 8. 4 x 10 2 1 0 beat markers ! -1 ! -2 0 5 10 15 20 25 240 190 143 tempogram 114 96 72 60 0 5 10 15 20 25 1 0.8 0.6 tempo spectrum 0.4 0.2 0 60 72 96 114 143 190 240 JEHAN STYLE
  9. 9. ANY OL SOUND, for free, chop it up into Sections: verse, chorus, bridge Bars Beats (downbeat) Segments / syllables / notes
  10. 10. >> song.segments [segment, segment, segment...] >> song.segments[10].start 34.502 >> song.segments[10].timbre [-30.2, -10.4, 4.5, 3.2...] >> song.segments[10].pitch [0.5, 0.13, 1.0, .... ] >> song.segments.reverse() >> for i in segments: i.stretch(2) i = i + othersong.segment[12] >> You can mix elements, time stretch them, detect & change pitch, move them around, repeat them on downbeats, find a closest match in another song, detect and modify volume envelopes, read/write mp3, aiff, wav File "<stdin>", line 1 SyntaxError: invalid syntax ALL SONG ELEMENTS ARE ITEMS IN A LIST
  11. 11. WHAT YOU CAN DO WITH THE ECHO NEST REMIX API
  12. 12. MAKE WEB SITES
  13. 13. MAKE WEB SITES THAT CONFUSE PEOPLE
  14. 14. MAKE PRETTY PICTURES
  15. 15. MAKE PRETTY PICTURES
  16. 16. I’ve always wanted to hear Justin Timberlake trying to sing Billie Jean automatically by comparing timbre, pitch and loudness distances. -B.L. MAKE MUSIC
  17. 17. Let’s go on residency in Amsterdam and get an adorably nervous Austrian accordionist to play like a bird! -K.D. & B.W. MAKE MUSIC
  18. 18. James Brown... FOREVER. - T.J. MAKE MUSIC
  19. 19. MAKE MOVIES
  20. 20. THE NEAR FUTURE OF THE ECHO NEST REMIX API
  21. 21. STAGE ONE: ALL MUSIC, ALL THE TIME
  22. 22. >> from echonest import search >> segments = search.query(“voice”, soundsLike=”bjork”, pitch=”F#”) >> len(segments) 65706 >> new_song = random.shuffle(segments).write(“bjork2009.mp3”)
  23. 23. STAGE TWO: GET OFF THE COMPUTER
  24. 24. HAVE YOU SEEN THIS THING IT’S CRAZY
  25. 25. STAGE THREE: Let NORMAL PEOPLE use it
  26. 26. 100% 75% Music goodness 50% brian 25% 0% nothing not much a little somewhat pretty good expert dork prime Computers know-how
  27. 27. YES WE CAN
  28. 28. brian@echonest.com do you wonder if are you one of those sysex is turing python “people” (you complete? know what I’m saying) would you like to HELP US put girl talk out of did you ever write a business? music app in {R, MATLAB, Excel, bash}? we catalog every orchestra hit 1980-1992. want the password? http://code.google.com/p/echo-nest-remix

×