Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Final Presentation: Project RAiMONES

147 views

Published on

Final Presentation of the Data-Science Project "RAiMONES": http://raimones.komakino.ch

Published in: Data & Analytics
  • Be the first to comment

Final Presentation: Project RAiMONES

  1. 1. PROJECT RAIMONES: 
 TRAIN A COMPUTER TO COMPOSE RAMONES SONGS
  2. 2. HEY, HO,
  3. 3. LET’S GO!
  4. 4. SO WHO ARE THE RAMONES?
  5. 5. WELL I THINK WE’RE THE GREATEST ROCK’N’ROLL BAND IN THE WORLD. Joey Ramone WHO THE F**K ARE THE RAMONES?
  6. 6. 1975 - 1996 FACT #1
  7. 7. 14 STUDIO ALBUMS,
 178 SONGS FACT #2
  8. 8. AVERAGE SONG LENGTH: ~2 MINUTES (AND NO SOLOS) FACT #3
  9. 9. THE LAST SONG OF THEIR LAST ALBUM: BORN TO DIE IN BERLIN FACT #4
  10. 10. ALL ARE DEAD
  11. 11. JOEY: 1951 - 2001 JOHNNY: 1948 - 2004 DEE DEE: 1951 - 2002 TOMMY: 1949 - 2014
  12. 12. (ALMOST)
 ALL ARE DEAD
  13. 13. ONE, TWO…
  14. 14. THREE, FOUR!
  15. 15. WHO AM I?!
 
 AND WHY I NEED AI TO MAKE MUSIC.
  16. 16. WHO AM I? WHO AM I… ▸ Electronics Engineer with a PhD 
 from ETH Zurich (2006) ▸ Specialization:
 Analog Chip Design, Communications,
 Digital Signal Processing 
 … and now Data Science
  17. 17. WHO AM I? …AND WHY I NEED AI TO MAKE MUSIC ▸ Playing Bass Guitar and Violin in Bands since 1992
  18. 18. 2ND DEGREE FRIENDS 
 WITH THE RAMONES FACT #1:
  19. 19. ONE, TWO…
  20. 20. THREE, FOUR!
  21. 21. PROJECT DESCRIPTION
 RAIMONES. A IA I AI A IA I
  22. 22. THERE'S NOBODY AS GOOD AS THE RAMONES, NEVER WILL BE. I MEAN EVERYBODY JUST KINDA TAKES OUR SOUND AS THEIR FOUNDATION. Joey Ramone PROJECT DESCRIPTION
  23. 23. PROJECT RAIMONES: 
 TRAIN A COMPUTER TO COMPOSE RAMONES SONGS
  24. 24. PROJECT DESCRIPTION INPUT: SONG-LYRICS & SONGS ▸ Lyrics: 
 Lyrics of all 178 songs ▸ Songs: 
 Scraped 4 websites to download 
 130 MIDI Songs (60 unique songs)
 DESIRED OUTPUT ▸ New Lyrics inspired by The Ramones ▸ New Songs (Guitar & Bass) inspired by The Ramones
  25. 25. PROJECT DESCRIPTION - DEEP LEARNING RAIMONES: HOW TO? ▸ Train a deep learning neural network with the 
 corpus of Ramones songs
  26. 26. PROJECT DESCRIPTION - DEEP LEARNING TECHNOLOGY: DEEP LEARNING NETWORKS (LSTM-RNN) ▸ Deep Learning: 
 Perceptron - Multi Layer Perceptron - Deep learning NN ▸ RNN: 
 Recurrent Neural Networks
  27. 27. PROJECT DESCRIPTION - DEEP LEARNING TECHNOLOGY: DEEP LEARNING NETWORKS (LSTM-RNN) ▸ Deep Learning: 
 Perceptron - Multi Layer Perceptron - Deep learning NN ▸ RNN: 
 Recurrent Neural Networks
  28. 28. PROJECT DESCRIPTION - DEEP LEARNING TECHNOLOGY: DEEP LEARNING NETWORKS (LSTM-RNN) ▸ Deep Learning: 
 Perceptron - Multi Layer Perceptron - Deep learning NN ▸ RNN: 
 Recurrent Neural Networks
  29. 29. PROJECT DESCRIPTION - DEEP LEARNING TECHNOLOGY: DEEP LEARNING NETWORKS (LSTM-RNN) ▸ Deep Learning: 
 Perceptron - Multi Layer Perceptron - Deep learning NN ▸ RNN: 
 Recurrent Neural Networks
  30. 30. PROJECT DESCRIPTION - DEEP LEARNING TECHNOLOGY: DEEP LEARNING NETWORKS (LSTM-RNN) ▸ Deep Learning: 
 Perceptron - Multi Layer Perceptron - Deep learning NN ▸ RNN: 
 Recurrent Neural Networks Absolute Game-Changer
  31. 31. PROJECT DESCRIPTION - LYRICS INPUT: 178 SONG-LYRICS ▸ Lyrics: 
 Scraped websites to download the lyrics of all 178 songs "I Don't Want To Grow Up" When I'm lyin' in my bed at night I don't wanna grow up Nothing ever seems to turn out right I don't wanna grow up How do you move in a world of fog that's always changing things Makes wish that I could be a dog When I see the price that you pay I don't wanna grow up I don't ever want to be that way I don't wanna grow up Seems that folks turn into things that they never want The only thing to live for is today... I'm gonna put a hole in my T.V. set I don't wanna grow up Open up the medicine chest I don't wanna grow up I don't wanna have to shout it out I don't want my hair to fall out I don't wanna be filled with doubt I don't wanna be a good boy scout I don't wanna have to learn to count I don't wanna have the biggest amount I don't wanna grow up Well when I see my parents fight I don't wanna grow up They all go out and drinkin all night I don't wanna grow up I'd rather stay here in my room Nothin' out there but sad and gloom I don't wanna live in a big old tomb on grand street When I see the 5 oclock news I don't wanna grow up Comb their hair and shine their shoes I don't wanna grow up Stay around in my old hometown I don't wanna put no money down I don't wanna get a big old loan Work them fingers to the bone I don't wanna float on a broom Fall in love, get married then boom How the hell did it get here so soon I don't wanna grow up "Makin Monsters For My Friends" Everybody said so man you could see it on T.V. They stood there ashamed with nowhere to go Nobody wants them now the kids are alright Every day is a holiday and pushin' people around I'm making monsters for my friends I'm making monsters for my friends Someone caught one I could see so myself I had to call 254 so they wouldn't blame me We wanted to know how much trouble there was When we asked our daddy he said it's just because I'm making monsters for my friends I'm making monsters for my friends I don't wanna open a can of worms and I don't want any Spagetti-Os And I could always tell when someone is
  32. 32. PROJECT DESCRIPTION - LYRICS INPUT: 178 SONG-LYRICS "I Don't Want To Grow Up" When I'm lyin' in my bed at night I don't wanna grow up Nothing ever seems to turn out right I don't wanna grow up How do you move in a world of fog that's always changing things Makes wish that I could be a dog When I see the price that you pay I don't wanna grow up I don't ever want to be that way I don't wanna grow up Seems that folks turn into things that they never want The only thing to live for is today... I'm gonna put a hole in my T.V. set I don't wanna grow up Open up the medicine chest I don't wanna grow up I don't wanna have to shout it out I don't want my hair to fall out I don't wanna be filled with doubt I don't wanna be a good boy scout I don't wanna have to learn to count I don't wanna have the biggest amount I don't wanna grow up Well when I see my parents fight I don't wanna grow up They all go out and drinkin all night I don't wanna grow up I'd rather stay here in my room Nothin' out there but sad and gloom I don't wanna live in a big old tomb on grand street When I see the 5 oclock news I don't wanna grow up Comb their hair and shine their shoes I don't wanna grow up Stay around in my old hometown I don't wanna put no money down I don't wanna get a big old loan Work them fingers to the bone I don't wanna float on a broom Fall in love, get married then boom How the hell did it get here so soon I don't wanna grow up "Makin Monsters For My Friends" Everybody said so man you could see it on T.V. They stood there ashamed with nowhere to go Nobody wants them now the kids are alright Every day is a holiday and pushin' people around I'm making monsters for my friends I'm making monsters for my friends Someone caught one I could see so myself I had to call 254 so they wouldn't blame me We wanted to know how much trouble there was When we asked our daddy he said it's just because I'm making monsters for my friends I'm making monsters for my friends I don't wanna open a can of worms and I don't want any Spagetti-Os And I could always tell when someone is ▸ Lyrics from 178 songs: ▸ 6’361 lines, 29’976 words, 154’207 characters ▸ Most frequent word: “I” (1351 occurrences) ▸ Most frequent noun: “baby” (272 occurrences) ▸ Most frequent verb: “go” (235 occurrences) ▸ other notable words: “yeah” (196), “love” (168), “punk” (98)
  33. 33. "I Don't Want To Grow Up" When I'm lyin' in my bed at night I don't wanna grow up Nothing ever seems to turn out right I don't wanna grow up How do you move in a world of fog that's always changing things Makes wish that I could be a dog When I see the price that you pay I don't wanna grow up I don't ever want to be that way I don't wanna grow up Seems that folks turn into things that they never want The only thing to live for is today... I'm gonna put a hole in my T.V. set I don't wanna grow up Open up the medicine chest I don't wanna grow up I don't wanna have to shout it out I don't want my hair to fall out I don't wanna be filled with doubt I don't wanna be a good boy scout I don't wanna have to learn to count I don't wanna have the biggest amount I don't wanna grow up Well when I see my parents fight I don't wanna grow up They all go out and drinkin all night I don't wanna grow up I'd rather stay here in my room Nothin' out there but sad and gloom I don't wanna live in a big old tomb on grand street When I see the 5 oclock news I don't wanna grow up Comb their hair and shine their shoes I don't wanna grow up Stay around in my old hometown I don't wanna put no money down I don't wanna get a big old loan Work them fingers to the bone I don't wanna float on a broom Fall in love, get married then boom How the hell did it get here so soon I don't wanna grow up "Makin Monsters For My Friends" Everybody said so man you could see it on T.V. They stood there ashamed with nowhere to go Nobody wants them now the kids are alright Every day is a holiday and pushin' people around I'm making monsters for my friends I'm making monsters for my friends Someone caught one I could see so myself I had to call 254 so they wouldn't blame me We wanted to know how much trouble there was When we asked our daddy he said it's just because I'm making monsters for my friends I'm making monsters for my friends I don't wanna open a can of worms and I don't want any Spagetti-Os And I could always tell when someone is PROJECT DESCRIPTION - LYRICS TECHNOLOGY ▸ Network: ▸ Long Short-Term Memory Recurrent Neural Network ▸ sequence-length: 40 characters ▸ 33 sec/ epoch * 80 Epochs = ~45 min on GPU NVIDIA K80 ▸ Keras Python Library model = Sequential() model.add(LSTM(128, input_shape=(40, len(chars)))) model.add(Dense(len(chars))) model.add(Activation('softmax'))
  34. 34. PROJECT DESCRIPTION - LYRICS FIRST OUTPUT: ▸ all of a sudden i feel son gone a gas
 i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, 
 i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, 
 i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, 
 i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, 
 i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, i'm alive, 
 i'm alive, i'm alive, i'm alive, yeah, oh yeah
  35. 35. FIGHT FOR MONEY, FIGHT FOR FUN I WANT YOU AND I WANT YOU AND YOU WANNA SEE A HOLD I DON'T WANNA BE ALL MY BABY I HELL NEVER WAS GOTTA WANT TO BE DON'T WANT TO BE ALRIGHT I WANTED IT A GOOD FROM ME I DON'T WANNA BE ALL I WANT RAiMONES RAIMONES: LYRICS
  36. 36. PROJECT DESCRIPTION - LYRICS INPUT: 178 SONG-LYRICS ▸ Network: ▸ Markov Chain Model
 
 e.g., for n=3: 
 ‘punkrocker’ -> P(’k’ | ‘pun’)
 P(‘r’ | ‘unk’), … ▸ 0.2 seconds on a regular PC
  37. 37. I'M THE MAN WHO MAKE THE STREET HIS HOME. AND MY LEAN, MEAN HEART I JUST WANNA HAVE TO SHOUT IT OUT I DON'T HAVE BRAIN DAMAGE I'M NOT YOUR ENEMY GIRL, I AM YOUR FRIEND COME WITH US AND FIND THE PLEASURES OF A JOURNEY TO THE CENTER RAMarkovS, 10-gram RAIMONES: TEXT GENERATION
  38. 38. PROJECT DESCRIPTION - SONGS INPUT: 130 SONGS (GUITAR, BASS) GuitarBass Time: 1/16th Quantization
  39. 39. TECHNOLOGY: SONGS maxlen = 32 #max. seq.-length: 32 or 64 step = 1 # or 3
 model = Sequential() model.add(LSTM(128, return_sequences=True, input_shape=(maxlen, len(words)))) model.add(Dropout(0.2)) model.add(LSTM(128, return_sequences=False)) model.add(Dropout(0.2)) model.add(Dense(len(words))) model.add(Activation('softmax')) PROJECT DESCRIPTION - SONGS
  40. 40. OUTPUT: SONGS PROJECT DESCRIPTION - SONGS
  41. 41. OUTPUT: SONGS PROJECT DESCRIPTION - SONGS
  42. 42. GABBA,
  43. 43. GABBA, HEY!
  44. 44. IMPACT & CONCLUSION. A IA I AI A IA I
  45. 45. FOR AN INFINITE NUMBER OF RAMONES INFLUENCED SONGS! ARTIFICIAL INTELLIGENCE
  46. 46. IMPACT & CONCLUSION CURRENT & FUTURE USAGE ▸ Currently: ▸ Tool for creatives ▸ Inspiration for artists
 ▸ Future Products: ▸ Music generation for Computer Games or Background Music ▸ Generate Music according to listener’s mood automatically ▸ Work with other bands
  47. 47. PLAY BEFORE YOU GET GOOD, BECAUSE BY THE TIME YOU GET GOOD, YOU’RE TOO OLD TO PLAY. Joey Ramone TEAM, TIMELINE, BUDGET & IMPACT
  48. 48. FORMER GUITARIST OF MARKY RAMONE & THE INTRUDERS

 — INSPIRED BY RAIMONES MR. RATBOY
  49. 49. FIRST RAMONES-INSPIRED AI-ASSISTED SONG! “I’M ALIVE” - MR. RATBOY & THE RAIMONES
  50. 50. ONE, TWO…
  51. 51. THREE, FOUR!
  52. 52. TEAM, TIMELINE, BUDGET & IMPACT THANK YOU TO: ▸ Technical Advisor: 
 Dr. Amélie Anglade ▸ Musical Advisor: 
 Mr. Ratboy ▸ Websites:
 crimson-mist.tripod.com 
 freemidi.org 
 midimelody.ru 
 www.azlyrics.com ▸ Input-Providers:
 The Ramones
  53. 53. THANK YOU FOR YOUR INTEREST! ANY QUESTIONS? HTTP://RAIMONES.KOMAKINO.CH MFREY@IEEE.ORG END
  54. 54. SOMETIMES I FEELIN' MY SOUL IS AS 
 RESTLESS AS THE WIND MAYBE I WAS BORN TO DIE IN BERLIN Dee Dee Ramone END

×