Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
The Role of AI and Machine Learning in Creativity Douglas Eck @douglas_eck Research Scientist Google Brain Team
ConvNets
Translation https://research.googleblog.com/2016/09/a-neural-network-for-machine.html Perfect translation Human Neural (GN...
BACKTRANSLATION FROM JAPANESE Kilimanjaro is a mountain of 19,710 feet covered with snow, which is said to be the highest ...
12% of all responses sent on mobile are sent with ML-based suggestions Google Inbox
QuickDraw Dataset Thanks to Jonas Jongejan and friends at Google Creative Lab.
Learning to Draw
Lower temperature Higher temperature
Human Input Human InputReconstruction Reconstruction Demo
A ht Xt h t Note on Note off Note Velocity Advance clock
A ht Xt h t Note on Note off Note Velocity Advance clock
Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
RNN Decoder A h t X t Encoder Z Decoder
Decoder
Encoder Z Measure and Phrase Decoders
Photo: Magenta team member Jesse Engel
g.co/magenta
“Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distort...
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017
Upcoming SlideShare
Loading in …5
×

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

1,113 views

Published on

The Role of AI and Machine Learning in Creativity:
I’ll discuss Magenta, a Google Brain project investigating music and art generation using deep learning and reinforcement learning. I’ll describe the goals of Magenta and how it fits into the general trend of AI moving into our daily lives. One crucial question is: Where does AI and Machine Learning fit in the creative process? I’ll argue that it’s about augmenting and extending the artist rather than just creating artifacts (songs, paintings, etc.) with machines. I’ll talk about two recent projects. In the first, we explore the use of recurrent neural networks to extend musical phrases in different ways. In the second we look at teaching a neural network to draw with strokes. This will be a high-level overview talk with no need for knowledge of AI or Machine Learning.

Bio:Doug leads Magenta, a Google Brain project working to generate music, video, image and text using deep learning and reinforcement learning. A main goal of Magenta is to better understanding how AI can enable artists and musicians to express themselves in innovative new ways. Before Magenta, Doug led the Google Play Music search and recommendation team. From 2003 to 2010 Doug was faculty at the University of Montreal’s MILA Machine Learning lab, where he worked on expressive music performance and automatic tagging of music audio.

Published in: Technology
no profile picture user

  • Login to see the comments

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

  1. 1. The Role of AI and Machine Learning in Creativity Douglas Eck @douglas_eck Research Scientist Google Brain Team
  2. 2. ConvNets
  3. 3. Translation https://research.googleblog.com/2016/09/a-neural-network-for-machine.html Perfect translation Human Neural (GNMT) Phrase-based (PBMT) English > Spanish English > French English > Chinese Spanish > English French > Spanish Chinese > Spanish Translation model Translationquality old: PBMT new: GNMT
  4. 4. BACKTRANSLATION FROM JAPANESE Kilimanjaro is a mountain of 19,710 feet covered with snow, which is said to be the highest mountain in Africa. The summit of the west is called “Ngaje Ngai” God ‘s house in Masai language. There is a dried and frozen carcass of a leopard near the summit of the west. No one can explain what the leopard was seeking at that altitude. Kilimanjaro is 19,710 feet of the mountain covered with snow, and it is said that the highest mountain in Africa. Top of the west, “Ngaje Ngai” in the Maasai language, has been referred to as the house of God. The top close to the west, there is a dry, frozen carcass of a leopard. Whether the leopard had what the demand at that altitude, there is no that nobody explained. Google Neural Machine Translation (new system): Phrase-Based Machine Translation (old system):
  5. 5. 12% of all responses sent on mobile are sent with ML-based suggestions Google Inbox
  6. 6. QuickDraw Dataset Thanks to Jonas Jongejan and friends at Google Creative Lab.
  7. 7. Learning to Draw
  8. 8. Lower temperature Higher temperature
  9. 9. Human Input Human InputReconstruction Reconstruction Demo
  10. 10. A ht Xt h t Note on Note off Note Velocity Advance clock
  11. 11. A ht Xt h t Note on Note off Note Velocity Advance clock
  12. 12. Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
  13. 13. Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
  14. 14. Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
  15. 15. Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
  16. 16. Chopin Etude in E Major (Opus 10 No 3) Neural Network Performances
  17. 17. RNN Decoder A h t X t Encoder Z Decoder
  18. 18. Decoder
  19. 19. Encoder Z Measure and Phrase Decoders
  20. 20. Photo: Magenta team member Jesse Engel
  21. 21. g.co/magenta
  22. 22. “Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit ... The distorted guitar sound is the sound of something too loud for the medium supposed to carry it….” -- Brian Eno, A Year With Swollen Appendices

×