SlideShare a Scribd company logo

machine learning and art hack day

jtoy
jtoy
jtoysomatic

My slides from the presentation I gave

machine learning and art hack day

1 of 52
Download to read offline
SOME EXPERIMENTS I HAVE DONE
WITH ART + DEEP LEARNING
Jason Toy
THE PRESENTATION
show some of my experiments, both testing the limits of other
people’s models and training my own models
overview of how the models work
for artists and machine learners in the audience, i tried to make it
so you will all learn a little
hopefully inspire some of you to go out and build something
awesome
MY BACKGROUND - JASONTOY
my main passion is general artificial intelligence
studied math and computer science
generalists, program a little of everything, master of nothing
founded a couple of companies: rubynow, socmetrics - using ML for
mining social media
CEO of filepicker,sold in beginning of 2016
exploring the intersection of machine learning,art, entrepreneurship
DEEP LEARNINGVSTRADITIONAL
MACHINE LEARNING
mostly automated feature extraction
DEEP LEARNINGVSTRADITIONAL
MACHINE LEARNING
much better at learning nonlinear relationships
WHAT IS GENERATIVE
MODELING
generative vs discriminative
architect of models
GM around for a long time - used in architect, design,games,etc
miniature systems that mimic something in real life,“artist in a
box”
more fun; I'm not as interested to increase ad clickthrough rates
Ad

Recommended

Rga somatic hackday
Rga somatic hackdayRga somatic hackday
Rga somatic hackdayjtoy
 
Tensorflow ruby
Tensorflow rubyTensorflow ruby
Tensorflow rubyjtoy
 
a tour of several popular tensorflow models
a tour of several popular tensorflow modelsa tour of several popular tensorflow models
a tour of several popular tensorflow modelsjtoy
 
Deep Generative Models
Deep Generative ModelsDeep Generative Models
Deep Generative ModelsMijung Kim
 
Intro to myself and SFPC
Intro to myself and SFPCIntro to myself and SFPC
Intro to myself and SFPCjtoy
 
Deep learning in Computer Vision
Deep learning in Computer VisionDeep learning in Computer Vision
Deep learning in Computer VisionDavid Dao
 
Deep Style: Using Variational Auto-encoders for Image Generation
Deep Style: Using Variational Auto-encoders for Image GenerationDeep Style: Using Variational Auto-encoders for Image Generation
Deep Style: Using Variational Auto-encoders for Image GenerationTJ Torres
 
Lukáš Vrábel - Deep Convolutional Neural Networks
Lukáš Vrábel - Deep Convolutional Neural NetworksLukáš Vrábel - Deep Convolutional Neural Networks
Lukáš Vrábel - Deep Convolutional Neural NetworksMachine Learning Prague
 

More Related Content

Similar to machine learning and art hack day

Deep Learning from Scratch - Building with Python from First Principles.pdf
Deep Learning from Scratch - Building with Python from First Principles.pdfDeep Learning from Scratch - Building with Python from First Principles.pdf
Deep Learning from Scratch - Building with Python from First Principles.pdfYungSang1
 
Applied And Persuasive Applications For Museums
Applied And Persuasive Applications For MuseumsApplied And Persuasive Applications For Museums
Applied And Persuasive Applications For MuseumsPietro Polsinelli
 
Refactoring (the brain) for developers
Refactoring (the brain) for developers Refactoring (the brain) for developers
Refactoring (the brain) for developers Ionel Condor
 
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...Colin Panisset
 
Culture And Aesthetic Revisited
Culture And Aesthetic RevisitedCulture And Aesthetic Revisited
Culture And Aesthetic RevisitedAdam Keys
 
Designing An Applied Game For Your Museum - Workshop
Designing An Applied Game For Your Museum - WorkshopDesigning An Applied Game For Your Museum - Workshop
Designing An Applied Game For Your Museum - WorkshopPietro Polsinelli
 
Deep Learning and the state of AI / 2016
Deep Learning and the state of AI / 2016Deep Learning and the state of AI / 2016
Deep Learning and the state of AI / 2016Grigory Sapunov
 
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)Lynn Cherny
 
Smart Emotion Based Music Player With Sleep Alert System
Smart Emotion Based Music Player With Sleep Alert SystemSmart Emotion Based Music Player With Sleep Alert System
Smart Emotion Based Music Player With Sleep Alert SystemRobyn Martin
 
What Developers Need To Know About Visual Design
What Developers Need To Know About Visual DesignWhat Developers Need To Know About Visual Design
What Developers Need To Know About Visual DesignBen Hall
 
Emotion detection using cnn.pptx
Emotion detection using cnn.pptxEmotion detection using cnn.pptx
Emotion detection using cnn.pptxRADO7900
 
Hpai class 12 - potpourri & perception - 032620
Hpai   class 12 - potpourri & perception - 032620Hpai   class 12 - potpourri & perception - 032620
Hpai class 12 - potpourri & perception - 032620melendez321
 
Thinking Like a Storyteller
Thinking Like a StorytellerThinking Like a Storyteller
Thinking Like a StorytellerCindy Chastain
 
Object To Me Research Paper
Object To Me Research PaperObject To Me Research Paper
Object To Me Research PaperBella Bell
 

Similar to machine learning and art hack day (20)

Presentation unit 2 programming
Presentation  unit 2 programmingPresentation  unit 2 programming
Presentation unit 2 programming
 
Deep Learning from Scratch - Building with Python from First Principles.pdf
Deep Learning from Scratch - Building with Python from First Principles.pdfDeep Learning from Scratch - Building with Python from First Principles.pdf
Deep Learning from Scratch - Building with Python from First Principles.pdf
 
Applied And Persuasive Applications For Museums
Applied And Persuasive Applications For MuseumsApplied And Persuasive Applications For Museums
Applied And Persuasive Applications For Museums
 
Refactoring (the brain) for developers
Refactoring (the brain) for developers Refactoring (the brain) for developers
Refactoring (the brain) for developers
 
Applied and persuasive: playful learning
Applied and persuasive: playful learningApplied and persuasive: playful learning
Applied and persuasive: playful learning
 
Data, The Android
Data, The AndroidData, The Android
Data, The Android
 
ELO Sonnet
ELO SonnetELO Sonnet
ELO Sonnet
 
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...
LASTconf 2018 - System Mapping: Discover, Communicate and Explore the Real Co...
 
Culture And Aesthetic Revisited
Culture And Aesthetic RevisitedCulture And Aesthetic Revisited
Culture And Aesthetic Revisited
 
Midterm Pecha Kucha
Midterm Pecha KuchaMidterm Pecha Kucha
Midterm Pecha Kucha
 
Designing An Applied Game For Your Museum - Workshop
Designing An Applied Game For Your Museum - WorkshopDesigning An Applied Game For Your Museum - Workshop
Designing An Applied Game For Your Museum - Workshop
 
Deep Learning and the state of AI / 2016
Deep Learning and the state of AI / 2016Deep Learning and the state of AI / 2016
Deep Learning and the state of AI / 2016
 
Flow based-1994
Flow based-1994Flow based-1994
Flow based-1994
 
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)
Bestseller Analysis: Visualization Fiction (for PyData Boston 2013)
 
Smart Emotion Based Music Player With Sleep Alert System
Smart Emotion Based Music Player With Sleep Alert SystemSmart Emotion Based Music Player With Sleep Alert System
Smart Emotion Based Music Player With Sleep Alert System
 
What Developers Need To Know About Visual Design
What Developers Need To Know About Visual DesignWhat Developers Need To Know About Visual Design
What Developers Need To Know About Visual Design
 
Emotion detection using cnn.pptx
Emotion detection using cnn.pptxEmotion detection using cnn.pptx
Emotion detection using cnn.pptx
 
Hpai class 12 - potpourri & perception - 032620
Hpai   class 12 - potpourri & perception - 032620Hpai   class 12 - potpourri & perception - 032620
Hpai class 12 - potpourri & perception - 032620
 
Thinking Like a Storyteller
Thinking Like a StorytellerThinking Like a Storyteller
Thinking Like a Storyteller
 
Object To Me Research Paper
Object To Me Research PaperObject To Me Research Paper
Object To Me Research Paper
 

Recently uploaded

DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFE
DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFEDNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFE
DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFEandreiandasan
 
Manual Eurotronic Thermostatic Valve Comry Z-Wave
Manual Eurotronic Thermostatic Valve Comry Z-WaveManual Eurotronic Thermostatic Valve Comry Z-Wave
Manual Eurotronic Thermostatic Valve Comry Z-WaveDomotica daVinci
 
Tete thermostatique Zigbee MOES BRT-100 V2.pdf
Tete thermostatique Zigbee MOES BRT-100 V2.pdfTete thermostatique Zigbee MOES BRT-100 V2.pdf
Tete thermostatique Zigbee MOES BRT-100 V2.pdfDomotica daVinci
 
M.Aathiraju Self Intro.docx-AD21001_____
M.Aathiraju Self Intro.docx-AD21001_____M.Aathiraju Self Intro.docx-AD21001_____
M.Aathiraju Self Intro.docx-AD21001_____Aathiraju
 
Power of 2024 - WITforce Odyssey.pptx.pdf
Power of 2024 - WITforce Odyssey.pptx.pdfPower of 2024 - WITforce Odyssey.pptx.pdf
Power of 2024 - WITforce Odyssey.pptx.pdfkatalinjordans1
 
Bringing nullability into existing code - dammit is not the answer.pptx
Bringing nullability into existing code - dammit is not the answer.pptxBringing nullability into existing code - dammit is not the answer.pptx
Bringing nullability into existing code - dammit is not the answer.pptxMaarten Balliauw
 
Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Daniel Toomey
 
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdf
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdfZ-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdf
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdfDomotica daVinci
 
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?GleecusTechlabs1
 
Dynamical systems simulation in Python for science and engineering
Dynamical systems simulation in Python for science and engineeringDynamical systems simulation in Python for science and engineering
Dynamical systems simulation in Python for science and engineeringMassimo Talia
 
Semiconductor Review Magazine Feature.pdf
Semiconductor Review Magazine Feature.pdfSemiconductor Review Magazine Feature.pdf
Semiconductor Review Magazine Feature.pdfkeyaramicrochipusa
 
Q1 Memory Fabric Forum: SMART CXL Product Lineup
Q1 Memory Fabric Forum: SMART CXL Product LineupQ1 Memory Fabric Forum: SMART CXL Product Lineup
Q1 Memory Fabric Forum: SMART CXL Product LineupMemory Fabric Forum
 
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...Adrian Sanabria
 
Heltun_HE-RS01_User_Manual_B9AH.pdf
Heltun_HE-RS01_User_Manual_B9AH.pdfHeltun_HE-RS01_User_Manual_B9AH.pdf
Heltun_HE-RS01_User_Manual_B9AH.pdfMarielaL5
 
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptx
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptxEvolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptx
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptxKyle Willson
 
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...Adrian Sanabria
 
My self introduction to know others abut me
My self  introduction to know others abut meMy self  introduction to know others abut me
My self introduction to know others abut meManoj Prabakar B
 
Artificial-Intelligence-in-Marketing-Data.pdf
Artificial-Intelligence-in-Marketing-Data.pdfArtificial-Intelligence-in-Marketing-Data.pdf
Artificial-Intelligence-in-Marketing-Data.pdfIsidro Navarro
 
zigbee motion sensor user manual NAS-PD07B2.pdf
zigbee motion sensor user manual NAS-PD07B2.pdfzigbee motion sensor user manual NAS-PD07B2.pdf
zigbee motion sensor user manual NAS-PD07B2.pdfDomotica daVinci
 
Introduction to Serverless with AWS Lambda in C#.pptx
Introduction to Serverless with AWS Lambda in C#.pptxIntroduction to Serverless with AWS Lambda in C#.pptx
Introduction to Serverless with AWS Lambda in C#.pptxBrandon Minnick, MBA
 

Recently uploaded (20)

DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFE
DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFEDNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFE
DNA LIGASE BIOTECHNOLOGY BIOLOGY STUDY OF LIFE
 
Manual Eurotronic Thermostatic Valve Comry Z-Wave
Manual Eurotronic Thermostatic Valve Comry Z-WaveManual Eurotronic Thermostatic Valve Comry Z-Wave
Manual Eurotronic Thermostatic Valve Comry Z-Wave
 
Tete thermostatique Zigbee MOES BRT-100 V2.pdf
Tete thermostatique Zigbee MOES BRT-100 V2.pdfTete thermostatique Zigbee MOES BRT-100 V2.pdf
Tete thermostatique Zigbee MOES BRT-100 V2.pdf
 
M.Aathiraju Self Intro.docx-AD21001_____
M.Aathiraju Self Intro.docx-AD21001_____M.Aathiraju Self Intro.docx-AD21001_____
M.Aathiraju Self Intro.docx-AD21001_____
 
Power of 2024 - WITforce Odyssey.pptx.pdf
Power of 2024 - WITforce Odyssey.pptx.pdfPower of 2024 - WITforce Odyssey.pptx.pdf
Power of 2024 - WITforce Odyssey.pptx.pdf
 
Bringing nullability into existing code - dammit is not the answer.pptx
Bringing nullability into existing code - dammit is not the answer.pptxBringing nullability into existing code - dammit is not the answer.pptx
Bringing nullability into existing code - dammit is not the answer.pptx
 
Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024
 
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdf
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdfZ-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdf
Z-Wave Fan coil Thermostat Heltun_HE-HT01_User_Manual.pdf
 
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?
Unlocking the Cloud's True Potential: Why Multitenancy Is The Key?
 
Dynamical systems simulation in Python for science and engineering
Dynamical systems simulation in Python for science and engineeringDynamical systems simulation in Python for science and engineering
Dynamical systems simulation in Python for science and engineering
 
Semiconductor Review Magazine Feature.pdf
Semiconductor Review Magazine Feature.pdfSemiconductor Review Magazine Feature.pdf
Semiconductor Review Magazine Feature.pdf
 
Q1 Memory Fabric Forum: SMART CXL Product Lineup
Q1 Memory Fabric Forum: SMART CXL Product LineupQ1 Memory Fabric Forum: SMART CXL Product Lineup
Q1 Memory Fabric Forum: SMART CXL Product Lineup
 
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...
Early Tech Adoption: Foolish or Pragmatic? - 17th ISACA South Florida WOW Con...
 
Heltun_HE-RS01_User_Manual_B9AH.pdf
Heltun_HE-RS01_User_Manual_B9AH.pdfHeltun_HE-RS01_User_Manual_B9AH.pdf
Heltun_HE-RS01_User_Manual_B9AH.pdf
 
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptx
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptxEvolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptx
Evolution of Chatbots: From Custom AI Chatbots and AI Chatbots for Websites.pptx
 
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...
Avoiding Bad Stats and the Benefits of Playing Trivia with Friends: PancakesC...
 
My self introduction to know others abut me
My self  introduction to know others abut meMy self  introduction to know others abut me
My self introduction to know others abut me
 
Artificial-Intelligence-in-Marketing-Data.pdf
Artificial-Intelligence-in-Marketing-Data.pdfArtificial-Intelligence-in-Marketing-Data.pdf
Artificial-Intelligence-in-Marketing-Data.pdf
 
zigbee motion sensor user manual NAS-PD07B2.pdf
zigbee motion sensor user manual NAS-PD07B2.pdfzigbee motion sensor user manual NAS-PD07B2.pdf
zigbee motion sensor user manual NAS-PD07B2.pdf
 
Introduction to Serverless with AWS Lambda in C#.pptx
Introduction to Serverless with AWS Lambda in C#.pptxIntroduction to Serverless with AWS Lambda in C#.pptx
Introduction to Serverless with AWS Lambda in C#.pptx
 

machine learning and art hack day

  • 1. SOME EXPERIMENTS I HAVE DONE WITH ART + DEEP LEARNING Jason Toy
  • 2. THE PRESENTATION show some of my experiments, both testing the limits of other people’s models and training my own models overview of how the models work for artists and machine learners in the audience, i tried to make it so you will all learn a little hopefully inspire some of you to go out and build something awesome
  • 3. MY BACKGROUND - JASONTOY my main passion is general artificial intelligence studied math and computer science generalists, program a little of everything, master of nothing founded a couple of companies: rubynow, socmetrics - using ML for mining social media CEO of filepicker,sold in beginning of 2016 exploring the intersection of machine learning,art, entrepreneurship
  • 5. DEEP LEARNINGVSTRADITIONAL MACHINE LEARNING much better at learning nonlinear relationships
  • 6. WHAT IS GENERATIVE MODELING generative vs discriminative architect of models GM around for a long time - used in architect, design,games,etc miniature systems that mimic something in real life,“artist in a box” more fun; I'm not as interested to increase ad clickthrough rates
  • 7. DISCRIMINATIVEVS GENERATIVE generative: naive bayes LDA deep learning discriminative: SVM random forest linear/logistic regression
  • 10. CHAR-RNN “I'm not going anywhere. I will bring the poorly educated back bigger and better. It's an incredible movement. ” “We're losing companies, the economy.We are going to save it. We're going to bring the party. Let's Make America Great Again” “I want to thank the volunteers.They've been unbelievable, they work like endlessly, you know, they don't want to die. My leadership is good”
  • 11. CHAR-RNN 1vanilla (image classification) 2 sequence output (image -> text) 3 sequence input ( sentiment analysis) 4 seq2seq (machine translation) 5 synced seq2seq (video classification)
  • 12. CHAR-RNN RNN - recurrent because they perform the same task for every element of a sequence; typically 2-3 layers LSTM - long short term memory similar, state is calculated differently
  • 13. MY CHAR-RNN EXPERIMENTS what does Hellen Keller think? seeing is like or inspirents of a kiss licks, in child, for the last decting of accomplish with me for the mistakes in silence is to keep the moments filled whiter, the chaps of the house language was sends a humanise. i wish i could presepred its repepenting and the days like the poor discuss of language of the poem in the letters, dotiment in the endless good and eager and over the charicality of the hall of rubbings that I hapmende the comprehend, the birds like your mind to perhaps the not wind I should do?
  • 14. MY CHAR-RNN EXPERIMENTS “i love you. Now her before it just numberse idevening with the press over. I was probably ever need to ever admit? Right” - Trump “life is an economy. I was in the LGBT communities can to the worst of the gun not only the fight are of us safe and I start up these are not grow…” - Hillary
  • 15. FUTURE CHAR-RNN EXPERIMENTS train a model to talk like a person with little data? transfer learning? could we train a model off of a standard “human” model ? could we train a model to talk in different emotions/styles?
  • 16. DEEP DREAMING / INCEPTION
  • 17. A MACHINE LEARNING IMAGE CLASSIFIER
  • 21. LAYER AMPLIFICATION objective function: activate as many neurons in a layer key trick: push back to image feedback loop choose different layers for different effects: conv2/3x3,inception_3a,etc
  • 26. TRAINING MY OWN DREAMS
  • 30. INCEPTION FUTURE EXPERIMENTS train with different image sets - sea life, reptiles? different objective function - activate only 1 group of neurons? selective regions of hallucinating? testing different network architects
  • 31. NEURALSTYLE Paint images in the style of any painting
  • 32. A NEURAL ALGORITHM OF ARTISTIC STYLE paper: http://arxiv.org/abs/1508.06576 The key finding of this paper is that the representations of content and style in the CNNs are separable. CNNs - convolutional Neural Network
  • 33. high layers in the network act as the content of the image style computed from multiple layers’ filter responses
  • 36. NEURALSTYLE FUTURE EXPERIMENTS can we automatically find the “good” images from a combination? can we know beforehand if a combo style/content will look good? currently trained on vggnet data, what happens if we train it on a different data set, will the art look different? will a different architect make better art?
  • 38. I ACCIDENTALLY GAVETHE ANIMAL BACK OF MY HEAD , BREATHING DEEPLY .THERE WAS NO DOUBT IN HER EYES ,AND I COULDTELL BY THE LOOK ON HIS FACETHAT HE DID N'T APPROVE OF WHAT WAS HAPPENINGTO ME . IN FACT , IT MUST HAVE BEEN ONE OFTHOSE RARE OCCASIONS ,AS WELL AS A PET ANIMAL . HER SCENT FILLED THE AIR .THAT 'S WHAT SHE WAS LOOKING FOR ,AND NOW SHE HADTO STAY AWAKE LONG ENOUGHTO DIG UPTHE LEASH
  • 42. FUTURE NEURAL STORY EXPERIMENTS train with different text a “seeing” Hellen Keller version train on different visual features
  • 43. AND MANY OTHER EXPERIMENTS……. HOPEFULLY INSPIRING
  • 44. DATA IS ESSENTIAL many of these models are built on public datasets always has been a problem; bigger problem for DL and general models very hard to get data; how can this be solved? constantly on my mind ; lets connect me if interested
  • 45. DL IS NOT ALL FUN AND UNICORNS data issue specialized software/hardware pipelines; GPUs be prepared to wait; think weeks, not hours model tuning architect tuning techniques and architects changing everyday
  • 46. WHY? I dream of building larger models AGI and multi modal models larger experiments want to collaborate with cool artists and coders fun? lets talk!
  • 48. STUDY LINKS what is deep learning: http://www.jtoy.net/2016/02/14/opening- up-deep-learning-for-everyone.html generative models: https://en.wikipedia.org/wiki/ Generative_model discriminative models: https://en.wikipedia.org/wiki/ Discriminative_model
  • 49. TEST LIVE MODEL LINKS trump char-rnn model: http://somatic.io/models/WZmmBjZ9 neural style model: http://www.somatic.io/models/5BkaqkMR neural talk model: http://somatic.io/models/qoEGanRe romance story telling: http://somatic.io/models/2n6g7RZQ
  • 50. LINKS VGG net data used: http://www.robots.ox.ac.uk/~vgg/research/ very_deep/ tensorflow version: https://github.com/anishathalye/neural-style neural style paper: http://arxiv.org/abs/1508.06576 char-rnn code: https://github.com/somaticio/char-rnn-tensorflow mscoco: http://mscoco.org imagenet: http://image-net.org/
  • 51. LINKS char-rnn: https://github.com/somaticio/char-rnn-tensorflow tensorflow char-rnn tutorial: https://www.tensorflow.org/ versions/r0.9/tutorials/seq2seq/index.html#recurrent-neural- networks neuralstyle: https://github.com/anishathalye/neural-style
  • 52. –John Dewey “Every great advance in science has issued from a new audacity of imagination.” Jason Toy jason@somatic.io I write here: http://jtoy.net http://somatic.io/bog my models here: http://somatic.io @jtoy QUESTIONS?