my talk for a hackathon I did with rga and somatic

1. How Neural Networks Can Help Us
Expand Visual Creativity
Jason Toy

3. ABOUT ME
❖ builder of things
❖ SFPC
❖ somatic

4. ArtTech

5. DEEP DREAMING - INCEPTION
seeing what the computer sees

6. neural network concepts
❖ blackbox
❖ neurons-inputs;outputs; 0-1
❖ accelerates at processing images
❖ layer types
❖ training ~= compiling
❖ most ML problems:
classification,regression,reinforcement

7. deepdream key modifications
how do we understand neural network?
objective function: activate as many neurons in a layer
key trick: push back to image
looping and recursion

9. GOOGLENET
m

10. how we changed the objective function of deep dream
❖ https://github.com/somaticio/bat-country/blob/
master/batcountry/batcountry.py

12. STYLETRANSFER

14. neural style details
❖ classifier
❖ same network can be used (vgg, googlenet)
❖ visual representation of our world
❖ repurposed - transfer learning

15. high layers in the network act as the content of the image
style computed from multiple layers’ filter responses

17. Trials from experimentation
of modifying data and algorithms

26. other examples of image processing networks
❖ black and white photos -> colorized images
❖ low resolution -> super resolution
❖ blurry images -> clear images - CSI magic!!!
❖ image to story -> romance novels / ad generators

27. Ideas for other transformations?
❖ selective region of inception/style transfer?
❖ dreaming different objects
❖ mixing transformations
❖ really up to our imaginations!! - we will explore

28. hackathon projects
❖ style transfer photo gallery
❖ slack stylebot
❖ inceptionism - modify an objective function (advanced
programming and math)

29. Thank you!!
Questions?
Jason Toy
jason@somatic.io
http://somatic.io