Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

9,773 views

Published on

6/7/2017 - Cambridge, Massachusetts
Event: https://www.meetup.com/Cambridge-Artificial-Intelligence-Meetup/events/240392504

Get Sam Putnam's essays and talk schedule in your inbox: https://upscri.be/2611dd/

Published in: Software
  • Be the first to comment

Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

  1. 1. Deep Learning and Artistic Style Transfer for Videos Sam Putnam 6/6/2017 + = 6/6/2017 Want to learn more? I am teaching the Deploying Data Science Masterclass at Data Science Conf® Tickets are available now: www.DataScienceConf.com
  2. 2. Deep Learning Deep Learning Sam PutnamDeep Learning and Artistic Style Transfer for Videos 6/6/2017
  3. 3. Artistic Style Transfer Artistic Style Transfer Sam PutnamDeep Learning and Artistic Style Transfer for Videos 6/6/2017 https://arxiv.org/abs/1604.08610
  4. 4. Butterfly Demo Butterfly Demo Sam PutnamDeep Learning and Artistic Style Transfer for Videos 6/6/2017 https://twitter.com/samdeeplearning/status/854332749695602720
  5. 5. Part 1 of 3 Deep Learning Sam PutnamDeep Learning and Artistic Style Transfer for Videos Deep Learning 6/6/2017
  6. 6. Deep Learning Sam PutnamDeep Learning and Artistic Style Transfer for Videos 6/6/2017
  7. 7. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Deep Learning 6/6/2017
  8. 8. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Deep Learning 6/6/2017
  9. 9. Part 2 of 3 Artistic Style Transfer Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  10. 10. Sam Putnam Content and Style Loss Minimization Deep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  11. 11. Sam Putnam Total Loss Deep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  12. 12. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  13. 13. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  14. 14. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  15. 15. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  16. 16. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Artistic Style Transfer 6/6/2017
  17. 17. Part 3 of 3 Butterfly Demo (Will Go Through This Fast) Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  18. 18. A - Picked NN (Try CUDNN for Speed) Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  19. 19. B - Picked GPU Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  20. 20. C - Use Original Resolution Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  21. 21. D - Successfully Loaded VGG Model Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  22. 22. E - Finishes 2 Hours Later; scp the stylized video onto your computer Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  23. 23. 1 - Select Amazon Deep Learning AMI that has Torch and CUDA pre-installed Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  24. 24. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 2 - Select P2.xlarge GPU instance for Tesla K80 6/6/2017
  25. 25. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 3 - Allow Incoming Connections on Port 22 6/6/2017
  26. 26. 4 - Create a Key Pair - I always use the same one that I named TheanoKeyPair Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  27. 27. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 5 - Launch Instance 6/6/2017
  28. 28. Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6 - Wait Until It’s Running 6/6/2017
  29. 29. 7 - ssh -i TheanoKeyPair.pem ubuntu@ec2-34-207-200-9.compute-1.amazonaws. com Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  30. 30. 8 - Try Several Times Until It Connects Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  31. 31. 9 - You’re In Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  32. 32. 10 - cd torch; sudo apt-get install libprotobuf-dev protobuf-compiler Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  33. 33. 11 - luarocks install loadcaffe Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  34. 34. 12 - Re-install Torch Because It’s Fast Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  35. 35. 13 - wget -c https://gist.githubusercontent.com/ ksimonyan/3785162f95cd2d5fee77/raw/ bb2b4fe0a9bb0669211cf3d0bc949dfdda173e9e/ VGG_ILSVRC_19_layers_deploy.prototxt Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  36. 36. 14 - wget -c --no-check-certificate https:// bethgelab.org/media/uploads/deeptextures/ vgg_normalised.caffemodel Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  37. 37. 15 - wget -c http://www.robots.ox.ac.uk/~vgg/ software/very_deep/caffe/ VGG_ILSVRC_19_layers.caffemodel Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  38. 38. 16- wget -c http://pascal.inrialpes.fr/data2/ deepmatching/files/DeepFlow_release2.0.tar.gz; unzipand move ‘static’ file to src directory Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  39. 39. 17 - wget -c http://lear.inrialpes.fr/src/ deepmatching/code/deepmatching_1.0.2.zip; unzip and move ‘static’ file to src directory Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  40. 40. 18 - Upload Video & Image of Matching Resolution to Github; git clone repo on your instance Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  41. 41. 19 - git clone https://github.com/manuelruder/ artistic-videos Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  42. 42. 20 - SSH in using Your KeyPair.pem and Ubuntu as the User Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  43. 43. 21 - ./stylizeVideo.sh Butterfly.mov vanGogh596x336.png Sam PutnamDeep Learning and Artistic Style Transfer for Videos Butterfly Demo 6/6/2017
  44. 44. Thank you Deep Learning and Artistic Style Transfer for Videos Sam Putnam Sam@EDeepLearning.com Thank you to Manuel Ruder et al. Slides are for today only. Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics 6/6/2017 https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77

×