Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Marco Marchesi - Practical uses of style transfer in the creative industry

191 views

Published on

This talk by Marco Marchesi from Happy Finish on "Can you make this image more neoclassical? Practical uses of Style Transfer in the creative industry" was presented at the Style Transfer event on 18th April at TechHub as part of the Creative AI meetup.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Marco Marchesi - Practical uses of style transfer in the creative industry

  1. 1. CREATIVE AI MEETUP - 18.04.18 "Can you make this image more neoclassical?" Practical uses of Style Transfer in the creative industry Marco Marchesi Head of Technology Happy Finish
  2. 2. CREATIVE AI MEETUP - 18.04.18 Summary ● So far… ● Yinka Shonibare VR ● Other approaches: GAN’s ● Deep Retouching ● This year ● Conclusions from “Come Swim” (2017)
  3. 3. CREATIVE AI MEETUP - 18.04.18 So far... Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015). https://harishnarayanan.org/writing/artistic-style-transfer
  4. 4. CREATIVE AI MEETUP - 18.04.18 So far... Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
  5. 5. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR “The Townley Venus” (1-2 century AD) Shonibare’s “Townley Venus” (2017) Gavin Hamilton’s “Venus giving Helen to Paris as his wife” (1782-1784)
  6. 6. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR
  7. 7. CREATIVE AI MEETUP - 18.04.18 Texture Synthesis Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
  8. 8. CREATIVE AI MEETUP - 18.04.18 First Tests Test 1 Test 2 Test 3 Style Mask Mask Content
  9. 9. CREATIVE AI MEETUP - 18.04.18 Image Analogy... Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768 (2016).https://github.com/DmitryUlyanov/fast-neural-doodle Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017). https://github.com/awentzonline/image-analogies
  10. 10. CREATIVE AI MEETUP - 18.04.18 ...that actually makes art!
  11. 11. CREATIVE AI MEETUP - 18.04.18 Our Process CONTENT TEXTURE IMAGE STYLE IMAGE CONTENT MASK STYLE MASK NEURAL STYLE TRANSFER TARGET IMAGE CONTENT MASK TARGET TEXTURE IMAGE video
  12. 12. CREATIVE AI MEETUP - 18.04.18 Final Result video
  13. 13. CREATIVE AI MEETUP - 18.04.18 Another Approach: Generative Adversarial Networks Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017). https://github.com/junyanz/CycleGAN Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT CycleGAN (2017) MUNIT (2018)
  14. 14. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  15. 15. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  16. 16. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  17. 17. CREATIVE AI MEETUP - 18.04.18 This year: Deep Painterly Harmonization (Cornell U., Adobe, 2018) Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
  18. 18. CREATIVE AI MEETUP - 18.04.18 This year: Fast Photo Style (NVIDIA, 2018) Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
  19. 19. CREATIVE AI MEETUP - 18.04.18 The semantic limitations of style transfer
  20. 20. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  21. 21. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  22. 22. CREATIVE AI MEETUP - 18.04.18 Conclusions Patent Pending ● Semantically consistent results ● Really Hi-Res ● More content transformation What’s next?
  23. 23. www.happyfinish.com Everything is possible. Marco Marchesi| Head of Technology marco.marchesi@happyfinish.com

×