SlideShare a Scribd company logo
CREATIVE AI MEETUP - 18.04.18
"Can you make this image more neoclassical?"
Practical uses of Style Transfer in the creative industry
Marco Marchesi
Head of Technology
Happy Finish
CREATIVE AI MEETUP - 18.04.18
Summary
● So far…
● Yinka Shonibare VR
● Other approaches: GAN’s
● Deep Retouching
● This year
● Conclusions
from “Come Swim” (2017)
CREATIVE AI MEETUP - 18.04.18
So far...
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015).
https://harishnarayanan.org/writing/artistic-style-transfer
CREATIVE AI MEETUP - 18.04.18
So far...
Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
“The Townley Venus”
(1-2 century AD)
Shonibare’s
“Townley Venus”
(2017)
Gavin Hamilton’s “Venus
giving Helen to Paris as his
wife” (1782-1784)
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
CREATIVE AI MEETUP - 18.04.18
Texture Synthesis
Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint
arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
First Tests
Test 1 Test 2 Test 3
Style Mask
Mask Content
CREATIVE AI MEETUP - 18.04.18
Image Analogy...
Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768
(2016).https://github.com/DmitryUlyanov/fast-neural-doodle
Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017).
https://github.com/awentzonline/image-analogies
CREATIVE AI MEETUP - 18.04.18
...that actually makes art!
CREATIVE AI MEETUP - 18.04.18
Our Process
CONTENT
TEXTURE IMAGE
STYLE
IMAGE
CONTENT
MASK
STYLE
MASK
NEURAL STYLE TRANSFER
TARGET
IMAGE
CONTENT
MASK
TARGET
TEXTURE IMAGE
video
CREATIVE AI MEETUP - 18.04.18
Final Result
video
CREATIVE AI MEETUP - 18.04.18
Another Approach: Generative Adversarial Networks
Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017).
https://github.com/junyanz/CycleGAN
Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT
CycleGAN (2017) MUNIT (2018)
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
This year: Deep Painterly Harmonization
(Cornell U., Adobe, 2018)
Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
CREATIVE AI MEETUP - 18.04.18
This year: Fast Photo Style (NVIDIA, 2018)
Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
CREATIVE AI MEETUP - 18.04.18
The semantic limitations of style transfer
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
Conclusions
Patent Pending
● Semantically consistent results
● Really Hi-Res
● More content transformation
What’s next?
www.happyfinish.com Everything is possible.
Marco Marchesi| Head of Technology
marco.marchesi@happyfinish.com

More Related Content

Similar to Marco Marchesi - Practical uses of style transfer in the creative industry

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Treder
uxpin
 
Resume
ResumeResume
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016
Cédric Brun
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
FITC
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approach
Jukka Huhtamäki
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Marco Aurelio Gerosa
 

Similar to Marco Marchesi - Practical uses of style transfer in the creative industry (6)

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Treder
 
Resume
ResumeResume
Resume
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approach
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
 

More from Luba Elliott

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV Conference
Luba Elliott
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetup
Luba Elliott
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
Luba Elliott
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Luba Elliott
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC Archive
Luba Elliott
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview
Luba Elliott
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Luba Elliott
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Luba Elliott
 
Design in AI
Design in AIDesign in AI
Design in AI
Luba Elliott
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Luba Elliott
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Luba Elliott
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Luba Elliott
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through Art
Luba Elliott
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Luba Elliott
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Luba Elliott
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Luba Elliott
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Luba Elliott
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Luba Elliott
 

More from Luba Elliott (20)

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV Conference
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - Oxford
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML Prague
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetup
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC Archive
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
 
Design in AI
Design in AIDesign in AI
Design in AI
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through Art
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
 

Recently uploaded

Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
Globus
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 

Recently uploaded (20)

Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 

Marco Marchesi - Practical uses of style transfer in the creative industry

  • 1. CREATIVE AI MEETUP - 18.04.18 "Can you make this image more neoclassical?" Practical uses of Style Transfer in the creative industry Marco Marchesi Head of Technology Happy Finish
  • 2. CREATIVE AI MEETUP - 18.04.18 Summary ● So far… ● Yinka Shonibare VR ● Other approaches: GAN’s ● Deep Retouching ● This year ● Conclusions from “Come Swim” (2017)
  • 3. CREATIVE AI MEETUP - 18.04.18 So far... Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015). https://harishnarayanan.org/writing/artistic-style-transfer
  • 4. CREATIVE AI MEETUP - 18.04.18 So far... Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 5. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR “The Townley Venus” (1-2 century AD) Shonibare’s “Townley Venus” (2017) Gavin Hamilton’s “Venus giving Helen to Paris as his wife” (1782-1784)
  • 6. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR
  • 7. CREATIVE AI MEETUP - 18.04.18 Texture Synthesis Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 8. CREATIVE AI MEETUP - 18.04.18 First Tests Test 1 Test 2 Test 3 Style Mask Mask Content
  • 9. CREATIVE AI MEETUP - 18.04.18 Image Analogy... Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768 (2016).https://github.com/DmitryUlyanov/fast-neural-doodle Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017). https://github.com/awentzonline/image-analogies
  • 10. CREATIVE AI MEETUP - 18.04.18 ...that actually makes art!
  • 11. CREATIVE AI MEETUP - 18.04.18 Our Process CONTENT TEXTURE IMAGE STYLE IMAGE CONTENT MASK STYLE MASK NEURAL STYLE TRANSFER TARGET IMAGE CONTENT MASK TARGET TEXTURE IMAGE video
  • 12. CREATIVE AI MEETUP - 18.04.18 Final Result video
  • 13. CREATIVE AI MEETUP - 18.04.18 Another Approach: Generative Adversarial Networks Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017). https://github.com/junyanz/CycleGAN Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT CycleGAN (2017) MUNIT (2018)
  • 14. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 15. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 16. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 17. CREATIVE AI MEETUP - 18.04.18 This year: Deep Painterly Harmonization (Cornell U., Adobe, 2018) Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
  • 18. CREATIVE AI MEETUP - 18.04.18 This year: Fast Photo Style (NVIDIA, 2018) Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
  • 19. CREATIVE AI MEETUP - 18.04.18 The semantic limitations of style transfer
  • 20. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 21. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 22. CREATIVE AI MEETUP - 18.04.18 Conclusions Patent Pending ● Semantically consistent results ● Really Hi-Res ● More content transformation What’s next?
  • 23. www.happyfinish.com Everything is possible. Marco Marchesi| Head of Technology marco.marchesi@happyfinish.com