DiscoGAN - Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
1. Learning to Discover Cross-Domain Relations with
Generative Adversarial Networks
Taeksoo Kim, Moonsu Cha, Hyunsoo Kim, Jung Kwon Lee and Jiwon Kim
DiscoGAN
1
SKT-Brain
6. SKT-Brain
Generative Adversarial Networks (GANs)
Related Works
I. Goodfellow et al., “Generative Adversarial Networks”, 2014
Pathak et al., “Context Encoders: Feature Learning by Inpainting”, CVPR 2016
C. Ledig et al., “Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network”, 2016
6
Image Completion
Super Resolution
45. SKT-Brain
Male → Female
Experimental Results - DiscoGAN
45
Input
Mapping
Result
Source domain : Male face images
Target domain : Female face images
52. SKT-Brain
Conclusion
52
Summary
• We presents a learning method to discover cross-domain relations with a
generative adversarial network.
• Our approach works without any explicit pair labels and learns to relate
datasets from very different domains.
Whenever you get bored, just download
any two datasets and put them into
DiscoGAN. It will give you an interesting
result that you didn’t think of!
Code is available on GitHub (https://github.com/SKTBrain/DiscoGAN).
Follow-up work is available on arXiv
(T. Kim at el, “Unsupervised Visual Attribute Transfer with Reconfigurable Generative Adversarial Networks”)
53. SKT-Brain
Future Work (on arXiv)
53
Future Work
Input
Hair color
[black / brown / blond]
Bang hair
[with / without]
Smile
[with / without]
T. Kim et al., “Unsupervised Visual Attribute Transfer with Reconfigurable Generative Adversarial Networks”, 2017
Extension to multiple domains (single network!)
54. SKT-Brain
Future Work (on arXiv)
54
Future Work
Extension to attribute transfer
Bang hair transfer Smile transfer
T. Kim et al., “Unsupervised Visual Attribute Transfer with Reconfigurable Generative Adversarial Networks”, 2017