Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Image Synthesis From
Reconfigurable Layout and Style
Weijian Deng
Outline
1. Introduction to Image Synthesis from Layout
a. Task
b. Background knowledge
2. Solution: A layout- and style-ba...
1. Introduction to Image Synthesis from Layout
Image Generation from Layout
Layout
Image
Image to Image Translation
Image to Image Translation
Image to Image Translation
Pixel-pixel GAN
CVPR 2017
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reco...
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
2. Object style reconfiguration
Change the style at...
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
3. Layout reconfiguration
 Change the location of ...
2. Solution: A layout- and style-based
architecture (LostGAN)
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reco...
StyleGAN
A layout- and style-based architecture (LostGAN)
A layout- and style-based architecture (LostGAN)
A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask predict...
× +
γ
β
A layout- and style-based architecture (LostGAN)
1. Label Embedding
Embedding matrix
A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
Embedding matrix
A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask predict...
A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask predict...
A layout- and style-based architecture (LostGAN)
A layout- and style-based architecture (LostGAN)
Experiment
Experiment
Experiment
Train resnet-101 on cropped objects from generated images (generate
five samples for each layout) and evaluate ...
Experiment
Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reco...
Thanks!
Semantic Image Synthesis with Spatially-Adaptive Normalization
Zhujunyan CVPR 2019
Semantic Image Synthesis with Spatially-Adaptive Normalization
Zhujunyan CVPR 2019
You’ve finished this document.
Download and read it offline.
Upcoming SlideShare
What to Upload to SlideShare
Next
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

0

Share

Image Synthesis From Reconfigurable Layout and Style

Download to read offline

weijian deng

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Image Synthesis From Reconfigurable Layout and Style

  1. 1. Image Synthesis From Reconfigurable Layout and Style Weijian Deng
  2. 2. Outline 1. Introduction to Image Synthesis from Layout a. Task b. Background knowledge 2. Solution: A layout- and style-based architecture (LostGAN) 3. Experiment
  3. 3. 1. Introduction to Image Synthesis from Layout
  4. 4. Image Generation from Layout Layout Image
  5. 5. Image to Image Translation
  6. 6. Image to Image Translation
  7. 7. Image to Image Translation Pixel-pixel GAN CVPR 2017
  8. 8. Image Generation from Reconfigurable Layout and Style Reconfigurablity 1. Image style reconfiguration 2. Object style reconfiguration 3. Layout reconfiguration
  9. 9. Image Generation from Reconfigurable Layout and Style Reconfigurablity 1. Image style reconfiguration
  10. 10. Image Generation from Reconfigurable Layout and Style Reconfigurablity 2. Object style reconfiguration Change the style at instance-level.
  11. 11. Image Generation from Reconfigurable Layout and Style Reconfigurablity 3. Layout reconfiguration  Change the location of bbox  Add/ delete bbox
  12. 12. 2. Solution: A layout- and style-based architecture (LostGAN)
  13. 13. Image Generation from Reconfigurable Layout and Style Reconfigurablity 1. Image style reconfiguration 2. Object style reconfiguration 3. Layout reconfiguration
  14. 14. StyleGAN
  15. 15. A layout- and style-based architecture (LostGAN)
  16. 16. A layout- and style-based architecture (LostGAN)
  17. 17. A layout- and style-based architecture (LostGAN) 1. Label Embedding 2. Object instance-specific projection 3. Mask prediction 4. ISLA γ and β computation Embedding matrix
  18. 18. × + γ β
  19. 19. A layout- and style-based architecture (LostGAN) 1. Label Embedding Embedding matrix
  20. 20. A layout- and style-based architecture (LostGAN) 1. Label Embedding 2. Object instance-specific projection Embedding matrix
  21. 21. A layout- and style-based architecture (LostGAN) 1. Label Embedding 2. Object instance-specific projection 3. Mask prediction Embedding matrix
  22. 22. A layout- and style-based architecture (LostGAN) 1. Label Embedding 2. Object instance-specific projection 3. Mask prediction 4. ISLA γ and β computation Embedding matrix
  23. 23. A layout- and style-based architecture (LostGAN)
  24. 24. A layout- and style-based architecture (LostGAN)
  25. 25. Experiment
  26. 26. Experiment
  27. 27. Experiment Train resnet-101 on cropped objects from generated images (generate five samples for each layout) and evaluate on objects from real images
  28. 28. Experiment
  29. 29. Image Generation from Reconfigurable Layout and Style Reconfigurablity 1. Image style reconfiguration 2. Object style reconfiguration 3. Layout reconfiguration
  30. 30. Thanks!
  31. 31. Semantic Image Synthesis with Spatially-Adaptive Normalization Zhujunyan CVPR 2019
  32. 32. Semantic Image Synthesis with Spatially-Adaptive Normalization Zhujunyan CVPR 2019

weijian deng

Views

Total views

154

On Slideshare

0

From embeds

0

Number of embeds

0

Actions

Downloads

1

Shares

0

Comments

0

Likes

0

×