Image Synthesis From Reconfigurable Layout and Style2. Outline
1. Introduction to Image Synthesis from Layout
a. Task
b. Background knowledge
2. Solution: A layout- and style-based architecture (LostGAN)
3. Experiment
8. Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reconfiguration
3. Layout reconfiguration
10. Image Generation from Reconfigurable Layout and Style
Reconfigurablity
2. Object style reconfiguration
Change the style at instance-level.
11. Image Generation from Reconfigurable Layout and Style
Reconfigurablity
3. Layout reconfiguration
Change the location of bbox
Add/ delete bbox
13. Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reconfiguration
3. Layout reconfiguration
17. A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask prediction
4. ISLA γ and β computation
Embedding matrix
19. A layout- and style-based architecture (LostGAN)
1. Label Embedding
Embedding matrix
20. A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
Embedding matrix
21. A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask prediction
Embedding matrix
22. A layout- and style-based architecture (LostGAN)
1. Label Embedding
2. Object instance-specific projection
3. Mask prediction
4. ISLA γ and β computation
Embedding matrix
27. Experiment
Train resnet-101 on cropped objects from generated images (generate
five samples for each layout) and evaluate on objects from real images
29. Image Generation from Reconfigurable Layout and Style
Reconfigurablity
1. Image style reconfiguration
2. Object style reconfiguration
3. Layout reconfiguration