SlideShare a Scribd company logo
Alias-Free Generative Adversarial
Networks (StyleGAN3)
Jin Hyeon Kim
2023.02.06
Previous Works
StyleGAN StyleGAN2 StyleGAN3
Previous Works
StyleGAN StyleGAN2 StyleGAN3
- Mapping network: input latent code z is transformed to
an intermediate latent code w.
- Affine transformation: makes w a style vector,
guaranteeing disentanglement of feature styles.
- Noise added to obtain stochastic variation on image.
Previous Works
StyleGAN StyleGAN2 StyleGAN3
- Blob shaped artifacts(water droplets) appeared in images
- Removed AdaIN and used weight demodulation to solve
the water droplet problem.
- Used a skip generator and residual discriminator instead
of PGGAN to produce high quality images
Previous Works
StyleGAN StyleGAN2 StyleGAN3
- Blob shaped artifacts(water droplets) appeared in images
- Removed AdaIN and used weight demodulation to solve
the water droplet problem.
- Used a skip generator and residual discriminator instead
of PGGAN to produce high quality images
Previous Works
StyleGAN StyleGAN2 StyleGAN3
Texture Sticking!!
Previous Works
StyleGAN StyleGAN2 StyleGAN3
Texture Sticking!!
Texture Sticking
Root Cause
1. Image Borders
2. Per-pixel noise inputs
3. Positional Encoding
4. Aliasing
Root Cause
1. Image Borders
2. Per-pixel noise inputs
3. Positional Encoding
4. Aliasing
Aliasing?
Nyquist-Shannon Sampling Theorem(Reconstruction Theorem)
: Sampling frequency(fs) should be at least twice the frequency of the highest frequency(f). i.e fs ≥ 2f
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing!!
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing!!
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Frequency Band
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
LPF
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
LPF
Aliasing? Fourier Transform? Bandlimit?
Fourier Transform
Fourier Transform
Fourier Transform
Fourier Transform
Frequency Band
Frequency Band
Conditions to prevent Aliasing
Condition 1).
Sampling process should accommodate appropriate sampling rate(frequency).
Condition 2).
Apply low-pass filter(LPF) to isolate unwanted high frequency components.
Where does aliasing occur ?
1. Upsampling Filters: - Non ideal filters
- Low pass filter not applied properly
- Unwanted high frequency components are
accumulated
2. Non-linearities such as ReLU: - Value sparks for negative values
How to solve Aliasing?
“ Our goal is to make every layer of G equivariant ~ “
How to solve Aliasing?
“ Our goal is to make every layer of G equivariant ~ “
How to solve Aliasing?
“ Our goal is to make every layer of G equivariant ~ “
Equivariance
= Change(variance) in the input is equally applied to the output
Four Operations on Two Transformations (Translation & Rotation)
1. Convolution
2. Up-sampling
3. Down-sampling
4. Non-Linearity
Four Operations on Two Transformations (Translation & Rotation)
1. Convolution
2. Up-sampling
3. Down-sampling
4. Non-Linearity
Condition 1).
Sampling process should accommodate appropriate sampling rate(frequency).
Condition 2).
Apply low-pass filter(LPF) to isolate unwanted high frequency components.
Discrete and Continuous Representation
Discretely sampled feature map
: Z
Discrete operation
: F
Discrete operation applied on feature map
: Z’ = F(Z)
Discrete and Continuous Representation
Discretely sampled feature map
: Z z
Discrete operation
: F f
Discrete operation applied on feature map
: Z’ = F(Z) z ’ = f(z)
Discrete and Continuous Representation
Discretely sampled feature map
: Z z
Discrete operation
: F f
Discrete operation applied on feature map
: Z’ = F(Z) z ’ = f(z)
Interpolation filter
Dirac comb function
Figure 2.
Figure 2.
Figure 3.
Figure 3 – (a)
Figure 3 – (a)
Figure 3 – (a)
Figure 3 – (a)
LPF
Figure 3.
LPF
Figure 3 – (a)
Figure 3 – (b)
Figure 3 – (b)
Figure 3 – (c)
Results
Results
Thank You

More Related Content

Similar to Alias-Free GAN(styleGAN3).pptx

[PR12] Making Convolutional Networks Shift-Invariant Again
[PR12] Making Convolutional Networks Shift-Invariant Again[PR12] Making Convolutional Networks Shift-Invariant Again
[PR12] Making Convolutional Networks Shift-Invariant Again
Hyeongmin Lee
 
Introduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.pptIntroduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.ppt
debeshidutta2
 
Analysis of vibration signals to identify cracks in a gear unit
Analysis of vibration signals to identify cracks in a gear unitAnalysis of vibration signals to identify cracks in a gear unit
Analysis of vibration signals to identify cracks in a gear unitsushanthsjce
 
Image Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain FiltersImage Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain Filters
Karthika Ramachandran
 
Analysis of local affine model v2
Analysis of  local affine model v2Analysis of  local affine model v2
Analysis of local affine model v2
cindy071434
 
Analysis of local affine model v2
Analysis of  local affine model v2Analysis of  local affine model v2
Analysis of local affine model v2
cindy071434
 
Wavelet Based Image Compression Using FPGA
Wavelet Based Image Compression Using FPGAWavelet Based Image Compression Using FPGA
Wavelet Based Image Compression Using FPGA
Dr. Mohieddin Moradi
 
Op amp applications filters cw final (2)
Op amp applications filters cw final (2)Op amp applications filters cw final (2)
Op amp applications filters cw final (2)
JUNAID SK
 
Op amp applications filters cw final
Op amp applications filters cw finalOp amp applications filters cw final
Op amp applications filters cw final
JUNAID SK
 
04 image transformations_ii
04 image transformations_ii04 image transformations_ii
04 image transformations_ii
ankit_ppt
 
Signal Processing Assignment Help
Signal Processing Assignment HelpSignal Processing Assignment Help
Signal Processing Assignment Help
Matlab Assignment Experts
 
Lec 07 image enhancement in frequency domain i
Lec 07 image enhancement in frequency domain iLec 07 image enhancement in frequency domain i
Lec 07 image enhancement in frequency domain iAli Hassan
 
"Evaluation of the Hilbert Huang transformation of transient signals for brid...
"Evaluation of the Hilbert Huang transformation of transient signals for brid..."Evaluation of the Hilbert Huang transformation of transient signals for brid...
"Evaluation of the Hilbert Huang transformation of transient signals for brid...
TRUSS ITN
 
Mediump support in Mesa (XDC 2019)
Mediump support in Mesa (XDC 2019)Mediump support in Mesa (XDC 2019)
Mediump support in Mesa (XDC 2019)
Igalia
 
3.Wavelet Transform(Backup slide-3)
3.Wavelet Transform(Backup slide-3)3.Wavelet Transform(Backup slide-3)
3.Wavelet Transform(Backup slide-3)
Nashid Alam
 
bode plot.pptx
bode plot.pptxbode plot.pptx
bode plot.pptx
SivaSankar306103
 
Ao4103236259
Ao4103236259Ao4103236259
Ao4103236259
IJERA Editor
 

Similar to Alias-Free GAN(styleGAN3).pptx (20)

Exp passive filter (5)
Exp passive filter (5)Exp passive filter (5)
Exp passive filter (5)
 
[PR12] Making Convolutional Networks Shift-Invariant Again
[PR12] Making Convolutional Networks Shift-Invariant Again[PR12] Making Convolutional Networks Shift-Invariant Again
[PR12] Making Convolutional Networks Shift-Invariant Again
 
Introduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.pptIntroduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.ppt
 
Analysis of vibration signals to identify cracks in a gear unit
Analysis of vibration signals to identify cracks in a gear unitAnalysis of vibration signals to identify cracks in a gear unit
Analysis of vibration signals to identify cracks in a gear unit
 
Image Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain FiltersImage Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain Filters
 
Analysis of local affine model v2
Analysis of  local affine model v2Analysis of  local affine model v2
Analysis of local affine model v2
 
Analysis of local affine model v2
Analysis of  local affine model v2Analysis of  local affine model v2
Analysis of local affine model v2
 
Wavelet Based Image Compression Using FPGA
Wavelet Based Image Compression Using FPGAWavelet Based Image Compression Using FPGA
Wavelet Based Image Compression Using FPGA
 
Op amp applications filters cw final (2)
Op amp applications filters cw final (2)Op amp applications filters cw final (2)
Op amp applications filters cw final (2)
 
Exp passive filter (4)
Exp passive filter (4)Exp passive filter (4)
Exp passive filter (4)
 
Op amp applications filters cw final
Op amp applications filters cw finalOp amp applications filters cw final
Op amp applications filters cw final
 
04 image transformations_ii
04 image transformations_ii04 image transformations_ii
04 image transformations_ii
 
Signal Processing Assignment Help
Signal Processing Assignment HelpSignal Processing Assignment Help
Signal Processing Assignment Help
 
Lec 07 image enhancement in frequency domain i
Lec 07 image enhancement in frequency domain iLec 07 image enhancement in frequency domain i
Lec 07 image enhancement in frequency domain i
 
"Evaluation of the Hilbert Huang transformation of transient signals for brid...
"Evaluation of the Hilbert Huang transformation of transient signals for brid..."Evaluation of the Hilbert Huang transformation of transient signals for brid...
"Evaluation of the Hilbert Huang transformation of transient signals for brid...
 
Mediump support in Mesa (XDC 2019)
Mediump support in Mesa (XDC 2019)Mediump support in Mesa (XDC 2019)
Mediump support in Mesa (XDC 2019)
 
3.Wavelet Transform(Backup slide-3)
3.Wavelet Transform(Backup slide-3)3.Wavelet Transform(Backup slide-3)
3.Wavelet Transform(Backup slide-3)
 
bode plot.pptx
bode plot.pptxbode plot.pptx
bode plot.pptx
 
Exp passive filter (7)
Exp passive filter (7)Exp passive filter (7)
Exp passive filter (7)
 
Ao4103236259
Ao4103236259Ao4103236259
Ao4103236259
 

Recently uploaded

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 

Recently uploaded (20)

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 

Alias-Free GAN(styleGAN3).pptx

  • 1. Alias-Free Generative Adversarial Networks (StyleGAN3) Jin Hyeon Kim 2023.02.06
  • 3. Previous Works StyleGAN StyleGAN2 StyleGAN3 - Mapping network: input latent code z is transformed to an intermediate latent code w. - Affine transformation: makes w a style vector, guaranteeing disentanglement of feature styles. - Noise added to obtain stochastic variation on image.
  • 4. Previous Works StyleGAN StyleGAN2 StyleGAN3 - Blob shaped artifacts(water droplets) appeared in images - Removed AdaIN and used weight demodulation to solve the water droplet problem. - Used a skip generator and residual discriminator instead of PGGAN to produce high quality images
  • 5. Previous Works StyleGAN StyleGAN2 StyleGAN3 - Blob shaped artifacts(water droplets) appeared in images - Removed AdaIN and used weight demodulation to solve the water droplet problem. - Used a skip generator and residual discriminator instead of PGGAN to produce high quality images
  • 6. Previous Works StyleGAN StyleGAN2 StyleGAN3 Texture Sticking!!
  • 7. Previous Works StyleGAN StyleGAN2 StyleGAN3 Texture Sticking!!
  • 9. Root Cause 1. Image Borders 2. Per-pixel noise inputs 3. Positional Encoding 4. Aliasing
  • 10. Root Cause 1. Image Borders 2. Per-pixel noise inputs 3. Positional Encoding 4. Aliasing
  • 11. Aliasing? Nyquist-Shannon Sampling Theorem(Reconstruction Theorem) : Sampling frequency(fs) should be at least twice the frequency of the highest frequency(f). i.e fs ≥ 2f
  • 12. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 13. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 14. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 15. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 16. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 17. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band Aliasing!!
  • 18. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 19. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 20. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 21. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 22. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band Aliasing!!
  • 23. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 24. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 25. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 26. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 27. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band Frequency Band
  • 28. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band LPF
  • 29. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band LPF
  • 30. Aliasing? Fourier Transform? Bandlimit? Fourier Transform Fourier Transform Fourier Transform Fourier Transform Frequency Band Frequency Band
  • 31. Conditions to prevent Aliasing Condition 1). Sampling process should accommodate appropriate sampling rate(frequency). Condition 2). Apply low-pass filter(LPF) to isolate unwanted high frequency components.
  • 32. Where does aliasing occur ? 1. Upsampling Filters: - Non ideal filters - Low pass filter not applied properly - Unwanted high frequency components are accumulated 2. Non-linearities such as ReLU: - Value sparks for negative values
  • 33. How to solve Aliasing? “ Our goal is to make every layer of G equivariant ~ “
  • 34. How to solve Aliasing? “ Our goal is to make every layer of G equivariant ~ “
  • 35. How to solve Aliasing? “ Our goal is to make every layer of G equivariant ~ “ Equivariance = Change(variance) in the input is equally applied to the output
  • 36. Four Operations on Two Transformations (Translation & Rotation) 1. Convolution 2. Up-sampling 3. Down-sampling 4. Non-Linearity
  • 37. Four Operations on Two Transformations (Translation & Rotation) 1. Convolution 2. Up-sampling 3. Down-sampling 4. Non-Linearity Condition 1). Sampling process should accommodate appropriate sampling rate(frequency). Condition 2). Apply low-pass filter(LPF) to isolate unwanted high frequency components.
  • 38. Discrete and Continuous Representation Discretely sampled feature map : Z Discrete operation : F Discrete operation applied on feature map : Z’ = F(Z)
  • 39. Discrete and Continuous Representation Discretely sampled feature map : Z z Discrete operation : F f Discrete operation applied on feature map : Z’ = F(Z) z ’ = f(z)
  • 40. Discrete and Continuous Representation Discretely sampled feature map : Z z Discrete operation : F f Discrete operation applied on feature map : Z’ = F(Z) z ’ = f(z) Interpolation filter Dirac comb function
  • 47. Figure 3 – (a) LPF