1. VARIATIONAL DISCRIMINATOR BOTTLENECK:
IMPROVING IMITATION LEARNING, INVERSE RL, AND GANS BY
CONSTRAINING INFORMATION FLOW
Yawei Luo

2. Notoriously D & G
D can always find out the nonessential information from G(z) to make a judgement “fake”.
-> Uninformative gradients -> Unstable training!
How to force D to focus on essential information of G(z)?

3. Preliminaries
• Mutual Information
• Object function in information theoretic view

4. Preliminaries
• Information Bottleneck

5. Preliminaries

6. Preliminaries
q: decoder
E: encoder

7. Back to GANs

8. Back to GANs
Vanilla GAN:
GAN with VIB:

9. Training
I(X, Z) > Ic -> beta ++
I(X, Z) < Ic -> beta --

10. Experiments - IMITATION LEARNING

11. Experiments - IMITATION LEARNING

12. Experiments - INVERSE REINFORCEMENT LEARNING

13. Experiments – image generation