3. : Categorical Reparameterization with Gumbel-Softmax
n ICLR 2017 accepted
n : Eric Jang(google brain)
n : Gumbel-Softmax
[Kingma, 2013]
[Gumbel, 1954]
GS ( )
4. : Gumbel-Softmax
n p(z)
[Gumbel, 1954]
n Gumbel-Max trick
n g Gumbel
n π z
n ex) z = (0, 1, 0, ..., 0)
n argmax Softmax
n y Gumbel-Softmax
n τ
n k
n ex) y = (0.1, 0.2, 0.5, …, 0.1)
y
y
z
22. gumbel-softmax /
n Learning Disentangled Joint Continuous and Discrete Representations(NIPS, 2018)
n Learning Disentangled Representations with Semi-Supervised Deep Generative Models(NIPS,
2017)
n Auxiliary Deep Generative Models (ICML, 2016)
n GANS for Sequences of Discrete Elements with the Gumbel-softmax Distribution(NIPS
workshop, 2016)
23. n pixyz
n : https://qiita.com/kogepan102/items/22b685ce7e9a51fbab98
n : https://github.com/HironoOkamoto/practice_pixyz
n pixyz : https://github.com/masa-su/pixyz