Skip to content (access key 's')
Logo of Technion
Logo of CS Department
Logo of CS4People
Events

The Taub Faculty of Computer Science Events and Talks

Data Science & Deep Learning: Direct Optimization through arg max for Discrete Variational Auto-Encoder
event speaker icon
Tamir Hazan (IE, Technion)
event date icon
Monday, 11.11.2019, 12:30
event location icon
Taub 301 Taub Bld.
Reparameterization of variational auto-encoders with continuous random variables is an effective method for reducing the variance of their gradient estimates. Our work optimizes the discrete VAE objective directly, using its Gumbel-Max reparameterization. This optimization technique propagates gradients through the reparameterized argmax, and replaces MCMC sampling by the difference of gradients of two argmax predictions. This realization provides the means to learn latent representations in cases when evaluating the argmax operation is tractable while evaluating the softmax operation is intractable.