`

Timezone: »

 
Poster
MCMC Variational Inference via Uncorrected Hamiltonian Annealing
Tomas Geffner · Justin Domke

Thu Dec 09 08:30 AM -- 10:00 AM (PST) @ None #None

Given an unnormalized target distribution we want to obtain approximate samples from it and a tight lower bound on its (log) normalization constant log Z. Annealed Importance Sampling (AIS) with Hamiltonian MCMC is a powerful method that can be used to do this. Its main drawback is that it uses non-differentiable transition kernels, which makes tuning its many parameters hard. We propose a framework to use an AIS-like procedure with Uncorrected Hamiltonian MCMC, called Uncorrected Hamiltonian Annealing. Our method leads to tight and differentiable lower bounds on log Z. We show empirically that our method yields better performances than other competing approaches, and that the ability to tune its parameters using reparameterization gradients may lead to large performance improvements.

Author Information

Tomas Geffner (UMass Amherst)
Justin Domke (University of Massachusetts, Amherst)

More from the Same Authors