Timezone: »

Bayesian Sampling Using Stochastic Gradient Thermostats
Nan Ding · Youhan Fang · Ryan Babbush · Changyou Chen · Robert D Skeel · Hartmut Neven

Thu Dec 11 11:00 AM -- 03:00 PM (PST) @ Level 2, room 210D

Dynamics-based sampling methods, such as Hybrid Monte Carlo (HMC) and Langevin dynamics (LD), are commonly used to sample target distributions. Recently, such approaches have been combined with stochastic gradient techniques to increase sampling efficiency when dealing with large datasets. An outstanding problem with this approach is that the stochastic gradient introduces an unknown amount of noise which can prevent proper sampling after discretization. To remedy this problem, we show that one can leverage a small number of additional variables in order to stabilize momentum fluctuations induced by the unknown noise. Our method is inspired by the idea of a thermostat in statistical physics and is justified by a general theory.

Author Information

Nan Ding (Google)
Youhan Fang (Purdue University)
Ryan Babbush (Google)
Changyou Chen (University at Buffalo)
Robert D Skeel (Purdue University)
Hartmut Neven (Google)

More from the Same Authors