Skip to yearly menu bar Skip to main content


Poster

A Latent Variational Framework for Stochastic Optimization

Philippe Casgrain

Keywords: [ Stochastic Optimization ] [ Optimization ] [ Control Theory ] [ Optimization -> Convex Optimization; Probabilistic Methods; Theory; Theory ]

[ ]
2019 Poster

Abstract:

This paper provides a unifying theoretical framework for stochastic optimization algorithms by means of a latent stochastic variational problem. Using techniques from stochastic control, the solution to the variational problem is shown to be equivalent to that of a Forward Backward Stochastic Differential Equation (FBSDE). By solving these equations, we recover a variety of existing adaptive stochastic gradient descent methods. This framework establishes a direct connection between stochastic optimization algorithms and a secondary latent inference problem on gradients, where a prior measure on gradient observations determines the resulting algorithm.

Live content is unavailable. Log in and register to view live content