Timezone: »
Schrödinger Bridges (SBs) is an optimal transport problem that has received increasing attentions in deep generative modeling for its mathematical flexibility compared to Scored-based Generative Models (SGMs). However, it remains unclear whether the optimization principle of SBs relates to modern training of deep generative models, which often relies on constructing parametrized log-likelihood objectives.This raises questions on the suitability of SB models as a principled alternative for generative applications. In this work, we present a novel computational framework for likelihood training of SB models grounded on Forward-Backward Stochastic Differential Equations Theory – a nonlinear stochastic optimal control principle that transforms the optimality condition of SBs into a set of SDEs. Crucially, these SDEs can be used to construct the likelihood objectives for SBs that, surprisingly, generalizes the ones for SGMs as special cases. This leads to a new optimization principle that inherits the same SB optimality yet without losing application of modern generative training techniques, and we show that the resulting training algorithm achieves encouraging results on generating realistic images on MNIST and CelebA.
Author Information
Tianrong Chen (Georgia Institute of Technology)
Guan-Horng Liu (Georgia Institute of Technology)
Evangelos Theodorou (Georgia Institute of Technology)
More from the Same Authors
-
2021 Spotlight: Second-Order Neural ODE Optimizer »
Guan-Horng Liu · Tianrong Chen · Evangelos Theodorou -
2022 : Data-driven discovery of non-Newtonian astronomy via learning non-Euclidean Hamiltonian »
Oswin So · Gongjie Li · Evangelos Theodorou · Molei Tao -
2022 Panel: Panel 6B-3: Exponential Family Model-Based… & Deep Generalized Schrödinger… »
Guan-Horng Liu · Gene Li -
2022 : Invited Talk: Guan-Horng Liu »
Guan-Horng Liu -
2022 Poster: Deep Generalized Schrödinger Bridge »
Guan-Horng Liu · Tianrong Chen · Oswin So · Evangelos Theodorou -
2021 Poster: Second-Order Neural ODE Optimizer »
Guan-Horng Liu · Tianrong Chen · Evangelos Theodorou -
2020 : Contributed talks in Session 2 (Zoom) »
Martin Takac · Samuel Horváth · Guan-Horng Liu · Nicolas Loizou · Sharan Vaswani -
2020 : Contributed Video: DDPNOpt: Differential Dynamic Programming Neural Optimizer, Guan-Horng Liu »
Guan-Horng Liu -
2020 : Poster Session 1 (gather.town) »
Laurent Condat · Tiffany Vlaar · Ohad Shamir · Mohammadi Zaki · Zhize Li · Guan-Horng Liu · Samuel Horváth · Mher Safaryan · Yoni Choukroun · Kumar Shridhar · Nabil Kahale · Jikai Jin · Pratik Kumar Jawanpuria · Gaurav Kumar Yadav · Kazuki Koyama · Junyoung Kim · Xiao Li · Saugata Purkayastha · Adil Salim · Dighanchal Banerjee · Peter Richtarik · Lakshman Mahto · Tian Ye · Bamdev Mishra · Huikang Liu · Jiajie Zhu