Timezone: »
Simulation-based techniques such as variants of stochastic Runge–Kutta are the de facto approach for inference with stochastic differential equations (SDEs) in machine learning. These methods are general-purpose and used with parametric and non-parametric models, and neural SDEs. Stochastic Runge–Kutta relies on the use of sampling schemes that can be inefficient in high dimensions. We address this issue by revisiting the classical SDE literature and derive direct approximations to the (typically intractable) Fokker–Planck–Kolmogorov equation by matching moments. We show how this workflow is fast, scales to high-dimensional latent spaces, and is applicable to scarce-data applications, where a non-parametric SDE with a driving Gaussian process velocity field specifies the model.
Author Information
Arno Solin (Aalto University)
Ella Tamir (Aalto University)
Prakhar Verma (Aalto University)
More from the Same Authors
-
2022 : Fantasizing with Dual GPs in Bayesian Optimization and Active Learning »
Paul Chang · Prakhar Verma · ST John · Victor Picheny · Henry Moss · Arno Solin -
2022 : Towards Improved Learning in Gaussian Processes: The Best of Two Worlds »
Rui Li · ST John · Arno Solin -
2021 : Sparse Gaussian Processes for Stochastic Differential Equations »
Prakhar Verma · Vincent ADAM · Arno Solin -
2021 Poster: Dual Parameterization of Sparse Variational Gaussian Processes »
Vincent ADAM · Paul Chang · Mohammad Emtiyaz Khan · Arno Solin -
2021 Poster: Periodic Activation Functions Induce Stationarity »
Lassi Meronen · Martin Trapp · Arno Solin -
2021 Poster: Spatio-Temporal Variational Gaussian Processes »
Oliver Hamelijnck · William Wilkinson · Niki Loppi · Arno Solin · Theodoros Damoulas -
2020 Poster: Stationary Activations for Uncertainty Calibration in Deep Learning »
Lassi Meronen · Christabella Irwanto · Arno Solin -
2020 Poster: Deep Automodulators »
Ari Heljakka · Yuxin Hou · Juho Kannala · Arno Solin -
2018 Poster: Infinite-Horizon Gaussian Processes »
Arno Solin · James Hensman · Richard Turner