Timezone: »
We present two new methods for inference in Gaussian process (GP) models with general nonlinear likelihoods. Inference is based on a variational framework where a Gaussian posterior is assumed and the likelihood is linearized about the variational posterior mean using either a Taylor series expansion or statistical linearization. We show that the parameter updates obtained by these algorithms are equivalent to the state update equations in the iterative extended and unscented Kalman filters respectively, hence we refer to our algorithms as extended and unscented GPs. The unscented GP treats the likelihood as a 'black-box' by not requiring its derivative for inference, so it also applies to non-differentiable likelihood models. We evaluate the performance of our algorithms on a number of synthetic inversion problems and a binary classification dataset.
Author Information
Daniel M Steinberg (Data61)
Edwin Bonilla (CSIRO's Data61)
Related Events (a corresponding poster, oral, or spotlight)
-
2014 Poster: Extended and Unscented Gaussian Processes »
Thu. Dec 11th 12:00 -- 04:59 AM Room Level 2, room 210D
More from the Same Authors
-
2019 : Outstanding Contribution Talk: Variational Graph Convolutional Networks »
Edwin Bonilla -
2019 Poster: Structured Variational Inference in Continuous Cox Process Models »
Virginia Aglietti · Edwin Bonilla · Theodoros Damoulas · Sally Cripps -
2015 Poster: Scalable Inference for Gaussian Process Models with Black-Box Likelihoods »
Amir Dezfouli · Edwin Bonilla -
2014 Poster: Automated Variational Inference for Gaussian Process Models »
Trung V Nguyen · Edwin Bonilla -
2013 Workshop: Machine Learning for Sustainability »
Edwin Bonilla · Thomas Dietterich · Theodoros Damoulas · Andreas Krause · Daniel Sheldon · Iadine Chades · J. Zico Kolter · Bistra Dilkina · Carla Gomes · Hugo P Simao -
2011 Poster: Improving Topic Coherence with Regularized Topic Models »
David Newman · Edwin Bonilla · Wray Buntine -
2010 Poster: Gaussian Process Preference Elicitation »
Edwin Bonilla · Shengbo Guo · Scott Sanner -
2007 Poster: Multi-task Gaussian Process Prediction »
Edwin Bonilla · Kian Ming A Chai · Chris Williams -
2007 Spotlight: Multi-task Gaussian Process Prediction »
Edwin Bonilla · Kian Ming A Chai · Chris Williams