Timezone: »
We introduce implicit Deep Adaptive Design (iDAD), a new method for performing adaptive experiments in real-time with implicit models. iDAD amortizes the cost of Bayesian optimal experimental design (BOED) by learning a design policy network upfront, which can then be deployed quickly at the time of the experiment. The iDAD network can be trained on any model which simulates differentiable samples, unlike previous design policy work that requires a closed form likelihood and conditionally independent experiments. At deployment, iDAD allows design decisions to be made in milliseconds, in contrast to traditional BOED approaches that require heavy computation during the experiment itself. We illustrate the applicability of iDAD on a number of experiments, and show that it provides a fast and effective mechanism for performing adaptive design with implicit models.
Author Information
Desi R Ivanova (University of Oxford)
Adam Foster (Microsoft Research Cambridge)
Steven Kleinegesse (The University of Edinburgh)
Michael Gutmann (University of Edinburgh)
Thomas Rainforth (University of Oxford)
More from the Same Authors
-
2021 : Certifiably Robust Variational Autoencoders »
Ben Barrett · Alexander Camuto · Matthew Willetts · Thomas Rainforth -
2021 : Efficient Automated Online Experimentation with Multi-Fidelity »
Steven Kleinegesse · Zhenwen Dai · Andreas Damianou · Kamil Ciosek · Federico Tomasi -
2021 : Bayesian Optimal Experimental Design for Simulator Models of Cognition »
Simon Valentin · Steven Kleinegesse · Neil Bramley · Michael Gutmann · Chris Lucas -
2021 : Certifiably Robust Variational Autoencoders »
Ben Barrett · Alexander Camuto · Matthew Willetts · Thomas Rainforth -
2021 : Certifiably Robust Variational Autoencoders »
Ben Barrett · Alexander Camuto · Matthew Willetts · Thomas Rainforth -
2023 Poster: Trans-Dimensional Generative Modeling via Jump Diffusion Models »
Andrew Campbell · William Harvey · Christian Weilbach · Valentin De Bortoli · Thomas Rainforth · Arnaud Doucet -
2023 Poster: Deep Stochastic Processes via Functional Markov Transition Operators »
Jin Xu · Emilien Dupont · Kaspar Märtens · Thomas Rainforth · Yee Whye Teh -
2023 Poster: Variational Gibbs Inference for Statistical Model Estimation from Incomplete Data »
Vaidotas Simkus · Benjamin Rhodes · Michael Gutmann -
2022 Poster: A Continuous Time Framework for Discrete Denoising Models »
Andrew Campbell · Joe Benton · Valentin De Bortoli · Thomas Rainforth · George Deligiannidis · Arnaud Doucet -
2022 Poster: Rethinking Variational Inference for Probabilistic Programs with Stochastic Support »
Tim Reichelt · Luke Ong · Thomas Rainforth -
2022 Poster: Active Surrogate Estimators: An Active Learning Approach to Label-Efficient Model Evaluation »
Jannik Kossen · Sebastian Farquhar · Yarin Gal · Thomas Rainforth -
2021 Poster: On Contrastive Representations of Stochastic Processes »
Emile Mathieu · Adam Foster · Yee Teh -
2021 Poster: Group Equivariant Subsampling »
Jin Xu · Hyunjik Kim · Thomas Rainforth · Yee Teh -
2021 Poster: Online Variational Filtering and Parameter Learning »
Andrew Campbell · Yuyang Shi · Thomas Rainforth · Arnaud Doucet -
2021 Poster: Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning »
Jannik Kossen · Neil Band · Clare Lyle · Aidan Gomez · Thomas Rainforth · Yarin Gal -
2021 Oral: Online Variational Filtering and Parameter Learning »
Andrew Campbell · Yuyang Shi · Thomas Rainforth · Arnaud Doucet -
2020 Poster: Telescoping Density-Ratio Estimation »
Benjamin Rhodes · Kai Xu · Michael Gutmann -
2020 Spotlight: Telescoping Density-Ratio Estimation »
Benjamin Rhodes · Kai Xu · Michael Gutmann -
2019 Poster: On the Fairness of Disentangled Representations »
Francesco Locatello · Gabriele Abbati · Thomas Rainforth · Stefan Bauer · Bernhard Schölkopf · Olivier Bachem -
2019 Poster: Variational Bayesian Optimal Experimental Design »
Adam Foster · Martin Jankowiak · Elias Bingham · Paul Horsfall · Yee Whye Teh · Thomas Rainforth · Noah Goodman -
2019 Spotlight: Variational Bayesian Optimal Experimental Design »
Adam Foster · Martin Jankowiak · Elias Bingham · Paul Horsfall · Yee Whye Teh · Thomas Rainforth · Noah Goodman -
2018 : Panel on research process »
Zachary Lipton · Charles Sutton · Finale Doshi-Velez · Hanna Wallach · Suchi Saria · Rich Caruana · Thomas Rainforth -
2018 Workshop: Critiquing and Correcting Trends in Machine Learning »
Thomas Rainforth · Matt Kusner · Benjamin Bloem-Reddy · Brooks Paige · Rich Caruana · Yee Whye Teh -
2018 Poster: Faithful Inversion of Generative Models for Effective Amortized Inference »
Stefan Webb · Adam Golinski · Rob Zinkov · Siddharth N · Thomas Rainforth · Yee Whye Teh · Frank Wood -
2017 : Poster Spotlights »
Francesco Locatello · Ari Pakman · Da Tang · Thomas Rainforth · Zalan Borsos · Marko Järvenpää · Eric Nalisnick · Gabriele Abbati · XIAOYU LU · Jonathan Huggins · Rachit Singh · Rui Luo -
2017 Poster: VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning »
Akash Srivastava · Lazar Valkov · Chris Russell · Michael Gutmann · Charles Sutton -
2016 : Probabilistic structure discovery in time series data »
David Janz · Brooks Paige · Thomas Rainforth · Jan-Willem van de Meent -
2016 Poster: Bayesian Optimization for Probabilistic Programs »
Thomas Rainforth · Tuan Anh Le · Jan-Willem van de Meent · Michael A Osborne · Frank Wood