Timezone: »

 
Bayesian Optimal Experimental Design for Simulator Models of Cognition
Simon Valentin · Steven Kleinegesse · Neil Bramley · Michael Gutmann · Chris Lucas

@
in AI for Science: Mind the Gaps »
Event URL: https://openreview.net/forum?id=PNMTx1cx3UU »

Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and known likelihood functions. However, tractability often comes at the cost of realism; simulator models that can capture the richness of human behavior are often intractable. In this work, we combine recent advances in BOED and approximate inference for intractable models, using machine-learning methods to find optimal experimental designs, approximate sufficient summary statistics and amortized posterior distributions. Our simulation experiments on multi-armed bandit tasks show that our method results in improved model discrimination and parameter estimation, as compared to experimental designs commonly used in the literature.

Author Information

Simon Valentin (University of Edinburgh)
Steven Kleinegesse (The University of Edinburgh)
Neil Bramley (University of Edinburgh)
Michael Gutmann (University of Edinburgh)
Chris Lucas (University of Edinburgh)

More from the Same Authors