Timezone: »
Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of SBI in neuroscience involves estimating the parameters governing the response dynamics of Hodgkin-Huxley (HH) models from electrophysiological measurements, by inferring a posterior over the parameters that is consistent with a set of observations. To this end, many SBI methods employ a set of summary statistics or scientifically interpretable features to estimate a surrogate likelihood or posterior. However, currently, there is no way to identify how much each summary statistic or feature contributes to reducing posterior uncertainty. To address this challenge, one could simply compare the posteriors with and without a given feature included in the inference process. However, for large or nested feature sets, this would necessitate repeatedly estimating the posterior, which is computationally expensive or even prohibitive. Here, we provide a more efficient approach based on the SBI method neural likelihood estimation (NLE): We show that one can marginalize the trained surrogate likelihood post-hoc before inferring the posterior to assess the contribution of a feature. We demonstrate the usefulness of our method by identifying the most important features for inferring parameters of an example HH neuron model. Beyond neuroscience, our method is generally applicable to SBI workflows that rely on data features for inference used in other scientific fields.
Author Information
Jonas Beck (University of Tuebingen)
Michael Deistler (University of Tuebingen)
Yves Bernaerts (University of Tübingen)
On the borderline between neural science and machine learning. Using sparse bottleneck neural networks to obtain lower dimensional visualizations of paired datasets. Interested in inferring interpretable biophysical model parameters using deep neural network architectures.
Jakob H Macke (University of Tübingen & MPI IS Tübingen)
Philipp Berens (University of Tübingen)
More from the Same Authors
-
2021 Spotlight: Removing Inter-Experimental Variability from Functional Data in Systems Neuroscience »
Dominic Gonschorek · Larissa Höfling · Klaudia P. Szatko · Katrin Franke · Timm Schubert · Benjamin Dunn · Philipp Berens · David Klindt · Thomas Euler -
2022 Poster: Attraction-Repulsion Spectrum in Neighbor Embeddings »
Jan Niklas Böhm · Philipp Berens · Dmitry Kobak -
2022 Poster: Truncated proposals for scalable and hassle-free simulation-based inference »
Michael Deistler · Pedro Goncalves · Jakob H Macke -
2021 Poster: Removing Inter-Experimental Variability from Functional Data in Systems Neuroscience »
Dominic Gonschorek · Larissa Höfling · Klaudia P. Szatko · Katrin Franke · Timm Schubert · Benjamin Dunn · Philipp Berens · David Klindt · Thomas Euler -
2020 Poster: System Identification with Biophysical Constraints: A Circuit Model of the Inner Retina »
Cornelius Schröder · David Klindt · Sarah Strauss · Katrin Franke · Matthias Bethge · Thomas Euler · Philipp Berens -
2020 Spotlight: System Identification with Biophysical Constraints: A Circuit Model of the Inner Retina »
Cornelius Schröder · David Klindt · Sarah Strauss · Katrin Franke · Matthias Bethge · Thomas Euler · Philipp Berens -
2019 : Poster Session »
Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar -
2019 Poster: Approximate Bayesian Inference for a Mechanistic Model of Vesicle Release at a Ribbon Synapse »
Cornelius Schröder · Ben James · Leon Lagnado · Philipp Berens -
2019 Poster: Intrinsic dimension of data representations in deep neural networks »
Alessio Ansuini · Alessandro Laio · Jakob H Macke · Davide Zoccolan -
2017 Spotlight: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations »
Marcel Nonnenmacher · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Flexible statistical inference for mechanistic models of neural dynamics »
Jan-Matthis Lueckmann · Pedro Goncalves · Giacomo Bassetto · Kaan Öcal · Marcel Nonnenmacher · Jakob H Macke -
2016 : From Brains to Bits and Back Again »
Yoshua Bengio · Terrence Sejnowski · Christos H Papadimitriou · Jakob H Macke · Demis Hassabis · Alyson Fletcher · Andreas Tolias · Jascha Sohl-Dickstein · Konrad P Koerding -
2016 Workshop: Brains and Bits: Neuroscience meets Machine Learning »
Alyson Fletcher · Eva Dyer · Jascha Sohl-Dickstein · Joshua T Vogelstein · Konrad Koerding · Jakob H Macke -
2015 : Correlations and Signatures of Criticality in Neural Population Models »
Jakob H Macke -
2015 Workshop: Statistical Methods for Understanding Neural Systems »
Alyson Fletcher · Jakob H Macke · Ryan Adams · Jascha Sohl-Dickstein -
2015 Poster: Unlocking neural population non-stationarities using hierarchical dynamics models »
Mijung Park · Gergo Bohner · Jakob H Macke -
2014 Workshop: Large scale optical physiology: From data-acquisition to models of neural coding »
Il Memming Park · Jakob H Macke · Ferran Diego Andilla · Eftychios Pnevmatikakis · Jeremy Freeman -
2014 Poster: A Bayesian model for identifying hierarchically organised states in neural population activity »
Patrick Putzky · Florian Franzen · Giacomo Bassetto · Jakob H Macke -
2014 Spotlight: A Bayesian model for identifying hierarchically organised states in neural population activity »
Patrick Putzky · Florian Franzen · Giacomo Bassetto · Jakob H Macke -
2014 Poster: Low-dimensional models of neural population activity in sensory cortical circuits »
Evan Archer · Urs Koster · Jonathan W Pillow · Jakob H Macke -
2013 Workshop: Acquiring and Analyzing the Activity of Large Neural Ensembles »
Srinivas C Turaga · Lars Buesing · Maneesh Sahani · Jakob H Macke -
2013 Poster: Inferring neural population dynamics from multiple partial recordings of the same neural circuit »
Srinivas C Turaga · Lars Buesing · Adam M Packer · Henry Dalgleish · Noah Pettit · Michael Hausser · Jakob H Macke -
2013 Spotlight: Inferring neural population dynamics from multiple partial recordings of the same neural circuit »
Srinivas C Turaga · Lars Buesing · Adam M Packer · Henry Dalgleish · Noah Pettit · Michael Hausser · Jakob H Macke -
2012 Poster: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2012 Oral: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2011 Oral: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: How biased are maximum entropy models? »
Jakob H Macke · Iain Murray · Peter E Latham -
2009 Poster: Bayesian estimation of orientation preference maps »
Jakob H Macke · Sebastian Gerwinn · Leonard White · Matthias Kaschube · Matthias Bethge -
2007 Oral: Bayesian Inference for Spiking Neuron Models with a Sparsity Prior »
Sebastian Gerwinn · Jakob H Macke · Matthias Seeger · Matthias Bethge -
2007 Poster: Bayesian Inference for Spiking Neuron Models with a Sparsity Prior »
Sebastian Gerwinn · Jakob H Macke · Matthias Seeger · Matthias Bethge -
2007 Poster: Receptive Fields without Spike-Triggering »
Jakob H Macke · Günther Zeck · Matthias Bethge -
2006 Poster: Inducing Metric Violations in Human Similarity Judgements »
Julian Laub · Jakob H Macke · Klaus-Robert Müller · Felix A Wichmann