Timezone: »
Neural responses in visual cortex are influenced by visual stimuli and by ongoing spiking activity in local circuits. An important challenge in computational neuroscience is to develop models that can account for both of these features in large multi-neuron recordings and to reveal how stimulus representations interact with and depend on cortical dynamics. Here we introduce a statistical model of neural population activity that integrates a nonlinear receptive field model with a latent dynamical model of ongoing cortical activity. This model captures the temporal dynamics, effective network connectivity in large population recordings, and correlations due to shared stimulus drive as well as common noise. Moreover, because the nonlinear stimulus inputs are mixed by the ongoing dynamics, the model can account for a relatively large number of idiosyncratic receptive field shapes with a small number of nonlinear inputs to a low-dimensional latent dynamical model. We introduce a fast estimation method using online expectation maximization with Laplace approximations. Inference scales linearly in both population size and recording duration. We apply this model to multi-channel recordings from primary visual cortex and show that it accounts for a large number of individual neural receptive fields using a small number of nonlinear inputs and a low-dimensional dynamical model.
Author Information
Evan Archer (Sony AI)
Urs Koster (Cerebras Systems)
Jonathan W Pillow (UT Austin)
Jonathan Pillow is an assistant professor in Psychology and Neurobiology at the University of Texas at Austin. He graduated from the University of Arizona in 1997 with a degree in mathematics and philosophy, and was a U.S. Fulbright fellow in Morocco in 1998. He received his Ph.D. in neuroscience from NYU in 2005, and was a Royal Society postdoctoral reserach fellow at the Gatsby Computational Neuroscience Unit, UCL from 2005 to 2008. His recent work involves statistical methods for understanding the neural code in single neurons and neural populations, and his lab conducts psychophysical experiments designed to test Bayesian models of human sensory perception.
Jakob H Macke (University of Tübingen & MPI IS Tübingen)
More from the Same Authors
-
2022 Poster: Value Function Decomposition for Iterative Design of Reinforcement Learning Agents »
James MacGlashan · Evan Archer · Alisa Devlic · Takuma Seno · Craig Sherstan · Peter Wurman · Peter Stone -
2022 Poster: Truncated proposals for scalable and hassle-free simulation-based inference »
Michael Deistler · Pedro Goncalves · Jakob H Macke -
2022 Poster: Efficient identification of informative features in simulation-based inference »
Jonas Beck · Michael Deistler · Yves Bernaerts · Jakob H Macke · Philipp Berens -
2019 : Poster Session »
Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar -
2019 Poster: Intrinsic dimension of data representations in deep neural networks »
Alessio Ansuini · Alessandro Laio · Jakob H Macke · Davide Zoccolan -
2017 Spotlight: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations »
Marcel Nonnenmacher · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Flexible statistical inference for mechanistic models of neural dynamics »
Jan-Matthis Lueckmann · Pedro Goncalves · Giacomo Bassetto · Kaan Öcal · Marcel Nonnenmacher · Jakob H Macke -
2016 : From Brains to Bits and Back Again »
Yoshua Bengio · Terrence Sejnowski · Christos H Papadimitriou · Jakob H Macke · Demis Hassabis · Alyson Fletcher · Andreas Tolias · Jascha Sohl-Dickstein · Konrad P Koerding -
2016 : Jonathan Pillow : Scalable Inference for Structured Hierarchical Receptive Field Models »
Jonathan W Pillow -
2016 Workshop: Brains and Bits: Neuroscience meets Machine Learning »
Alyson Fletcher · Eva Dyer · Jascha Sohl-Dickstein · Joshua T Vogelstein · Konrad Koerding · Jakob H Macke -
2016 Poster: Linear dynamical neural population models through nonlinear embeddings »
Yuanjun Gao · Evan Archer · Liam Paninski · John Cunningham -
2015 : Correlations and Signatures of Criticality in Neural Population Models »
Jakob H Macke -
2015 Workshop: Statistical Methods for Understanding Neural Systems »
Alyson Fletcher · Jakob H Macke · Ryan Adams · Jascha Sohl-Dickstein -
2015 Poster: Unlocking neural population non-stationarities using hierarchical dynamics models »
Mijung Park · Gergo Bohner · Jakob H Macke -
2014 Workshop: Large scale optical physiology: From data-acquisition to models of neural coding »
Il Memming Park · Jakob H Macke · Ferran Diego Andilla · Eftychios Pnevmatikakis · Jeremy Freeman -
2014 Poster: A Bayesian model for identifying hierarchically organised states in neural population activity »
Patrick Putzky · Florian Franzen · Giacomo Bassetto · Jakob H Macke -
2014 Poster: Optimal prior-dependent neural population codes under shared input noise »
Agnieszka Grabska-Barwinska · Jonathan W Pillow -
2014 Spotlight: A Bayesian model for identifying hierarchically organised states in neural population activity »
Patrick Putzky · Florian Franzen · Giacomo Bassetto · Jakob H Macke -
2014 Poster: Inferring sparse representations of continuous signals with continuous orthogonal matching pursuit »
Karin C Knudson · Jacob Yates · Alexander Huk · Jonathan W Pillow -
2014 Poster: Inferring synaptic conductances from spike trains with a biophysically inspired point process model »
Kenneth W Latimer · E.J. Chichilnisky · Fred Rieke · Jonathan W Pillow -
2014 Poster: Sparse Bayesian structure learning with dependent relevance determination prior »
Anqi Wu · Mijung Park · Sanmi Koyejo · Jonathan W Pillow -
2013 Workshop: Acquiring and Analyzing the Activity of Large Neural Ensembles »
Srinivas C Turaga · Lars Buesing · Maneesh Sahani · Jakob H Macke -
2013 Poster: Spike train entropy-rate estimation using hierarchical Dirichlet process priors »
Karin C Knudson · Jonathan W Pillow -
2013 Poster: Inferring neural population dynamics from multiple partial recordings of the same neural circuit »
Srinivas C Turaga · Lars Buesing · Adam M Packer · Henry Dalgleish · Noah Pettit · Michael Hausser · Jakob H Macke -
2013 Poster: Bayesian entropy estimation for binary spike train data using parametric prior knowledge »
Evan Archer · Il Memming Park · Jonathan W Pillow -
2013 Poster: Universal models for binary spike patterns using centered Dirichlet processes »
Il Memming Park · Evan Archer · Kenneth W Latimer · Jonathan W Pillow -
2013 Spotlight: Inferring neural population dynamics from multiple partial recordings of the same neural circuit »
Srinivas C Turaga · Lars Buesing · Adam M Packer · Henry Dalgleish · Noah Pettit · Michael Hausser · Jakob H Macke -
2013 Spotlight: Bayesian entropy estimation for binary spike train data using parametric prior knowledge »
Evan Archer · Il Memming Park · Jonathan W Pillow -
2013 Poster: Spectral methods for neural characterization using generalized quadratic models »
Il Memming Park · Evan Archer · Nicholas Priebe · Jonathan W Pillow -
2013 Poster: Bayesian inference for low rank spatiotemporal neural receptive fields »
Mijung Park · Jonathan W Pillow -
2012 Poster: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2012 Poster: Fully Bayesian inference for neural models with negative-binomial spiking »
Jonathan W Pillow · James Scott -
2012 Poster: Bayesian active learning with localized priors for fast receptive field characterization »
Mijung Park · Jonathan W Pillow -
2012 Oral: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2012 Poster: Bayesian estimation of discrete entropy with mixtures of stick-breaking priors »
Evan Archer · Jonathan W Pillow · Il Memming Park -
2011 Oral: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Session: Oral Session 13 »
Jonathan W Pillow -
2011 Poster: Bayesian Spike-Triggered Covariance Analysis »
Il Memming Park · Jonathan W Pillow -
2011 Poster: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: Active learning of neural response functions with Gaussian processes »
Mijung Park · Greg Horwitz · Jonathan W Pillow -
2011 Spotlight: Active learning of neural response functions with Gaussian processes »
Mijung Park · Greg Horwitz · Jonathan W Pillow -
2011 Poster: How biased are maximum entropy models? »
Jakob H Macke · Iain Murray · Peter E Latham -
2011 Tutorial: Flexible, Multivariate Point Process Models for Unlocking the Neural Code »
Jonathan W Pillow -
2009 Oral: Time-rescaling Methods for the Estimation and Assessment of Non-Poisson Neural Encoding Models »
Jonathan W Pillow -
2009 Poster: Time-rescaling methods for the estimation and assessment of non-Poisson neural encoding models »
Jonathan W Pillow -
2009 Poster: Bayesian estimation of orientation preference maps »
Jakob H Macke · Sebastian Gerwinn · Leonard White · Matthias Kaschube · Matthias Bethge -
2008 Poster: Characterizing neural dependencies with Poisson copula models »
Pietro Berkes · Frank Wood · Jonathan W Pillow -
2008 Spotlight: Characterizing neural dependencies with Poisson copula models »
Pietro Berkes · Frank Wood · Jonathan W Pillow -
2007 Oral: Neural characterization in partially observed populations of spiking neurons »
Jonathan W Pillow · Peter E Latham -
2007 Oral: Bayesian Inference for Spiking Neuron Models with a Sparsity Prior »
Sebastian Gerwinn · Jakob H Macke · Matthias Seeger · Matthias Bethge -
2007 Poster: Bayesian Inference for Spiking Neuron Models with a Sparsity Prior »
Sebastian Gerwinn · Jakob H Macke · Matthias Seeger · Matthias Bethge -
2007 Poster: Neural characterization in partially observed populations of spiking neurons »
Jonathan W Pillow · Peter E Latham -
2007 Poster: Receptive Fields without Spike-Triggering »
Jakob H Macke · Günther Zeck · Matthias Bethge -
2006 Poster: Inducing Metric Violations in Human Similarity Judgements »
Julian Laub · Jakob H Macke · Klaus-Robert Müller · Felix A Wichmann