Timezone: »
Hippocampal place fields have been shown to reflect behaviorally relevant aspects of space. For instance, place fields tend to be skewed along commonly traveled directions, they cluster around rewarded locations, and they are constrained by the geometric structure of the environment. We hypothesize a set of design principles for the hippocampal cognitive map that explain how place fields represent space in a way that facilitates navigation and reinforcement learning. In particular, we suggest that place fields encode not just information about the current location, but also predictions about future locations under the current transition distribution. Under this model, a variety of place field phenomena arise naturally from the structure of rewards, barriers, and directional biases as reflected in the transition policy. Furthermore, we demonstrate that this representation of space can support efficient reinforcement learning. We also propose that grid cells compute the eigendecomposition of place fields in part because is useful for segmenting an enclosure along natural boundaries. When applied recursively, this segmentation can be used to discover a hierarchical decomposition of space. Thus, grid cells might be involved in computing subgoals for hierarchical reinforcement learning.
Author Information
Kimberly Stachenfeld (DeepMind)
Matthew Botvinick (Princeton University/ Google DeepMind)
Samuel J Gershman (Harvard University)
Related Events (a corresponding poster, oral, or spotlight)
-
2014 Spotlight: Design Principles of the Hippocampal Cognitive Map »
Tue. Dec 9th 08:30 -- 08:50 PM Room Level 2, room 210
More from the Same Authors
-
2021 : CCNLab: A Benchmarking Framework for Computational Cognitive Neuroscience »
Nikhil Bhattasali · Momchil Tomov · Samuel J Gershman -
2022 : Closing Remarks »
Samuel J Gershman -
2022 Workshop: Information-Theoretic Principles in Cognitive Systems »
Noga Zaslavsky · Mycal Tucker · Sarah Marzen · Irina Higgins · Stephanie Palmer · Samuel J Gershman -
2022 : Panel Discussion: Opportunities and Challenges »
Kenneth Norman · Janice Chen · Samuel J Gershman · Albert Gu · Sepp Hochreiter · Ida Momennejad · Hava Siegelmann · Sainbayar Sukhbaatar -
2018 Poster: Human-in-the-Loop Interpretability Prior »
Isaac Lage · Andrew Ross · Samuel J Gershman · Been Kim · Finale Doshi-Velez -
2018 Spotlight: Human-in-the-Loop Interpretability Prior »
Isaac Lage · Andrew Ross · Samuel J Gershman · Been Kim · Finale Doshi-Velez -
2016 Poster: Probing the Compositionality of Intuitive Functions »
Eric Schulz · Josh Tenenbaum · David Duvenaud · Maarten Speekenbrink · Samuel J Gershman -
2015 Workshop: Bounded Optimality and Rational Metareasoning »
Samuel J Gershman · Falk Lieder · Tom Griffiths · Noah Goodman -
2012 Poster: A systematic approach to extracting semantic information from functional MRI data »
Francisco Pereira · Matthew Botvinick -
2010 Poster: The Neural Costs of Optimal Control »
Samuel J Gershman · Robert C Wilson -
2009 Poster: Perceptual Multistability as Markov Chain Monte Carlo Inference »
Samuel J Gershman · Edward Vul · Josh Tenenbaum -
2009 Spotlight: Perceptual Multistability as Markov Chain Monte Carlo Inference »
Samuel J Gershman · Edward Vul · Josh Tenenbaum -
2009 Poster: A Bayesian Analysis of Dynamics in Free Recall »
Richard Socher · Samuel J Gershman · Adler Perotte · Per Sederberg · David Blei · Kenneth Norman -
2008 Poster: Goal-directed decision making in prefrontal cortex: a computational framework »
Matthew Botvinick · James An -
2007 Workshop: Hierarchical Organization of Behavior: Computational, Psychological and Neural Perspectives (Part 2) »
Yael Niv · Matthew Botvinick · Andrew G Barto -
2007 Workshop: Hierarchical Organization of Behavior: Computational, Psychological and Neural Perspectives (Part 1) »
Yael Niv · Matthew Botvinick · Andrew G Barto