Timezone: »
The aim of this workshop is to discuss current ideas from computer science, psychology and neuroscience regarding learning and control of hierarchically structured behavior. Psychological research has long emphasized that human behavior is hierarchically structured. Indeed, a hierarchical organization of human behavior that matches the hierarchical structure of real-world problems has been the focus of much empirical and theoretical research, and has played a pivotal role in research on organized, goal-directed behavior. Behavioral hierarchy has been of longstanding interest within neuroscience as well, where it has been considered to relate closely to prefrontal cortical function. The prefrontal cortex, which, with its high cognitive functions, remains the most poorly understood area of the brain, has been repeatedly implicated in supporting and executing hierarchical learning and control. In yet a third field, recent developments within machine learning have led to the emergence of 'hierarchical reinforcement learning'. This line of research has begun investigating in depth how optimal control can learn, and make use of, hierarchical structures, specifically, how hierarchies of skills (also termed options, macros or temporally abstract actions) could by learned and utilized optimally. The workshop will bring together front-line researchers from each of these fields, with the aim of gleaning new insights from the integration of knowledge from these somewhat disparate areas of active research.
Author Information
Yael Niv (Princeton University)
Yael Niv received her MA in psychobiology from Tel Aviv University and her PhD from the Hebrew University in Jerusalem, having conducted a major part of her thesis research at the Gatsby Computational Neuroscience Unit in UCL. After a short postdoc at Princeton she became faculty at the Psychology Department and the Princeton Neuroscience Institute. Her lab's research focuses on the neural and computational processes underlying reinforcement learning and decision-making in humans and animals, with a particular focus on representation learning. She recently co-founded the Rutgers-Princeton Center for Computational Cognitive Neuropsychiatry, and is currently taking the research in her lab in the direction of computational psychiatry.
Matthew Botvinick (Princeton University/ Google DeepMind)
Andrew G Barto (University of Massachusetts)
More from the Same Authors
-
2020 : Invited Talk #7 QnA - Yael Niv »
Yael Niv · Doina Precup · Raymond Chua · Feryal Behbahani -
2020 : Invited Talk #7 Yael Niv - Latent causes, prediction errors and the organization of memory »
Yael Niv -
2020 : Panel Discussions »
Grace Lindsay · George Konidaris · Shakir Mohamed · Kimberly Stachenfeld · Peter Dayan · Yael Niv · Doina Precup · Catherine Hartley · Ishita Dasgupta -
2020 : Contributed Talk #1: Learning multi-dimensional rules with probabilistic feedback via value-based serial hypothesis testing »
Mingyu Song · Ming Bo Cai · Yael Niv -
2017 Workshop: Hierarchical Reinforcement Learning »
Andrew G Barto · Doina Precup · Shie Mannor · Tom Schaul · Roy Fox · Carlos Florensa -
2017 Invited Talk: Learning State Representations »
Yael Niv -
2016 Poster: A Bayesian method for reducing bias in neural representational similarity analysis »
Mingbo Cai · Nicolas W Schuck · Jonathan Pillow · Yael Niv -
2014 Poster: Design Principles of the Hippocampal Cognitive Map »
Kimberly Stachenfeld · Matthew Botvinick · Samuel J Gershman -
2014 Spotlight: Design Principles of the Hippocampal Cognitive Map »
Kimberly Stachenfeld · Matthew Botvinick · Samuel J Gershman -
2012 Poster: A systematic approach to extracting semantic information from functional MRI data »
Francisco Pereira · Matthew Botvinick -
2011 Poster: Clustering via Dirichlet Process Mixture Models for Portable Skill Discovery »
Scott Niekum · Andrew G Barto -
2010 Poster: Constructing Skill Trees for Reinforcement Learning Agents from Demonstration Trajectories »
George Konidaris · Scott R Kuindersma · Andrew G Barto · Roderic A Grupen -
2009 Poster: Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining »
George Konidaris · Andrew G Barto -
2009 Spotlight: Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining »
George Konidaris · Andrew G Barto -
2008 Poster: Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement »
Michael Todd · Yael Niv · Jonathan D Cohen -
2008 Oral: Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement »
Michael Todd · Yael Niv · Jonathan D Cohen -
2008 Poster: Goal-directed decision making in prefrontal cortex: a computational framework »
Matthew Botvinick · James An -
2008 Poster: Skill Characterization Based on Betweenness »
Özgür Şimşek · Andrew G Barto -
2007 Workshop: Hierarchical Organization of Behavior: Computational, Psychological and Neural Perspectives (Part 1) »
Yael Niv · Matthew Botvinick · Andrew G Barto