Timezone: »
The goal of this workshop is to bring together cognitive scientists, neuroscientists, and AI researchers to discuss opportunities for improving machine learning by leveraging our scientific understanding of human perception and cognition. There is a history of making these connections: artificial neural networks were originally motivated by the massively parallel, deep architecture of the brain; considerations of biological plausibility have driven the development of learning procedures; and architectures for computer vision draw parallels to the connectivity and physiology of mammalian visual cortex. However, beyond these celebrated examples, cognitive science and neuroscience has fallen short of its potential to influence the next generation of AI systems. Areas such as memory, attention, and development have rich theoretical and experimental histories, yet these concepts, as applied to AI systems so far, only bear a superficial resemblance to their biological counterparts.
The premise of this workshop is that there are valuable data and models from cognitive science that can inform the development of intelligent adaptive machines, and can endow learning architectures with the strength and flexibility of the human cognitive architecture. The structures and mechanisms of the mind and brain can provide the sort of strong inductive bias needed for machine-learning systems to attain human-like performance. We conjecture that this inductive bias will become more important as researchers move from domain-specific tasks such as object and speech recognition toward tackling general intelligence and the human-like ability to dynamically reconfigure cognition in service of changing goals. For ML researchers, the workshop will provide access to a wealth of data and concepts situated in the context of contemporary ML. For cognitive scientists, the workshop will suggest research questions that are of critical interest to ML researchers.
The workshop will focus on three interconnected topics of particular relevance to ML:
(1) Learning and development. Cognitive capabilities expressed early in a child’s development are likely to be crucial for bootstrapping adult learning and intelligence. Intuitive physics and intuitive psychology allow the developing organism to build an understanding of the world and of other agents. Additionally, children and adults often demonstrate “learning-to-learn,” where previous concepts and skills form a compositional basis for learning new concepts and skills.
(2) Memory. Human memory operates on multiple time scales, from memories that literally persist for the blink of an eye to those that persist for a lifetime. These different forms of memory serve different computational purposes. Although forgetting is typically thought of as a disadvantage, the ability to selectively forget/override irrelevant knowledge in nonstationary environments is highly desirable.
(3) Attention and Decision Making. These refer to relatively high-level cognitive functions that allow task demands to purposefully control an agent’s external environment and sensory data stream, dynamically reconfigure internal representation and architecture, and devise action plans that strategically trade off multiple, oft-conflicting behavioral objectives.
The long-term aims of this workshop are:
* to promote work that incorporates insights from human cognition to suggest novel and improved AI architectures;
* to facilitate the development of ML methods that can better predict human behavior; and
* to support the development of a field of ‘cognitive computing’ that is more than a marketing slogan一a field that improves on both natural and artificial cognition by synergistically advancing each and integrating their strengths in complementary manners.
Sat 8:30 a.m. - 8:40 a.m.
|
Workshop overview
(
talk
)
|
Michael Mozer · Angela Yu · Brenden Lake 🔗 |
Sat 8:40 a.m. - 9:05 a.m.
|
Cognitive AI
(
talk
)
|
Brenden Lake 🔗 |
Sat 9:05 a.m. - 9:30 a.m.
|
Computational modeling of human face processing
(
talk
)
|
Angela Yu 🔗 |
Sat 9:30 a.m. - 9:55 a.m.
|
People infer object shape in a 3D, object-centered coordinate system
(
talk
)
|
Robert A Jacobs 🔗 |
Sat 9:55 a.m. - 10:10 a.m.
|
Relational neural expectation maximization
(
talk
)
|
Sjoerd van Steenkiste 🔗 |
Sat 10:10 a.m. - 10:15 a.m.
|
Contextual dependence of human preference for complex objects: A Bayesian statistical account
(
spotlight
)
|
Chaitanya Ryali 🔗 |
Sat 10:15 a.m. - 10:20 a.m.
|
A biologically-inspired sparse, topographic recurrent neural network model for robust change detection
(
spotlight
)
|
Devarajan Sridharan 🔗 |
Sat 10:20 a.m. - 10:25 a.m.
|
Visual attention guided deep imitation learning
(
spotlight
)
|
Ruohan Zhang 🔗 |
Sat 10:25 a.m. - 10:30 a.m.
|
Human learning of video games
(
spotlight
)
|
Pedro Tsividis 🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
COFFEE BREAK AND POSTER SESSION
|
🔗 |
Sat 11:00 a.m. - 11:25 a.m.
|
Life history and learning: Extended human childhood as a way to resolve explore/exploit trade-offs and improve hypothesis search
(
talk
)
|
Alison Gopnik 🔗 |
Sat 11:25 a.m. - 11:50 a.m.
|
Meta-reinforcement learning in brains and machines
(
talk
)
|
Matt Botvinick 🔗 |
Sat 11:50 a.m. - 12:15 p.m.
|
Revealing human inductive biases and metacognitive processes with rational models
(
talk
)
|
Tom Griffiths 🔗 |
Sat 12:15 p.m. - 12:30 p.m.
|
Learning to select computations
(
talk
)
|
Falk Lieder · Fred Callaway · Sayan Gul · Paul Krueger 🔗 |
Sat 2:00 p.m. - 2:25 p.m.
|
From deep learning of disentangled representations to higher-level cognition
(
talk
)
|
Yoshua Bengio 🔗 |
Sat 2:25 p.m. - 2:50 p.m.
|
Access consciousness and the construction of actionable representations
(
talk
)
|
Michael C Mozer 🔗 |
Sat 2:50 p.m. - 3:05 p.m.
|
Evaluating the capacity to reason about beliefs
(
talk
)
|
Aida Nematzadeh 🔗 |
Sat 3:05 p.m. - 3:30 p.m.
|
COFFEE BREAK AND POSTER SESSION II
|
🔗 |
Sat 3:30 p.m. - 3:55 p.m.
|
Mapping the spatio-temporal dynamics of cognition in the human brain
(
talk
)
|
Aude Oliva 🔗 |
Sat 3:55 p.m. - 4:20 p.m.
|
Scale-invariant temporal memory in AI
(
talk
)
|
Marc Howard 🔗 |
Sat 4:20 p.m. - 4:35 p.m.
|
Scale-invariant temporal history (SITH): Optimal slicing of the past in an uncertain world
(
talk
)
|
Tyler Spears · Brandon Jacques · Marc Howard · Per B Sederberg 🔗 |
Sat 4:35 p.m. - 4:40 p.m.
|
Efficient human-like semantic representations via the information bottleneck principle
(
spotlight
)
|
Noga Zaslavsky 🔗 |
Sat 4:40 p.m. - 4:45 p.m.
|
The mutation sampler: A sampling approach to causal representation
(
spotlight
)
|
Zachary Davis 🔗 |
Sat 4:45 p.m. - 4:50 p.m.
|
Generating more human-like recommendations with a cognitive model of generalization
(
spotlight
)
|
David Bourgin 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Sample-efficient reinforcement learning through transfer and architectural priors
(
poster
)
|
Benjamin Spector 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Variational probability flow for biologically plausible training of deep neural networks
(
poster
)
|
ZUOZHU LIU · Shaowei Lin 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Curiosity-driven reinforcement learning with hoemostatic regulation
(
poster
)
|
Ildefons Magrans de Abril 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Context-modulation of hippocampal dynamics and deep convolutional networks
(
poster
)
|
Brad Aimone 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Cognitive modeling and the wisdom of the crowd
(
poster
)
|
Michael D Lee 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Concept acquisition through meta-learning
(
poster
)
|
Erin Grant 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Pre-training attentional mechanisms
(
poster
)
|
Jack Lindsey 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Using STDP for unsupervised, event-based online learning
(
poster
)
|
Johannes Thiele 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Learning to organize knowledge with N-gram machines
(
poster
)
|
Fan Yang 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Power-law temporal discounting over a logarithmically compressed timeline for scale invariant reinforcement learning
(
poster
)
|
Zoran Tiganj 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Improving transfer using augmented feedback in progressive neural networks
(
poster
)
|
Deepika Bablani · Parth Chadha 🔗 |
Sat 4:50 p.m. - 5:25 p.m.
|
POSTER: Question asking as program generation
(
poster
)
|
Anselm Rothe 🔗 |
Sat 5:25 p.m. - 5:50 p.m.
|
Object-oriented intelligence
(
talk
)
|
Peter Battaglia 🔗 |
Sat 5:50 p.m. - 6:15 p.m.
|
Representational primitives, in minds and machines
(
talk
)
|
Gary Marcus 🔗 |
Author Information
Michael Mozer (Google Brain / U. Colorado)
Brenden Lake (New York University)
Angela Yu (UC San Diego)
More from the Same Authors
-
2021 : Compositional with Kevin Ellis, Judith Fan, Brenden Lake, Josh Tenenbaum »
Kevin Ellis · Judith Fan · Brenden Lake · Josh Tenenbaum · Zenna Tavares -
2021 : Panel I: Human decisions »
Jennifer Trueblood · Alex Peysakhovich · Angela Yu · Ori Plonsky · Tal Yarkoni · Daniel Bjorkegren -
2021 Poster: Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning »
Maxwell Nye · Michael Tessler · Josh Tenenbaum · Brenden Lake -
2021 Poster: Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of others »
Kanishk Gandhi · Gala Stojnic · Brenden Lake · Moira R. Dillon -
2020 Poster: A Benchmark for Systematic Generalization in Grounded Language Understanding »
Laura Ruis · Jacob Andreas · Marco Baroni · Diane Bouchacourt · Brenden Lake -
2020 Poster: Learning Compositional Rules via Neural Program Synthesis »
Maxwell Nye · Armando Solar-Lezama · Josh Tenenbaum · Brenden Lake -
2020 Poster: Mutual exclusivity as a challenge for deep neural networks »
Kanishk Gandhi · Brenden Lake -
2020 Poster: Self-supervised learning through the eyes of a child »
Emin Orhan · Vaibhav Gupta · Brenden Lake -
2019 : Compositional generalization in minds and machines »
Brenden Lake -
2019 : Panel Discussion led by Grace Lindsay »
Grace Lindsay · Blake Richards · Doina Precup · Jacqueline Gottlieb · Jeff Clune · Jane Wang · Richard Sutton · Angela Yu · Ida Momennejad -
2019 : Invited Talk #6: Features or Bugs: Synergistic Idiosyncrasies in Human Learning and Decision-Making »
Angela Yu -
2019 Poster: Compositional generalization through meta sequence-to-sequence learning »
Brenden Lake -
2018 Poster: Why so gloomy? A Bayesian explanation of human pessimism bias in the multi-armed bandit task »
Dalin Guo · Angela Yu -
2018 Poster: Learning Deep Disentangled Embeddings With the F-Statistic Loss »
Karl Ridgeway · Michael Mozer -
2018 Poster: Demystifying excessively volatile human learning: A Bayesian persistent prior and a neural approximation »
Chaitanya Ryali · Gautam Reddy · Angela Yu -
2018 Poster: Adapted Deep Embeddings: A Synthesis of Methods for k-Shot Inductive Transfer Learning »
Tyler Scott · Karl Ridgeway · Michael Mozer -
2018 Poster: Beauty-in-averageness and its contextual modulations: A Bayesian statistical account »
Chaitanya Ryali · Angela Yu -
2018 Poster: Sparse Attentive Backtracking: Temporal Credit Assignment Through Reminding »
Nan Rosemary Ke · Anirudh Goyal · Olexa Bilaniuk · Jonathan Binas · Michael Mozer · Chris Pal · Yoshua Bengio -
2018 Spotlight: Sparse Attentive Backtracking: Temporal Credit Assignment Through Reminding »
Nan Rosemary Ke · Anirudh Goyal · Olexa Bilaniuk · Jonathan Binas · Michael Mozer · Chris Pal · Yoshua Bengio -
2018 Spotlight: Adapted Deep Embeddings: A Synthesis of Methods for k-Shot Inductive Transfer Learning »
Tyler Scott · Karl Ridgeway · Michael Mozer -
2017 : Access consciousness and the construction of actionable representations »
Michael C Mozer -
2017 : Computational modeling of human face processing »
Angela Yu -
2017 : Cognitive AI »
Brenden Lake -
2017 : Workshop overview »
Michael Mozer · Angela Yu · Brenden Lake -
2017 Poster: Question Asking as Program Generation »
Anselm Rothe · Brenden Lake · Todd Gureckis -
2016 : Overcoming temptation: Incentive design for intertemporal choice »
Michael Mozer -
2016 : Opening Remarks, Invited Talk: Michael C. Mozer »
Michael Mozer -
2015 Poster: Softstar: Heuristic-Guided Probabilistic Inference »
Mathew Monfort · Brenden M Lake · Brenden Lake · Brian Ziebart · Patrick Lucey · Josh Tenenbaum -
2014 Workshop: Human Propelled Machine Learning »
Richard Baraniuk · Michael Mozer · Divyanshu Vats · Christoph Studer · Andrew E Waters · Andrew Lan -
2014 Poster: Automatic Discovery of Cognitive Skills to Improve the Prediction of Student Learning »
Robert Lindsey · Mohammad Khajah · Michael Mozer -
2013 Poster: Forgetful Bayes and myopic planning: Human learning and decision-making in a bandit setting »
Shunan Zhang · Angela Yu -
2013 Poster: Context-sensitive active sensing in humans »
Sheeraz Ahmad · He Huang · Angela Yu -
2013 Poster: Optimizing Instructional Policies »
Robert Lindsey · Michael Mozer · William J Huggins · Harold Pashler -
2013 Oral: Optimizing Instructional Policies »
Robert Lindsey · Michael Mozer · William J Huggins · Harold Pashler -
2012 Workshop: Personalizing education with machine learning »
Michael Mozer · javier r movellan · Robert Lindsey · Jacob Whitehill -
2012 Poster: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2012 Oral: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2011 Poster: An Unsupervised Decontamination Procedure For Improving The Reliability Of Human Judgments »
Michael Mozer · Benjamin Link · Harold Pashler -
2010 Oral: A rational decision making framework for inhibitory control »
Pradeep Shenoy · Rajesh PN Rao · Angela Yu -
2010 Spotlight: Improving Human Judgments by Decontaminating Sequential Dependencies »
Michael Mozer · Harold Pashler · Matthew Wilder · Robert Lindsey · Matt Jones · Michael Jones -
2010 Poster: Improving Human Judgments by Decontaminating Sequential Dependencies »
Michael Mozer · Harold Pashler · Matthew Wilder · Robert Lindsey · Matt Jones · Michael Jones -
2010 Poster: A rational decision making framework for inhibitory control »
Pradeep Shenoy · Rajesh PN Rao · Angela Yu -
2009 Poster: Predicting the Optimal Spacing of Study: A Multiscale Context Model of Memory »
Michael Mozer · Harold Pashler · Nicholas Cepeda · Robert Lindsey · Edward Vul -
2009 Spotlight: Predicting the Optimal Spacing of Study: A Multiscale Context Model of Memory »
Michael Mozer · Harold Pashler · Nicholas Cepeda · Robert Lindsey · Edward Vul -
2009 Poster: Sequential effects reflect parallel learning of multiple environmental regularities »
Matthew Wilder · Matt Jones · Michael Mozer -
2008 Poster: Optimal Response Initiation: Why Recent Experience Matters »
Matt Jones · Michael Mozer · Sachiko Kinoshita -
2008 Poster: Sequential effects: Superstition or rational behavior? »
Angela Yu · Jonathan D Cohen -
2008 Spotlight: Sequential effects: Superstition or rational behavior? »
Angela Yu · Jonathan D Cohen -
2008 Spotlight: Optimal Response Initiation: Why Recent Experience Matters »
Matt Jones · Michael Mozer · Sachiko Kinoshita -
2008 Poster: Temporal Dynamics of Cognitive Control »
Jeremy Reynolds · Michael Mozer -
2007 Spotlight: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2007 Spotlight: Experience-Guided Search: A Theory of Attentional Control »
Michael Mozer · David Baldwin -
2007 Poster: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2007 Poster: Experience-Guided Search: A Theory of Attentional Control »
Michael Mozer · David Baldwin -
2006 Poster: Context Effects in Category Learning: An Investigation of Four Probabilistic Models »
Michael Mozer · Michael Jones · Michael Shettel -
2006 Poster: Optimal Change-Detection and Spiking Neurons »
Angela Yu