Timezone: »
Poster
Mutual exclusivity as a challenge for deep neural networks
Kanishk Gandhi · Brenden Lake
Strong inductive biases allow children to learn in fast and adaptable ways. Children use the mutual exclusivity (ME) bias to help disambiguate how words map to referents, assuming that if an object has one label then it does not need another. In this paper, we investigate whether or not vanilla neural architectures have an ME bias, demonstrating that they lack this learning assumption. Moreover, we show that their inductive biases are poorly matched to lifelong learning formulations of classification and translation. We demonstrate that there is a compelling case for designing task-general neural networks that learn through mutual exclusivity, which remains an open challenge.
Author Information
Kanishk Gandhi (New York University)
Brenden Lake (New York University)
More from the Same Authors
-
2021 : Compositional with Kevin Ellis, Judith Fan, Brenden Lake, Josh Tenenbaum »
Kevin Ellis · Judith Fan · Brenden Lake · Josh Tenenbaum · Zenna Tavares -
2021 Poster: Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning »
Maxwell Nye · Michael Tessler · Josh Tenenbaum · Brenden Lake -
2021 Poster: Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of others »
Kanishk Gandhi · Gala Stojnic · Brenden Lake · Moira R. Dillon -
2020 Poster: A Benchmark for Systematic Generalization in Grounded Language Understanding »
Laura Ruis · Jacob Andreas · Marco Baroni · Diane Bouchacourt · Brenden Lake -
2020 Poster: Learning Compositional Rules via Neural Program Synthesis »
Maxwell Nye · Armando Solar-Lezama · Josh Tenenbaum · Brenden Lake -
2020 Poster: Self-supervised learning through the eyes of a child »
Emin Orhan · Vaibhav Gupta · Brenden Lake -
2019 : Compositional generalization in minds and machines »
Brenden Lake -
2019 Poster: Compositional generalization through meta sequence-to-sequence learning »
Brenden Lake -
2017 : Cognitive AI »
Brenden Lake -
2017 : Workshop overview »
Michael Mozer · Angela Yu · Brenden Lake -
2017 Workshop: Cognitively Informed Artificial Intelligence: Insights From Natural Intelligence »
Michael Mozer · Brenden Lake · Angela Yu -
2017 Poster: Question Asking as Program Generation »
Anselm Rothe · Brenden Lake · Todd Gureckis -
2015 Poster: Softstar: Heuristic-Guided Probabilistic Inference »
Mathew Monfort · Brenden M Lake · Brenden Lake · Brian Ziebart · Patrick Lucey · Josh Tenenbaum