Timezone: »
Formal definitions of rationality are instrumental for understanding and designing intelligent systems. By specifying the optimal way to reason under the constraint of limited information, Bayesian rationality has enabled tremendous advances in machine learning and artificial intelligence together with deep insights into human cognition and brain function. Bounded optimality (Horvitz, 1989; Russell, & Wefald, 1991a) extends Bayesian rationality by taking into account two additional constraints: limited time and finite computational resources. Bounded optimality is a practical framework for designing the best AI system possible given the constraints of its limited-performance hardware (Russell & Subramanian, 1995), and provides a way to capture the time and resource-constraints on human cognition. To adaptively allocate their finite computational bounded agents may have to perform rational metareasoning (Russel, & Wefald, 1991b) which corresponds to topics like cognitive control and metacognition studied in cognitive neuroscience and psychology.
Current research in cognitive science is leveraging bounded optimality and rational metareasoning to understand how the human mind can achieve so much with so little computation (Gershman, Horvitz, & Tenenbaum, in press; Vul, Griffiths, Goodman, & Tenenbaum, 2014), to develop and constrain process models of cognition (Griffiths, Lieder, & Goodman, 2015; Lewis, Howes, & Singh, 2014), to reevaluate the evidence for human irrationality, and to rethink heuristics and biases (Lieder, Griffiths, & Goodman, 2013; Lieder, Plunkett, et al. 2015). Rational metareasoning and bounded optimality also have interesting connections to neuroscience including the top-down control of neural information processing (e.g., Shenhav, Botvinick, & Cohen, 2013) and neural coding (Gershman, & Wilson, 2007).
This workshop brings together computer scientists working on bounded optimality and metareasoning with psychologists and neuroscientists reverse-engineering the computational principles that make the human brain incredibly resource-efficient. The goal of this workshop is to synthesize these different perspectives on bounded optimality, to promote interdisciplinary interactions and cross-fertilization, and to identify directions for future research.
References
-------------
1. Horvitz, E. (1987). Reasoning about Beliefs and Actions under Computational Resource Constraints, Third Workshop on Uncertainty in Artificial Intelligence, Seattle, Washington. Association for Uncertainty and Artificial Intelligence. pp. 429-444.
2. Russell, S. J., & Wefald, E. H. (1991a). Do the Right Thing: Studies in Limited Rationality. Cambridge, MA: MIT Press.
3. Russell, S. J., & Wefald, E. H. (1991a). Principles of Metareasoning. Artificial Intelligence, 49, 361–395.
4. Russell, S. J., & Subramanian, D. (1995). Provably bounded-optimal agents. Journal of Artificial Intelligence Research, 2, 575-609.
5. Gershman, S.J., Horvitz, E.J., & Tenenbaum, J.B. (2015). Computational rationality: A converging paradigm for intelligence in brains, minds and machines. Science, 349, 273-278.
6. Vul, E., Goodman, N., Griffiths, T. L., & Tenenbaum, J. B. (2014). One and done? Optimal decisions from very few samples. Cognitive science, 38(4), 599-637.
7. Griffiths, T.L., Lieder, F., & Goodman, N.D. (2015). Rational use of cognitive resources: Levels of analysis between the computational and the algorithmic. Topics in Cognitive Science, 7(2), 217-229.
8. Lieder, F., Plunkett, D., Hamrick, J.B., Russell, S.J, Hay, N.J., & Griffiths, T.L. (2014). Algorithm Selection by Rational Metareasoning as a Model of Human Strategy Selection. Advances in Neural Information Processing Systems 27, pp. 2870-2878.
9. Lewis, R. L., Howes, A., & Singh, S. (2014). Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization. Topics in cognitive science, 6(2), 279-311.
10. Lieder, F., Griffiths, T. L., & Goodman, N. D. (2013). Burn-in, bias, and the rationality of anchoring. Advances in Neural Information Processing Systems 26, 2690-2798.
11. Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron, 79(2), 217-240.
12. Gershman, S., & Wilson, R. (2010). The neural costs of optimal control. Advances in neural information processing systems 23, 712-720.
Author Information
Samuel J Gershman (Harvard University)
Falk Lieder (UC Berkeley)
Tom Griffiths (UC Berkeley)
Noah Goodman (Stanford University)
More from the Same Authors
-
2021 : CCNLab: A Benchmarking Framework for Computational Cognitive Neuroscience »
Nikhil Bhattasali · Momchil Tomov · Samuel J Gershman -
2021 : DABS: a Domain-Agnostic Benchmark for Self-Supervised Learning »
Alex Tamkin · Vincent Liu · Rongfei Lu · Daniel Fein · Colin Schultz · Noah Goodman -
2021 : Learning to solve complex tasks by growing knowledge culturally across generations »
Michael Tessler · Jason Madeano · Pedro Tsividis · Noah Goodman · Josh Tenenbaum -
2022 : Lemma: Bootstrapping High-Level Mathematical Reasoning with Learned Symbolic Abstractions »
Zhening Li · Gabriel Poesia Reis e Silva · Omar Costilla Reyes · Noah Goodman · Armando Solar-Lezama -
2022 : On Rate-Distortion Theory in Capacity-Limited Cognition & Reinforcement Learning »
Dilip Arumugam · Mark Ho · Noah Goodman · Benjamin Van Roy -
2022 : In the ZONE: Measuring difficulty and progression in curriculum generation »
Rose Wang · Jesse Mu · Dilip Arumugam · Natasha Jaques · Noah Goodman -
2023 Poster: Why think step by step? Reasoning emerges from the locality of experience »
Benjamin Prystawski · Michael Li · Noah Goodman -
2023 Poster: Parsel🐍: Algorithmic Reasoning with Language Models by Composing Decompositions »
Eric Zelikman · Qian Huang · Gabriel Poesia · Noah Goodman · Nick Haber -
2023 Poster: Successor-Predecessor Intrinsic Exploration »
Changmin Yu · Neil Burgess · Samuel J Gershman · Maneesh Sahani -
2023 Poster: Interpretability at Scale: Identifying Causal Mechanisms in Alpaca »
Zhengxuan Wu · Atticus Geiger · Christopher Potts · Noah Goodman -
2023 Poster: Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning »
Alex Tamkin · Margalit Glasgow · Xiluo He · Noah Goodman -
2023 Poster: Learning to Compress Prompts with Gist Tokens »
Jesse Mu · Xiang Li · Noah Goodman -
2023 Poster: Understanding Social Reasoning in Language Models with Language Models »
Kanishk Gandhi · Jan-Philipp Franken · Tobias Gerstenberg · Noah Goodman -
2023 Oral: Why think step by step? Reasoning emerges from the locality of experience »
Benjamin Prystawski · Michael Li · Noah Goodman -
2022 : Closing Remarks »
Samuel J Gershman -
2022 : MATH-AI: Toward Human-Level Mathematical Reasoning »
Francois Charton · Noah Goodman · Behnam Neyshabur · Talia Ringer · Daniel Selsam -
2022 : Learning Mathematical Reasoning for Education »
Noah Goodman -
2022 Workshop: Information-Theoretic Principles in Cognitive Systems »
Noga Zaslavsky · Mycal Tucker · Sarah Marzen · Irina Higgins · Stephanie Palmer · Samuel J Gershman -
2022 : Panel Discussion: Opportunities and Challenges »
Kenneth Norman · Janice Chen · Samuel J Gershman · Albert Gu · Sepp Hochreiter · Ida Momennejad · Hava Siegelmann · Sainbayar Sukhbaatar -
2022 : Invited Talk: Noah Goodman »
Noah Goodman -
2022 Poster: Assistive Teaching of Motor Control Tasks to Humans »
Megha Srivastava · Erdem Biyik · Suvir Mirchandani · Noah Goodman · Dorsa Sadigh -
2022 Poster: CLEVRER-Humans: Describing Physical and Causal Events the Human Way »
Jiayuan Mao · Xuelin Yang · Xikun Zhang · Noah Goodman · Jiajun Wu -
2022 Poster: Geoclidean: Few-Shot Generalization in Euclidean Geometry »
Joy Hsu · Jiajun Wu · Noah Goodman -
2022 Poster: Active Learning Helps Pretrained Models Learn the Intended Task »
Alex Tamkin · Dat Nguyen · Salil Deshpande · Jesse Mu · Noah Goodman -
2022 Poster: Foundation Posteriors for Approximate Probabilistic Inference »
Mike Wu · Noah Goodman -
2022 Poster: STaR: Bootstrapping Reasoning With Reasoning »
Eric Zelikman · Yuhuai Wu · Jesse Mu · Noah Goodman -
2022 Poster: DABS 2.0: Improved Datasets and Algorithms for Universal Self-Supervision »
Alex Tamkin · Gaurab Banerjee · Mohamed Owda · Vincent Liu · Shashank Rammoorthy · Noah Goodman -
2022 Poster: Improving Intrinsic Exploration with Language Abstractions »
Jesse Mu · Victor Zhong · Roberta Raileanu · Minqi Jiang · Noah Goodman · Tim Rocktäschel · Edward Grefenstette -
2021 : Spotlight Talk: Learning to solve complex tasks by growing knowledge culturally across generations »
Noah Goodman · Josh Tenenbaum · Michael Tessler · Jason Madeano -
2021 : Multi-party referential communication in complex strategic games »
Jessica Mankewitz · Veronica Boyce · Brandon Waldon · Georgia Loukatou · Dhara Yu · Jesse Mu · Noah Goodman · Michael C Frank -
2021 Workshop: Meaning in Context: Pragmatic Communication in Humans and Machines »
Jennifer Hu · Noga Zaslavsky · Aida Nematzadeh · Michael Franke · Roger Levy · Noah Goodman -
2021 : Opening remarks »
Jennifer Hu · Noga Zaslavsky · Aida Nematzadeh · Michael Franke · Roger Levy · Noah Goodman -
2021 Poster: Emergent Communication of Generalizations »
Jesse Mu · Noah Goodman -
2021 Poster: Contrastive Reinforcement Learning of Symbolic Reasoning Domains »
Gabriel Poesia · WenXin Dong · Noah Goodman -
2021 Poster: Improving Compositionality of Neural Networks by Decoding Representations to Inputs »
Mike Wu · Noah Goodman · Stefano Ermon -
2021 Panel: The Consequences of Massive Scaling in Machine Learning »
Noah Goodman · Melanie Mitchell · Joelle Pineau · Oriol Vinyals · Jared Kaplan -
2020 Poster: Language Through a Prism: A Spectral Approach for Multiscale Language Representations »
Alex Tamkin · Dan Jurafsky · Noah Goodman -
2019 Poster: Variational Bayesian Optimal Experimental Design »
Adam Foster · Martin Jankowiak · Elias Bingham · Paul Horsfall · Yee Whye Teh · Thomas Rainforth · Noah Goodman -
2019 Spotlight: Variational Bayesian Optimal Experimental Design »
Adam Foster · Martin Jankowiak · Elias Bingham · Paul Horsfall · Yee Whye Teh · Thomas Rainforth · Noah Goodman -
2018 : Research Panel »
Sinead Williamson · Barbara Engelhardt · Tom Griffiths · Neil Lawrence · Hanna Wallach -
2018 Poster: Human-in-the-Loop Interpretability Prior »
Isaac Lage · Andrew Ross · Samuel J Gershman · Been Kim · Finale Doshi-Velez -
2018 Spotlight: Human-in-the-Loop Interpretability Prior »
Isaac Lage · Andrew Ross · Samuel J Gershman · Been Kim · Finale Doshi-Velez -
2018 Poster: Bias and Generalization in Deep Generative Models: An Empirical Study »
Shengjia Zhao · Hongyu Ren · Arianna Yuan · Jiaming Song · Noah Goodman · Stefano Ermon -
2018 Spotlight: Bias and Generalization in Deep Generative Models: An Empirical Study »
Shengjia Zhao · Hongyu Ren · Arianna Yuan · Jiaming Song · Noah Goodman · Stefano Ermon -
2018 Poster: Multimodal Generative Models for Scalable Weakly-Supervised Learning »
Mike Wu · Noah Goodman -
2017 : Learning to select computations »
Falk Lieder · Fred Callaway · Sayan Gul · Paul Krueger -
2017 : Revealing human inductive biases and metacognitive processes with rational models »
Tom Griffiths -
2017 : Morning panel discussion »
Jürgen Schmidhuber · Noah Goodman · Anca Dragan · Pushmeet Kohli · Dhruv Batra -
2017 : "Language in context" »
Noah Goodman -
2017 Poster: A graph-theoretic approach to multitasking »
Noga Alon · Daniel Reichman · Igor Shinkar · Tal Wagner · Sebastian Musslick · Jonathan D Cohen · Tom Griffiths · Biswadip dey · Kayhan Ozcimder -
2017 Oral: A graph-theoretic approach to multitasking »
Noga Alon · Daniel Reichman · Igor Shinkar · Tal Wagner · Sebastian Musslick · Jonathan D Cohen · Tom Griffiths · Biswadip dey · Kayhan Ozcimder -
2017 Poster: Learning Disentangled Representations with Semi-Supervised Deep Generative Models »
Siddharth Narayanaswamy · Brooks Paige · Jan-Willem van de Meent · Alban Desmaison · Noah Goodman · Pushmeet Kohli · Frank Wood · Philip Torr -
2016 : Bounded Optimality and Rational Metareasoning in Human Cognition »
Tom Griffiths -
2016 Poster: Neurally-Guided Procedural Models: Amortized Inference for Procedural Graphics Programs using Neural Networks »
Daniel Ritchie · Anna Thomas · Pat Hanrahan · Noah Goodman -
2016 Poster: Probing the Compositionality of Intuitive Functions »
Eric Schulz · Josh Tenenbaum · David Duvenaud · Maarten Speekenbrink · Samuel J Gershman -
2014 Poster: Algorithm selection by rational metareasoning as a model of human strategy selection »
Falk Lieder · Dillon Plunkett · Jessica B Hamrick · Stuart J Russell · Nicholas Hay · Tom Griffiths -
2014 Poster: Design Principles of the Hippocampal Cognitive Map »
Kimberly Stachenfeld · Matthew Botvinick · Samuel J Gershman -
2014 Spotlight: Design Principles of the Hippocampal Cognitive Map »
Kimberly Stachenfeld · Matthew Botvinick · Samuel J Gershman -
2013 Poster: Visual Concept Learning: Combining Machine Vision and Bayesian Generalization on Concept Hierarchies »
Yangqing Jia · Joshua T Abbott · Joseph L Austerweil · Tom Griffiths · Trevor Darrell -
2013 Poster: Learning and using language via recursive pragmatic reasoning about other agents »
Nathaniel J Smith · Noah Goodman · Michael C Frank -
2013 Poster: Learning Stochastic Inverses »
Andreas Stuhlmüller · Jacob Taylor · Noah Goodman -
2012 Workshop: Probabilistic Programming: Foundations and Applications (2 day) »
Vikash Mansinghka · Daniel Roy · Noah Goodman -
2012 Workshop: Probabilistic Programming: Foundations and Applications (2 day) »
Vikash Mansinghka · Daniel Roy · Noah Goodman -
2012 Poster: Human memory search as a random walk in a semantic network »
Joshua T Abbott · Joseph L Austerweil · Tom Griffiths -
2012 Spotlight: Human memory search as a random walk in a semantic network »
Joshua T Abbott · Joseph L Austerweil · Tom Griffiths -
2012 Poster: Burn-in, bias, and the rationality of anchoring »
Falk Lieder · Tom Griffiths · Noah Goodman -
2011 Poster: A rational model of causal inference with continuous causes »
M Pacer · Tom Griffiths -
2011 Poster: An ideal observer model for identifying the reference frame of objects »
Joseph L Austerweil · Abram Friesen · Tom Griffiths -
2011 Poster: Testing a Bayesian Measure of Representativeness Using a Large Image Database »
Joshua T Abbott · Katherine Heller · Zoubin Ghahramani · Tom Griffiths -
2011 Poster: Nonstandard Interpretations of Probabilistic Programs for Efficient Inference »
David Wingate · Noah Goodman · Andreas Stuhlmueller · Jeffrey Siskind -
2010 Workshop: Transfer Learning Via Rich Generative Models. »
Russ Salakhutdinov · Ryan Adams · Josh Tenenbaum · Zoubin Ghahramani · Tom Griffiths -
2010 Spotlight: Learning invariant features using the Transformed Indian Buffet Process »
Joseph L Austerweil · Tom Griffiths -
2010 Poster: Learning invariant features using the Transformed Indian Buffet Process »
Joseph L Austerweil · Tom Griffiths -
2010 Poster: The Neural Costs of Optimal Control »
Samuel J Gershman · Robert C Wilson -
2009 Workshop: Bounded-rational analyses of human cognition: Bayesian models, approximate inference, and the brain »
Noah Goodman · Edward Vul · Tom Griffiths · Josh Tenenbaum -
2009 Poster: Perceptual Multistability as Markov Chain Monte Carlo Inference »
Samuel J Gershman · Edward Vul · Josh Tenenbaum -
2009 Poster: Neural Implementation of Hierarchical Bayesian Inference by Importance Sampling »
Lei ShiUpdateMe · Tom Griffiths -
2009 Spotlight: Neural Implementation of Hierarchical Bayesian Inference by Importance Sampling »
Lei ShiUpdateMe · Tom Griffiths -
2009 Spotlight: Perceptual Multistability as Markov Chain Monte Carlo Inference »
Samuel J Gershman · Edward Vul · Josh Tenenbaum -
2009 Poster: Differential Use of Implicit Negative Evidence in Generative and Discriminative Language Learning »
Anne Hsu · Tom Griffiths -
2009 Oral: Differential Use of Implicit Negative Evidence in Generative and Discriminative Language Learning »
Anne Hsu · Tom Griffiths -
2009 Poster: A Bayesian Analysis of Dynamics in Free Recall »
Richard Socher · Samuel J Gershman · Adler Perotte · Per Sederberg · David Blei · Kenneth Norman -
2009 Poster: Nonparametric Latent Feature Models for Link Prediction »
Kurt T Miller · Tom Griffiths · Michael Jordan -
2009 Spotlight: Nonparametric Latent Feature Models for Link Prediction »
Kurt T Miller · Tom Griffiths · Michael Jordan -
2008 Workshop: Machine learning meets human learning »
Nathaniel D Daw · Tom Griffiths · Josh Tenenbaum · Jerry Zhu -
2008 Poster: Modeling the effects of memory on human online sentence processing with particle filters »
Roger Levy · Florencia Reali · Tom Griffiths -
2008 Oral: Modeling the effects of memory on human online sentence processing with particle filters »
Roger Levy · Florencia Reali · Tom Griffiths -
2008 Poster: How memory biases affect information transmission: A rational analysis of serial reproduction »
Jing Xu · Tom Griffiths -
2008 Poster: Analyzing human feature learning as nonparametric Bayesian inference »
Joseph L Austerweil · Tom Griffiths -
2008 Poster: A rational model of preference learning and choice prediction by children »
Chris Lucas · Tom Griffiths · Fei Xu · Christine Fawcett -
2008 Spotlight: Analyzing human feature learning as nonparametric Bayesian inference »
Joseph L Austerweil · Tom Griffiths -
2008 Spotlight: A rational model of preference learning and choice prediction by children »
Chris Lucas · Tom Griffiths · Fei Xu · Christine Fawcett -
2008 Spotlight: How memory biases affect information transmission: A rational analysis of serial reproduction »
Jing Xu · Tom Griffiths -
2008 Poster: Modeling human function learning with Gaussian processes »
Tom Griffiths · Chris Lucas · Joseph Jay Williams · Michael Kalish -
2007 Oral: Markov Chain Monte Carlo with People »
Adam Sanborn · Tom Griffiths -
2007 Poster: Markov Chain Monte Carlo with People »
Adam Sanborn · Tom Griffiths -
2007 Poster: A Probabilistic Approach to Language Change »
Alexandre Bouchard-Côté · Percy Liang · Tom Griffiths · Dan Klein -
2006 Poster: Particle Filtering for Nonparametric Bayesian Matrix Factorization »
Frank Wood · Tom Griffiths -
2006 Poster: Adaptor Grammars: A Framework for Specifying Compositional Nonparametric Bayesian Mod »
Mark Johnson · Tom Griffiths · Sharon Goldwater -
2006 Poster: A Nonparametric Bayesian Method for Inferring Features From Similarity Judgments »
Daniel Navarro · Tom Griffiths