Timezone: »
Previous theoretical and experimental work on optimal decision-making was restricted to the artificial setting of a reliability of the momentary sensory evidence that remained constant within single trials. The work presented here describes the computation and characterization of optimal decision-making in the more realistic case of an evidence reliability that varies across time even within a trial. It shows that, in this case, the optimal behavior is determined by a bound in the decision maker's belief that depends only on the current, but not the past, reliability. We furthermore demonstrate that simpler heuristics fail to match the optimal performance for certain characteristics of the process that determines the time-course of this reliability, causing a drop in reward rate by more than 50%.
Author Information
Jan Drugowitsch (Harvard Medical School)
Ruben Moreno-Bote (Foundation Sant Joan de Deu)
Alexandre Pouget (University of Geneva)
Related Events (a corresponding poster, oral, or spotlight)
-
2014 Poster: Optimal decision-making with time-varying evidence reliability »
Thu. Dec 11th 07:00 -- 11:00 PM Room Level 2, room 210D
More from the Same Authors
-
2023 : Distributional Reinforcement Learning in the Mammalian Brain »
Adam Lowet · Qiao Zheng · Melissa Meng · Sara Matias · Jan Drugowitsch · Naoshige Uchida -
2023 : Distributional Reinforcement Learning in the Mammalian Brain »
Adam Lowet · Qiao Zheng · Melissa Meng · Sara Matias · Jan Drugowitsch · Naoshige Uchida -
2022 : Is the information geometry of probabilistic population codes learnable? »
John Vastola · Zach Cohen · Jan Drugowitsch -
2020 Poster: A Local Temporal Difference Code for Distributional Reinforcement Learning »
Pablo Tano · Peter Dayan · Alexandre Pouget -
2020 Poster: Adaptation Properties Allow Identification of Optimized Neural Codes »
Luke Rast · Jan Drugowitsch -
2020 Poster: Dynamic allocation of limited memory resources in reinforcement learning »
Nisheet Patel · Luigi Acerbi · Alexandre Pouget -
2013 Poster: Demixing odors - fast inference in olfaction »
Agnieszka Grabska-Barwinska · Jeff Beck · Alexandre Pouget · Peter E Latham -
2013 Spotlight: Demixing odors - fast inference in olfaction »
Agnieszka Grabska-Barwinska · Jeff Beck · Alexandre Pouget · Peter E Latham