Timezone: »
The experimental study of neural information processing in the biological visual system is challenging due to the nonlinear nature of neuronal responses to visual input. Artificial neural networks play a dual role in improving our understanding of this complex system, not only allowing computational neuroscientists to build predictive digital twins for novel hypothesis generation in silico, but also allowing machine learning to progressively bridge the gap between biological and machine vision. The mouse has recently emerged as a popular model system to study visual information processing, but no standardized large-scale benchmark to identify state-of-the-art models of the mouse visual system has been established. To fill this gap, we propose the sensorium benchmark competition. We collected a large-scale dataset from mouse primary visual cortex containing the responses of more than 28,000 neurons across seven mice stimulated with thousands of natural images.Using this dataset, we will host two benchmark tracks to find the best predictive models of neuronal responses on a held-out test set. The two tracks differ in whether measured behavior signals are made available or not. We provide code, tutorials, and pre-trained baseline models to lower the barrier for entering the competition. Beyond this proposal, our goal is to keep the accompanying website open with new yearly challenges for it to become a standard tool to measure progress in large-scale neural system identification models of the entire mouse visual hierarchy and beyond.
Tue 1:00 p.m. - 1:15 p.m.
|
Introduction to the Sensorium Competition
(
Opening Remarks
)
|
Konstantin Willeke · Paul Fahey 🔗 |
Tue 1:15 p.m. - 1:30 p.m.
|
Competition Results
(
Overview
)
|
Konstantin Willeke · Paul Fahey 🔗 |
Tue 1:30 p.m. - 1:35 p.m.
|
Presentation of the Winners: Sensorium Rank 3
(
Invited Talk
)
|
🔗 |
Tue 1:35 p.m. - 1:40 p.m.
|
Presentation of the Winners: Sensorium Rank 2
(
Invited Talk
)
|
🔗 |
Tue 1:40 p.m. - 1:45 p.m.
|
Presentation of the Winners: Sensorium Rank 1
(
Invited Talk
)
|
🔗 |
Tue 1:45 p.m. - 1:50 p.m.
|
Presentation of the Winners: Sensorium+ Track Rank 3
(
Invited Talk
)
|
🔗 |
Tue 1:50 p.m. - 1:55 p.m.
|
Presentation of the Winners: Sensorium+ Track Rank 2
(
Invited Talk
)
|
🔗 |
Tue 1:55 p.m. - 2:00 p.m.
|
Presentation of the Winners: Sensorium+ Track Rank 1
(
Invited Talk
)
|
🔗 |
Tue 2:00 p.m. - 2:30 p.m.
|
Invited talk: "How good would your model be if you had an infinite amount of noiseless data?"
(
Invited Talk
)
|
Dean Pospisil 🔗 |
Tue 2:30 p.m. - 3:15 p.m.
|
Invited talk: "Predicting mouse neural activity with models trained through supervised, unsupervised, and reinforcement learning" ( Invited Talk ) link » | Grace Lindsay 🔗 |
Tue 3:15 p.m. - 3:45 p.m.
|
Conclusion, Discussion, Outlook
(
Discussion
)
|
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz 🔗 |
Tue 3:45 p.m. - 4:00 p.m.
|
Lessons Learned
(
Closing Remarks
)
|
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz 🔗 |
-
|
Fifteen-minute Competition Overview Video
(
Overview
)
SlidesLive Video » |
Konstantin Willeke · Paul Fahey · Andreas Tolias · Alexander Ecker · Fabian Sinz 🔗 |
Author Information
Konstantin Willeke (University of Tuebingen)
Paul Fahey (Baylor College of Medicine)
Mohammad Bashiri (University of Tuebingen)
Laura Hansel (Georg-August Universität Göttingen)
Max Burg (University of Göttingen)
Christoph Blessing (Georg-August Universität Göttingen)
Santiago Cadena (University of Tübingen)
Zhiwei Ding (Baylor College of Medicine)
Konstantin-Klemens Lurz (University of Tuebingen)
Kayla Ponder (Baylor College of Medicine)
Subash Prakash (Tübingen AI Center)
Kishan Naik (Tübingen AI Center)
Kantharaju Narayanappa (University of Tuebingen)
Alexander Ecker (Georg-August Universität Göttingen)
Andreas Tolias (Baylor College of Medicine)
Fabian Sinz (University Tübingen)
More from the Same Authors
-
2021 Spotlight: A flow-based latent state generative model of neural population responses to natural images »
Mohammad Bashiri · Edgar Walker · Konstantin-Klemens Lurz · Akshay Jagadish · Taliah Muhammad · Zhiwei Ding · Zhuokun Ding · Andreas Tolias · Fabian Sinz -
2022 : Learning Dynamics and Structure of Complex Systems Using Graph Neural Networks »
Zhe Li · Andreas Tolias · Xaq Pitkow -
2022 : Learning Invariance Manifolds of Visual Sensory Neurons »
Luca Baroni · Mohammad Bashiri · Konstantin Willeke · Ján Antolík · Fabian Sinz -
2022 : Bayesian Oracle for bounding information gain in neural encoding models »
Konstantin-Klemens Lurz · Mohammad Bashiri · Fabian Sinz -
2022 : Fifteen-minute Competition Overview Video »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Alexander Ecker · Fabian Sinz -
2023 Poster: Taking the neural sampling code very seriously: A data-driven approach for assessing generative models of the visual system »
Suhas Shrinivasan · Konstantin-Klemens Lurz · Kelli Restivo · George Denfield · Andreas Tolias · Edgar Walker · Fabian Sinz -
2023 Poster: Energy Guided Diffusion for Generating Neurally Exciting Images »
Pawel Pierzchlewicz · Konstantin Willeke · Arne Nix · Pavithra Elumalai · Kelli Restivo · Tori Shinn · Cate Nealley · Gabrielle Rodriguez · Saumil Patel · Katrin Franke · Andreas Tolias · Fabian Sinz -
2023 Competition: The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos »
Polina Turishcheva · Paul Fahey -
2022 : Lessons Learned »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz -
2022 : Conclusion, Discussion, Outlook »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz -
2022 : Competition Results »
Konstantin Willeke · Paul Fahey -
2022 : Introduction to the Sensorium Competition »
Konstantin Willeke · Paul Fahey -
2022 : Leading by example: Guiding knowledge transfer with adversarial data augmentation »
Arne Nix · Max Burg · Fabian Sinz -
2021 Poster: Towards robust vision by multi-task learning on monkey visual cortex »
Shahd Safarani · Arne Nix · Konstantin Willeke · Santiago Cadena · Kelli Restivo · George Denfield · Andreas Tolias · Fabian Sinz -
2021 Oral: Partial success in closing the gap between human and machine vision »
Robert Geirhos · Kantharaju Narayanappa · Benjamin Mitzkus · Tizian Thieringer · Matthias Bethge · Felix A. Wichmann · Wieland Brendel -
2021 Poster: A flow-based latent state generative model of neural population responses to natural images »
Mohammad Bashiri · Edgar Walker · Konstantin-Klemens Lurz · Akshay Jagadish · Taliah Muhammad · Zhiwei Ding · Zhuokun Ding · Andreas Tolias · Fabian Sinz -
2021 Poster: Partial success in closing the gap between human and machine vision »
Robert Geirhos · Kantharaju Narayanappa · Benjamin Mitzkus · Tizian Thieringer · Matthias Bethge · Felix A. Wichmann · Wieland Brendel -
2020 Poster: Factorized Neural Processes for Neural Processes: K-Shot Prediction of Neural Responses »
Ronald (James) Cotton · Fabian Sinz · Andreas Tolias -
2019 : Poster Session »
Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar -
2019 Poster: Learning from brains how to regularize machines »
Zhe Li · Wieland Brendel · Edgar Walker · Erick Cobos · Taliah Muhammad · Jacob Reimer · Matthias Bethge · Fabian Sinz · Xaq Pitkow · Andreas Tolias -
2018 Poster: Stimulus domain transfer in recurrent models for large scale cortical population prediction on video »
Fabian Sinz · Alexander Ecker · Paul Fahey · Edgar Walker · Erick M Cobos · Emmanouil Froudarakis · Dimitri Yatsenko · Xaq Pitkow · Jacob Reimer · Andreas Tolias -
2016 : From Brains to Bits and Back Again »
Yoshua Bengio · Terrence Sejnowski · Christos H Papadimitriou · Jakob H Macke · Demis Hassabis · Alyson Fletcher · Andreas Tolias · Jascha Sohl-Dickstein · Konrad P Koerding -
2015 : Methods overview: Studying the function and structure of microcircuits »
Andreas Tolias -
2013 Poster: Least Informative Dimensions »
Fabian H Sinz · Anna Stockl · Jan Grewe · Jan Benda -
2009 Poster: Hierarchical Modeling of Local Image Features through $L_p$-Nested Symmetric Distributions »
Fabian H Sinz · Eero Simoncelli · Matthias Bethge -
2008 Poster: The Conjoint Effect of Divisive Normalization and Orientation Selectivity on Redundancy Reduction »
Fabian H Sinz · Matthias Bethge -
2008 Spotlight: The Conjoint Effect of Divisive Normalization and Orientation Selectivity on Redundancy Reduction »
Fabian H Sinz · Matthias Bethge -
2007 Poster: An Analysis of Inference with the Universum »
Fabian H Sinz · Olivier Chapelle · Alekh Agarwal · Bernhard Schölkopf -
2007 Spotlight: An Analysis of Inference with the Universum »
Fabian H Sinz · Olivier Chapelle · Alekh Agarwal · Bernhard Schölkopf