Timezone: »
We present a free online tool that predicts brain activity from text, images and videos that users supply to the system. The tool is based on models that were trained using data from experiments in which subjects process complex, uncontrolled stimuli: they listen to hours of stories and watch real movies. The models can then predict brain activity for any new stimulus, effectively simulating the results of an fMRI experiment that was not performed. Our system allows users to run a variety of common analysis tools used in imaging such as computing contrasts between conditions, running statistical tests, and interactively visualizing the obtained brain maps in multiple views. This can be useful while planning a new fMRI experiment, and could be crucial for encouraging replicability of fMRI results: published results and activation maps can be easily compared against our predictions for the same stimuli.
Author Information
Leila Wehbe (UC Berkeley)
Alexander G Huth (UC Berkeley)
Fatma Deniz (UC Berkeley & TU Berlin)
Marie-Luise Kieseler (UC Berkeley)
Jack Gallant (University of California)
More from the Same Authors
-
2021 : A finer mapping of convolutional neural network layers to the visual cortex »
Tom Dupre la Tour · Michael Lu · Michael Eickenberg · Jack Gallant -
2019 Workshop: Context and Compositionality in Biological and Artificial Neural Systems »
Javier Turek · Shailee Jain · Alexander Huth · Leila Wehbe · Emma Strubell · Alan Yuille · Tal Linzen · Christopher Honey · Kyunghyun Cho -
2017 : Panel Discussion »
Felix Hill · Olivier Pietquin · Jack Gallant · Raymond Mooney · Sanja Fidler · Chen Yu · Devi Parikh -
2017 : The interface between vision and language in the human brain? »
Jack Gallant -
2016 : Alex Huth - Using Natural Language for Studying the Human Cortex »
Alexander G Huth -
2016 Workshop: Representation Learning in Artificial and Biological Neural Networks »
Leila Wehbe · Marcel Van Gerven · Moritz Grosse-Wentrup · Irina Rish · Brian Murphy · Georg Langs · Guillermo Cecchi · Anwar O Nunez-Elizalde -
2015 Workshop: Machine Learning and Interpretation in Neuroimaging (day 1) »
Irina Rish · Leila Wehbe · Brian Murphy · Georg Langs · Guillermo Cecchi · Moritz Grosse-Wentrup -
2014 Workshop: MLINI 2014 - 4th NIPS Workshop on Machine Learning and Interpretation in Neuroimaging: Beyond the Scanner »
Irina Rish · Georg Langs · Brian Murphy · Guillermo Cecchi · Kai-min K Chang · Leila Wehbe -
2008 Poster: Nonparametric sparse hierarchical models describe V1 fMRI responses to natural images »
Pradeep Ravikumar · Vincent Vu · Bin Yu · Thomas Naselaris · Kendrick Kay · Jack Gallant -
2008 Spotlight: Nonparametric sparse hierarchical models describe V1 fMRI responses to natural images »
Pradeep Ravikumar · Vincent Vu · Bin Yu · Thomas Naselaris · Kendrick Kay · Jack Gallant