Timezone: »
Many complex systems are composed of interacting parts, and the underlying laws are usually simple and universal. While graph neural networks provide a useful relational inductive bias for modeling such systems, generalization to new system instances of the same type is less studied. In this work we trained graph neural networks to fit time series from an example nonlinear dynamical system, the belief propagation algorithm. We found simple interpretations of the learned representation and model components, and they are consistent with core properties of the probabilistic inference algorithm. We successfully identified a 'graph translator' between the statistical attributes in belief propagation and parameters of the corresponding trained network, and showed that it enables two types of novel generalization: to recover the underlying structure of a new system instance based solely on time series observations, and to construct a new network from this structure directly. Our results demonstrated a path towards understanding both dynamics and structure of a complex system and how such understanding can be used for generalization.
Author Information
Zhe Li (Baylor College of Medicine)
Andreas Tolias (Baylor College of Medicine)
Xaq Pitkow (BCM/Rice)
More from the Same Authors
-
2021 Spotlight: A flow-based latent state generative model of neural population responses to natural images »
Mohammad Bashiri · Edgar Walker · Konstantin-Klemens Lurz · Akshay Jagadish · Taliah Muhammad · Zhiwei Ding · Zhuokun Ding · Andreas Tolias · Fabian Sinz -
2022 : Attention as inference with third-order interactions »
Yicheng Fei · Xaq Pitkow -
2022 : Fifteen-minute Competition Overview Video »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Alexander Ecker · Fabian Sinz -
2022 : Lessons Learned »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz -
2022 : Conclusion, Discussion, Outlook »
Konstantin Willeke · Paul Fahey · Andreas Tolias · Fabian Sinz -
2022 Competition: The SENSORIUM competition on predicting large scale mouse primary visual cortex activity »
Konstantin Willeke · Paul Fahey · Mohammad Bashiri · Laura Hansel · Max Burg · Christoph Blessing · Santiago Cadena · Zhiwei Ding · Konstantin-Klemens Lurz · Kayla Ponder · Subash Prakash · Kishan Naik · Kantharaju Narayanappa · Alexander Ecker · Andreas Tolias · Fabian Sinz -
2022 Poster: Phase transitions in when feedback is useful »
Lokesh Boominathan · Xaq Pitkow -
2021 Poster: Towards robust vision by multi-task learning on monkey visual cortex »
Shahd Safarani · Arne Nix · Konstantin Willeke · Santiago Cadena · Kelli Restivo · George Denfield · Andreas Tolias · Fabian Sinz -
2021 Poster: A flow-based latent state generative model of neural population responses to natural images »
Mohammad Bashiri · Edgar Walker · Konstantin-Klemens Lurz · Akshay Jagadish · Taliah Muhammad · Zhiwei Ding · Zhuokun Ding · Andreas Tolias · Fabian Sinz -
2020 Poster: Factorized Neural Processes for Neural Processes: K-Shot Prediction of Neural Responses »
Ronald (James) Cotton · Fabian Sinz · Andreas Tolias -
2020 Poster: Inverse Rational Control with Partially Observable Continuous Nonlinear Dynamics »
Minhae Kwon · Saurabh Daptardar · Paul R Schrater · Xaq Pitkow -
2019 : Poster Session »
Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar -
2019 Poster: Learning from brains how to regularize machines »
Zhe Li · Wieland Brendel · Edgar Walker · Erick Cobos · Taliah Muhammad · Jacob Reimer · Matthias Bethge · Fabian Sinz · Xaq Pitkow · Andreas Tolias -
2018 Poster: Stimulus domain transfer in recurrent models for large scale cortical population prediction on video »
Fabian Sinz · Alexander Ecker · Paul Fahey · Edgar Walker · Erick M Cobos · Emmanouil Froudarakis · Dimitri Yatsenko · Xaq Pitkow · Jacob Reimer · Andreas Tolias -
2016 : From Brains to Bits and Back Again »
Yoshua Bengio · Terrence Sejnowski · Christos H Papadimitriou · Jakob H Macke · Demis Hassabis · Alyson Fletcher · Andreas Tolias · Jascha Sohl-Dickstein · Konrad P Koerding -
2016 Poster: Inference by Reparameterization in Neural Population Codes »
Rajkumar Vasudeva Raju · Xaq Pitkow -
2015 : Methods overview: Studying the function and structure of microcircuits »
Andreas Tolias