Timezone: »

Learning interaction rules from multi-animal trajectories via augmented behavioral models
Keisuke Fujii · Naoya Takeishi · Kazushi Tsutsui · Emyo Fujioka · Nozomi Nishiumi · Ryoya Tanaka · Mika Fukushiro · Kaoru Ide · Hiroyoshi Kohno · Ken Yoda · Susumu Takahashi · Shizuko Hiryu · Yoshinobu Kawahara

Thu Dec 09 12:30 AM -- 02:00 AM (PST) @ Virtual

Extracting the interaction rules of biological agents from movement sequences pose challenges in various domains. Granger causality is a practical framework for analyzing the interactions from observed time-series data; however, this framework ignores the structures and assumptions of the generative process in animal behaviors, which may lead to interpretational problems and sometimes erroneous assessments of causality. In this paper, we propose a new framework for learning Granger causality from multi-animal trajectories via augmented theory-based behavioral models with interpretable data-driven models. We adopt an approach for augmenting incomplete multi-agent behavioral models described by time-varying dynamical systems with neural networks. For efficient and interpretable learning, our model leverages theory-based architectures separating navigation and motion processes, and the theory-guided regularization for reliable behavioral modeling. This can provide interpretable signs of Granger-causal effects over time, i.e., when specific others cause the approach or separation. In experiments using synthetic datasets, our method achieved better performance than various baselines. We then analyzed multi-animal datasets of mice, flies, birds, and bats, which verified our method and obtained novel biological insights.

Author Information

Keisuke Fujii (Nagoya University)
Naoya Takeishi (HES-SO / RIKEN)
Kazushi Tsutsui (Nagoya University)
Emyo Fujioka (Doshisha University)
Nozomi Nishiumi (National Institute for Basic Biology)
Ryoya Tanaka (Nagoya University)
Mika Fukushiro (doshisha university)
Kaoru Ide (Doshisha University)
Hiroyoshi Kohno (Tokai University)
Ken Yoda (Nagoya University)
Susumu Takahashi (Doshisha University)
Shizuko Hiryu (Doshisha University)
Yoshinobu Kawahara (Kyushu University / RIKEN)

More from the Same Authors