Timezone: »
This work provides the first theoretical study on the ability of graph Message Passing Neural Networks (gMPNNs) ---such as Graph Neural Networks (GNNs)--- to perform inductive out-of-distribution (OOD) link prediction tasks, where deployment (test) graph sizes are larger than training graphs. We first prove non-asymptotic bounds showing that link predictors based on permutation-equivariant (structural) node embeddings obtained by gMPNNs can converge to a random guess as test graphs get larger. We then propose a theoretically-sound gMPNN that outputs structural pairwise (2-node) embeddings and prove non-asymptotic bounds showing that, as test graphs grow, these embeddings converge to embeddings of a continuous function that retains its ability to predict links OOD. Empirical results on random graphs show agreement with our theoretical results.
Author Information
Yangze Zhou (Purdue University)
Gitta Kutyniok (LMU München)
Bruno Ribeiro (Purdue)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphs »
Dates n/a. Room
More from the Same Authors
-
2022 : Conditional Invariances for Conformer Invariant Protein Representations »
Balasubramaniam Srinivasan · Vassilis Ioannidis · Soji Adeshina · Mayank Kakodkar · George Karypis · Bruno Ribeiro -
2022 Spotlight: Lightning Talks 1B-1 »
Qitian Wu · Runlin Lei · Rongqin Chen · Luca Pinchetti · Yangze Zhou · Abhinav Kumar · Hans Hao-Hsun Hsu · Wentao Zhao · Chenhao Tan · Zhen Wang · Shenghui Zhang · Yuesong Shen · Tommaso Salvatori · Gitta Kutyniok · Zenan Li · Amit Sharma · Leong Hou U · Yordan Yordanov · Christian Tomani · Bruno Ribeiro · Yaliang Li · David P Wipf · Daniel Cremers · Bolin Ding · Beren Millidge · Ye Li · Yuhang Song · Junchi Yan · Zhewei Wei · Thomas Lukasiewicz -
2022 Poster: Generalization Analysis of Message Passing Neural Networks on Large Random Graphs »
Sohir Maskey · Ron Levie · Yunseok Lee · Gitta Kutyniok -
2022 Poster: Graph Scattering beyond Wavelet Shackles »
Christian Koke · Gitta Kutyniok -
2021 Poster: Reconstruction for Powerful Graph Representations »
Leonardo Cotta · Christopher Morris · Bruno Ribeiro -
2020 Poster: Unsupervised Joint k-node Graph Representations with Compositional Energy-Based Models »
Leonardo Cotta · Carlos H. C. Teixeira · Ananthram Swami · Bruno Ribeiro