Timezone: »

 
Oral
Graph Random Neural Networks for Semi-Supervised Learning on Graphs
Wenzheng Feng · Jie Zhang · Yuxiao Dong · Yu Han · Huanbo Luan · Qian Xu · Qiang Yang · Evgeny Kharlamov · Jie Tang

Thu Dec 10 06:30 AM -- 06:45 AM (PST) @ Orals & Spotlights: Graph/Relational/Theory
in Orals & Spotlights Track 26: Graph/Relational/Theory »

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and weak-generalization when labeled nodes are scarce. In this paper, we propose a simple yet effective framework—GRAPH RANDOM NEURAL NETWORKS (GRAND)—to address these issues. In GRAND, we first design a random propagation strategy to perform graph data augmentation. Then we leverage consistency regularization to optimize the prediction consistency of unlabeled nodes across different data augmentations. Extensive experiments on graph benchmark datasets suggest that GRAND significantly outperforms state-of- the-art GNN baselines on semi-supervised node classification. Finally, we show that GRAND mitigates the issues of over-smoothing and non-robustness, exhibiting better generalization behavior than existing GNNs. The source code of GRAND is publicly available at https://github.com/Grand20/grand.

Keywords: Information Theory · Signal Processing · Applications · Theory

Author Information

Wenzheng Feng (Tsinghua University)
Jie Zhang (Webank Co.,Ltd)
Yuxiao Dong (Microsoft)
Yu Han (Tsinghua University)
Huanbo Luan (Tsinghua University)
Qian Xu (WeBank)
Qiang Yang (WeBank and HKUST)
Evgeny Kharlamov (Bosch Center for Artificial Intelligence)
Jie Tang (Tsinghua University)
Jie Tang

Jie Tang is a WeBank Chair Professor of Computer Science at Tsinghua University. He is a Fellow of the ACM, a Fellow of AAAI, and a Fellow of IEEE. His interest is artificial general intelligence (AGI). His research received the SIGKDD Test-of-Time Award (10-year Best Paper). He also received the SIGKDD Service Award. Recently, he puts all efforts into Large Language Models (LLMs): GLM, ChatGLM, etc.

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors