Timezone: »

 
Spotlight
Debiasing Graph Neural Networks via Learning Disentangled Causal Substructure
Shaohua Fan · Xiao Wang · Yanhu Mo · Chuan Shi · Jian Tang

Tue Dec 06 05:00 PM -- 07:00 PM (PST) @
in Lightning Talks 2B-3 »

Most Graph Neural Networks (GNNs) predict the labels of unseen graphs by learning the correlation between the input graphs and labels. However, by presenting a graph classification investigation on the training graphs with severe bias, surprisingly, we discover that GNNs always tend to explore the spurious correlations to make decision, even if the causal correlation always exists. This implies that existing GNNs trained on such biased datasets will suffer from poor generalization capability. By analyzing this problem in a causal view, we find that disentangling and decorrelating the causal and bias latent variables from the biased graphs are both crucial for debiasing. Inspired by this, we propose a general disentangled GNN framework to learn the causal substructure and bias substructure, respectively. Particularly, we design a parameterized edge mask generator to explicitly split the input graph into causal and bias subgraphs. Then two GNN modules supervised by causal/bias-aware loss functions respectively are trained to encode causal and bias subgraphs into their corresponding representations. With the disentangled representations, we synthesize the counterfactual unbiased training samples to further decorrelate causal and bias variables. Moreover, to better benchmark the severe bias problem, we construct three new graph datasets, which have controllable bias degrees and are easier to visualize and explain. Experimental results well demonstrate that our approach achieves superior generalization performance over existing baselines. Furthermore, owing to the learned edge mask, the proposed model has appealing interpretability and transferability.

Keywords: graph neural networks · Causal substructure · Debiasing

Author Information

Shaohua Fan (Beijing University of Post and Telecommunication)
Xiao Wang (Beijing University of Post and Telecommunication)
Yanhu Mo (Beijing University of Posts and Telecommunications)
Chuan Shi (Beijing University of Post and Telecommunication, Tsinghua University)
Jian Tang (Mila)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors