Timezone: »
Revisiting Robustness in Graph Machine Learning
Lukas Gosch · Daniel Sturm · Simon Geisler · Stephan Günnemann
Event URL: https://openreview.net/forum?id=lxFHe7CnRY »
Many works show that node-level predictions of Graph Neural Networks (GNNs) are unrobust to small, often termed adversarial, changes to the graph structure. However, because manual inspection of a graph is difficult, it is unclear if the studied perturbations always preserve a core assumption of adversarial examples: that of unchanged semantic content. To address this problem, we introduce a more principled notion of an adversarial graph, which is aware of semantic content change. Using Contextual Stochastic Block Models (CSBMs) and real-world graphs, our results uncover: $i)$ for a majority of nodes the prevalent perturbation models include a large fraction of perturbed graphs violating the unchanged semantics assumption; $ii)$ surprisingly, all assessed GNNs show over-robustness - that is robustness beyond the point of semantic change. We find this to be a complementary phenomenon to adversarial robustness related to the small degree of nodes and their class membership dependence on the neighbourhood structure.
Many works show that node-level predictions of Graph Neural Networks (GNNs) are unrobust to small, often termed adversarial, changes to the graph structure. However, because manual inspection of a graph is difficult, it is unclear if the studied perturbations always preserve a core assumption of adversarial examples: that of unchanged semantic content. To address this problem, we introduce a more principled notion of an adversarial graph, which is aware of semantic content change. Using Contextual Stochastic Block Models (CSBMs) and real-world graphs, our results uncover: $i)$ for a majority of nodes the prevalent perturbation models include a large fraction of perturbed graphs violating the unchanged semantics assumption; $ii)$ surprisingly, all assessed GNNs show over-robustness - that is robustness beyond the point of semantic change. We find this to be a complementary phenomenon to adversarial robustness related to the small degree of nodes and their class membership dependence on the neighbourhood structure.
Author Information
Lukas Gosch (Technical University of Munich)
Daniel Sturm (Technische Universität München)
Simon Geisler (Technical University of Munich)
Stephan Günnemann (Technical University of Munich)
More from the Same Authors
-
2021 : Whole Brain Vessel Graphs: A Dataset and Benchmark for Graph Learning and Neuroscience »
Johannes C. Paetzold · Julian McGinnis · Suprosanna Shit · Ivan Ezhov · Paul Büschl · Chinmay Prabhakar · Anjany Sekuboyina · Mihail Todorov · Georgios Kaissis · Ali Ertürk · Stephan Günnemann · Bjoern Menze -
2021 : 3D Pre-training improves GNNs for Molecular Property Prediction »
Hannes Stärk · Dominique Beaini · Gabriele Corso · Prudencio Tossou · Christian Dallago · Stephan Günnemann · Pietro Lió -
2021 : 3D Pre-training improves GNNs for Molecular Property Prediction »
Hannes Stärk · Gabriele Corso · Christian Dallago · Stephan Günnemann · Pietro Lió -
2022 : torchode: A Parallel ODE Solver for PyTorch »
Marten Lienen · Stephan Günnemann -
2022 : Modeling Temporal Data as Continuous Functions with Process Diffusion »
Marin Biloš · Kashif Rasul · Anderson Schneider · Yuriy Nevmyvaka · Stephan Günnemann -
2022 : Training Differentially Private Graph Neural Networks with Random Walk Sampling »
Morgane Ayle · Jan Schuchardt · Lukas Gosch · Daniel Zügner · Stephan Günnemann -
2022 : Revisiting Robustness in Graph Machine Learning »
Lukas Gosch · Daniel Sturm · Simon Geisler · Stephan Günnemann -
2022 : Contributed Talk: Revisiting Robustness in Graph Machine Learning »
Lukas Gosch · Daniel Sturm · Simon Geisler · Stephan Günnemann -
2022 Poster: Are Defenses for Graph Neural Networks Robust? »
Felix Mujkanovic · Simon Geisler · Stephan Günnemann · Aleksandar Bojchevski -
2022 Poster: Invariance-Aware Randomized Smoothing Certificates »
Jan Schuchardt · Stephan Günnemann -
2022 Poster: Predicting Cellular Responses to Novel Drug Perturbations at a Single-Cell Resolution »
Leon Hetzel · Simon Boehm · Niki Kilbertus · Stephan Günnemann · mohammad lotfollahi · Fabian Theis -
2022 Poster: Randomized Message-Interception Smoothing: Gray-box Certificates for Graph Neural Networks »
Yan Scholten · Jan Schuchardt · Simon Geisler · Aleksandar Bojchevski · Stephan Günnemann -
2021 Poster: Robustness of Graph Neural Networks at Scale »
Simon Geisler · Tobias Schmidt · Hakan Şirin · Daniel Zügner · Aleksandar Bojchevski · Stephan Günnemann -
2021 Poster: Directional Message Passing on Molecular Graphs via Synthetic Coordinates »
Johannes Gasteiger · Chandan Yeshwanth · Stephan Günnemann -
2021 Poster: Neural Flows: Efficient Alternative to Neural ODEs »
Marin Biloš · Johanna Sommer · Syama Sundar Rangapuram · Tim Januschowski · Stephan Günnemann -
2021 Poster: Detecting Anomalous Event Sequences with Temporal Point Processes »
Oleksandr Shchur · Ali Caner Turkmen · Tim Januschowski · Jan Gasthaus · Stephan Günnemann -
2021 Poster: GemNet: Universal Directional Graph Neural Networks for Molecules »
Johannes Gasteiger · Florian Becker · Stephan Günnemann -
2021 Poster: Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification »
Maximilian Stadler · Bertrand Charpentier · Simon Geisler · Daniel Zügner · Stephan Günnemann -
2020 Poster: Fast and Flexible Temporal Point Processes with Triangular Maps »
Oleksandr Shchur · Nicholas Gao · Marin Biloš · Stephan Günnemann -
2020 Poster: Deep Rao-Blackwellised Particle Filters for Time Series Forecasting »
Richard Kurle · Syama Sundar Rangapuram · Emmanuel de Bézenac · Stephan Günnemann · Jan Gasthaus -
2020 Poster: Reliable Graph Neural Networks via Robust Aggregation »
Simon Geisler · Daniel Zügner · Stephan Günnemann -
2020 Oral: Fast and Flexible Temporal Point Processes with Triangular Maps »
Oleksandr Shchur · Nicholas Gao · Marin Biloš · Stephan Günnemann -
2020 Poster: Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Counts »
Bertrand Charpentier · Daniel Zügner · Stephan Günnemann -
2019 Poster: Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift »
Stephan Rabanser · Stephan Günnemann · Zachary Lipton -
2019 Poster: Diffusion Improves Graph Learning »
Johannes Gasteiger · Stefan Weißenberger · Stephan Günnemann -
2019 Poster: Uncertainty on Asynchronous Time Event Prediction »
Marin Biloš · Bertrand Charpentier · Stephan Günnemann -
2019 Spotlight: Uncertainty on Asynchronous Time Event Prediction »
Marin Biloš · Bertrand Charpentier · Stephan Günnemann -
2019 Poster: Certifiable Robustness to Graph Perturbations »
Aleksandar Bojchevski · Stephan Günnemann