Timezone: »
We propose a geometric version of the Weisfeiler-Leman graph isomorphism test (GWL) for discriminating geometric graphs while respecting the underlying symmetries such as permutation, rotation, and translation.We use GWL to characterise the expressive power of Graph Neural Networks (GNNs) for geometric graphs and provide formal results for the following: (1) What geometric graphs can and cannot be distinguished by GNNs invariant or equivariant to spatial symmetries;(2) Equivariant GNNs are strictly more powerful than their invariant counterparts.
Author Information
Cristian Bodnar (University of Cambridge)
Chaitanya K. Joshi (University of Cambridge)
Simon Mathis (University of Cambridge)
Taco Cohen (Qualcomm AI Research)
Taco Cohen is a machine learning research scientist at Qualcomm AI Research in Amsterdam and a PhD student at the University of Amsterdam, supervised by prof. Max Welling. He was a co-founder of Scyfer, a company focussed on active deep learning, acquired by Qualcomm in 2017. He holds a BSc in theoretical computer science from Utrecht University and a MSc in artificial intelligence from the University of Amsterdam (both cum laude). His research is focussed on understanding and improving deep representation learning, in particular learning of equivariant and disentangled representations, data-efficient deep learning, learning on non-Euclidean domains, and applications of group representation theory and non-commutative harmonic analysis, as well as deep learning based source compression. He has done internships at Google Deepmind (working with Geoff Hinton) and OpenAI. He received the 2014 University of Amsterdam thesis prize, a Google PhD Fellowship, ICLR 2018 best paper award for “Spherical CNNs”, and was named one of 35 innovators under 35 in Europe by MIT in 2018.
Pietro Liò (University of Cambridge)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 : On the Expressive Power of Geometric Graph Neural Networks »
Sat. Dec 3rd 05:30 -- 05:35 PM Room
More from the Same Authors
-
2022 : Sheaf Attention Networks »
Federico Barbero · Cristian Bodnar · Haitz Sáez de Ocáriz Borde · Pietro Lió -
2022 : Surfing on the Neural Sheaf »
Julian Suk · Lorenzo Giusti · Tamir Hemo · Miguel Lopez · Marco La Vecchia · Konstantinos Barmpas · Cristian Bodnar -
2022 : Deconfounded Imitation Learning »
Risto Vuorio · Pim de Haan · Johann Brehmer · Hanno Ackermann · Daniel Dijkman · Taco Cohen -
2023 Poster: EDGI: Equivariant Diffusion for Planning with Embodied Agents »
Johann Brehmer · Joey Bose · Pim de Haan · Taco Cohen -
2023 Poster: Geometric Algebra Transformers »
Johann Brehmer · Pim de Haan · Sönke Behrends · Taco Cohen -
2022 Spotlight: Lightning Talks 2A-3 »
David Buterez · Chengan He · Xuan Kan · Yutong Lin · Konstantin Schürholt · Yu Yang · Louis Annabi · Wei Dai · Xiaotian Cheng · Alexandre Pitti · Ze Liu · Jon Paul Janet · Jun Saito · Boris Knyazev · Mathias Quoy · Zheng Zhang · James Zachary · Steven J Kiddle · Xavier Giro-i-Nieto · Chang Liu · Hejie Cui · Zilong Zhang · Hakan Bilen · Damian Borth · Dino Oglic · Holly Rushmeier · Han Hu · Xiangyang Ji · Yi Zhou · Nanning Zheng · Ying Guo · Pietro Liò · Stephen Lin · Carl Yang · Yue Cao -
2022 Spotlight: Graph Neural Networks with Adaptive Readouts »
David Buterez · Jon Paul Janet · Steven J Kiddle · Dino Oglic · Pietro Liò -
2022 : Panel Discussion I: Geometric and topological principles for representation learning in ML »
Irina Higgins · Taco Cohen · Erik Bekkers · Nina Miolane · Rose Yu -
2022 : Sheaf Attention Networks »
Federico Barbero · Cristian Bodnar · Haitz Sáez de Ocáriz Borde · Pietro Lió -
2022 : From Equivariance to Naturality »
Taco Cohen -
2022 Poster: A PAC-Bayesian Generalization Bound for Equivariant Networks »
Arash Behboodi · Gabriele Cesa · Taco Cohen -
2022 Poster: Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs »
Cristian Bodnar · Francesco Di Giovanni · Benjamin Chamberlain · Pietro Lió · Michael Bronstein -
2022 Poster: Graph Neural Networks with Adaptive Readouts »
David Buterez · Jon Paul Janet · Steven J Kiddle · Dino Oglic · Pietro Liò -
2022 Poster: Weakly supervised causal representation learning »
Johann Brehmer · Pim de Haan · Phillip Lippe · Taco Cohen -
2022 Poster: On the symmetries of the synchronization problem in Cryo-EM: Multi-Frequency Vector Diffusion Maps on the Projective Plane »
Gabriele Cesa · Arash Behboodi · Taco Cohen · Max Welling -
2021 : Learning Graph Search Heuristics »
Michal Pándy · Rex Ying · Gabriele Corso · Petar Veličković · Jure Leskovec · Pietro Liò -
2021 : Neural ODE Processes: A Short Summary »
Alexander Norcliffe · Cristian Bodnar · Ben Day · Jacob Moss · Pietro Lió -
2021 : On Second Order Behaviour in Augmented Neural ODEs: A Short Summary »
Alexander Norcliffe · Cristian Bodnar · Ben Day · Nikola Simidjievski · Pietro Lió -
2021 Poster: Neural Distance Embeddings for Biological Sequences »
Gabriele Corso · Zhitao Ying · Michal Pándy · Petar Veličković · Jure Leskovec · Pietro Liò -
2021 Poster: Weisfeiler and Lehman Go Cellular: CW Networks »
Cristian Bodnar · Fabrizio Frasca · Nina Otter · Yuguang Wang · Pietro Liò · Guido Montufar · Michael Bronstein -
2020 : Contributed Talk 4: Directional Graph Networks »
Dominique Beaini · Saro Passaro · Vincent Létourneau · Will Hamilton · Gabriele Corso · Pietro Liò -
2020 Poster: Natural Graph Networks »
Pim de Haan · Taco Cohen · Max Welling -
2020 Poster: On Second Order Behaviour in Augmented Neural ODEs »
Alexander Norcliffe · Cristian Bodnar · Ben Day · Nikola Simidjievski · Pietro Lió -
2020 Poster: Principal Neighbourhood Aggregation for Graph Nets »
Gabriele Corso · Luca Cavalleri · Dominique Beaini · Pietro Liò · Petar Veličković -
2020 Tutorial: (Track2) Equivariant Networks Q&A »
Risi Kondor · Taco Cohen -
2020 Tutorial: (Track2) Equivariant Networks »
Risi Kondor · Taco Cohen -
2019 : Poster Session #1 »
Adarsh Jamadandi · Sophia Sanborn · Huaxiu Yao · Chen Cai · Yu Chen · Jean-Marc Andreoli · Niklas Stoehr · Shih-Yang Su · Tony Duan · Fábio Ferreira · Davide Belli · Amit Boyarski · Ze Ye · Elahe Ghalebi · Arindam Sarkar · MAHMOUD KHADEMI · Evgeniy Faerman · Joey Bose · Jiaqi Ma · Lin Meng · Seyed Mehran Kazemi · Guangtao Wang · Tong Wu · Yuexin Wu · Chaitanya K. Joshi · Marc Brockschmidt · Daniele Zambon · Colin Graber · Rafaël Van Belle · Osman Asif Malik · Xavier Glorot · Mario Krenn · Chris Cameron · Binxuan Huang · George Stoica · Alexia Toumpa -
2019 Poster: A General Theory of Equivariant CNNs on Homogeneous Spaces »
Taco Cohen · Mario Geiger · Maurice Weiler -
2018 Poster: 3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data »
Maurice Weiler · Wouter Boomsma · Mario Geiger · Max Welling · Taco Cohen -
2017 : One Minute Poster Spotlight »
Tiancheng Zhao · Chandra khatri · Chaitanya K. Joshi · Maryam Fazel-Zarandi · Arpit Gupta · Shang-Wen Li · Amanda Cercas Curry · Behnam Hedayatnia · Li Zhou · Anushree Venkatesh · Fei Mi · Ming Cheng