Timezone: »
Prevailing methods for graphs require abundant label and edge information for learning. When data for a new task are scarce, meta-learning can learn from prior experiences and form much-needed inductive biases for fast adaption to new tasks. Here, we introduce G-Meta, a novel meta-learning algorithm for graphs. G-Meta uses local subgraphs to transfer subgraph-specific information and learn transferable knowledge faster via meta gradients. G-Meta learns how to quickly adapt to a new task using only a handful of nodes or edges in the new task and does so by learning from data points in other graphs or related, albeit disjoint, label sets. G-Meta is theoretically justified as we show that the evidence for a prediction can be found in the local subgraph surrounding the target node or edge. Experiments on seven datasets and nine baseline methods show that G-Meta outperforms existing methods by up to 16.3%. Unlike previous methods, G-Meta successfully learns in challenging, few-shot learning settings that require generalization to completely new graphs and never-before-seen labels. Finally, G-Meta scales to large graphs, which we demonstrate on a new Tree-of-Life dataset comprising 1,840 graphs, a two-orders of magnitude increase in the number of graphs used in prior work.
Author Information
Kexin Huang (Harvard University)
Marinka Zitnik (Harvard University)
More from the Same Authors
-
2022 : Structure-Inducing Pre-training »
Matthew McDermott · Brendan Yap · Peter Szolovits · Marinka Zitnik -
2023 : Mapping the intermolecular interaction universe through self-supervised learning on molecular crystals »
Ada Fang · Ada Fang · ZAIXI ZHANG · Marinka Zitnik · Marinka Zitnik -
2023 : Keynote: Marinka Zitnik »
Marinka Zitnik -
2023 Workshop: AI for Science: from Theory to Practice »
Yuanqi Du · Max Welling · Yoshua Bengio · Marinka Zitnik · Carla Gomes · Jure Leskovec · Maria Brbic · Wenhao Gao · Kexin Huang · Ziming Liu · RocĂo Mercado · Miles Cranmer · Shengchao Liu · Lijing Wang -
2023 Poster: Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency »
Owen Queen · Tom Hartvigsen · Teddy Koker · Huan He · Theodoros Tsiligkaridis · Marinka Zitnik -
2023 Poster: Full-Atom Protein Pocket Design via Iterative Refinement »
ZAIXI ZHANG · Zepu Lu · Hao Zhongkai · Marinka Zitnik · Qi Liu -
2022 : Keynote »
Marinka Zitnik -
2022 Workshop: New Frontiers in Graph Learning »
Jiaxuan You · Marinka Zitnik · Rex Ying · Yizhou Sun · Hanjun Dai · Stefanie Jegelka -
2022 Workshop: AI for Science: Progress and Promises »
Yi Ding · Yuanqi Du · Tianfan Fu · Hanchen Wang · Anima Anandkumar · Yoshua Bengio · Anthony Gitter · Carla Gomes · Aviv Regev · Max Welling · Marinka Zitnik -
2022 Poster: OpenXAI: Towards a Transparent Evaluation of Model Explanations »
Chirag Agarwal · Satyapriya Krishna · Eshika Saxena · Martin Pawelczyk · Nari Johnson · Isha Puri · Marinka Zitnik · Himabindu Lakkaraju -
2022 Poster: Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency »
Xiang Zhang · Ziyuan Zhao · Theodoros Tsiligkaridis · Marinka Zitnik -
2021 Workshop: AI for Science: Mind the Gaps »
Payal Chandak · Yuanqi Du · Tianfan Fu · Wenhao Gao · Kexin Huang · Shengchao Liu · Ziming Liu · Gabriel Spadon · Max Tegmark · Hanchen Wang · Adrian Weller · Max Welling · Marinka Zitnik -
2020 Poster: Open Graph Benchmark: Datasets for Machine Learning on Graphs »
Weihua Hu · Matthias Fey · Marinka Zitnik · Yuxiao Dong · Hongyu Ren · Bowen Liu · Michele Catasta · Jure Leskovec -
2020 Spotlight: Open Graph Benchmark: Datasets for Machine Learning on Graphs »
Weihua Hu · Matthias Fey · Marinka Zitnik · Yuxiao Dong · Hongyu Ren · Bowen Liu · Michele Catasta · Jure Leskovec -
2020 Poster: GNNGuard: Defending Graph Neural Networks against Adversarial Attacks »
Xiang Zhang · Marinka Zitnik -
2020 Poster: Subgraph Neural Networks »
Emily Alsentzer · Samuel Finlayson · Michelle Li · Marinka Zitnik -
2020 Demonstration: MolDesigner: Interactive Design of Efficacious Drugs with Deep Learning »
Kexin Huang · Tianfan Fu · Dawood Khan · Ali Abid · Ali Abdalla · Abubaker Abid · Lucas Glass · Marinka Zitnik · Cao Xiao · Jimeng Sun