Timezone: »
Graph Neural Networks (GNNs) often suffer from weak-generalization due to sparsely labeled data despite their promising results on various graph-based tasks. Data augmentation is a prevalent remedy to improve the generalization ability of models in many domains. However, due to the non-Euclidean nature of data space and the dependencies between samples, designing effective augmentation on graphs is challenging. In this paper, we propose a novel framework Metropolis-Hastings Data Augmentation (MH-Aug) that draws augmented graphs from an explicit target distribution for semi-supervised learning. MH-Aug produces a sequence of augmented graphs from the target distribution enables flexible control of the strength and diversity of augmentation. Since the direct sampling from the complex target distribution is challenging, we adopt the Metropolis-Hastings algorithm to obtain the augmented samples. We also propose a simple and effective semi-supervised learning strategy with generated samples from MH-Aug. Our extensive experiments demonstrate that MH-Aug can generate a sequence of samples according to the target distribution to significantly improve the performance of GNNs.
Author Information
Hyeonjin Park (Korea University)
Seunghun Lee (Korea University)
Sihyeon Kim (Korea University)
Jinyoung Park (Korea University)
Jisu Jeong (Korea Advanced Institute of Science and Technology)
Kyung-Min Kim (NAVER)
Jung-Woo Ha (NAVER CLOVA AI Lab)
Hyunwoo Kim (Korea University)
More from the Same Authors
-
2021 : KLUE: Korean Language Understanding Evaluation »
Sungjoon Park · Jihyung Moon · Sungdong Kim · Won Ik Cho · Ji Yoon Han · Jangwon Park · Chisung Song · Junseong Kim · Youngsook Song · Taehwan Oh · Joohong Lee · Juhyun Oh · Sungwon Lyu · Younghoon Jeong · Inkwon Lee · Sangwoo Seo · Dongjun Lee · Hyunwoo Kim · Myeonghwa Lee · Seongbo Jang · Seungwon Do · Sunkyoung Kim · Kyungtae Lim · Jongwon Lee · Kyumin Park · Jamin Shin · Seonghyun Kim · Lucy Park · Alice Oh · Jung-Woo Ha · Kyunghyun Cho -
2022 : Fine-tuning Diffusion Models with Limited Data »
Taehong Moon · Moonseok Choi · Gayoung Lee · Jung-Woo Ha · Juho Lee -
2022 Poster: TokenMixup: Efficient Attention-guided Token-level Data Augmentation for Transformers »
Hyeong Kyu Choi · Joonmyung Choi · Hyunwoo Kim -
2022 Poster: Invertible Monotone Operators for Normalizing Flows »
Byeongkeun Ahn · Chiyoon Kim · Youngjoon Hong · Hyunwoo Kim -
2022 Poster: On Divergence Measures for Bayesian Pseudocoresets »
Balhae Kim · Jungwon Choi · Seanie Lee · Yoonho Lee · Jung-Woo Ha · Juho Lee -
2022 Poster: SageMix: Saliency-Guided Mixup for Point Clouds »
Sanghyeok Lee · Minkyu Jeon · Injae Kim · Yunyang Xiong · Hyunwoo Kim -
2021 Poster: Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Prediction »
Seongjun Yun · Seoyoon Kim · Junhyun Lee · Jaewoo Kang · Hyunwoo Kim -
2021 Social: ML in Korea »
Jung-Woo Ha -
2020 Poster: Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs »
Dasol Hwang · Jinyoung Park · Sunyoung Kwon · KyungMin Kim · Jung-Woo Ha · Hyunwoo Kim -
2020 Social: NeurIPS 2020 Social ML in Korea »
Jung-Woo Ha -
2019 Poster: Graph Transformer Networks »
Seongjun Yun · Minbyul Jeong · Raehyun Kim · Jaewoo Kang · Hyunwoo Kim -
2017 : Posters and Coffee »
Jean-Baptiste Tristan · Yunseong Lee · Anna Veronika Dorogush · Shohei Hido · Michael Terry · Mennatullah Siam · Hidemoto Nakada · Cody Coleman · Jung-Woo Ha · Hao Zhang · Adam Stooke · Chen Meng · Christopher Kappler · Lane Schwartz · Christopher Olston · Sebastian Schelter · Minmin Sun · Daniel Kang · Waldemar Hummer · Jichan Chung · Tim Kraska · Kannan Ramchandran · Nick Hynes · Christoph Boden · Donghyun Kwak -
2017 Spotlight: Maximizing Subset Accuracy with Recurrent Neural Networks in Multi-label Classification »
Jinseok Nam · Eneldo Loza Mencía · Hyunwoo J Kim · Johannes Fürnkranz -
2017 Poster: Overcoming Catastrophic Forgetting by Incremental Moment Matching »
Sang-Woo Lee · Jin-Hwa Kim · Jaehyun Jun · Jung-Woo Ha · Byoung-Tak Zhang -
2017 Poster: Maximizing Subset Accuracy with Recurrent Neural Networks in Multi-label Classification »
Jinseok Nam · Eneldo Loza Mencía · Hyunwoo J Kim · Johannes Fürnkranz -
2017 Spotlight: Overcoming Catastrophic Forgetting by Incremental Moment Matching »
Sang-Woo Lee · Jin-Hwa Kim · Jaehyun Jun · Jung-Woo Ha · Byoung-Tak Zhang