Timezone: »
The performance of many network learning applications crucially hinges on the success of network embedding algorithms, which aim to encode rich network information into low-dimensional vertex-based vector representations. This paper considers a novel variational formulation of network embeddings, with special focus on textual networks. Different from most existing methods that optimize a discriminative objective, we introduce Variational Homophilic Embedding (VHE), a fully generative model that learns network embeddings by modeling the semantic (textual) information with a variational autoencoder, while accounting for the structural (topology) information through a novel homophilic prior design. Homophilic vertex embeddings encourage similar embedding vectors for related (connected) vertices. The VHE encourages better generalization for downstream tasks, robustness to incomplete observations, and the ability to generalize to unseen vertices. Extensive experiments on real-world networks, for multiple tasks, demonstrate that the proposed method achieves consistently superior performance relative to competing state-of-the-art approaches.
Author Information
Wenlin Wang (Duke University)
Chenyang Tao (Duke University)
Zhe Gan (Microsoft)
Guoyin Wang (Duke University)
Liqun Chen (Duke University)
Xinyuan Zhang (Duke University)
Ruiyi Zhang (Duke University)
Qian Yang (Duke University)
Ricardo Henao (Duke University)
Lawrence Carin (Duke University)
More from the Same Authors
-
2021 Spotlight: Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer »
Junya Chen · Zidi Xiu · Benjamin Goldstein · Ricardo Henao · Lawrence Carin · Chenyang Tao -
2022 : CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks »
Sakshi Varshney · Vinay Verma · Srijith PK · Piyush Rai · Lawrence Carin -
2022 : A Framework for the Evaluation of Clinical Time Series Models »
Michael Gao · Jiayu Yao · Ricardo Henao -
2022 : A Framework for the Evaluation of Clinical Time Series Models »
Michael Gao · Jiayu Yao · Ricardo Henao -
2022 : Weakly Supervised Data Augmentation Through Prompting for Dialogue Understanding »
Maximillian Chen · Alexandros Papangelis · Chenyang Tao · Andy Rosenbaum · Seokhwan Kim · Yang Liu · Zhou Yu · Dilek Hakkani-Tur -
2022 Poster: Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization »
Qing Guo · Junya Chen · Dong Wang · Yuewei Yang · Xinwei Deng · Jing Huang · Larry Carin · Fan Li · Chenyang Tao -
2021 Poster: Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer »
Junya Chen · Zidi Xiu · Benjamin Goldstein · Ricardo Henao · Lawrence Carin · Chenyang Tao -
2021 Poster: CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks »
Sakshi Varshney · Vinay Kumar Verma · P. K. Srijith · Lawrence Carin · Piyush Rai -
2020 Poster: GAN Memory with No Forgetting »
Yulai Cong · Miaoyun Zhao · Jianqiao Li · Sijia Wang · Lawrence Carin -
2020 Poster: Reconsidering Generative Objectives For Counterfactual Reasoning »
Danni Lu · Chenyang Tao · Junya Chen · Fan Li · Feng Guo · Lawrence Carin -
2020 Poster: AutoSync: Learning to Synchronize for Data-Parallel Distributed Deep Learning »
Hao Zhang · Yuan Li · Zhijie Deng · Xiaodan Liang · Lawrence Carin · Eric Xing -
2020 Poster: Perturbing Across the Feature Hierarchy to Improve Standard and Strict Blackbox Attack Transferability »
Nathan Inkawhich · Kevin J Liang · Binghui Wang · Matthew Inkawhich · Lawrence Carin · Yiran Chen -
2020 Poster: Large-Scale Adversarial Training for Vision-and-Language Representation Learning »
Zhe Gan · Yen-Chun Chen · Linjie Li · Chen Zhu · Yu Cheng · Jingjing Liu -
2020 Spotlight: Large-Scale Adversarial Training for Vision-and-Language Representation Learning »
Zhe Gan · Yen-Chun Chen · Linjie Li · Chen Zhu · Yu Cheng · Jingjing Liu -
2020 Poster: Calibrating CNNs for Lifelong Learning »
Pravendra Singh · Vinay Kumar Verma · Pratik Mazumder · Lawrence Carin · Piyush Rai -
2019 : Poster Session »
Lili Yu · Aleksei Kroshnin · Alex Delalande · Andrew Carr · Anthony Tompkins · Aram-Alexandre Pooladian · Arnaud Robert · Ashok Vardhan Makkuva · Aude Genevay · Bangjie Liu · Bo Zeng · Charlie Frogner · Elsa Cazelles · Esteban G Tabak · Fabio Ramos · François-Pierre PATY · Georgios Balikas · Giulio Trigila · Hao Wang · Hinrich Mahler · Jared Nielsen · Karim Lounici · Kyle Swanson · Mukul Bhutani · Pierre Bréchet · Piotr Indyk · samuel cohen · Stefanie Jegelka · Tao Wu · Thibault Sejourne · Tudor Manole · Wenjun Zhao · Wenlin Wang · Wenqi Wang · Yonatan Dukler · Zihao Wang · Chaosheng Dong -
2019 : Poster Session #2 »
Yunzhu Li · Peter Meltzer · Jianing Sun · Guillaume SALHA · Marin Vlastelica Pogančić · Chia-Cheng Liu · Fabrizio Frasca · Marc-Alexandre Côté · Vikas Verma · Abdulkadir CELIKKANAT · Pierluca D'Oro · Priyesh Vijayan · Maria Schuld · Petar Veličković · Kshitij Tayal · Yulong Pei · Hao Xu · Lei Chen · Pengyu Cheng · Ines Chami · Dongkwan Kim · Guilherme Gomes · Lukasz Maziarka · Jessica Hoffmann · Ron Levie · Antonia Gogoglou · Shunwang Gong · Federico Monti · Wenlin Wang · Yan Leng · Salvatore Vivona · Daniel Flam-Shepherd · Chester Holtz · Li Zhang · MAHMOUD KHADEMI · I-Chung Hsieh · Aleksandar Stanić · Ziqiao Meng · Yuhang Jiao -
2019 Poster: Ouroboros: On Accelerating Training of Transformer-Based Language Models »
Qian Yang · Zhouyuan Huo · Wenlin Wang · Lawrence Carin -
2019 Poster: Scalable Gromov-Wasserstein Learning for Graph Partitioning and Matching »
Hongteng Xu · Dixin Luo · Lawrence Carin -
2019 Poster: Kernel-Based Approaches for Sequence Modeling: Connections to Neural Methods »
Kevin J Liang · Guoyin Wang · Yitong Li · Ricardo Henao · Lawrence Carin -
2019 Poster: Certified Adversarial Robustness with Additive Noise »
Bai Li · Changyou Chen · Wenlin Wang · Lawrence Carin -
2019 Poster: On Fenchel Mini-Max Learning »
Chenyang Tao · Liqun Chen · Shuyang Dai · Junya Chen · Ke Bai · Dong Wang · Jianfeng Feng · Wenlian Lu · Georgiy Bobashev · Lawrence Carin -
2018 Poster: Adversarial Text Generation via Feature-Mover's Distance »
Liqun Chen · Shuyang Dai · Chenyang Tao · Haichao Zhang · Zhe Gan · Dinghan Shen · Yizhe Zhang · Guoyin Wang · Dinghan Shen · Lawrence Carin -
2018 Poster: Distilled Wasserstein Learning for Word Embedding and Topic Modeling »
Hongteng Xu · Wenlin Wang · Wei Liu · Lawrence Carin -
2018 Poster: Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization »
Yizhe Zhang · Michel Galley · Jianfeng Gao · Zhe Gan · Xiujun Li · Chris Brockett · Bill Dolan -
2018 Poster: Diffusion Maps for Textual Network Embedding »
Xinyuan Zhang · Yitong Li · Dinghan Shen · Lawrence Carin -
2018 Spotlight: Diffusion Maps for Textual Network Embedding »
Xinyuan Zhang · Yitong Li · Dinghan Shen · Lawrence Carin -
2017 Spotlight: Targeting EEG/LFP Synchrony with Neural Nets »
Yitong Li · michael Murias · samantha Major · geraldine Dawson · Kafui Dzirasa · Lawrence Carin · David Carlson -
2017 Poster: Targeting EEG/LFP Synchrony with Neural Nets »
Yitong Li · michael Murias · samantha Major · geraldine Dawson · Kafui Dzirasa · Lawrence Carin · David Carlson -
2017 Poster: Triangle Generative Adversarial Networks »
Zhe Gan · Liqun Chen · Weiyao Wang · Yuchen Pu · Yizhe Zhang · Hao Liu · Chunyuan Li · Lawrence Carin -
2017 Poster: ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matching »
Chunyuan Li · Hao Liu · Changyou Chen · Yuchen Pu · Liqun Chen · Ricardo Henao · Lawrence Carin -
2017 Poster: An inner-loop free solution to inverse problems using deep neural networks »
Kai Fan · Qi Wei · Lawrence Carin · Katherine Heller -
2017 Poster: VAE Learning via Stein Variational Gradient Descent »
Yuchen Pu · Zhe Gan · Ricardo Henao · Chunyuan Li · Shaobo Han · Lawrence Carin -
2017 Poster: Deconvolutional Paragraph Representation Learning »
Yizhe Zhang · Dinghan Shen · Guoyin Wang · Zhe Gan · Ricardo Henao · Lawrence Carin -
2017 Poster: Adversarial Symmetric Variational Autoencoder »
Yuchen Pu · Weiyao Wang · Ricardo Henao · Liqun Chen · Zhe Gan · Chunyuan Li · Lawrence Carin -
2017 Poster: A Probabilistic Framework for Nonlinearities in Stochastic Neural Networks »
Qinliang Su · xuejun Liao · Lawrence Carin -
2017 Poster: Scalable Model Selection for Belief Networks »
Zhao Song · Yusuke Muraoka · Ryohei Fujimaki · Lawrence Carin -
2017 Poster: Cross-Spectral Factor Analysis »
Neil Gallagher · Kyle Ulrich · Austin Talbot · Kafui Dzirasa · Lawrence Carin · David Carlson -
2016 Poster: Towards Unifying Hamiltonian Monte Carlo and Slice Sampling »
Yizhe Zhang · Xiangyu Wang · Changyou Chen · Ricardo Henao · Kai Fan · Lawrence Carin -
2016 Poster: Variational Autoencoder for Deep Learning of Images, Labels and Captions »
Yunchen Pu · Zhe Gan · Ricardo Henao · Xin Yuan · Chunyuan Li · Andrew Stevens · Lawrence Carin -
2016 Poster: Linear Feature Encoding for Reinforcement Learning »
Zhao Song · Ronald Parr · Xuejun Liao · Lawrence Carin -
2016 Poster: Stochastic Gradient MCMC with Stale Gradients »
Changyou Chen · Nan Ding · Chunyuan Li · Yizhe Zhang · Lawrence Carin -
2015 Poster: GP Kernels for Cross-Spectrum Analysis »
Kyle R Ulrich · David Carlson · Kafui Dzirasa · Lawrence Carin -
2015 Poster: Deep Poisson Factor Modeling »
Ricardo Henao · Zhe Gan · James Lu · Lawrence Carin -
2015 Poster: Preconditioned Spectral Descent for Deep Learning »
David Carlson · Edo Collins · Ya-Ping Hsieh · Lawrence Carin · Volkan Cevher -
2015 Poster: Large-Scale Bayesian Multi-Label Learning via Topic-Based Label Embeddings »
Piyush Rai · Changwei Hu · Ricardo Henao · Lawrence Carin -
2015 Spotlight: Large-Scale Bayesian Multi-Label Learning via Topic-Based Label Embeddings »
Piyush Rai · Changwei Hu · Ricardo Henao · Lawrence Carin -
2015 Poster: On the Convergence of Stochastic Gradient MCMC Algorithms with High-Order Integrators »
Changyou Chen · Nan Ding · Lawrence Carin -
2015 Poster: Deep Temporal Sigmoid Belief Networks for Sequence Modeling »
Zhe Gan · Chunyuan Li · Ricardo Henao · David Carlson · Lawrence Carin -
2014 Poster: Analysis of Brain States from Multi-Region LFP Time-Series »
Kyle R Ulrich · David Carlson · Wenzhao Lian · Jana S Borg · Kafui Dzirasa · Lawrence Carin -
2014 Poster: Bayesian Nonlinear Support Vector Machines and Discriminative Factor Modeling »
Ricardo Henao · Xin Yuan · Lawrence Carin -
2014 Poster: Compressive Sensing of Signals from a GMM with Sparse Precision Matrices »
Jianbo Yang · Xuejun Liao · Minhua Chen · Lawrence Carin -
2014 Poster: On the relations of LFPs & Neural Spike Trains »
David Carlson · Jana Schaich Borg · Kafui Dzirasa · Lawrence Carin -
2014 Poster: Dynamic Rank Factor Model for Text Streams »
Shaobo Han · Lin Du · Esther Salazar · Lawrence Carin -
2013 Poster: Dynamic Clustering via Asymptotics of the Dependent Dirichlet Process Mixture »
Trevor Campbell · Miao Liu · Brian Kulis · Jonathan How · Lawrence Carin -
2013 Poster: Designed Measurements for Vector Count Data »
Liming Wang · David Carlson · Miguel Rodrigues · David Wilcox · Robert Calderbank · Lawrence Carin -
2013 Poster: Integrated Non-Factorized Variational Inference »
Shaobo Han · Xuejun Liao · Lawrence Carin -
2013 Poster: Real-Time Inference for a Gamma Process Model of Neural Spiking »
David Carlson · Vinayak Rao · Joshua T Vogelstein · Lawrence Carin -
2012 Workshop: Bayesian Nonparametric Models For Reliable Planning And Decision-Making Under Uncertainty »
Jonathan How · Lawrence Carin · John Fisher III · Michael Jordan · Alborz Geramifard -
2012 Poster: Joint Modeling of a Matrix with Associated Text via Latent Binary Features »
XianXing Zhang · Lawrence Carin -
2012 Poster: Augment-and-Conquer Negative Binomial Processes »
Mingyuan Zhou · Lawrence Carin -
2012 Spotlight: Augment-and-Conquer Negative Binomial Processes »
Mingyuan Zhou · Lawrence Carin -
2011 Poster: On the Analysis of Multi-Channel Neural Spike Data »
Bo Chen · David Carlson · Lawrence Carin -
2011 Poster: The Kernel Beta Process »
Lu Ren · Yingjian Wang · David B Dunson · Lawrence Carin -
2011 Spotlight: The Kernel Beta Process »
Lu Ren · Yingjian Wang · David B Dunson · Lawrence Carin -
2011 Poster: Hierarchical Topic Modeling for Analysis of Time-Evolving Personal Choices »
XianXing Zhang · David B Dunson · Lawrence Carin -
2010 Poster: Joint Analysis of Time-Evolving Binary Matrices and Associated Documents »
Eric X Wang · Dehong Liu · Jorge G Silva · David B Dunson · Lawrence Carin -
2009 Poster: A Bayesian Model for Simultaneous Image Clustering, Annotation and Object Segmentation »
Lan Du · Lu Ren · David B Dunson · Lawrence Carin -
2009 Poster: Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations »
Mingyuan Zhou · Haojun Chen · John Paisley · Lu Ren · Guillermo Sapiro · Lawrence Carin -
2009 Poster: Bayesian Sparse Factor Models and DAGs Inference and Comparison »
Ricardo Henao · Ole Winther -
2009 Poster: Learning to Explore and Exploit in POMDPs »
Chenghui Cai · Xuejun Liao · Lawrence Carin -
2008 Workshop: Cost Sensitive Learning »
Balaji R Krishnapuram · Shipeng Yu · Oksana Yakhnenko · R. Bharat Rao · Lawrence Carin -
2007 Poster: Semi-Supervised Multitask Learning »
Qiuhua Liu · Xuejun Liao · Lawrence Carin -
2007 Spotlight: Semi-Supervised Multitask Learning »
Qiuhua Liu · Xuejun Liao · Lawrence Carin