Timezone: »
In this work, we move beyond the traditional complex-valued representations, introducing more expressive hypercomplex representations to model entities and relations for knowledge graph embeddings. More specifically, quaternion embeddings, hypercomplex-valued embeddings with three imaginary components, are utilized to represent entities. Relations are modelled as rotations in the quaternion space. The advantages of the proposed approach are: (1) Latent inter-dependencies (between all components) are aptly captured with Hamilton product, encouraging a more compact interaction between entities and relations; (2) Quaternions enable expressive rotation in four-dimensional space and have more degree of freedom than rotation in complex plane; (3) The proposed framework is a generalization of ComplEx on hypercomplex space while offering better geometrical interpretations, concurrently satisfying the key desiderata of relational representation learning (i.e., modeling symmetry, anti-symmetry and inversion). Experimental results demonstrate that our method achieves state-of-the-art performance on four well-established knowledge graph completion benchmarks.
Author Information
SHUAI ZHANG (University of New South Wales)
Yi Tay (NTU, Singapore)
Lina Yao (University of New South Wales)
Qi Liu (Facebook AI Research)
More from the Same Authors
-
2021 Poster: Self-Instantiated Recurrent Units with Dynamic Soft Recursion »
Aston Zhang · Yi Tay · Yikang Shen · Alvin Chan · SHUAI ZHANG -
2020 Poster: Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting »
LEI BAI · Lina Yao · Can Li · Xianzhi Wang · Can Wang -
2019 Poster: Compositional De-Attention Networks »
Yi Tay · Anh Tuan Luu · Aston Zhang · Shuohang Wang · Siu Cheung Hui -
2018 : Coffee Break 1 (Posters) »
Ananya Kumar · Siyu Huang · Huazhe Xu · Michael Janner · Parth Chadha · Nils Thuerey · Peter Lu · Maria Bauza · Anthony Tompkins · Guanya Shi · Thomas Baumeister · André Ofner · Zhi-Qi Cheng · Yuping Luo · Deepika Bablani · Jeroen Vanbaar · Kartic Subr · Tatiana López-Guevara · Devesh Jha · Fabian Fuchs · Stefano Rosa · Alison Pouplin · Alex Ray · Qi Liu · Eric Crawford -
2018 Poster: Constrained Graph Variational Autoencoders for Molecule Design »
Qi Liu · Miltiadis Allamanis · Marc Brockschmidt · Alexander Gaunt -
2018 Poster: Densely Connected Attention Propagation for Reading Comprehension »
Yi Tay · Anh Tuan Luu · Siu Cheung Hui · Jian Su -
2018 Poster: Recurrently Controlled Recurrent Networks »
Yi Tay · Anh Tuan Luu · Siu Cheung Hui