Timezone: »
Poster
Pixels to Graphs by Associative Embedding
Alejandro Newell · Jia Deng
Graphs are a useful abstraction of image content. Not only can graphs represent details about individual objects in a scene but they can capture the interactions between pairs of objects. We present a method for training a convolutional neural network such that it takes in an input image and produces a full graph definition. This is done end-to-end in a single stage with the use of associative embeddings. The network learns to simultaneously identify all of the elements that make up a graph and piece them together. We benchmark on the Visual Genome dataset, and demonstrate state-of-the-art performance on the challenging task of scene graph generation.
Author Information
Alejandro Newell (University of Michigan)
Jia Deng (University of Michigan)
More from the Same Authors
-
2017 Poster: Premise Selection for Theorem Proving by Deep Graph Embedding »
Mingzhe Wang · Yihe Tang · Jian Wang · Jia Deng -
2017 Spotlight: Premise Selection for Theorem Proving by Deep Graph Embedding »
Mingzhe Wang · Yihe Tang · Jian Wang · Jia Deng -
2017 Poster: Associative Embedding: End-to-End Learning for Joint Detection and Grouping »
Alejandro Newell · Zhiao Huang · Jia Deng -
2016 Poster: Single-Image Depth Perception in the Wild »
Weifeng Chen · Zhao Fu · Dawei Yang · Jia Deng -
2014 Workshop: Representation and Learning Methods for Complex Outputs »
Richard Zemel · Dale Schuurmans · Kilian Q Weinberger · Yuhong Guo · Jia Deng · Francesco Dinuzzo · Hal Daumé III · Honglak Lee · Noah A Smith · Richard Sutton · Jiaqian YU · Vitaly Kuznetsov · Luke Vilnis · Hanchen Xiong · Calvin Murdock · Thomas Unterthiner · Jean-Francis Roy · Martin Renqiang Min · Hichem SAHBI · Fabio Massimo Zanzotto