Timezone: »
From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with integrated attribute localization ability would be beneficial for zero-shot learning. To this end, we propose a novel zero-shot representation learning framework that jointly learns discriminative global and local features using only class-level attributes. While a visual-semantic embedding layer learns global features, local features are learned through an attribute prototype network that simultaneously regresses and decorrelates attributes from intermediate features. We show that our locality augmented image representations achieve a new state-of-the-art on three zero-shot learning benchmarks. As an additional benefit, our model points to the visual evidence of the attributes in an image, e.g. for the CUB dataset, confirming the improved attribute localization ability of our image representation.
Author Information
Wenjia Xu (University of Chinese Academy of Sciences)
Yongqin Xian (Max Planck Institute Informatics)
Jiuniu Wang (City University of Hong Kong)
Bernt Schiele (Max Planck Institute for Informatics)
Zeynep Akata (University of Tübingen)
More from the Same Authors
-
2020 : Paper 21: Haar Wavelet based Block Autoregressive Flows for Trajectories »
Apratim Bhattacharyya · Christoph-Nikolas Straehle · Mario Fritz · Bernt Schiele -
2022 : PlanT: Explainable Planning Transformers via Object-Level Representations »
Katrin Renz · Kashyap Chitta · Otniel-Bogdan Mercea · A. Sophia Koepke · Zeynep Akata · Andreas Geiger -
2022 : Momentum-based Weight Interpolation of Strong Zero-Shot Models for Continual Learning »
Zafir Stojanovski · Karsten Roth · Zeynep Akata -
2022 : Momentum-based Weight Interpolation of Strong Zero-Shot Models for Continual Learning »
Zafir Stojanovski · Karsten Roth · Zeynep Akata -
2022 Spotlight: Lightning Talks 6A-4 »
Xiu-Shen Wei · Konstantina Dritsa · Guillaume Huguet · ABHRA CHAUDHURI · Zhenbin Wang · Kevin Qinghong Lin · Yutong Chen · Jianan Zhou · Yongsen Mao · Junwei Liang · Jinpeng Wang · Mao Ye · Yiming Zhang · Aikaterini Thoma · H.-Y. Xu · Daniel Sumner Magruder · Enwei Zhang · Jianing Zhu · Ronglai Zuo · Massimiliano Mancini · Hanxiao Jiang · Jun Zhang · Fangyun Wei · Faen Zhang · Ioannis Pavlopoulos · Zeynep Akata · Xiatian Zhu · Jingfeng ZHANG · Alexander Tong · Mattia Soldan · Chunhua Shen · Yuxin Peng · Liuhan Peng · Michael Wray · Tongliang Liu · Anjan Dutta · Yu Wu · Oluwadamilola Fasina · Panos Louridas · Angel Chang · Manik Kuchroo · Manolis Savva · Shujie LIU · Wei Zhou · Rui Yan · Gang Niu · Liang Tian · Bo Han · Eric Z. XU · Guy Wolf · Yingying Zhu · Brian Mak · Difei Gao · Masashi Sugiyama · Smita Krishnaswamy · Rong-Cheng Tu · Wenzhe Zhao · Weijie Kong · Chengfei Cai · WANG HongFa · Dima Damen · Bernard Ghanem · Wei Liu · Mike Zheng Shou -
2022 Spotlight: Relational Proxies: Emergent Relationships as Fine-Grained Discriminators »
ABHRA CHAUDHURI · Massimiliano Mancini · Zeynep Akata · Anjan Dutta -
2022 Poster: Motion Transformer with Global Intention Localization and Local Movement Refinement »
Shaoshuai Shi · Li Jiang · Dengxin Dai · Bernt Schiele -
2022 Poster: Assaying Out-Of-Distribution Generalization in Transfer Learning »
Florian Wenzel · Andrea Dittadi · Peter Gehler · Carl-Johann Simon-Gabriel · Max Horn · Dominik Zietlow · David Kernert · Chris Russell · Thomas Brox · Bernt Schiele · Bernhard Schölkopf · Francesco Locatello -
2022 Poster: Relational Proxies: Emergent Relationships as Fine-Grained Discriminators »
ABHRA CHAUDHURI · Massimiliano Mancini · Zeynep Akata · Anjan Dutta -
2022 Poster: USB: A Unified Semi-supervised Learning Benchmark for Classification »
Yidong Wang · Hao Chen · Yue Fan · Wang SUN · Ran Tao · Wenxin Hou · Renjie Wang · Linyi Yang · Zhi Zhou · Lan-Zhe Guo · Heli Qi · Zhen Wu · Yu-Feng Li · Satoshi Nakamura · Wei Ye · Marios Savvides · Bhiksha Raj · Takahiro Shinozaki · Bernt Schiele · Jindong Wang · Xing Xie · Yue Zhang -
2021 Workshop: ImageNet: Past, Present, and Future »
Zeynep Akata · Lucas Beyer · Sanghyuk Chun · A. Sophia Koepke · Diane Larlus · Seong Joon Oh · Rafael Rezende · Sangdoo Yun · Xiaohua Zhai -
2021 Poster: RMM: Reinforced Memory Management for Class-Incremental Learning »
Yaoyao Liu · Bernt Schiele · Qianru Sun -
2020 Poster: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2020 Oral: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2019 Poster: Learning to Self-Train for Semi-Supervised Few-Shot Classification »
Xinzhe Li · Qianru Sun · Yaoyao Liu · Qin Zhou · Shibao Zheng · Tat-Seng Chua · Bernt Schiele -
2018 Poster: Adversarial Scene Editing: Automatic Object Removal from Weak Supervision »
Rakshith R Shetty · Mario Fritz · Bernt Schiele -
2017 Poster: Pose Guided Person Image Generation »
Liqian Ma · Xu Jia · Qianru Sun · Bernt Schiele · Tinne Tuytelaars · Luc Van Gool -
2016 Poster: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2016 Oral: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2015 Poster: Efficient Output Kernel Learning for Multiple Tasks »
Pratik Kumar Jawanpuria · Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Poster: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Spotlight: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2013 Poster: Transfer Learning in a Transductive Setting »
Marcus Rohrbach · Sandra Ebert · Bernt Schiele