Timezone: »
Unsupervised pretraining methods for object detection aim to learn object discrimination and localization ability from large amounts of images. Typically, recent works design pretext tasks that supervise the detector to predict the defined object priors. They normally leverage heuristic methods to produce object priors, \emph{e.g.,} selective search, which separates the prior generation and detector learning and leads to sub-optimal solutions. In this work, we propose a novel object detection pretraining framework that could generate object priors and learn detectors jointly by generating accurate object priors from the model itself. Specifically, region priors are extracted by attention maps from the encoder, which highlights foregrounds. Instance priors are the selected high-quality output bounding boxes of the detection decoder. By assuming objects as instances in the foreground, we can generate object priors with both region and instance priors. Moreover, our object priors are jointly refined along with the detector optimization. With better object priors as supervision, the model could achieve better detection capability, which in turn promotes the object priors generation. Our method improves the competitive approaches by \textbf{+1.3 AP}, \textbf{+1.7 AP} in 1\% and 10\% COCO low-data regimes object detection.
Author Information
Yizhou Wang (Zhejiang University)
Meilin Chen (Zhejiang University)
SHIXIANG TANG (University of Sydney)
Feng Zhu (SenseTime Research)
Haiyang Yang (Nanjing University)
LEI BAI (UNSW, Sydney)
Rui Zhao (Qing Yuan Research Institute, Shanghai Jiao Tong University)
Yunfeng Yan (Zhejiang University)
Donglian Qi (Zhejiang University)
Wanli Ouyang (University of Sydney)
More from the Same Authors
-
2022 Poster: Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing »
Peng Ye · Shengji Tang · Baopu Li · Tao Chen · Wanli Ouyang -
2022 Poster: Learning from Future: A Novel Self-Training Framework for Semantic Segmentation »
Ye Du · Yujun Shen · Haochen Wang · Jingjing Fei · Wei Li · Liwei Wu · Rui Zhao · Zehua Fu · Qingjie LIU -
2022 Poster: Obj2Seq: Formatting Objects as Sequences with Class Prompt for Visual Tasks »
Zhiyang Chen · Yousong Zhu · Zhaowen Li · Fan Yang · Wei Li · Haixin Wang · Chaoyang Zhao · Liwei Wu · Rui Zhao · Jinqiao Wang · Ming Tang -
2023 Poster: CluB: Cluster Meets BEV for LiDAR-Based 3D Object Detection »
Yingjie Wang · Jiajun Deng · Yuenan Hou · Yao Li · Yu Zhang · Jianmin Ji · Wanli Ouyang · Yanyong Zhang -
2023 Poster: Learning to Parameterize Visual Attributes for Open-set Fine-grained Retrieval »
Shijie Wang · Jianlong Chang · Haojie Li · Zhihui Wang · Wanli Ouyang · Qi Tian -
2023 Poster: Exposing the Troublemakers in Described Object Detection »
Chi Xie · Zhao Zhang · Yixuan Wu · Feng Zhu · Rui Zhao · Shuang Liang -
2023 Poster: LargeST: A Benchmark Dataset for Large-Scale Traffic Forecasting »
Xu Liu · Yutong Xia · Yuxuan Liang · Junfeng Hu · Yiwei Wang · LEI BAI · Chao Huang · Zhenguang Liu · Bryan Hooi · Roger Zimmermann -
2023 Poster: LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark »
Zhenfei Yin · Jiong WANG · Jianjian Cao · Zhelun Shi · Dingning Liu · Mukai Li · Lu Sheng · Xiaoshui Huang · LEI BAI · Zhiyong Wang · Wanli Ouyang · Jing Shao -
2023 Poster: Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images »
Zeyu Lu · Di Huang · LEI BAI · Jingjing Qu · Chengyue Wu · Xihui Liu · Wanli Ouyang -
2022 Spotlight: Lightning Talks 5A-4 »
Yangrui Chen · Zhiyang Chen · Liang Zhang · Hanqing Wang · Jiaqi Han · Shuchen Wu · shaohui peng · Ganqu Cui · Yoav Kolumbus · Noemi Elteto · Xing Hu · Anwen Hu · Wei Liang · Cong Xie · Lifan Yuan · Noam Nisan · Wenbing Huang · Yousong Zhu · Ishita Dasgupta · Luc V Gool · Tingyang Xu · Rui Zhang · Qin Jin · Zhaowen Li · Meng Ma · Bingxiang He · Yangyi Chen · Juncheng Gu · Wenguan Wang · Ke Tang · Yu Rong · Eric Schulz · Fan Yang · Wei Li · Zhiyuan Liu · Jiaming Guo · Yanghua Peng · Haibin Lin · Haixin Wang · Qi Yi · Maosong Sun · Ruizhi Chen · Chuan Wu · Chaoyang Zhao · Yibo Zhu · Liwei Wu · xishan zhang · Zidong Du · Rui Zhao · Jinqiao Wang · Ling Li · Qi Guo · Ming Tang · Yunji Chen -
2022 Spotlight: Obj2Seq: Formatting Objects as Sequences with Class Prompt for Visual Tasks »
Zhiyang Chen · Yousong Zhu · Zhaowen Li · Fan Yang · Wei Li · Haixin Wang · Chaoyang Zhao · Liwei Wu · Rui Zhao · Jinqiao Wang · Ming Tang -
2022 Spotlight: Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing »
Peng Ye · Shengji Tang · Baopu Li · Tao Chen · Wanli Ouyang -
2021 Poster: MST: Masked Self-Supervised Transformer for Visual Representation »
Zhaowen Li · Zhiyang Chen · Fan Yang · Wei Li · Yousong Zhu · Chaoyang Zhao · Rui Deng · Liwei Wu · Rui Zhao · Ming Tang · Jinqiao Wang -
2020 Poster: Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting »
LEI BAI · Lina Yao · Can Li · Xianzhi Wang · Can Wang -
2020 Poster: Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID »
Yixiao Ge · Feng Zhu · Dapeng Chen · Rui Zhao · Hongsheng Li