Timezone: »

4D Unsupervised Object Discovery
Yuqi Wang · Yuntao Chen · ZHAO-XIANG ZHANG

Thu Dec 08 05:00 PM -- 07:00 PM (PST) @

Object discovery is a core task in computer vision. While fast progresses have been made in supervised object detection, its unsupervised counterpart remains largely unexplored. With the growth of data volume, the expensive cost of annotations is the major limitation hindering further study. Therefore, discovering objects without annotations has great significance. However, this task seems impractical on still-image or point cloud alone due to the lack of discriminative information. Previous studies underlook the crucial temporal information and constraints naturally behind multi-modal inputs. In this paper, we propose 4D unsupervised object discovery, jointly discovering objects from 4D data -- 3D point clouds and 2D RGB images with temporal information. We present the first practical approach for this task by proposing a ClusterNet on 3D point clouds, which is jointly iteratively optimized with a 2D localization network. Extensive experiments on the large-scale Waymo Open Dataset suggest that the localization network and ClusterNet achieve competitive performance on both class-agnostic 2D object detection and 3D instance segmentation, bridging the gap between unsupervised methods and full supervised ones. Codes and models will be made available at https://github.com/Robertwyq/LSMOL.

Author Information

Yuqi Wang (Institute of automation, Chinese academy of science, Chinese Academy of Sciences)
Yuntao Chen (Centre for Artificial Intelligence and Robotics, HKISI, CAS)
ZHAO-XIANG ZHANG (Chinese Academy of Sciences, China)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors

  • 2022 Poster: Fully Sparse 3D Object Detection »
    Lue Fan · Feng Wang · Naiyan Wang · ZHAO-XIANG ZHANG
  • 2022 Spotlight: Lightning Talks 6A-3 »
    Junyu Xie · Chengliang Zhong · Ali Ayub · Sravanti Addepalli · Harsh Rangwani · Jiapeng Tang · Yuchen Rao · Zhiying Jiang · Yuqi Wang · Xingzhe He · Gene Chou · Ilya Chugunov · Samyak Jain · Yuntao Chen · Weidi Xie · Sumukh K Aithal · Carter Fendley · Lev Markhasin · Yiqin Dai · Peixing You · Bastian Wandt · Yinyu Nie · Helge Rhodin · Felix Heide · Ji Xin · Angela Dai · Andrew Zisserman · Bi Wang · Xiaoxue Chen · Mayank Mishra · ZHAO-XIANG ZHANG · Venkatesh Babu R · Justus Thies · Ming Li · Hao Zhao · Venkatesh Babu R · Jimmy Lin · Fuchun Sun · Matthias Niessner · Guyue Zhou · Xiaodong Mu · Chuang Gan · Wenbing Huang
  • 2019 Poster: Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection »
    Junran Peng · Ming Sun · ZHAO-XIANG ZHANG · Tieniu Tan · Junjie Yan