Timezone: »
Novel class discovery (NCD) is to infer novel categories in an unlabeled set using prior knowledge of a labeled set comprising diverse but related classes. Existing research focuses on using the labeled set methodologically and little on analyzing it. In this study, we closer look at NCD from the labeled set and focus on two questions: (i) Given an unlabeled set, \textit{what labeled set best supports novel class discovery?} (ii) A fundamental premise of NCD is that the labeled set must be related to the unlabeled set, but \textit{how can we measure this relation?} For (i), we propose and substantiate the hypothesis that NCD could benefit from a labeled set with high semantic similarity to the unlabeled set. Using ImageNet's hierarchical class structure, we create a large-scale benchmark with variable semantic similarity across labeled/unlabeled datasets. In contrast, existing NCD benchmarks ignore the semantic relation. For (ii), we introduce a mathematical definition for quantifying the semantic similarity between labeled and unlabeled sets. We utilize this metric to validate our established benchmark and demonstrate it highly corresponds with NCD performance. Furthermore, without quantitative analysis, previous works commonly believe that label information is always beneficial. However, counterintuitively, our experimental results show that using labels may lead to sub-optimal outcomes in low-similarity settings.
Author Information
ZIYUN LI (Hasso Plattner Institut)
Jona Otholt (Hasso Plattner Institute)
Ben Dai (The Chinese University of Hong Kong)
Di Hu (Renmin University of China)
Christoph Meinel (Hasso Plattner Institute)
Haojin Yang (Hasso-Plattner-Institut für Digital Engineering gGmbH)
More from the Same Authors
-
2022 : Not All Knowledge Is Created Equal: Mutual Distillation of Confident Knowledge »
ZIYUN LI · Xinshao Wang · Christoph Meinel · Neil Robertson · David Clifton · Haojin Yang -
2020 Poster: Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching »
Di Hu · Rui Qian · Minyue Jiang · Xiao Tan · Shilei Wen · Errui Ding · Weiyao Lin · Dejing Dou