`

Timezone: »

 
Spotlight
Part-dependent Label Noise: Towards Instance-dependent Label Noise
Xiaobo Xia · Tongliang Liu · Bo Han · Nannan Wang · Mingming Gong · Haifeng Liu · Gang Niu · Dacheng Tao · Masashi Sugiyama

Thu Dec 10 08:20 PM -- 08:30 PM (PST) @ Orals & Spotlights: Deep Learning
in Orals & Spotlights Track 34: Deep Learning »

Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive instances by decomposing them into parts. Annotators are therefore more likely to annotate instances based on the parts rather than the whole instances, where a wrong mapping from parts to classes may cause the instance-dependent label noise. Motivated by this human cognition, in this paper, we approximate the instance-dependent label noise by exploiting \textit{part-dependent} label noise. Specifically, since instances can be approximately reconstructed by a combination of parts, we approximate the instance-dependent \textit{transition matrix} for an instance by a combination of the transition matrices for the parts of the instance. The transition matrices for parts can be learned by exploiting anchor points (i.e., data points that belong to a specific class almost surely). Empirical evaluations on synthetic and real-world datasets demonstrate our method is superior to the state-of-the-art approaches for learning from the instance-dependent label noise.

Author Information

Xiaobo Xia (The University of Sydney)
Tongliang Liu (The University of Sydney)
Bo Han (HKBU / RIKEN)
Nannan Wang (Xidian University)
Mingming Gong (University of Melbourne)
Haifeng Liu (Brain-Inspired Technology Co., Ltd.)
Gang Niu (RIKEN)

Gang Niu is currently a research scientist (indefinite-term) at RIKEN Center for Advanced Intelligence Project. He received the PhD degree in computer science from Tokyo Institute of Technology in 2013. Before joining RIKEN as a research scientist, he was a senior software engineer at Baidu and then an assistant professor at the University of Tokyo. He has published more than 70 journal articles and conference papers, including 14 NeurIPS (1 oral and 3 spotlights), 28 ICML, and 2 ICLR (1 oral) papers. He has served as an area chair 14 times, including ICML 2019--2021, NeurIPS 2019--2021, and ICLR 2021--2022.

Dacheng Tao (University of Sydney)
Masashi Sugiyama (RIKEN / University of Tokyo)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors