Timezone: »
To improve the performance of deep learning, mixup has been proposed to force the neural networks favoring simple linear behaviors in-between training samples. Performing mixup for transfer learning with pre-trained models however is not that simple, a high capacity pre-trained model with a large fully-connected (FC) layer could easily overfit to the target dataset even with samples-to-labels mixed up. In this work, we propose SMILE — \underline{S}ample-to-feature \underline{M}ixup for Eff\underline{I}cient Transfer \underline{LE}arning. With mixed images as inputs, SMILE regularizes the outputs of CNN feature extractors to learn from the mixed feature vectors of inputs, in addition to the mixed labels. SMILE incorporates a mean teacher to provide the surrogate "ground truth" for mixed feature vectors. Extensive experiments have been done to verify the performance improvement made by \TheName, in comparisons with a wide spectrum of transfer learning algorithms, including fine-tuning, L2-SP, DELTA, BSS, RIFLE, Co-Tuning and RegSL, even with mixup strategies combined.
Author Information
Xingjian Li (Baidu Research)
Haoyi Xiong (Baidu)
Cheng-Zhong Xu (University of Macau)
Dejing Dou (Baidu)
More from the Same Authors
-
2022 Poster: Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement »
Yan Li · Xinjiang Lu · Yaqing Wang · Dejing Dou -
2022 Poster: InterpretDL: Explaining Deep Models in PaddlePaddle »
Xuhong Li · Haoyi Xiong · Xingjian Li · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 : A Simple Framework for Active Learning to Rank »
Qingzhong Wang · Haifang Li · Haoyi Xiong · Wen Wang · Jiang Bian · Yu Lu · Shuaiqiang Wang · zhicong cheng · Dawei Yin · Dejing Dou -
2022 : A Comparative Survey of Deep Active Learning »
Xueying Zhan · Qingzhong Wang · Kuan-Hao Huang · Haoyi Xiong · Dejing Dou · Antoni Chan -
2023 Poster: $\mathcal{M}^4$: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities and Models »
Xuhong Li · Mengnan Du · Jiamin Chen · Yekun Chai · Himabindu Lakkaraju · Haoyi Xiong -
2022 Spotlight: InterpretDL: Explaining Deep Models in PaddlePaddle »
Xuhong Li · Haoyi Xiong · Xingjian Li · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 Spotlight: Lightning Talks 1A-1 »
Siba Smarak Panigrahi · Xuhong Li · Mikhail Usvyatsov · Shaohan Chen · Sohan Patnaik · Haoyi Xiong · Nikolaos V Sahinidis · Rafael Ballester-Ripoll · Chuanhou Gao · Xingjian Li · Konrad Schindler · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 Poster: MORA: Improving Ensemble Robustness Evaluation with Model Reweighing Attack »
yunrui yu · Xitong Gao · Cheng-Zhong Xu -
2022 Poster: AutoMS: Automatic Model Selection for Novelty Detection with Error Rate Control »
Yifan Zhang · Haiyan Jiang · Haojie Ren · Changliang Zou · Dejing Dou -
2021 : [O6] Explaining Information Flow Inside Vision Transformers Using Markov Chain »
Tingyi Yuan · Xuhong Li · Haoyi Xiong · Dejing Dou -
2020 Poster: Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching »
Di Hu · Rui Qian · Minyue Jiang · Xiao Tan · Shilei Wen · Errui Ding · Weiyao Lin · Dejing Dou -
2019 Poster: Focused Quantization for Sparse CNNs »
Yiren Zhao · Xitong Gao · Daniel Bates · Robert Mullins · Cheng-Zhong Xu