Timezone: »
In this paper, we point out that there exist scaling and initialization problems in most existing multiple kernel learning (MKL) approaches, which employ the large margin principle to jointly learn both a kernel and an SVM classifier. The reason is that the margin itself can not well describe how good a kernel is due to the negligence of the scaling. We use the ratio between the margin and the radius of the minimum enclosing ball to measure the goodness of a kernel, and present a new minimization formulation for kernel learning. This formulation is invariant to scalings of learned kernels, and when learning linear combination of basis kernels it is also invariant to scalings of basis kernels and to the types (e.g., L1 or L2) of norm constraints on combination coefficients. We establish the differentiability of our formulation, and propose a gradient projection algorithm for kernel learning. Experiments show that our method significantly outperforms both SVM with the uniform combination of basis kernels and other state-of-art MKL approaches.
Author Information
Kun Gai (Alibaba group)
Guangyun Chen (Tsinghua University)
Changshui Zhang (Tsinghua University)
More from the Same Authors
-
2022 Poster: Synergy-of-Experts: Collaborate to Improve Adversarial Robustness »
Sen Cui · Jingfeng ZHANG · Jian Liang · Bo Han · Masashi Sugiyama · Changshui Zhang -
2021 Poster: Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning »
Sen Cui · Weishen Pan · Jian Liang · Changshui Zhang · Fei Wang -
2021 Poster: ReSSL: Relational Self-Supervised Learning with Weak Augmentation »
Mingkai Zheng · Shan You · Fei Wang · Chen Qian · Changshui Zhang · Xiaogang Wang · Chang Xu -
2020 Poster: Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space »
Shangchen Du · Shan You · Xiaojie Li · Jianlong Wu · Fei Wang · Chen Qian · Changshui Zhang -
2020 Poster: When Counterpoint Meets Chinese Folk Melodies »
Nan Jiang · Sheng Jin · Zhiyao Duan · Changshui Zhang -
2019 Poster: Subspace Attack: Exploiting Promising Subspaces for Query-Efficient Black-box Attacks »
Yiwen Guo · Ziang Yan · Changshui Zhang -
2018 Poster: Sparse DNNs with Improved Adversarial Robustness »
Yiwen Guo · Chao Zhang · Changshui Zhang · Yurong Chen -
2018 Poster: Connectionist Temporal Classification with Maximum Entropy Regularization »
Hu Liu · Sheng Jin · Changshui Zhang -
2018 Spotlight: Connectionist Temporal Classification with Maximum Entropy Regularization »
Hu Liu · Sheng Jin · Changshui Zhang -
2018 Poster: Deep Defense: Training DNNs with Improved Adversarial Robustness »
Ziang Yan · Yiwen Guo · Changshui Zhang -
2012 Poster: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Spotlight: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang