Timezone: »
Area under ROC (AUC) is a metric which is widely used for measuring the classification performance for imbalanced data. It is of theoretical and practical interest to develop online learning algorithms that maximizes AUC for large-scale data. A specific challenge in developing online AUC maximization algorithm is that the learning objective function is usually defined over a pair of training examples of opposite classes, and existing methods achieves on-line processing with higher space and time complexity. In this work, we propose a new stochastic online algorithm for AUC maximization. In particular, we show that AUC optimization can be equivalently formulated as a convex-concave saddle point problem. From this saddle representation, a stochastic online algorithm (SOLAM) is proposed which has time and space complexity of one datum. We establish theoretical convergence of SOLAM with high probability and demonstrate its effectiveness and efficiency on standard benchmark datasets.
Author Information
Yiming Ying (State University of New York at Albany)
Longyin Wen (State University of New York at Albany)
Siwei Lyu (State University of New York at Albany)
More from the Same Authors
-
2021 Poster: Simple Stochastic and Online Gradient Descent Algorithms for Pairwise Learning »
ZHENHUAN YANG · Yunwen Lei · Puyu Wang · Tianbao Yang · Yiming Ying -
2021 Poster: Generalization Guarantee of SGD for Pairwise Learning »
Yunwen Lei · Mingrui Liu · Yiming Ying -
2020 Poster: Learning by Minimizing the Sum of Ranked Range »
Shu Hu · Yiming Ying · xin wang · Siwei Lyu -
2017 Poster: Learning with Average Top-k Loss »
Yanbo Fan · Siwei Lyu · Yiming Ying · Baogang Hu -
2016 Oral: Stochastic Online AUC Maximization »
Yiming Ying · Longyin Wen · Siwei Lyu -
2012 Poster: Learning with Target Prior »
Zuoguan Wang · Siwei Lyu · Gerwin Schalk · Qiang Ji -
2011 Poster: Unifying Non-Maximum Likelihood Learning Objectives with Minimum KL Contraction »
Siwei Lyu -
2010 Poster: Divisive Normalization: Justification and Effectiveness as Efficient Coding Transform »
Siwei Lyu -
2009 Poster: Sparse Metric Learning via Smooth Optimization »
Yiming Ying · Kaizhu Huang · Colin I Campbell -
2009 Poster: Analysis of SVM with Indefinite Kernels »
Yiming Ying · Colin I Campbell · Mark A Girolami -
2009 Spotlight: Analysis of SVM with Indefinite Kernels »
Yiming Ying · Colin I Campbell · Mark A Girolami -
2008 Oral: Reducing statistical dependencies in natural signals using radial Gaussianization »
Siwei Lyu · Eero Simoncelli -
2008 Poster: Reducing statistical dependencies in natural signals using radial Gaussianization »
Siwei Lyu · Eero Simoncelli -
2007 Spotlight: A Spectral Regularization Framework for Multi-Task Structure Learning »
Andreas Argyriou · Charles A. Micchelli · Massimiliano Pontil · Yiming Ying -
2007 Poster: A Spectral Regularization Framework for Multi-Task Structure Learning »
Andreas Argyriou · Charles A. Micchelli · Massimiliano Pontil · Yiming Ying -
2006 Poster: Statistical Modeling of Images with Fields of Gaussian Scale Mixtures »
Siwei Lyu · Eero Simoncelli