Timezone: »
Spotlight
Fast Graph Laplacian Regularized Kernel Learning via Semidefinite–Quadratic–Linear Programming
Xiao-Ming Wu · Anthony Man-Cho So · Zhenguo Li · Shuo-Yen Robert Li
Kernel learning is a powerful framework for nonlinear data modeling. Using the kernel trick, a number of problems have been formulated as semidefinite programs (SDPs). These include Maximum Variance Unfolding (MVU) (Weinberger et al., 2004) in nonlinear dimensionality reduction, and Pairwise Constraint Propagation (PCP) (Li et al., 2008) in constrained clustering. Although in theory SDPs can be efficiently solved, the high computational complexity incurred in numerically processing the huge linear matrix inequality constraints has rendered the SDP approach unscalable. In this paper, we show that a large class of kernel learning problems can be reformulated as semidefinite-quadratic-linear programs (SQLPs), which only contain a simple positive semidefinite constraint, a second-order cone constraint and a number of linear constraints. These constraints are much easier to process numerically, and the gain in speedup over previous approaches is at least of the order $m^{2.5}$, where m is the matrix dimension. Experimental results are also presented to show the superb computational efficiency of our approach.
Author Information
Xiao-Ming Wu (Columbia University)
Anthony Man-Cho So (CUHK)
Zhenguo Li (Huawei Noah's Ark Lab, Hong Kong)
Shuo-Yen Robert Li
Related Events (a corresponding poster, oral, or spotlight)
-
2009 Poster: Fast Graph Laplacian Regularized Kernel Learning via Semidefinite–Quadratic–Linear Programming »
Thu. Dec 10th 03:00 -- 07:59 AM Room
More from the Same Authors
-
2022 : Nonsmooth Composite Nonconvex-Concave Minimax Optimization »
Jiajin Li · Linglingzhi Zhu · Anthony Man-Cho So -
2022 : Accelerating Perturbed Stochastic Iterates in Asynchronous Lock-Free Optimization »
Kaiwen Zhou · Anthony Man-Cho So · James Cheng -
2023 Poster: ReSync: Riemannian Subgradient-based Robust Rotation Synchronization »
Huikang Liu · Xiao Li · Anthony Man-Cho So -
2023 Poster: LogSpecT: Feasible Graph Learning Model from Stationary Signals with Recovery Guarantees »
Shangyuan LIU · Linglingzhi Zhu · Anthony Man-Cho So -
2023 Poster: Outlier-Robust Gromov Wasserstein for Graph Data »
Lemin Kong · Jiajin Li · Jianheng Tang · Anthony Man-Cho So -
2023 Poster: Doubly Smoothed GDA for Constrained Nonconvex-Nonconcave Minimax Optimization »
Taoli Zheng · Linglingzhi Zhu · Anthony Man-Cho So · Jose Blanchet · Jiajin Li -
2020 Poster: Boosting First-Order Methods by Shifting Objective: New Schemes with Faster Worst-Case Rates »
Kaiwen Zhou · Anthony Man-Cho So · James Cheng -
2020 Poster: Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector Machine »
Jiajin Li · Caihua Chen · Anthony Man-Cho So -
2019 Poster: A First-Order Algorithmic Framework for Wasserstein Distributionally Robust Logistic Regression »
Jiajin Li · SEN HUANG · Anthony Man-Cho So -
2013 Poster: Analyzing the Harmonic Structure in Graph-Based Learning »
Xiao-Ming Wu · Zhenguo Li · Shih-Fu Chang -
2013 Poster: On the Linear Convergence of the Proximal Gradient Method for Trace Norm Regularization »
Ke Hou · Zirui Zhou · Anthony Man-Cho So · Zhi-Quan Luo -
2012 Poster: Learning with Partially Absorbing Random Walks »
Xiao-Ming Wu · Zhenguo Li · Shih-Fu Chang · John Wright · Anthony Man-Cho So