Timezone: »
Poster
t-logistic regression
Nan Ding · S.V.N. Vishwanathan
We extend logistic regression by using t-exponential families which were introduced recently in statistical physics. This gives rise to a regularized risk minimization problem with a non-convex loss function. An efficient block coordinate descent optimization scheme can be derived for estimating the parameters. Because of the nature of the loss function, our algorithm is tolerant to label noise. Furthermore, unlike other algorithms which employ non-convex loss functions, our algorithm is fairly robust to the choice of initial values. We verify both these observations empirically on a number of synthetic and real datasets.
Author Information
Nan Ding (Google)
S.V.N. Vishwanathan (UCSC)
More from the Same Authors
-
2021 Poster: Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning »
Nan Ding · Xi Chen · Tomer Levinboim · Sebastian Goodman · Radu Soricut -
2017 Poster: Cold-Start Reinforcement Learning with Softmax Policy Gradient »
Nan Ding · Radu Soricut -
2016 Poster: Stochastic Gradient MCMC with Stale Gradients »
Changyou Chen · Nan Ding · Chunyuan Li · Yizhe Zhang · Lawrence Carin -
2015 Poster: A Structural Smoothing Framework For Robust Graph Comparison »
Pinar Yanardag · S.V.N. Vishwanathan -
2015 Poster: Embedding Inference for Structured Multilabel Prediction »
Farzaneh Mirzazadeh · Siamak Ravanbakhsh · Nan Ding · Dale Schuurmans -
2014 Poster: Bayesian Sampling Using Stochastic Gradient Thermostats »
Nan Ding · Youhan Fang · Ryan Babbush · Changyou Chen · Robert D Skeel · Hartmut Neven -
2011 Poster: t-divergence Based Approximate Inference »
Nan Ding · S.V.N. Vishwanathan · Yuan Qi -
2010 Poster: Lower Bounds on Rate of Convergence of Cutting Plane Methods »
Xinhua Zhang · Ankan Saha · S.V.N. Vishwanathan -
2010 Spotlight: Multiple Kernel Learning and the SMO Algorithm »
S.V.N. Vishwanathan · Zhaonan sun · Nawanol T Ampornpunt · Manik Varma -
2010 Poster: Multiple Kernel Learning and the SMO Algorithm »
S.V.N. Vishwanathan · Zhaonan sun · Nawanol T Ampornpunt · Manik Varma -
2010 Poster: Multitask Learning without Label Correspondences »
Novi Quadrianto · Alexander Smola · Tiberio Caetano · S.V.N. Vishwanathan · James Petterson