Timezone: »
Oral
Generalization Bounds and Consistency for Latent Structural Probit and Ramp Loss
David Mcallester · Joseph Keshet
We consider latent structural versions of probit loss and ramp loss. We show that these surrogate loss functions are consistent in the strong sense that for any feature map (finite or infinite dimensional) they yield predictors approaching the infimum task loss achievable by any linear predictor over the given features. We also give finite sample generalization bounds (convergence rates) for these loss functions. These bounds suggest that probit loss converges more rapidly. However, ramp loss is more easily optimized and may ultimately be more practical.
Author Information
David Mcallester (Toyota Tech Institute Chicago)
Joseph Keshet (Bar-Ilan University)
Related Events (a corresponding poster, oral, or spotlight)
-
2011 Poster: Generalization Bounds and Consistency for Latent Structural Probit and Ramp Loss »
Tue. Dec 13th 04:45 -- 10:59 PM Room
More from the Same Authors
-
2017 Poster: Exploring Generalization in Deep Learning »
Behnam Neyshabur · Srinadh Bhojanapalli · David Mcallester · Nati Srebro -
2014 Poster: Discriminative Metric Learning by Neighborhood Gerrymandering »
Shubhendu Trivedi · David Mcallester · Greg Shakhnarovich -
2013 Workshop: Deep Learning »
Yoshua Bengio · Hugo Larochelle · Russ Salakhutdinov · Tomas Mikolov · Matthew D Zeiler · David Mcallester · Nando de Freitas · Josh Tenenbaum · Jian Zhou · Volodymyr Mnih -
2013 Poster: Learning Efficient Random Maximum A-Posteriori Predictors with Non-Decomposable Loss Functions »
Tamir Hazan · Subhransu Maji · Joseph Keshet · Tommi Jaakkola -
2011 Poster: Object Detection with Grammar Models »
Ross B Girshick · Pedro Felzenszwalb · David Mcallester -
2011 Spotlight: Object Detection with Grammar Models »
Ross B Girshick · Pedro Felzenszwalb · David Mcallester -
2010 Poster: Direct Loss Minimization for Structured Prediction »
David A McAllester · Tamir Hazan · Joseph Keshet -
2008 Poster: Suppport Vector Machines with a Reject Option »
Yves Grandvalet · Joseph Keshet · Alain Rakotomamonjy · Stephane Canu