Timezone: »

 
Spotlight
Exact Convex Confidence-Weighted Learning
Yacov Crammer · Mark Dredze · Fernando Pereira

Tue Dec 09 05:27 PM -- 05:28 PM (PST) @
in Spotlights »

Confidence-weighted (CW) learning [6], an online learning method for linear classifiers, maintains a Gaussian distributions over weight vectors, with a covariance matrix that represents uncertainty about weights and correlations. Confidence constraints ensure that a weight vector drawn from the hypothesis distribution correctly classifies examples with a specified probability. Within this framework, we derive a new convex form of the constraint and analyze it in the mistake bound model. Empirical evaluation with both synthetic and text data shows our version of CW learning achieves lower cumulative and out-of-sample errors than commonly used first-order and second-order online methods.

Author Information

Yacov Crammer (Technion)
Mark Dredze (Johns Hopkins)
Fernando Pereira (Google)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors