Timezone: »

 
Poster
Learning latent variable structured prediction models with Gaussian perturbations
Kevin Bello · Jean Honorio

Thu Dec 06 07:45 AM -- 09:45 AM (PST) @ Room 517 AB #115
in Thu Poster Session A »

The standard margin-based structured prediction commonly uses a maximum loss over all possible structured outputs. The large-margin formulation including latent variables not only results in a non-convex formulation but also increases the search space by a factor of the size of the latent space. Recent work has proposed the use of the maximum loss over random structured outputs sampled independently from some proposal distribution, with theoretical guarantees. We extend this work by including latent variables. We study a new family of loss functions under Gaussian perturbations and analyze the effect of the latent space on the generalization bounds. We show that the non-convexity of learning with latent variables originates naturally, as it relates to a tight upper bound of the Gibbs decoder distortion with respect to the latent space. Finally, we provide a formulation using random samples and relaxations that produces a tighter upper bound of the Gibbs decoder distortion up to a statistical accuracy, which enables a polynomial time evaluation of the objective function. We illustrate the method with synthetic experiments and a computer vision application.

Keywords: Learning Theory · Structured Prediction
[ Paper] 

Author Information

Kevin Bello (Purdue University)
Jean Honorio (Purdue University)

More from the Same Authors