Timezone: »

Infinite Latent SVM for Classification and Multi-task Learning
Jun Zhu · Ning Chen · Eric Xing

Mon Dec 12 10:00 AM -- 02:59 PM (PST) @

Unlike existing nonparametric Bayesian models, which rely solely on specially conceived priors to incorporate domain knowledge for discovering improved latent representations, we study nonparametric Bayesian inference with regularization on the desired posterior distributions. While priors can indirectly affect posterior distributions through Bayes' theorem, imposing posterior regularization is arguably more direct and in some cases can be much easier. We particularly focus on developing infinite latent support vector machines (iLSVM) and multi-task infinite latent support vector machines (MT-iLSVM), which explore the large-margin idea in combination with a nonparametric Bayesian model for discovering predictive latent features for classification and multi-task learning, respectively. We present efficient inference methods and report empirical studies on several benchmark datasets. Our results appear to demonstrate the merits inherited from both large-margin learning and Bayesian nonparametrics.

Author Information

Jun Zhu (Tsinghua University)
Ning Chen (Tsinghua University)
Eric Xing (Petuum Inc. / Carnegie Mellon University)

More from the Same Authors