Timezone: »
It is becoming increasingly important to learn from a partially-observed random matrix and predict its missing elements. We assume that the entire matrix is a single sample drawn from a matrix-variate t distribution and suggest a matrix-variate t model (MVTM) to predict those missing elements. We show that MVTM generalizes a range of known probabilistic models, and automatically performs model selection to encourage sparse predictive models. Due to the non-conjugacy of its prior, it is difficult to make predictions by computing the mode or mean of the posterior distribution. We suggest an optimization method that sequentially minimizes a convex upper-bound of the log-likelihood, which is very efficient and scalable. The experiments on a toy data and EachMovie dataset show a good predictive accuracy of the model.
Author Information
Shenghuo Zhu (NEC Laboratories America)
Kai Yu (Baidu)
Yihong Gong
More from the Same Authors
-
2014 Poster: Communication Efficient Distributed Machine Learning with the Parameter Server »
Mu Li · David G Andersen · Alexander Smola · Kai Yu -
2013 Demonstration: Demos of Deep Learning Technologies at Baidu IDL »
Yi Yang · Kai Yu -
2012 Poster: Deep Learning of invariant features via tracked video sequences »
Will Y Zou · Andrew Y Ng · Shenghuo Zhu · Kai Yu -
2012 Poster: Stochastic Gradient Descent with Only One Projection »
Mehrdad Mahdavi · Tianbao Yang · Rong Jin · Shenghuo Zhu -
2010 Workshop: Machine Learning for Social Computing »
Zenglin Xu · Irwin King · Shenghuo Zhu · Yuan Qi · Rong Yan · John Yen -
2010 Poster: Deep Coding Network »
Yuanqing Lin · Tong Zhang · Shenghuo Zhu · Kai Yu -
2009 Poster: Nonlinear Learning using Local Coordinate Coding »
Kai Yu · Tong Zhang · Yihong Gong -
2008 Poster: Stochastic Relational Models for Large-scale Dyadic Data using MCMC »
Shenghuo Zhu · Kai Yu · Yihong Gong -
2008 Spotlight: Stochastic Relational Models for Large-scale Dyadic Data using MCMC »
Shenghuo Zhu · Kai Yu · Yihong Gong -
2008 Poster: Deep Learning with Kernel Regularization for Visual Recognition »
Kai Yu · Wei Xu · Yihong Gong -
2008 Spotlight: Deep Learning with Kernel Regularization for Visual Recognition »
Kai Yu · Wei Xu · Yihong Gong -
2007 Poster: Gaussian Process Models for Link Analysis and Transfer Learning »
Kai Yu · Wei Chu -
2007 Demonstration: Gender and Age Recognition »
Wei Xu · Kai Yu · Yihong Gong -
2006 Poster: Gaussian Process Models for Discriminative Link Prediction »
Kai Yu · Wei Chu · Shipeng Yu · Volker Tresp · Zhao Xu