Timezone: »
Reliably recovering 3D human pose from monocular video requires constraints that bias the estimates towards typical human poses and motions. We define priors for people tracking using a Laplacian Eigenmaps Latent Variable Model (LELVM). LELVM is a probabilistic dimensionality reduction model that naturally combines the advantages of latent variable models---definining a multimodal probability density for latent and observed variables, and globally differentiable nonlinear mappings for reconstruction and dimensionality reduction---with those of spectral manifold learning methods---no local optima, ability to unfold highly nonlinear manifolds, and good practical scaling to latent spaces of high dimension. LELVM is computationally efficient, simple to learn from sparse training data, and compatible with standard probabilistic trackers such as particle filters. We analyze the performance of a LELVM-based probabilistic sigma point mixture tracker in several real and synthetic human motion sequences and demonstrate that LELVM provides sufficient constraints for robust operation in the presence of missing, noisy and ambiguous image measurements.
Author Information
Zhengdong Lu (Noah's Ark Lab Huawei Technologies)
Miguel A. Carreira-Perpinan (University of California, Merced)
Cristian Sminchisescu (Lund University/Google)
More from the Same Authors
-
2021 Spotlight: H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion »
Hongyi Xu · Thiemo Alldieck · Cristian Sminchisescu -
2022 Poster: Semi-Supervised Learning with Decision Trees: Graph Laplacian Tree Alternating Optimization »
Arman Zharmagambetov · Miguel A. Carreira-Perpinan -
2021 Poster: Relative Flatness and Generalization »
Henning Petzka · Michael Kamp · Linara Adilova · Cristian Sminchisescu · Mario Boley -
2021 Poster: REMIPS: Physically Consistent 3D Reconstruction of Multiple Interacting People under Weak Supervision »
Mihai Fieraru · Mihai Zanfir · Teodor Szente · Eduard Bazavan · Vlad Olaru · Cristian Sminchisescu -
2021 Poster: H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion »
Hongyi Xu · Thiemo Alldieck · Cristian Sminchisescu -
2018 Poster: Alternating optimization of decision trees, with application to learning sparse oblique trees »
Miguel A. Carreira-Perpinan · Pooya Tavallali -
2017 : Poster Session 2 »
Farhan Shafiq · Antonio Tomas Nevado Vilchez · Takato Yamada · Sakyasingha Dasgupta · Robin Geyer · Moin Nabi · Crefeda Rodrigues · Edoardo Manino · Alexantrou Serb · Miguel A. Carreira-Perpinan · Kar Wai Lim · Bryan Kian Hsiang Low · Rohit Pandey · Marie C White · Pavel Pidlypenskyi · Xue Wang · Christine Kaeser-Chen · Michael Zhu · Suyog Gupta · Sam Leroux -
2017 : Poster Session (encompasses coffee break) »
Beidi Chen · Borja Balle · Daniel Lee · iuri frosio · Jitendra Malik · Jan Kautz · Ke Li · Masashi Sugiyama · Miguel A. Carreira-Perpinan · Ramin Raziperchikolaei · Theja Tulabandhula · Yung-Kyun Noh · Adams Wei Yu -
2016 Poster: An ensemble diversity approach to supervised binary hashing »
Miguel A. Carreira-Perpinan · Ramin Raziperchikolaei -
2016 Poster: Optimizing affinity-based binary hashing using auxiliary coordinates »
Ramin Raziperchikolaei · Miguel A. Carreira-Perpinan -
2015 Poster: A fast, universal algorithm to learn parametric nonlinear embeddings »
Miguel A. Carreira-Perpinan · Max Vladymyrov -
2011 Poster: Probabilistic Joint Image Segmentation and Labeling »
Adrian Ion · Joao Carreira · Cristian Sminchisescu -
2011 Spotlight: Probabilistic Joint Image Segmentation and Labeling »
Adrian Ion · Joao Carreira · Cristian Sminchisescu -
2011 Poster: A Denoising View of Matrix Completion »
Weiran Wang · Miguel A. Carreira-Perpinan · Zhengdong Lu -
2010 Poster: Convex Multiple-Instance Learning by Estimating Likelihood Ratio »
Fuxin Li · Cristian Sminchisescu -
2009 Poster: Efficient Match Kernel between Sets of Features for Visual Recognition »
Liefeng Bo · Cristian Sminchisescu -
2009 Spotlight: Efficient Match Kernel between Sets of Features for Visual Recognition »
Liefeng Bo · Cristian Sminchisescu -
2008 Poster: Hierarchical Fisher Kernels for Longitudinal Data »
Zhengdong Lu · Todd K Leen · Jeffrey Kaye