Timezone: »

 
Spotlight
3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data
Benjamin Biggs · David Novotny · Sebastien Ehrhardt · Hanbyul Joo · Ben Graham · Andrea Vedaldi

Tue Dec 08 08:00 AM -- 08:10 AM (PST) @ Orals & Spotlights: Vision Applications
in Orals & Spotlights Track 07: Vision Applications »

We consider the problem of obtaining dense 3D reconstructions of deformable objects from single and partially occluded views. In such cases, the visual evidence is usually insufficient to identify a 3D reconstruction uniquely, so we aim at recovering several plausible reconstructions compatible with the input data. We suggest that ambiguities can be modeled more effectively by parametrizing the possible body shapes and poses via a suitable 3D model, such as SMPL for humans. We propose to learn a multi-hypothesis neural network regressor using a best-of-M loss, where each of the M hypotheses is constrained to lie on a manifold of plausible human poses by means of a generative model. We show that our method outperforms alternative approaches in ambiguous pose recovery on standard benchmarks for 3D humans, and in heavily occluded versions of these benchmarks.

Author Information

Benjamin Biggs (University of Cambridge)
David Novotny (Facebook AI Research)
Sebastien Ehrhardt (University of Oxford)
Hanbyul Joo (FAIR)
Ben Graham (Facebook Research)
Andrea Vedaldi (University of Oxford / Facebook AI Research)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors