`

Timezone: »

 
Spotlight
Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
Lior Yariv · Yoni Kasten · Dror Moran · Meirav Galun · Matan Atzmon · Basri Ronen · Yaron Lipman

Tue Dec 08 07:20 AM -- 07:30 AM (PST) @ Orals & Spotlights: Vision Applications

In this work we address the challenging problem of multiview 3D surface reconstruction. We introduce a neural network architecture that simultaneously learns the unknown geometry, camera parameters, and a neural renderer that approximates the light reflected from the surface towards the camera. The geometry is represented as a zero level-set of a neural network, while the neural renderer, derived from the rendering equation, is capable of (implicitly) modeling a wide set of lighting conditions and materials. We trained our network on real world 2D images of objects with different material properties, lighting conditions, and noisy camera initializations from the DTU MVS dataset. We found our model to produce state of the art 3D surface reconstructions with high fidelity, resolution and detail.

Author Information

Lior Yariv (Weizmann Institute of Science)
Yoni Kasten (Weizmann Institute)
Dror Moran (Weizmann Institute of Science)
Meirav Galun (Weizmann Institute of Science)
Matan Atzmon (Weizmann Institute of Science)
Basri Ronen (Weizmann Inst.)
Yaron Lipman (Weizmann Institute of Science)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors