Timezone: »
In this work we address the challenging problem of multiview 3D surface reconstruction. We introduce a neural network architecture that simultaneously learns the unknown geometry, camera parameters, and a neural renderer that approximates the light reflected from the surface towards the camera. The geometry is represented as a zero level-set of a neural network, while the neural renderer, derived from the rendering equation, is capable of (implicitly) modeling a wide set of lighting conditions and materials. We trained our network on real world 2D images of objects with different material properties, lighting conditions, and noisy camera initializations from the DTU MVS dataset. We found our model to produce state of the art 3D surface reconstructions with high fidelity, resolution and detail.
Author Information
Lior Yariv (Weizmann Institute of Science)
Yoni Kasten (Weizmann Institute)
Dror Moran (Weizmann Institute of Science)
Meirav Galun (Weizmann Institute of Science)
Matan Atzmon (Weizmann Institute of Science)
Basri Ronen (Weizmann Inst.)
Yaron Lipman (Weizmann Institute of Science)
Related Events (a corresponding poster, oral, or spotlight)
-
2020 Spotlight: Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance »
Tue. Dec 8th 03:20 -- 03:30 PM Room Orals & Spotlights: Vision Applications
More from the Same Authors
-
2022 Poster: VisCo Grids: Surface Reconstruction with Viscosity and Coarea Grids »
Albert Pumarola · Artsiom Sanakoyeu · Lior Yariv · Ali Thabet · Yaron Lipman -
2022 Poster: On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels »
Amnon Geifman · Meirav Galun · David Jacobs · Basri Ronen -
2022 Poster: Neural Conservation Laws: A Divergence-Free Perspective »
Jack Richter-Powell · Yaron Lipman · Ricky T. Q. Chen -
2021 Oral: Moser Flow: Divergence-based Generative Modeling on Manifolds »
Noam Rozen · Aditya Grover · Maximilian Nickel · Yaron Lipman -
2021 Poster: Shift Invariance Can Reduce Adversarial Robustness »
Vasu Singla · Songwei Ge · Basri Ronen · David Jacobs -
2021 Oral: Volume Rendering of Neural Implicit Surfaces »
Lior Yariv · Jiatao Gu · Yoni Kasten · Yaron Lipman -
2021 Poster: Moser Flow: Divergence-based Generative Modeling on Manifolds »
Noam Rozen · Aditya Grover · Maximilian Nickel · Yaron Lipman -
2021 Poster: Volume Rendering of Neural Implicit Surfaces »
Lior Yariv · Jiatao Gu · Yoni Kasten · Yaron Lipman -
2020 Poster: Set2Graph: Learning Graphs From Sets »
Hadar Serviansky · Nimrod Segol · Jonathan Shlomi · Kyle Cranmer · Eilam Gross · Haggai Maron · Yaron Lipman -
2020 Poster: On the Similarity between the Laplace and Neural Tangent Kernels »
Amnon Geifman · Abhay Yadav · Yoni Kasten · Meirav Galun · David Jacobs · Basri Ronen -
2019 Poster: The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies »
Basri Ronen · David Jacobs · Yoni Kasten · Shira Kritchman -
2019 Poster: Controlling Neural Level Sets »
Matan Atzmon · Niv Haim · Lior Yariv · Ofer Israelov · Haggai Maron · Yaron Lipman -
2019 Poster: Provably Powerful Graph Networks »
Haggai Maron · Heli Ben-Hamu · Hadar Serviansky · Yaron Lipman -
2018 Poster: (Probably) Concave Graph Matching »
Haggai Maron · Yaron Lipman -
2018 Spotlight: (Probably) Concave Graph Matching »
Haggai Maron · Yaron Lipman -
2006 Poster: Fundamental Limitations of Spectral Clustering Methods »
Boaz Nadler · Meirav Galun