Timezone: »

Hardware Design and Accurate Simulation of Structured-Light Scanning for Benchmarking of 3D Reconstruction Algorithms
Sebastian Koch · Yurii Piadyk · Markus Worchel · Marc Alexa · Claudio Silva · Denis Zorin · Daniele Panozzo
Event URL: https://openreview.net/forum?id=bNL5VlTfe3p »

Images of a real scene taken with a camera commonly differ from synthetic images of a virtual replica of the same scene, despite advances in light transport simulation and calibration. By explicitly co-developing the Structured-Light Scanning (SLS) hardware and rendering pipeline we are able to achieve negligible per-pixel difference between the real image and the synthesized image on geometrically complex calibration objects with known material properties. This approach provides an ideal test-bed for developing and evaluating data-driven algorithms in the area of 3D reconstruction, as the synthetic data is indistinguishable from real data and can be generated at large scale by simulation. We propose three benchmark challenges using a combination of acquired and synthetic data generated with our system: (1) a denoising benchmark tailored to structured-light scanning, (2) a shape completion benchmark to fill in missing data, and (3) a benchmark for surface reconstruction from dense point clouds. Besides, we provide a large collection of high-resolution scans that allow to use our system and benchmarks without reproduction of the hardware setup on our website: https://geometryprocessing.github.io/scanner-sim

Author Information

Sebastian Koch (TU Berlin)
Yurii Piadyk (New York University)

I am currently pursuing a PhD degree in Computer Science at NYU Tandon School of Engineering under the supervision of Prof. Claudio Silva. I hold a B.S. in Physics (2014) and M.Sc. in High Energy Physics (2016) from Taras Shevchenko National University of Kyiv (KNU), Ukraine.

Markus Worchel (Technische Universit├Ąt Berlin)
Marc Alexa (TU Berlin)
Claudio Silva (New York University)
Denis Zorin (New York University)
Daniele Panozzo (NYU)

More from the Same Authors