1: \begin{abstract}
2: This paper deals with the highly challenging problem of reconstructing the shape of a refracting object from a single image of its resulting caustic. %, i.e. the brightness distribution on a surface caused by illuminating the object.
3: %
4: Due to the ubiquity of transparent refracting objects in everyday life, reconstruction of their shape entails a multitude of practical applications.
5: %
6: The recent Shape from Caustics (SfC) method casts the problem as the inverse of a light propagation simulation for synthesis of the caustic image, that can be solved by a differentiable renderer.
7: %
8: However, the inherent complexity of light transport through refracting surfaces currently limits the practicability with respect to reconstruction speed and robustness.
9: %
10: To address these issues, we introduce Neural-Shape from Caustics (N-SfC), a learning-based extension that incorporates two components into the reconstruction pipeline:
11: a denoising module, which alleviates the computational cost of the light transport simulation, and an optimization process based on learned gradient descent, which enables better convergence using fewer iterations.
12: %
13: Extensive experiments demonstrate the effectiveness of our neural extensions in the scenario of quality control in 3D glass printing, where we significantly outperform the current state-of-the-art in terms of computational speed and final surface error.
14: \end{abstract}
15: