1d2927202032f622.tex
1: \begin{abstract}
2: % We present a novel depth estimation method for multi-frame structured light systems via the neural implicit representations of the 3D space. Specifically, we represent the 3D space with a neural signed distance field (SDF), which is trained using a differentiable rendering process in a self-supervised manner. In contrast to the passive vision case where radiance fields and geometry fields has to be estimated jointly, we leverage the projected patterns in structured light systems as the prior known radiance field. Therefore, we can optimize the geometry field solely, ensuring the convergence and performance of our neural network given a fixed device position. To further ensure a clear and smooth geometric output from the neural function, we apply an additional color loss based on the object surface during the training process. Experiments on the real-world data show that our method not only outperforms the state-of-the-arts in terms of geometric performance for few-shot cases, but also achieve comparable results when more patterns are available.
3: We introduce a novel depth estimation technique for multi-frame structured light setups using neural implicit representations of 3D space. Our approach employs a neural signed distance field (SDF), trained through self-supervised differentiable rendering. Unlike passive vision, where joint estimation of radiance and geometry fields is necessary, we capitalize on known radiance fields from projected patterns in structured light systems. This enables isolated optimization of the geometry field, ensuring convergence and network efficacy with fixed device positioning. To enhance geometric fidelity, we incorporate an additional color loss based on object surfaces during training. Real-world experiments demonstrate our method's superiority in geometric performance for few-shot scenarios, while achieving comparable results with increased pattern availability.
4: \end{abstract}
5: