16188e3246359455.tex
1: \begin{abstract}
2:     We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured.
3:     Our approach builds on two recent developments:
4:     surface reconstruction using neural radiance fields for the reconstruction of the visible parts of the surface,
5:     and guidance of pre-trained 2D diffusion models in the form of Score Distillation Sampling (SDS) to complete the shape in unobserved regions in a plausible manner.
6:     We introduce three components.
7:     First, we suggest employing normal maps as a pure geometric representation for SDS instead of color renderings which are entangled with the appearance information.
8:     Second, we introduce the freezing of the SDS noise during training which results in more coherent gradients and better convergence.
9:     Third, we propose Multi-View SDS as a way to condition the generation of the non-observable part of the surface without fine-tuning or making changes to the underlying 2D Stable Diffusion model.
10:     We evaluate our approach on the BlendedMVS dataset demonstrating significant qualitative and quantitative improvements over competing methods.
11: \end{abstract}
12: