dc6c560ada7fdc81.tex
1: \begin{abstract}
2: Very recently neural implicit rendering techniques have been rapidly evolved and shown great advantages in novel view synthesis and 3D scene reconstruction.
3: However, existing neural rendering methods for editing purposes offer limited functionality, \eg, rigid transformation, or not applicable for fine-grained editing for general objects from daily lives.
4: In this paper, we present a novel mesh-based representation by encoding the neural implicit field with disentangled geometry and texture codes on mesh vertices, which facilitates a set of editing functionalities, including mesh-guided geometry editing, designated texture editing with texture swapping, filling and painting operations. To this end, we develop several techniques including learnable sign indicators to magnify spatial distinguishability of mesh-based representation, distillation and fine-tuning mechanism to make a steady convergence, and the spatial-aware optimization strategy to realize precise texture editing.
5: Extensive experiments and editing examples on both real and synthetic data demonstrate the superiority of our method on representation quality and editing ability. Code is available on the project webpage: \url{https://zju3dv.github.io/neumesh/}.
6: 
7: 
8: \keywords{neural rendering, mesh-based representation, scene editing, view synthesis, 3D deep learning}
9: 
10: \end{abstract}
11: