1: \begin{abstract}
2:
3: %
4: Novel View Synthesis (NVS) without Structure-from-Motion (SfM) pre-processed camera poses—referred to as SfM-free methods—is crucial for promoting rapid response capabilities and enhancing robustness against variable operating conditions.
5:
6: Recent SfM-free methods have integrated pose optimization, designing end-to-end frameworks for joint camera pose estimation and NVS.
7: %
8: However, most existing works rely on per-pixel image loss functions, such as L2 loss. In SfM-free methods, inaccurate initial poses lead to misalignment issue, which, under the constraints of per-pixel image loss functions, results in excessive gradients, causing unstable optimization and poor convergence for NVS.
9:
10: In this study, we propose a correspondence-guided SfM-free 3D Gaussian splatting for NVS.
11: %
12: We use correspondences between the target and the rendered result to achieve better pixel alignment, facilitating the optimization of relative poses between frames.
13: %
14: We then apply the learned poses to optimize the entire scene.
15: %
16: Each 2D screen-space pixel is associated with its corresponding 3D Gaussians through approximated surface rendering to facilitate gradient back-propagation.
17: %
18: Experimental results underline the superior performance and time efficiency of the proposed approach compared to the state-of-the-art baselines.
19: \end{abstract}
20: