1: \begin{abstract}

2: The inversion of diffusion model sampling, which aims to find the corresponding initial noise of a sample, plays a critical role in various tasks.

3: Recently, several heuristic exact inversion samplers have been proposed to address the inexact inversion issue in a training-free manner. 

4: However, the theoretical properties of these heuristic samplers remain unknown and they often exhibit mediocre sampling quality.

5: In this paper, we introduce a generic formulation, \emph{Bidirectional Explicit Linear Multi-step} (BELM) samplers, of the exact inversion samplers, which includes all previously proposed heuristic exact inversion samplers as special cases.

6: The BELM formulation is derived from the variable-stepsize-variable-formula linear multi-step method via integrating a bidirectional explicit constraint. We highlight this bidirectional explicit constraint is the key of mathematically exact inversion.

7: We systematically investigate the Local Truncation Error (LTE) within the BELM framework and show that the existing heuristic designs of exact inversion samplers yield sub-optimal LTE.

8: Consequently, we propose the Optimal BELM (O-BELM) sampler through the LTE minimization approach.

9: We conduct additional analysis to substantiate the theoretical stability and global convergence property of the proposed optimal sampler.

10: Comprehensive experiments demonstrate our O-BELM sampler establishes the exact inversion property while achieving high-quality sampling.

11: Additional experiments in image editing and image interpolation highlight the extensive  potential of applying O-BELM in varying applications.

12: \end{abstract}

13: