1: \begin{abstract}
2: In this paper, we consider the underdamped Langevin diffusion (ULD) and propose
3: a numerical approximation using its associated ordinary differential equation (ODE).
4: %This ODE is constructed from the same Brownian motion underlying the diffusion
5: %process in such a way that its solution has a similar local Taylor expansion to ULD.
6: %In each step, we discretize this ODE with an appropriate solver to obtain a practical
7: %(and potentially high order) numerical method for ULD. Due to specific structure of
8: %the ODE, we recommend the fourth order splitting method due to Forest and Ruth.
9: When used as a Markov Chain Monte Carlo (MCMC) algorithm, we show that the
10: ODE approximation achieves a $2\m$-Wasserstein error of $\varepsilon$ in $\mathcal{O}\big(\cubed/\varepsilon^{\frac{2}{3}}\big)$ steps under the standard smoothness and strong convexity assumptions on the target distribution.
11: This matches the complexity of the randomized midpoint method proposed by
12: Shen and Lee [NeurIPS 2019] which was shown to be order optimal by Cao, Lu and Wang.
13: However, the main feature of the proposed numerical method is that it can utilize
14: additional smoothness of the target log-density $f$. More concretely, we show that the
15: ODE approximation achieves a $2\m$-Wasserstein error of $\varepsilon$ in $\mathcal{O}\big(d^{\frac{2}{5}}/\varepsilon^{\frac{2}{5}}\big)$ and $\mathcal{O}\big(\sqrt{d\m}/\varepsilon^{\frac{1}{3}}\big)$
16: steps when Lipschitz continuity is assumed for the Hessian and third derivative of $f$.
17: By discretizing this ODE using a third order Runge-Kutta method, we can obtain a practical MCMC method that uses just two additional gradient evaluations per step. In our experiment, where the target comes from a logistic regression, this method shows faster convergence compared to other unadjusted Langevin MCMC algorithms.
18: \end{abstract}
19: