1: \begin{abstract}%
2: We propose an optimization algorithm called Hamiltonian Descent, which is a direct counterpart of classical Hamiltonian Monte Carlo in sampling.
3: We show that Hamiltonian Descent has a better convergence rate than the Chebyshev method for solving a linear system of equations, albeit with a high computational cost. To overcome the cost issue, we then propose Coordinate Hamiltonian Descent and its parallelizable variant, which turns out to encapsulate the classical Gauss-Seidel method, Successive Over-relaxation, Jacobi method, and more. The result not only offers a new perspective on these existing algorithms but also leads to a broader class of update schemes that guarantee the convergence.
4: \end{abstract}
5: