1: \begin{abstract}

2: 

3: Discrete gradient methods are geometric integration techniques that can preserve the dissipative structure of gradient flows. Due to the monotonic decay of the function values, they are well suited for general convex and nonconvex optimization problems. Both zero- and first-order algorithms can be derived from the discrete gradient method by selecting different discrete gradients. In this paper, we present a comprehensive analysis of the discrete gradient method for optimisation which provides a solid theoretical foundation. We show that the discrete gradient method is well-posed by proving the existence and uniqueness of iterates for any positive time step, and propose an efficient method for solving the associated discrete gradient equation. Moreover, we establish an \(O(1/k)\) convergence rate for convex objectives and prove linear convergence if instead the Polyak–Łojasiewicz inequality is satisfied. The analysis is carried out for three discrete gradients—the Gonzalez discrete gradient, the mean value discrete gradient, and the Itoh–Abe discrete gradient—as well as for a randomised Itoh–Abe method. Our theoretical results are illustrated with a variety of numerical experiments, and we furthermore demonstrate that the methods are robust with respect to stiffness.

4: 

5: 

6: \noindent\textbf{Keywords.} \hspace{0.1cm} Geometric integration, smooth optimisation, nonconvex optimisation, stochastic optimisation, discrete gradient method

7: % \PACS{PACS code1 \and PACS code2 \and more}

8: % \subclass{90C26 \and 90C30 \and 49M37 \and 65K05 \and 65K10 \and 74S60 \and 90C15 \and 49Q15}

9: 

10: \noindent\textbf{AMS subject classifications.} \hspace{0.1cm} 49M37, 49Q15, 65K05, 65K10, 90C15, 90C26, 90C30

11: \end{abstract}

12: