1: \begin{abstract}

2: We propose generic acceleration schemes for a wide class of optimization and iterative schemes based on relaxation and inertia. In particular, we introduce methods that automatically tunes the acceleration coefficients online, and establish their convergence. This is made possible by considering the class of fixed-points iterations over averaged operators which encompass gradient methods, ADMM, primal dual algorithms, an so on. 

3: 

4: % Optimization algorithms can often be seen as fixed-points iterations of some operators. It is well known that the convergence of these methods can be improved by combining previous values to construct the next iterate.

5: 

6: % Such acceleration methods can be separated in two main types: \emph{relaxation} (simple combination of current and previous iterate) and \emph{inertia} (slightly more involved modification made popular by Nesterov's acceleration and heavy balls). These methods have been celebrated for accelerating linearly and sub-linearly converging algorithms such as gradient methods, proximal gradient (FISTA), or ADMM (Fast ADMM).

7: 

8: % In this paper, we build upon generic contraction properties and affine approximations to i) provide a coherent vision of the reach and limitations of these modifications; and ii) propose generic auto-tuned acceleration methods. The performance of these methods is then evaluated for various optimization algorithms.

9: \end{abstract}

10: