696b99ba7e02fda7.tex
1: \begin{abstract}
2:     In this work, we propose an adaptive variation on the classical Heavy-ball method for convex quadratic minimization.
3:     The adaptivity crucially relies on so-called ``Polyak step-sizes'',
4:     which consists in using the knowledge of the optimal value of the optimization problem at hand
5:     instead of problem parameters such as a few eigenvalues of the Hessian of the problem.
6:     This method happens to  also be equivalent to a variation of the classical conjugate gradient method,
7:     and thereby inherits many of its attractive features, including its finite-time convergence,
8:     instance optimality, and its worst-case convergence rates.
9: 
10:     The classical gradient method with Polyak step-sizes is known to behave very well in situations in which it can be used,
11:     and the question of whether incorporating momentum in this method is possible and can improve the method itself appeared to be open.
12:     We provide a definitive answer to this question for minimizing convex quadratic functions,
13:     a arguably necessary first step for developing such methods in more general setups.
14: \end{abstract}
15: