1: \begin{abstract}

2: Heavy-Ball method (\algname{HB}) is known for its simplicity in implementation and practical efficiency. However, as with other momentum methods, it has non-monotone behavior, and for optimal parameters, the method suffers from the so-called \textit{peak effect}. To address this issue, in this paper, we consider an averaged version of Heavy-Ball method (\algname{AHB}). We show that for quadratic problems \algname{AHB} has a smaller maximal deviation from the solution than \algname{HB}. Moreover, for general convex and strongly convex functions, we prove non-accelerated rates of global convergence of \algname{AHB} and its weighted version. We conduct several numerical experiments on minimizing quadratic and non-quadratic functions to demonstrate the advantages of using averaging for \algname{HB}.

3: \end{abstract}

4: