766007332af47544.tex
1: \begin{abstract}
2: In this paper, a new variant of accelerated gradient descent is proposed. The proposed method does not require any information about the objective function, uses exact line search for the practical accelerations of convergence, converges according to the well-known lower bounds for both convex and non-convex objective functions, possesses primal-dual properties and can be applied in the non-euclidian set-up. As far as we know this is the first such method possessing all of the above properties at the same time. We also present a universal version of the method which is applicable to non-smooth problems. We demonstrate how in practice one can efficiently use the combination of line-search and primal-duality by considering a convex optimization problem with a simple structure (for example, linearly constrained). \iffalse The basic idea that lies behind our approach is the replacing 'coupling' step (convex combination of two auxiliary sequence of points to obtain new 'model' sequence of points) by line search on a segment $[0,1]$. This lead to the practical acceleration and increase the number of good theoretical properties of the method.\fi
3: 
4: 
5: 
6: 
7: \keywords{accelerated gradient descent, line-search, primal-dual methods, convex optimization, nonconvex optimization}
8: % \PACS{PACS code1 \and PACS code2 \and more}
9: % \subclass{MSC code1 \and MSC code2 \and more}
10: \begin{amscode}
11: 90C25, 68Q25
12: \end{amscode}
13: \end{abstract}
14: