e9d9d4b2e315e27c.tex
1: \begin{abstract}
2:    We introduce a generic scheme to solve nonconvex optimization
3:    problems using gradient-based algorithms originally designed for minimizing
4:    convex functions. When the objective is convex, the proposed approach
5:    enjoys the same properties as the Catalyst approach of Lin et al.~\cite{catalyst}.
6:    When the objective is nonconvex,
7:    it achieves the best known convergence rate to stationary points for first-order
8:    methods.
9:    Specifically, the proposed algorithm does not require knowledge about the
10:    convexity of the objective; yet, it obtains an overall worst-case efficiency of
11:    $\tilde{O}(\varepsilon^{-2})$ and, if the function is convex, the complexity
12:    reduces to the near-optimal rate $\tilde{O}(\varepsilon^{-2/3})$.
13:    We conclude the paper by showing promising experimental results obtained
14:    by applying the proposed approach to SVRG and SAGA
15:    for sparse matrix factorization and for
16:    learning neural networks.
17: \end{abstract}
18: