1: \begin{abstract}% <- trailing '%' for backward compatibility of .sty file
2: In this paper, we propose a unified view of gradient-based algorithms for
3: stochastic convex composite optimization by extending the concept of estimate
4: sequence introduced by Nesterov. More precisely, we interpret a large class of stochastic
5: optimization methods as procedures that iteratively minimize a surrogate of
6: the objective, which
7: covers the stochastic gradient descent method and variants of
8: the incremental approaches SAGA, SVRG, and MISO/Finito/SDCA.
9: This point of view has several advantages: (i) we provide a simple generic
10: proof of convergence for all of the aforementioned methods; (ii) we naturally
11: obtain new algorithms with the same guarantees; (iii) we derive generic
12: strategies to make these algorithms robust to stochastic noise, which is useful
13: when data is corrupted by small random perturbations. Finally, we propose a new
14: accelerated stochastic gradient descent algorithm and
15: a new accelerated SVRG algorithm that is robust to stochastic noise.
16: \end{abstract}
17: