1: \begin{abstract}

2: We propose a new stochastic gradient method for optimizing the sum of

3: a finite set of smooth functions, where the sum is strongly convex.

4: While standard stochastic gradient methods

5: converge at sublinear rates for this problem, the proposed method incorporates a memory of previous gradient values in order to achieve a linear convergence

6: rate.  In a machine learning context, numerical experiments indicate that the new algorithm can dramatically outperform standard

7: algorithms, both in terms of optimizing the training objective and reducing the testing objective quickly.

8: \end{abstract}

9: