1: \begin{abstract}
2: We propose a new stochastic L-BFGS algorithm and prove a linear convergence rate for strongly convex and smooth functions.
3: Our algorithm draws heavily from a recent stochastic variant of L-BFGS proposed in \citet{byrd2014stochastic} as well as a recent approach to variance reduction for stochastic gradient descent from \citet{johnson2013accelerating}.
4: We demonstrate experimentally that our algorithm performs well on large-scale convex and non-convex optimization problems, exhibiting linear convergence and rapidly solving the optimization problems to high levels of precision.
5: Furthermore, we show that our algorithm performs well for a wide-range of step sizes, often differing by several orders of magnitude.
6: \end{abstract}
7: