1: \begin{abstract}

2: Over the past ten years, driven by large scale optimisation problems arising from machine learning, the development of stochastic optimisation methods have witnessed a tremendous growth. 

3: However, despite their popularity, the theoretical understandings of these methods are quite limited in contrast to the deterministic optimisation methods. 

4: In this paper, we present a local convergence analysis for a typical type of stochastic optimisation methods: proximal variance reduced stochastic gradient methods, and mainly focus on the SAGA \cite{saga14} and Prox-SVRG~\cite{proxsvrg14} algorithms. 

5: Under the assumption that the non-smooth component of the optimisation problem is partly smooth relative to a smooth manifold, we present a unified framework for the local convergence analysis of the SAGA/Prox-SVRG algorithms: (i) the sequences generated by the SAGA/Prox-SVRG are able to identify the smooth manifold in a finite number of iterations; (ii) then the sequence enters a local linear convergence regime. 

6: Beyond local convergence analysis, we also discuss  various possibilities for accelerating these algorithms, including adapting to better local parameters, and applying higher-order deterministic/stochastic optimisation methods which can achieve super-linear convergence. 

7: Concrete examples arising from machine learning are considered to verify the obtained results. 

8: \end{abstract}

9: