1: \begin{abstract}

2: Within a statistical learning setting,  we propose and study an iterative regularization algorithm for least squares defined by  an incremental gradient method.   In particular, we show that, if all other parameters are fixed a priori, the number of passes over the data (epochs) acts as a regularization 

3: parameter, and  prove strong universal consistency, i.e.  almost sure convergence of the risk, as well as  sharp finite sample bounds for 

4: the iterates. Our  results are a step towards understanding the effect of multiple epochs in  stochastic 

5: gradient techniques in machine learning and rely  on  integrating  statistical and optimization

6: results.

7: \end{abstract}

8: