1: \begin{abstract}

2: 

3: Iterative regularization is a classic idea in regularization theory,  that has recently become popular  in machine learning. On the one hand, it allows to design efficient algorithms controlling at the same time  numerical and statistical accuracy. On the other hand it allows to shed light on the  learning curves observed while training neural networks. In this paper,  we focus on  iterative  regularization in the context of classification. After contrasting this  setting with that of regression and inverse problems, we develop an iterative regularization approach based on the use of the hinge loss function. More precisely we consider a diagonal approach for a family of algorithms for which we prove convergence as well as rates of convergence.

4: %\loz{let's be more specific here}

5: Our approach compares favorably with other alternatives, as confirmed also in numerical simulations. 

6: %via a diagonal method in the context of binary classification of linearly separable data (SVM). In particular we study the behavior of a family of inertial Gradient-Descent algorithms and its iterative regularization properties for solving Max-Margin (or Minimum-Norm) problems via a dual formulation of the penalized hinge loss. We provide some improved convergence rates with respect to the existing literature results which are put in evidence in some basic numerical examples on synthetic data.

7: 

8: 

9: 

10: %We collect and review results on how to build margin maximizing sequences for linear and nonlinear models, and  also  review results on minimal norm interpolation. 

11: \end{abstract}

12: