1: \begin{abstract}

2: We discuss stability for a class of learning algorithms with

3: respect to noisy labels. The algorithms we consider are for

4: regression, and they involve the minimization of regularized risk

5: functionals, such as $L(f) := \frac{1}{N} \sumi

6: (f(\mthx_i)-y_i)^2+\regterm$. We shall call the algorithm `stable'

7: if, when $y_i$ is a noisy version of $\overline{f}(\mthx_i)$ for

8: some function $\overline{f} \in \H$, the output of the algorithm

9: converges to $\overline{f}$ as the regularization term and noise

10: simultaneously vanish. We consider two flavors of this problem,

11: one where a data set of $N$ points remains fixed, and the other

12: where $N \rightarrow \infty$. For the case where $N \rightarrow

13: \infty$, we give conditions for convergence to $f_{\E}$ (the

14: function which is the expectation of $y(\mthx)$ for each $\mthx$),

15: as $\lambda\rightarrow 0$. For the fixed $N$ case, we describe the

16: limiting 'non-noisy', 'non-regularized' function $\overline{f}$,

17: and give conditions for convergence. In the process, we develop a

18: set of tools for dealing with functionals such as $L(f)$, which

19: are applicable to many

20: other problems in learning theory. %\vspace{30pt}

21: \end{abstract}

22: