1: \begin{abstract}
2: Regularized kernel methods such as, e.g.,
3: support vector machines and
4: least-squares support vector regression
5: constitute an important class of standard learning
6: algorithms in machine learning.
7: Theoretical investigations
8: concerning asymptotic properties
9: have manly focused on rates of convergence
10: during the last years but there are only very few
11: and limited (asymptotic) results on statistical
12: inference so far. As this is a serious limitation
13: for their use in mathematical statistics,
14: the goal of the article is to fill this gap.
15: Based on asymptotic normality of many of these
16: methods, the article derives a strongly consistent
17: estimator for the unknown covariance matrix of the
18: limiting normal distribution.
19: In this way, we obtain asymptotically correct
20: confidence sets for $\psi(f_{P,\lambda_0})$
21: where $f_{P,\lambda_0}$ denotes the minimizer
22: of the regularized risk in the reproducing kernel
23: Hilbert space $H$ and $\psi:H\rightarrow\mathds{R}^m$
24: is any Hadamard-differentiable functional.
25: Applications include (multivariate) pointwise
26: confidence sets for values of $f_{P,\lambda_0}$
27: and confidence sets for gradients, integrals,
28: and norms.
29: \end{abstract}