b3186faa197d6a9a.tex
1: \begin{abstract}
2: {Within the framework of statistical learning theory we analyze in
3: detail the so-called elastic-net regularization scheme proposed by
4: Zou and Hastie \cite{zhuhas05} for the selection of groups of
5: correlated variables. To investigate on the statistical properties
6: of this scheme and in particular on its consistency properties, we
7: set up a suitable mathematical framework. Our setting is
8: random-design regression where we allow the response variable to
9: be vector-valued and we consider prediction functions which are
10: linear combination of elements ({\em features}) in an
11: infinite-dimensional dictionary. Under the assumption that the
12: regression function admits a sparse representation on the
13: dictionary, we prove that there exists a particular ``{\em
14: elastic-net representation}'' of the regression function such
15: that, if the number of data increases, the elastic-net estimator
16: is consistent not only for prediction but also for
17: variable/feature selection. Our results include finite-sample
18: bounds and an adaptive scheme to select the regularization
19: parameter. Moreover, using convex analysis tools, we derive an
20: iterative thresholding algorithm for computing the elastic-net
21: solution which is different from the optimization procedure
22: originally proposed in \cite{zhuhas05}.}
23: \end{abstract}
24: