339d59b9ca9596ce.tex
1: \begin{abstract}
2: Sparse additive models are families of $d$-variate functions that have
3: the additive decomposition \mbox{$f^* = \sum_{j \in S} f^*_j$,} where
4: $S$ is an unknown subset of cardinality $s \ll d$. In this paper, we
5: consider the case where each univariate component function $f^*_j$
6: lies in a reproducing kernel Hilbert space (RKHS), and analyze a
7: method for estimating the unknown function $f^*$ based on kernels
8: combined with $\ell_1$-type convex regularization.  Working within a
9: high-dimensional framework that allows both the dimension $d$ and
10: sparsity $s$ to increase with $n$, we derive convergence rates (upper
11: bounds) in the $L^2(\mathbb{P})$ and $L^2(\mathbb{P}_n)$ norms over
12: the class $\MyBigClass$ of sparse additive models with each univariate
13: function $f^*_j$ in the unit ball of a univariate RKHS with bounded
14: kernel function.  We complement our upper bounds by deriving minimax
15: lower bounds on the $L^2(\mathbb{P})$ error, thereby showing the
16: optimality of our method.  Thus, we obtain optimal minimax rates for
17: many interesting classes of sparse additive models, including
18: polynomials, splines, and Sobolev classes.  We also show that if, in
19: contrast to our univariate conditions, the multivariate function class
20: is assumed to be globally bounded, then much faster estimation rates
21: are possible for any sparsity $s = \Omega(\sqrt{n})$, showing that
22: global boundedness is a significant restriction in the
23: high-dimensional setting.
24: \end{abstract}
25: