72c4f82423b025f9.tex
1: \begin{abstract}
2: We propose a two-stage procedure for estimating the location
3: $\bolds{\mu}$ and size~$M$ of the maximum of a smooth $d$-variate
4: regression function $f$. In the first stage, a preliminary estimator
5: of $\bolds{\mu}$ obtained from a standard nonparametric smoothing method
6: is used. At the second stage, we ``zoom-in'' near the vicinity of the
7: preliminary estimator and make further observations at some design
8: points in that vicinity. We fit an appropriate polynomial regression
9: model to estimate the location and size of the maximum.
10: We establish that, under suitable smoothness conditions and appropriate choice
11: of the zooming, the second stage estimators have better convergence
12: rates than the corresponding first stage estimators of $\bolds{\mu}$ and
13: $M$.  More specifically, for $\alpha$-smooth regression functions, the
14: optimal nonparametric rates $n^{-(\alpha-1)/(2\alpha+d)}$ and
15: $n^{-\alpha/(2\alpha+d)}$ at the first stage can be improved to
16: $n^{-(\alpha-1)/(2\alpha)}$ and $n^{-1/2}$, respectively, for
17: $\alpha>1+\sqrt{1+d/2}$. These rates are optimal in the class of all
18: possible sequential estimators. Interestingly, the two-stage procedure
19: resolves ``the curse of the dimensionality'' problem to some extent, as the
20: dimension $d$ does not control the second stage convergence rates,
21: provided that the function class is sufficiently smooth.
22: We consider a multi-stage generalization of our procedure that
23: attains the optimal rate for any smoothness level $\alpha>2$
24: starting with a preliminary estimator with any power-law rate at the first
25: stage.
26: \end{abstract}