a59f263df67c86a9.tex
1: \begin{abstract}
2: Classical least squares estimators are well-known to be robust with respect to moment assumptions 
3: concerning the error distribution in a wide variety of finite-dimensional statistical problems;  
4: generally only a second moment assumption is required for least squares estimators to maintain
5: the same rate of convergence that they would satisfy if the errors were assumed to be Gaussian.
6: In this paper, we give a geometric characterization of the robustness of shape-restricted 
7: least squares estimators (LSEs)  to error distributions with an 
8: $L_{2,1}$ moment, in terms of the `localized envelopes' of the model. 
9: 	
10: 
11: This envelope perspective gives a systematic approach to proving oracle inequalities 
12: for the LSEs in shape-restricted regression problems in the random design setting, 
13: under a minimal $L_{2,1}$ moment assumption on the errors. The canonical isotonic 
14: and convex regression models, and a more challenging additive regression model 
15: with shape constraints are studied in detail. Strikingly enough, in the additive model 
16: both the adaptation and robustness properties of the LSE can be preserved, up to 
17: error distributions with an $L_{2,1}$ moment, for estimating the shape-constrained 
18: proxy of the marginal $L_2$ projection of the true regression function. This holds 
19: essentially regardless of whether or not the additive model structure is correctly specified.
20: 
21: 
22: The new envelope perspective goes beyond shape constrained models. 
23: Indeed, at a general level, the localized envelopes give a sharp characterization 
24: of the convergence rate of the $L_2$ loss of the LSE between the worst-case 
25: rate as suggested by the recent work of the authors \cite{han2017sharp}, and the 
26: best possible parametric rate. 
27: 
28: \end{abstract}
29: