1d91ec2c8f528f2a.tex
1: \begin{abstract}
2: High-dimensional statistical inference deals with models in which the
3: the number of parameters $p$ is comparable to or larger than the
4: sample size $n$.  Since it is usually impossible to obtain consistent
5: procedures unless $p/n \rightarrow 0$, a line of recent work has
6: studied models with various types of low-dimensional structure,
7: including sparse vectors, sparse and structured matrices, low-rank
8: matrices, and combinations thereof.  In such settings, a general
9: approach to estimation is to solve a regularized optimization problem,
10: which combines a loss function measuring how well the model fits the
11: data with some regularization function that encourages the assumed
12: structure.  This paper provides a unified framework for establishing
13: consistency and convergence rates for such regularized $M$-estimators
14: under high-dimensional scaling.  We state one main theorem and show
15: how it can be used to re-derive some existing results, and also to
16: obtain a number of new results on consistency and convergence rates,
17: in both $\ell_2$-error and related norms. Our analysis also identifies
18: two key properties of loss and regularization functions, referred to
19: as restricted strong convexity and decomposability, that ensure
20: corresponding regularized $M$-estimators have fast convergence rates,
21: and which are optimal in many well-studied cases.
22: \end{abstract}
23: