1: \begin{abstract}
2: We propose a self-tuning $\LASSO$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity, and (drastic) non-Gaussianity of the noise. In addition our analysis allows for badly behaved designs, e.g. perfectly collinear regressors, and generates
3: sharp bounds on performance even in extreme cases, such as the infinite variance case and the noiseless case, in contrast to lasso. We systematically establish various non-asymptotic bounds for $\LASSO$ performance including prediction norm rate, $\ell_1$-rate, $\ell_\infty$-rate, and sharp sparsity bound. In order to cover heteroskedastic non-Gaussian noise, we rely on moderate deviation theory for self-normalized sums to achieve Gaussian-like results under weak conditions. Moreover, we derive bounds on the performance of ordinary least square (ols) applied to the model selected by $\LASSO$ accounting for possible misspecification of the selected model. Under mild conditions the rate of convergence of ols post $\LASSO$ is no worse than $\LASSO$ even with a misspecified selected model and possibly better otherwise.
4:
5: %Finally, the associated optimization problem can be cast as a convex conic programming problem and implementations based on interior point methods, first-order methods, and coordinatewise optimization are provided.
6:
7:
8: \emph{Key Words:} square-root lasso, high-dimensional sparse regression, imperfect model selection
9: non-Gaussian, heteroscedastic errors, unknown scale, infinite variance
10: \end{abstract}