1: \begin{abstract}% <- trailing '%' for backward compatibility of .sty file
2: There has been a surge of interest in developing robust estimators for models with heavy-tailed data in statistics and machine learning. This paper proposes a log-truncated M-estimator for a large family of statistical regressions and establishes its excess risk bound under the condition that the data have $(1+\e)$-th moment with $\e \in (0,1]$. With an additional assumption on the associated risk function, we obtain an $\ell_2$-error bound for the estimation. Our theorems are applied to establish robust M-estimators for concrete regressions. Besides convex regressions such as quantile regression and generalized linear models, many non-convex regressions can also be fit into our theorems, we focus on robust deep neural network regressions, which can be solved by the stochastic gradient descent algorithms. Simulations and real data analysis demonstrate the superiority of log-truncated estimations over standard estimations.
3:
4:
5:
6:
7: %Our results greatly extend the recent work \cite{zhang2018ell_1} and \cite{chen2020generalized}, which studied the log-truncated M-estimator of LAD.
8:
9: %The derived $\ell_2$-risk is applied in analyzing the convergence rate for the $L_2$-error of slope function estimates in both robust functional quantiles and generalized linear regressions with functional predictors, under functional principal components analysis (FPCA).
10:
11: %\footnote{This version submitted to arXiv on May 01, 2021}
12: \end{abstract}
13: