4180a13d1902d241.tex
1: \begin{abstract}
2: This paper studies the binary classification of unbounded data from ${\mathbb R}^d$ generated under Gaussian Mixture Models (GMMs) using deep ReLU neural networks. We obtain — for the first time —
3: non-asymptotic upper bounds and convergence rates of the excess risk (excess misclassification error) for the classification without restrictions on model parameters. The convergence rates we derive
4: do not depend on dimension $d$, demonstrating that deep ReLU networks can overcome the curse of dimensionality in classification. While the majority of existing generalization analysis of classification algorithms relies on a bounded domain, we consider an unbounded domain by 
5: leveraging the analyticity and fast decay of Gaussian distributions. 
6: To facilitate our analysis, we give a novel approximation error bound for general analytic functions using ReLU networks, which may be of independent interest. 
7: Gaussian distributions can be adopted nicely to model data arising in applications, e.g., speeches, images, and texts; our results provide a theoretical verification of the observed efficiency of deep neural networks in practical classification problems.
8: %Given the universality of the Gaussian distribution in some feature spaces of data, e.g., in speeches, images, and texts, our results provide a theoretical verification of the observed efficiency of deep neural networks in practical classification problems.
9: \end{abstract}
10: