1: \begin{abstract}

2:     Self-training, a semi-supervised learning  algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited. Despite empirical successes, its theoretical characterization remains illusive. To the best of our knowledge, this work establishes the first theoretical analysis for the known iterative self-training paradigm and formally proves the benefits of unlabeled data in both training convergence and generalization ability. To be specific, we prove that iterative self-training converges linearly with both the convergence rate and generalization accuracy improved in the order of  $1/\sqrt{M}$, where $M$ is the number of unlabeled samples. To make our theoretical analysis feasible, we focus on the case of  one-hidden-layer neural networks. However, theoretical justification on the benefit of unlabeled data in iterative self-training is non-trivial even for shallow neural network. First, the limited number of labeled data leads the optimization problem to be highly non-convex. Second, existing techniques of the landscape analysis built upon supervised learning on longer hold due to the introduction of unlabeled data. Nevertheless, the achieved theoretical insights are general and are validated by our experiments on deep neural networks.

3: \end{abstract}

4: