1: \begin{abstract}
2: Mini-batch algorithms have become increasingly popular due to the
3: requirement for solving optimization problems, based on large-scale
4: data sets. Using an existing online expectation-{}-maximization (EM)
5: algorithm framework, we demonstrate how mini-batch (MB) algorithms
6: may be constructed, and propose a scheme for the stochastic stabilization
7: of the constructed mini-batch algorithms. Theoretical results regarding
8: the convergence of the mini-batch EM algorithms are presented. We
9: then demonstrate how the mini-batch framework may be applied to conduct
10: maximum likelihood (ML) estimation of mixtures of exponential family
11: distributions, with emphasis on ML estimation for mixtures of normal
12: distributions. Via a simulation study, we demonstrate that the mini-batch
13: algorithm for mixtures of normal distributions can outperform the
14: standard EM algorithm. Further evidence of the performance of the
15: mini-batch framework is provided via an application to the famous
16: MNIST data set.
17: \end{abstract}
18: