1: \begin{abstract}

2: Generative Adversarial Networks (GAN) \cite{goodfellow2014generative}

3: are an effective method for training generative models of complex data

4: such as natural images. However, they are notoriously

5: hard to train and can suffer from the problem of {\em missing modes}

6: where the model is not able to produce examples in certain regions of the

7: space.

8: We propose an iterative procedure, called {\em AdaGAN},

9: where at every step we add a new component

10: into a mixture model by running a GAN algorithm on a reweighted sample.

11: This is inspired by {\em boosting} algorithms,

12: where many potentially weak individual predictors are greedily aggregated to

13: form a strong composite predictor.

14: We prove that such an incremental

15: procedure leads to convergence to the

16: true distribution in a finite number of steps if each step is optimal,

17: and convergence at an exponential rate otherwise.

18: We also illustrate experimentally that this procedure addresses

19: the problem of missing modes.

20: \end{abstract}

21: