1: \begin{abstract}

2: Recent work has shown local convergence of GAN training for absolutely continuous

3: data and generator distributions.

4: In this paper, we

5: show that the requirement of absolute continuity is necessary: we

6: describe a simple yet prototypical counterexample showing that in the more

7: realistic case of distributions that are not absolutely continuous,

8: unregularized GAN training is not always convergent.

9: Furthermore, we discuss regularization strategies that were

10: recently proposed to stabilize GAN training. 

11: Our analysis shows that GAN training with instance noise or

12: zero-centered gradient penalties

13: converges.

14: On the other hand, we show that

15: Wasserstein-GANs and WGAN-GP with a finite number of discriminator updates

16: per generator update

17: do not always converge to the equilibrium point.

18: We discuss these results, leading us to a new explanation

19: for the stability problems of GAN training.

20: Based on our analysis, we extend our convergence results to

21: more general GANs and prove local convergence 

22: for simplified gradient penalties even if the generator and 

23: data distributions lie on lower dimensional manifolds.

24: We find these penalties to work well in practice and use them

25: to learn high-resolution generative image models for a

26: variety of datasets with little

27: hyperparameter tuning.

28: \end{abstract}

29: