1: \begin{abstract}
2:
3: Generative adversarial networks (GANs) use adversarial training to implicitly learn a (potentially very complex) probability distribution.
4: One major form of training failure, known as mode collapse, involves the generator failing to reproduce the full diversity of modes in the target probability distribution.
5: %We present an effective model of GAN training which captures the learning dynamics of a wide generator neural networks by replacing the generator with a collection of $N$ particles coupled by a static NTK. We argue for a form of universality, in which these wide neural networks may be characterized by two numbers.
6: We present an effective model of GAN training, which captures the learning dynamics by replacing the generator neural network with a collection of particles in the output space; particles are coupled by a universal kernel valid for wide neural networks.
7: The generality of our simplified model allows us to study the conditions under which mode collapse occurs, identifying a clear transition boundary whose shape is determined by learning characteristics of the discriminator. Further, we find that GAN regularizers of intermediate strengths can optimally yield convergence through critical damping of the generator dynamics. Our effective GAN model thus provides an interpretable physical framework for understanding and improving adversarial training.
8:
9: % power of deep generative models
10: % what is GAN: G & D => saddle point of loss landscape, dynamics is hidden
11: % one major form of failure: MC
12: % effective model
13: % physical analogy & interpretation allow understanding of the origin of MC
14: % provide a guide to resolve MC and better train GANs
15:
16: \end{abstract}
17: