1: \begin{abstract}

2: % We study continuous dynamics describing local training of Generative Adversarial Networks (GANs) and show how it can be written as a system of partial differential equations. Thus, the convergence property can be inferred from the eigenvalues of the resulting differential operator. Surprisingly, these eigenvalues are uniquely defined by the eigenvalues of the weighted Laplace operator, and the convergence rate is determined by its minimal eigenvalue. This value, commonly called the Poincar\'{e} constant, depends solely on the target measure. In this framework we can provide explanations of common practices used in GAN training, such as gradient penalisation, discriminator balancing and data augmentation. Specifically, we show how the recent advances in improving FID scores by the extensive usage of augmentations can be explained in terms of shift of the corresponding Poincar\'e constant.

3: Recent work demonstrated the benefits of studying continuous-time dynamics governing the GAN training. However, this dynamics is analyzed in the model parameter space, which results in finite-dimensional dynamical systems. We propose a novel perspective where we study the local dynamics of adversarial training in the general functional space and show how it can be represented as a system of partial differential equations. Thus, the convergence properties can be inferred from the eigenvalues of the resulting differential operator. We show that these eigenvalues can be efficiently estimated from the target dataset before training. Our perspective reveals several insights on the practical tricks commonly used to stabilize GANs, such as gradient penalty, data augmentation, and advanced integration schemes. As an immediate practical benefit, we demonstrate how one can a priori select an optimal data augmentation strategy for a particular generation task.

4: 

5: \end{abstract}

6: