1: \begin{abstract}

2: Generative adversarial networks (GANs) have achieved impressive performance

3: in data synthesis and have driven the development of many applications.

4: However, GANs are known to be hard to train due to their bilevel objective,

5: which leads to the problems of convergence, mode collapse, and gradient

6: vanishing. In this paper, we propose a new generative model called

7: the generative adversarial NTK (GA-NTK) that has a single-level objective.

8: The GA-NTK keeps the spirit of adversarial learning (which helps generate

9: plausible data) while avoiding the training difficulties of GANs.

10: This is done by modeling the discriminator as a Gaussian process with

11: a neural tangent kernel (NTK-GP) whose training dynamics can be completely

12: described by a closed-form formula. We analyze the convergence behavior

13: of GA-NTK trained by gradient descent and give some sufficient conditions

14: for convergence. We also conduct extensive experiments to study the

15: advantages and limitations of GA-NTK and propose some techniques that

16: make GA-NTK more practical.\footnote{Our code is available on GitHub at \url{https://github.com/ga-ntk/ga-ntk}. }

17: \end{abstract}

18: