1: \begin{abstract}

2:     The Generative Adversarial Net (GAN) was recently introduced in the literature as a novel machine learning method for training generative models, which has many applications in statistics such as nonparametric conditional independence tests and nonparametric clustering. However, GAN is very difficult to train due to an instability issue known as mode collapse, i.e., there is a lack of diversity among generated data. In this work, we lay out a new theoretical framework for GAN based on randomized decision rules, where the discriminator converges to a fix point but the generator converges to a distribution at the Nash equilibrium. Under the new theoretical framework, we propose to train GAN by an empirical Bayesian method, where the generator is simulated from its conditional posterior distribution using a stochastic gradient MCMC algorithm, and the discriminator is treated as a hyper-parameter of the posterior distribution of the generator and trained by a stochastic approximation method along with the simulation of the generator. The convergence of the proposed method to the Nash equilibrium is asymptotically guaranteed. Compared to the existing GAN training methods, the proposed method has better capability to overcome the mode collapse issue and typically converges much faster to the Nash equilibrium an. In addition, we show that the proposed method is superior to classical statistical methods in nonparametric conditional independence tests and nonparametric clustering. 

3:     %The proposed method is very flexible, which allows many variants of GAN, such as Lipschitz GAN and cluster GAN, to be trained under the same framework and has their performance improved further.  

4:    \vspace{2mm}

5:    

6:    {\bf Keywords:} Minimax Game; Nonparametric Clustering; Nonparametric Conditional Independence Test; Stochastic Approximation; Stochastic Gradient MCMC

7: \end{abstract}

8: