1: \begin{abstract}

2:     The Generative Adversarial Net (GAN) was recently introduced in the literature as a novel machine learning method for training generative models, which has many applications in statistics such as nonparametric conditional independence tests and nonparametric clustering. However, GAN is very difficult to train due to an instability issue known as mode collapse, i.e., there is a lack of diversity among generated data. In this paper, we figure out the reason why GAN suffers from the mode collapse issue and lay out a new theoretical framework for GAN based on randomized decision rules such that the mode collapse issue can be overcome essentially. Under the new theoretical framework, the discriminator converges to a fixed point while the generator converges to a distribution at the Nash equilibrium. We propose to train GAN by an empirical Bayesian method, where the generator is simulated from its conditional posterior distribution using a stochastic gradient MCMC algorithm, and the discriminator is treated as a hyper-parameter of the posterior distribution of the generator and trained by a stochastic approximation method along with the simulation of the generator. The convergence of the proposed method to the Nash equilibrium is asymptotically guaranteed. In addition, we show that the proposed method is superior to classical statistical methods in nonparametric conditional independence tests and nonparametric clustering. 

3:     %The proposed method is very flexible, which allows many variants of GAN, such as Lipschitz GAN and cluster GAN, to be trained under the same framework and has their performance improved further.  

4:  \end{abstract}

5: