1: \begin{abstract}

2:     The Generative Adversarial Net (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. However, it is very difficult to train due to an instability issue known as model collapse, i.e., there is a lack of diversity among generated data. In this paper, we propose a   generalized empirical Bayesian method for training GANs, where the generator is sampled from its conditional posterior distribution, while the discriminator is treated as a hyper-parameter of the distribution of the generator and learned using the stochastic approximation method along with the simulation of the generator. We provide a theoretical guarantee for its convergence to a mixed strategy Nash equilibrium. Up to our knowledge, this is the first valid Bayesian method for training GANs. This work also provides an innovative and general training method for a class of mixed strategy minimax games where one player plays a randomized strategy and the other player plays a pure strategy. Empirical studies on synthetic and real data examples demonstrate the superiority of the proposed method over the  existing ones in training GANs. Through empirical studies, we also illustrate the use of the proposed method in classical statistical tasks such as nonparametric conditional independence testing and nonparametric clustering, \textcolor{red}{for which the proposed method significantly outperforms the existing ones. }

3:    \vspace{2mm}

4:    

5:    {\bf Keywords:} Bayesian GAN; Minimax Game; Nash Equilibrium; Stochastic Approximation; Stochastic Gradient MCMC

6: \end{abstract}

7: