1: \begin{abstract}

2:     The Generative Adversarial Net (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. However, it is very difficult to train due to an instability issue known as model collapse, i.e., there is a lack of diversity among generated data. In this paper, we propose a   generalized empirical Bayesian method for training GANs, where the generator is sampled from its conditional posterior distribution, while the discriminator is treated as a hyper-parameter of the distribution of the generator and learned using the stochastic approximation method along with the simulation of the generator. We provide a theoretical guarantee for its convergence to a mixed strategy Nash equilibrium. Up to our knowledge, this is the first valid Bayesian method for training GANs. This work also provides an innovative and general training method for a class of mixed strategy minimax games where one player plays a randomized strategy and the other player plays a pure strategy. Empirical studies on a synthetic multi-modal example and benchmark image datasets demonstrate the superiority of the proposed method over the  existing ones in training GANs.

3:     

4:    

5:    \vspace{2mm}

6:    

7:    {\bf Keywords:} Bayesian GAN; Minimax Game; Nash Equilibrium; Stochastic Approximation; Stochastic Gradient MCMC

8: \end{abstract}

9: