1: \begin{abstract}
2: % Generative adversarial networks(GAN) are drawing attention not only for good performance on generating data, but also for various applications such as semi-supervised learning, reinforcement learning etc. Behind its usefulness and potential, GANs are still less understood. Convergence and Stability issue of non minmax case are especially so. Various approaches have been proposed to solve such problem, and one promising approach is probabilistic modeling with sampling update. Training GAN by sampling may be accompanied by training of multiple models. So, it will be necessary to learn them sparse to save parameters for real world application. We propose a new GAN training algorithm that theoretically guarantees convergence and can be applied for sparse model.
3:
4: The Generative Adversarial Net (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. However, it is very difficult to train due to an instability issue known as model collapse, i.e., there is a lack of diversity among generated data. In this paper, we propose a
5: generalized empirical Bayesian method for training GANs, where the generator is sampled from its conditional posterior distribution, while the discriminator is treated as a parameter of the distribution of the generator and learned using the stochastic approximation method along
6: with sampling of the generator. We provide a theoretical guarantee for its convergence to the Nash equilibrium. Empirical studies on synthetic high-dimensional multi-modal data and benchmark image datasets, CIFAR-10 and HAM10000, demonstrate the superiority of the proposed method over the state-of-the-art GAN training methods.
7: % The numerical results indicate that the proposed method significantly outperforms the existing state-of-the-art methods in training GANs.
8: \end{abstract}
9: