2fc061f770146847.tex
1: \begin{abstract}
2:    Optimizing the discriminator in Generative Adversarial Networks (GANs) to completion   
3:    in the inner training loop is computationally prohibitive, and on finite datasets 
4:    would result in overfitting. To address this, a common update strategy is to alternate 
5:    between k optimization steps for the discriminator D and one optimization step for the generator G. 
6:    This strategy is repeated in various GAN algorithms where k is selected empirically. In this paper, 
7:    we show that this update strategy is not optimal in terms of accuracy and convergence speed,
8:    and propose a new update strategy for networks with Wasserstein GAN (WGAN) group related loss functions 
9:    (\eg WGAN, WGAN-GP, Deblur GAN, and Super resolution GAN). The proposed update strategy is based on a loss 
10:    change ratio comparison of G and D. We demonstrate that the proposed strategy improves
11:    both convergence speed and accuracy.
12: \end{abstract}
13: