f78b460403bda692.tex
1: \begin{abstract}
2:   %\vspace{-0.015\textheight}
3:         We generalize gradient descent with momentum for optimization in differentiable games to have complex-valued momentum.
4:         We give theoretical motivation for our method by proving convergence on bilinear zero-sum games for simultaneous and alternating updates.
5:         Our method gives real-valued parameter updates, making it a drop-in replacement for standard optimizers.
6:         We empirically demonstrate that complex-valued momentum can improve convergence in realistic adversarial games---like generative adversarial networks---by showing that we find better solutions with an almost identical computational cost.
7:         We also show a practical complex-valued Adam variant, which we use to train BigGAN to improve inception scores on CIFAR-10.
8: % \end{abstract}
9: