90fff6089d854c3a.tex
1: \begin{abstract}
2:   \vspace{-0.015\textheight}
3:         We generalize gradient descent with momentum for optimization in differentiable games to have complex-valued momentum.
4:         We give theoretical motivation for our method by proving convergence on bilinear zero-sum games for simultaneous and alternating updates.
5:         Our method gives real-valued parameter updates, making it a drop-in replacement for standard optimizers.
6:         We empirically demonstrate that complex-valued momentum can improve convergence in realistic adversarial games---like generative adversarial networks---by showing we can find better solutions with an almost identical computational cost.
7:         We also show a practical generalization to a complex-valued Adam variant, which we use to train BigGAN to better inception scores on CIFAR-10.
8: \end{abstract}
9: