1: \begin{abstract}

2: Games generalize the single-objective optimization paradigm by introducing different objective functions for different players.

3: Differentiable games often proceed by simultaneous or alternating gradient updates.

4: In machine learning, games are gaining new importance through formulations like generative adversarial networks (GANs) and actor-critic systems.

5: However, compared to single-objective optimization, game dynamics is more complex and less understood.

6: In this paper, we analyze gradient-based methods with momentum on simple games.

7: We prove that alternating updates are more stable than simultaneous updates.

8: Next, we show both theoretically and empirically that alternating gradient updates with a negative momentum term achieves convergence in a difficult toy adversarial problem, but also on the notoriously difficult to train saturating GANs.

9: %

10: %

11: \end{abstract}

12: