1: \begin{abstract}

2: The rapid progress in machine learning in recent years has been based on a highly productive

3: connection to gradient-based optimization.  Further progress hinges in part on a shift in focus from pattern recognition to decision-making and multi-agent

4: problems.  In these broader settings, new mathematical challenges emerge that involve equilibria

5: and game theory instead of optima.  Gradient-based methods remain essential---given the high

6: dimensionality and large scale of machine-learning problems---but simple gradient descent

7: is no longer the point of departure for algorithm design.  We provide a gentle introduction to a broader framework

8: for gradient-based algorithms in machine learning, beginning with saddle points and monotone

9: games, and proceeding to general variational inequalities.  While we provide convergence proofs

10: for several of the algorithms that we present, our main focus is that of providing motivation

11: and intuition.

12: \end{abstract}

13: