52f5ba8e2590e1e7.tex
1: \begin{abstract}
2: We consider differentiable games where the goal is to find a Nash equilibrium. 
3: The machine learning community has recently started using variants of the gradient method (\textsc{GD}).
4: Prime examples are extragradient (\textsc{EG}), the optimistic gradient method (\textsc{OG}) and consensus optimization (\textsc{CO}), which enjoy linear convergence in cases like bilinear games, where the standard \textsc{GD} fails. 
5: The full benefits of theses relatively new methods are not known as there is no unified analysis for both strongly monotone and bilinear games.
6: We provide new analyses of the \textsc{EG}’s local and global convergence properties and use is to get a tighter global convergence rate for \textsc{OG} and \textsc{CO}.
7: Our analysis covers the whole range of settings between bilinear and strongly monotone games.
8: It reveals that these methods converge via different mechanisms at these extremes;
9: in between, it exploits the most favorable mechanism for the given problem.
10: We then prove that \textsc{EG} achieves the optimal rate for a wide class of algorithms with any number of extrapolations.
11: Our tight analysis of \textsc{EG}’s convergence rate in games shows that, unlike in convex minimization, \textsc{EG} may be much faster than \textsc{GD}. 
12: \end{abstract}
13: