d72c5cad68b5a87c.tex
1: \begin{abstract}
2: We propose an efficient algorithm for finding first-order Nash equilibria in min-max problems of the form $\textstyle\min_{x \in X}\max_{y\in Y} F(x,y)$, where the objective function is smooth in both variables and concave with respect to $y$; the sets $X$ and $Y$ are convex and ``projection-friendly,'' and $Y$ is compact. Our goal is to find an $(\ex,\ey)$-first-order Nash equilibrium with respect to a stationarity criterion that is stronger than the commonly used proximal gradient norm. The proposed approach is fairly simple: we perform approximate proximal-point iterations on the primal function, with inexact oracle provided by Nesterov's algorithm run on the regularized function $F(x_t,\cdot)$, $x_t$ being the current primal iterate. The resulting iteration complexity is $O(\ex{}^{-2} \ey{}^{-1/2})$ up to a logarithmic factor. As a byproduct, the choice $\ey = O(\ex^2)$ allows for the $O(\ex{}^{-3})$ complexity of finding an $\ex$-stationary point for the standard Moreau envelope of the primal function. Moreover, when the objective is strongly concave with respect to $y$, the complexity estimate for our algorithm improves to $O({\ex}^{-2}{\kappa_\y}^{1/2})$ up to a logarithmic factor, where $\kappa_\y$ is the condition number \odima{appropriately adjusted for coupling}. In both scenarios, the complexity estimates are the best known so far, and are only known for the (weaker) proximal gradient norm criterion.
3: \odima{Meanwhile, our approach is ``user-friendly'': (i) the algorithm is built upon running a variant of Nesterov's accelerated algorithm as subroutine and avoids extragradient steps; 
4: (ii) the convergence analysis recycles the well-known results on accelerated methods with inexact oracle.} Finally, we extend the approach to non-Euclidean proximal geometries. 
5: \end{abstract}
6: