fea6263fe86fd287.tex
1: \begin{abstract}
2: This paper studies minimax optimization problems $\min_\x \max_\y f(\x,\y)$, where $f(\x,\y)$ is $m_\x$-strongly convex with respect to $\x$, $m_\y$-strongly concave with respect to $\y$ and $(L_\x,L_{\x\y},L_\y)$-smooth. Zhang et al. \cite{zhang2019lower} 
3: provided the following lower bound of the gradient complexity for
4: any first-order method:
5: $\Omega\Bigl(\sqrt{\frac{L_\x}{m_\x}+\frac{L_{\x\y}^2}{m_\x m_\y}+\frac{L_\y}{m_\y}}\ln(1/\epsilon)\Bigr).$ 
6: This paper proposes a new algorithm with gradient complexity upper bound 
7: $\Tilde{O}\Bigl(\sqrt{\frac{L_\x}{m_\x}+\frac{L\cdot L_{\x\y}}{m_\x m_\y}+\frac{L_\y}{m_\y}}\ln\left(1/\epsilon\right)\Bigr),$ where $L=\max\{L_\x,L_{\x\y},L_\y\}$. This improves over the best known upper bound $\Tilde{O}\left(\sqrt{\nicefrac{L^2}{m_\x m_\y}} \ln^3\left(1/\epsilon\right)\right)$
8: by Lin et al. \cite{lin2020near}. Our bound achieves linear convergence rate and tighter dependency on condition numbers, especially when 
9: $L_{\x\y}\ll L$ (i.e., when the interaction between $\x$ and $\y$ is weak).
10: Via reduction, our new bound also implies improved bounds for strongly convex-concave and convex-concave minimax optimization problems. 
11: When $f$ is quadratic, we can further improve the upper bound, 
12: which matches the lower bound up to a small sub-polynomial factor. 
13: \end{abstract}
14: