9796f362a8813acd.tex
1: \begin{abstract}
2: Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees
3: due to the relevance of these problems to a few emergent applications.
4: In this paper, we propose a unified single-loop alternating gradient projection  (AGP) algorithm for solving nonconvex-(strongly) concave and (strongly) convex-nonconcave minimax problems.
5: AGP employs simple gradient projection steps for updating the primal and dual variables alternatively at each iteration.
6: We show that it can find an $\varepsilon$-stationary point of the
7: objective function in $\mathcal{O}\left( \varepsilon ^{-2} \right)$ (resp. $\mathcal{O}\left( \varepsilon ^{-4} \right)$) iterations under nonconvex-strongly concave (resp. nonconvex-concave) setting.
8: Moreover, its gradient complexity to obtain an $\varepsilon$-stationary point of the objective function is bounded by $\mathcal{O}\left( \varepsilon ^{-2} \right)$ (resp., $\mathcal{O}\left( \varepsilon ^{-4} \right)$) under the strongly convex-nonconcave (resp.,  convex-nonconcave) setting. To the best of our knowledge, this is the first time that a simple and unified single-loop algorithm is developed for solving both nonconvex-(strongly) concave and (strongly) convex-nonconcave minimax problems. Moreover, the complexity results for solving the latter (strongly) convex-nonconcave minimax problems have never been obtained before in the literature.
9: \keywords{ minimax optimization problem  \and alternating gradient projection algorithm \and iteration complexity \and single-loop algorithm \and machine learning}
10: % \PACS{PACS code1 \and PACS code2 \and more}
11: \subclass{90C47 \and 90C26 \and 90C30}
12: \end{abstract}
13: