a077ff8e15f312bf.tex
1: \begin{abstract}
2: % Minimax problems are prevalent in modern machine learning applications, and % first-order algorithms such as SGDA, SGDmax, and ESGDA have become the de facto methods to solve these problems.
3: % Epoch Stochastic Gradient Descent Ascent (ESGDA) has become the de facto method for solving these problems. %is minimax optimization.
4: % % Among these first-order algorithms, ESGDA, which carries out several gradient ascent steps followed by one gradient descent step in each iteration, has achieved superior performance in practice. % implementable and has a superior empirical performance.
5: % Although empirically superior, ESGDA still lacks theoretical guarantees for practical problems beyond the convex-concave assumptions. % in the difficulty of analyzing its efficiency. 
6: % % Consequently, 
7: % To fill this gap, a recent pioneering work proposed to analyze the randomized variation of ESGDA, which is called Randomized Stochastic Gradient Descent Ascent (RSGDA). 
8: % However, the existing analysis is limited to a narrow class of problems with strong assumptions and the convergence results violate the empirical observations.
9: % %still unsatisfactory in several aspects, including the narrow assumptions and limited convergence results.
10: % In this paper, we reconsider the RSGDA algorithm by introducing a new technical framework, and establish new convergence results of RSGDA under the mild assumption requiring only % that the objective function satisfies
11: % the P{\L} condition for one variable.
12: % Our theoretical results demonstrate that RSGDA can work in the broader condition and has a better convergence rate compared with the previous analysis.  
13: % Furthermore, based on our analysis, we devise an (inner-)loop-size adaptation strategy in the iterative procedure of the RSGDA algorithm.
14: % Experimental evaluations confirm the derived convergence results and  the efficacy of our proposed strategy for solving minimax problems. 
15: % \end{abstract}
16: