f746bcedf9b943a1.tex
1: \begin{abstract}
2: In minimax optimization, the extragradient (EG) method has been extensively studied because it outperforms the gradient descent-ascent method in convex-concave (C-C) problems.
3: Yet, stochastic EG (SEG) has seen limited success in C-C problems, especially for unconstrained cases.
4: Motivated by the recent progress of shuffling-based stochastic methods, we investigate the convergence of \emph{shuffling-based SEG} in unconstrained \emph{finite-sum} minimax problems, in search of %
5: convergent
6: shuffling-based SEG.  
7: Our analysis reveals that both random reshuffling and the recently proposed flip-flop shuffling %
8: alone can suffer divergence in C-C problems. 
9: However, with an additional simple trick called anchoring, we develop the \emph{SEG with flip-flop anchoring} (\segffa{}) method which successfully converges in C-C problems.  
10: We also show upper and lower bounds in the strongly-convex-strongly-concave setting, demonstrating that \segffa{} has a provably faster convergence rate compared to other shuffling-based methods.
11: \end{abstract}
12: