1: \begin{abstract}

2:   The Stochastic Extragradient (SEG)

3: method is one of the most popular algorithms for solving finite-sum min-max

4: optimization and variational inequality 

5: problems (VIPs) appearing in various

6: machine learning tasks. However, existing

7: convergence analyses of SEG focus on its

8: with-replacement variants, while practical

9: implementations of the method randomly

10: reshuffle components and sequentially

11: use them. Unlike the well-studied with-replacement variants, SEG with Random

12: Reshuffling (SEG-RR) lacks established

13: theoretical guarantees. In this work, we

14: provide a convergence analysis of SEG-RR

15: for three classes of VIPs: (i) strongly

16: monotone, (ii) affine, and (iii) monotone. We derive conditions under

17: which SEG-RR achieves a faster convergence rate than

18: the uniform with-replacement sampling

19: SEG. In the monotone setting, our analysis of SEG-RR guarantees convergence to an arbitrary accuracy without large batch sizes, a strong requirement needed in the classical with-replacement SEG. As a byproduct of our results, we provide convergence guarantees for

20: Shuffle Once SEG (shuffles the data only

21: at the beginning of the algorithm) and the

22: Incremental Extragradient (does not shuffle the

23: data). We supplement our analysis with experiments validating empirically the superior performance of SEG-RR over the classical with-replacement sampling SEG.

24: \end{abstract}

25: