1: \begin{abstract}

2:   Stochastic Gradient Descent-Ascent (\algname{SGDA}) is one of the most prominent algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. 

3: The success of the method led to several advanced extensions of the classical \algname{SGDA}, including variants with arbitrary sampling, variance reduction, coordinate randomization, and distributed variants with compression, which were extensively studied in the literature, especially during the last few years.

4: In this paper, we propose a unified convergence analysis that covers a large variety of stochastic gradient descent-ascent methods, which so far have required different intuitions, have different applications and have been developed separately in various communities. A key to our unified framework is a parametric assumption on the stochastic estimates. Via our general theoretical framework, we either recover the sharpest known rates for the known special cases or tighten them.

5: Moreover, to illustrate the flexibility of our approach we develop several new variants of \algname{SGDA} such as a new variance-reduced method (\algname{L-SVRGDA}), new distributed methods with compression (\algname{QSGDA}, \algname{DIANA-SGDA}, \algname{VR-DIANA-SGDA}), and a new method with coordinate randomization (\algname{SEGA-SGDA}). Although variants of the new methods are known for solving minimization problems, they were never considered or analyzed for solving min-max problems and VIPs. We also demonstrate the most important properties of the new methods through extensive numerical experiments.

6: \end{abstract}

7: