1: \begin{abstract}

2: We consider {stochastic} strongly-convex-strongly-concave (SCSC) saddle point (SP) problems which frequently arise in applications {ranging} from distributionally robust learning to game theory and %{supervised learning with non-separable regularizers}.

3: fairness in machine learning.

4: We focus on the recently developed stochastic accelerated primal-dual algorithm (SAPD), which admits optimal complexity in several settings as an accelerated algorithm. We provide high probability guarantees for convergence to a neighborhood of the saddle point that reflects accelerated convergence behavior. We also provide an analytical formula for the limiting covariance matrix of the iterates for a class of {stochastic} SCSC quadratic problems where the gradient noise is additive and Gaussian. This allows us to develop lower bounds for this class of quadratic problems which show that our analysis is tight in terms of %its

5: \saa{the high probability bound} dependency to the parameters. We also provide a risk-averse convergence analysis characterizing {the} ``Conditional Value at Risk'', %, $\chi^2$-divergence

6: the ``Entropic Value at Risk''{, and the $\chi^2$-divergence} of the distance to the saddle point, highlighting the trade-offs between the bias and the risk associated with an approximate solution obtained by terminating the algorithm at any iteration.

7: \end{abstract}

8: