1: \begin{abstract}

2: In this paper, we present novel randomized algorithms for solving saddle point problems whose

3: dual feasible region is given by the direct product of many convex sets. Our algorithms can achieve

4: an ${\cal O}(1/N)$ and ${\cal O}(1/N^2)$ rate of convergence, respectively, for general bilinear saddle point

5: and smooth bilinear saddle point problems  based on a new prima-dual termination criterion, and each iteration

6: of these algorithms needs to solve only one randomly selected dual subproblem.

7: Moreover, these algorithms do not require strongly convex assumptions on the objective function and/or the incorporation of a strongly convex perturbation term. They do not necessarily require the primal or dual feasible regions to be bounded

8: or the estimation of the distance from the initial point to the set of optimal solutions to be available either.

9: We show that

10: when applied to linearly constrained problems, RPDs are equivalent to

11: certain randomized variants of the alternating direction method of multipliers (ADMM), while

12: a direct extension of ADMM does not necessarily converge when the number of blocks exceeds two.

13: 

14: \vspace{.1in}

15: 

16: \noindent {\bf Keywords.} Stochastic Optimization, Block Coordinate Descent, Nonsmooth Optimization, Saddle Point Optimization,

17: Alternating Direction Method of Multipliers

18: 

19: \vspace{.1in}

20: 

21: %\noindent {\bf AMS subject classifications.} 62L20, 90C25, 90C15, 68Q25

22: \end{abstract}