e2df4f7d73a36259.tex
1: \begin{abstract}
2: 		We consider the convex-concave saddle point problem $\min_{\bx}\max_{\by}\Phi(\bx,\by)$, where the decision variables $\bx $ and/or $\by$ subject to a multi-block structure and affine coupling constraints, and $\Phi(\bx,\by)$ possesses certain separable structure. Although the minimization counterpart of such problem has been widely studied under the topics of {ADMM}, this minimax problem is rarely investigated. In this paper, a convenient notion of $\epsilon$-saddle point is proposed, under which the convergence rate of several proposed algorithms are analyzed. When only one of $\bx$ and $\by$ has multiple blocks and affine constraint, several natural extensions of {ADMM} are proposed to solve the problem. Depending on the number of blocks and the level of smoothness, $\cO(1/T)$ or $\cO(1/\sqrt{T})$ convergence rates are derived for our algorithms. % Such results can be extended to cases where $\bx$ has more than 3 blocks, given additional conditions or proper purterbations.
3: 		When both $\bx$ and $\by$ have multiple blocks and affine constraints, a new algorithm called \underline{E}xtra\underline{G}radient \underline{M}ethod of \underline{M}ultipliers ({EGMM}) is proposed. Under desirable smoothness condition, an $\cO(1/T)$ rate of convergence can be guaranteed regardless of the number of blocks in $\bx$ and $\by$. In depth comparison between {EGMM} (fully primal-dual method) and {ADMM} (approximate dual method) is made over the multi-block optimization problems to illustrate the advantage of the EGMM.
4: 	\end{abstract}
5: