1: \begin{abstract}

2: Block Coordinate Update (BCU) methods enjoy low per-update computational complexity because every time

3: only one or a few block variables would need to be updated among possibly a large

4: number of blocks.

5: They are also easily parallelized and thus have been particularly popular for solving problems involving large-scale dataset and/or variables.

6: In this paper, we propose a primal-dual BCU method for solving linearly constrained convex program in multi-block variables. The method is an accelerated version of a

7: primal-dual algorithm proposed by the authors, which applies randomization in selecting block variables to update and establishes an $O(1/t)$ convergence rate under convexity assumption. We show that the rate can be accelerated to $O(1/t^2)$ if the objective is strongly convex. In addition, if one block variable is independent of the others in the objective, we then show that the algorithm can be modified to

8: achieve a linear rate of convergence.

9: The numerical experiments

10: show that the accelerated method performs stably with a single set of parameters while the original

11: method needs to tune the parameters for different datasets in order to achieve a comparable level of performance.

12: 

13: \vspace{0.5cm}

14: 

15: \noindent {\bf Keywords:} primal-dual method, block coordinate update, alternating direction method of multipliers (ADMM), accelerated first-order method.

16: 

17: \vspace{0.1cm}

18: 

19: \noindent {\bf Mathematics Subject Classification:} 90C25, 95C06, 68W20.

20: 

21: 

22: \end{abstract}

23: