719885aeca84e0fe.tex
1: \begin{abstract}
2: In this paper, we propose a new stochastic
3: alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full
4: gradient in the linearized ADMM formulation.
5: Besides having a low per-iteration complexity
6: as existing stochastic ADMM algorithms, the proposed algorithm improves the convergence rate
7: on convex problems
8: from $\mO \left(\frac 1 {\sqrt{T}}\right)$
9: to $\mO
10: \left(\frac 1 T\right)$,
11: where $T$ is the number of iterations. This
12: matches the  convergence rate of the batch ADMM algorithm, but without the need to visit all the samples in each
13: iteration.
14: Experiments on the graph-guided fused lasso
15: %a number of real-world data sets
16: demonstrate that the new algorithm is significantly
17: faster than state-of-the-art stochastic and batch
18: ADMM algorithms.
19: \end{abstract}
20: