6b6deaed7beef01c.tex
1: \begin{abstract}
2: Many problems reduce to the fixed-point problem of solving $x=T(x)$, {where $T$ is a mapping from a Hilbert space to itself.} To this problem, we apply the coordinate-update algorithms, which update only one or a few components of $x$ at each step. When {each step} is cheap, these algorithms are faster than the full fixed-point iteration (which updates all the components).
3: 
4: In this paper, we focus on {cyclic coordinate} selection rules, where the ordering of coordinates in each cycle is arbitrary. {The corresponding} algorithms are fast, but their convergence is unknown in the fixed-point setting.
5: 
6: When $T$ is a nonexpansive operator and has a fixed point, we show that the sequence of coordinate-update iterates converges to a fixed point under proper step sizes. This result applies to the primal-dual coordinate-update algorithms, which have {wide} applications to optimization problems with nonseparable nonsmooth objectives, as well as global linear constraints.
7: 
8: Numerically, we apply coordinate-update algorithms with cyclic, shuffled cyclic, and random selection rules to $\ell_1$ robust least squares, {total variation minimization}, as well as nonnegative matrix factorization. They converge much faster than the standard fixed-point iteration. Among the three rules, cyclic and shuffled cyclic rules are overall faster than the random rule.
9: \end{abstract}
10: