18d89ec83ca7d3d4.tex
1: \begin{abstract}
2: We first consider minimizing a smooth function subject to an summation constraint over its variables. 
3: By exploiting a connection between the greedy 2-coordinate update for this problem and equality-constrained steepest descent in the 1-norm, we give a convergence rate for greedy selection that is faster than random selection and independent of the problem dimension $n$ (under a proximal Polyak-\L{}ojasiewicz assumption). We then consider minimizing with both a summation constraint and bound constraints, as arise in the support vector machine dual problem. Existing greedy rules for this setting either do not guarantee non-trivial progress or require $O(n^2)$ time to compute. We show that bound- and summation-constrained steepest descent in the L1-norm guarantees more progress per iteration than previous rules and can be computed in only $O(n \log n)$.
4: %We analyze a greedy 2-coordinate update algorithm, and prove that greedy coordinate selection leads a dimension-independent convergence rate that is faster convergence than random selection (under a proximal Polyak-\L{}ojasiewicz assumption). Our simple analysis exploits an equivalence between the greedy 2-coordinate update and equality-constrained steepest descent in the 1-norm. Unlike previous 2-coordinate analyses, we obtain a dimension-independent linear convergence rate. 
5: \end{abstract}
6: