6e0525c13ab4cc00.tex
1: \begin{abstract} 
2: We consider solving the $\ell_1$-regularized least-squares ($\ell_1$-LS) 
3: problem in the context of sparse recovery, for applications such as 
4: compressed sensing.
5: The standard proximal gradient method, also known as iterative 
6: soft-thresholding when applied to this problem, has low computational cost 
7: per iteration but a rather slow convergence rate.
8: Nevertheless, when the solution is sparse, it often exhibits fast linear 
9: convergence in the final stage. 
10: We exploit the local linear convergence using a homotopy continuation strategy,
11: i.e., we solve the $\ell_1$-LS problem for a sequence of decreasing values 
12: of the regularization parameter, and use an approximate solution at the end 
13: of each stage to warm start the next stage.
14: Although similar strategies have been studied in the literature, 
15: there have been no theoretical analysis of their global iteration complexity.
16: This paper shows that under suitable assumptions for sparse recovery, 
17: the proposed homotopy strategy ensures that 
18: all iterates along the homotopy solution path are sparse.
19: Therefore the objective function is effectively strongly convex along the 
20: solution path, and geometric convergence at each stage can be established.
21: As a result, the overall iteration complexity of our method is 
22: $O(\log(1/\epsilon))$ for finding an $\epsilon$-optimal solution, which
23: can be interpreted as global geometric rate of convergence.
24: We also present empirical results to support our theoretical analysis.
25: \end{abstract}