1: \begin{abstract}

2: In regularized risk minimization, the associated optimization problem becomes particularly difficult when

3: both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear

4: convergence properties, are restricted to limited problem subclasses, or require careful setting of a

5: smoothing parameter. In this paper, we propose a continuation algorithm that is applicable to

6: a large class of 

7: nonsmooth regularized risk minimization problems,

8: can be flexibly used with a number of existing 

9: solvers for the underlying smoothed subproblem, and with convergence results on the whole

10: algorithm rather than just one of its subproblems.  In particular, when accelerated solvers

11: are used, the proposed algorithm achieves the fastest known rates of

12: $O(1/T^2)$ on strongly convex problems, and $O(1/T)$ on general convex problems. Experiments on nonsmooth

13: classification and regression tasks demonstrate that the proposed algorithm outperforms the state-of-the-art.

14: \end{abstract}

15: