debb311365f90698.tex
1: \begin{abstract}
2: This paper studies the long-existing idea of adding a nice smooth function to ``smooth'' a non-differentiable objective function in the context of sparse optimization, in particular, the minimization of $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|_2^2$, where $\vx$ is a vector, as well as  the minimization of
3: $\|\vX\|_*+\frac{1}{2\alpha}\|\vX\|_F^2$, where $\vX$ is a matrix and $\|\vX\|_*$ and $\|\vX\|_F$ are the nuclear and Frobenius norms of $\vX$,
4: respectively. We show that they let sparse vectors and low-rank matrices be efficiently recovered. In particular, they enjoy exact and stable recovery
5: guarantees
6:  similar to those known for the minimization of $\|\vx\|_1$ and $\|\vX\|_*$  under  the conditions on the sensing operator such as its  null-space property,
7: restricted isometry property, spherical section property, or  ``RIPless'' property. To recover a (nearly) sparse vector  $\vx^0$, minimizing
8: $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|^2_2$ returns (nearly) the same solution as minimizing $\|\vx\|_1$  whenever $\alpha\ge 10\|\vx^0\|_\infty$.
9: The same  relation also holds between minimizing $\|\vX\|_*+\frac{1}{2\alpha}\|\vX\|_F^2$ and minimizing $\|\vX\|_*$  for recovering a (nearly)
10: low-rank matrix  $\vX^0$ if  $\alpha\ge 10\|\vX^0\|_2$. Furthermore, we show that the linearized Bregman algorithm, as well as its two fast variants, for minimizing
11: $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|_2^2$ subject to $\vA\vx=\vb$ enjoys \emph{global} linear convergence as long as a nonzero solution exists,  and we
12: give an explicit rate of convergence. The convergence property does not require a sparse solution or any properties on  $\vA$. To our knowledge,
13: this is the best known global convergence result for  first-order sparse optimization algorithms.
14: \end{abstract}