1: \begin{abstract}
2: This paper studies the long-existing idea of adding a nice smooth function to ``smooth'' a non-differentiable objective function in the context of sparse optimization, in particular, the minimization of $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|_2^2$, where $\vx$ is a vector, as well as the minimization of
3: $\|\vX\|_*+\frac{1}{2\alpha}\|\vX\|_F^2$, where $\vX$ is a matrix and $\|\vX\|_*$ and $\|\vX\|_F$ are the nuclear and Frobenius norms of $\vX$,
4: respectively. We show that they let sparse vectors and low-rank matrices be efficiently recovered. In particular, they enjoy exact and stable recovery
5: guarantees
6: similar to those known for the minimization of $\|\vx\|_1$ and $\|\vX\|_*$ under the conditions on the sensing operator such as its null-space property,
7: restricted isometry property, spherical section property, or ``RIPless'' property. To recover a (nearly) sparse vector $\vx^0$, minimizing
8: $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|^2_2$ returns (nearly) the same solution as minimizing $\|\vx\|_1$ whenever $\alpha\ge 10\|\vx^0\|_\infty$.
9: The same relation also holds between minimizing $\|\vX\|_*+\frac{1}{2\alpha}\|\vX\|_F^2$ and minimizing $\|\vX\|_*$ for recovering a (nearly)
10: low-rank matrix $\vX^0$ if $\alpha\ge 10\|\vX^0\|_2$. Furthermore, we show that the linearized Bregman algorithm, as well as its two fast variants, for minimizing
11: $\|\vx\|_1+\frac{1}{2\alpha}\|\vx\|_2^2$ subject to $\vA\vx=\vb$ enjoys \emph{global} linear convergence as long as a nonzero solution exists, and we
12: give an explicit rate of convergence. The convergence property does not require a sparse solution or any properties on $\vA$. To our knowledge,
13: this is the best known global convergence result for first-order sparse optimization algorithms.
14: \end{abstract}