1: \begin{abstract}

2: Under certain conditions (known as the {\em Restricted Isometry Property} or RIP) on the $m\times N$-matrix $\Phi$ (where $m<N$), vectors $x \in \R^N$ that are sparse (i.e. have most of their entries equal to zero) can be recovered exactly from $y:=\Phi x$ even though $\Phi^{-1}(y)$ is typically an $(N-m)$-dimensional hyperplane; in addition $x$ is then

3: equal to the element in $\Phi^{-1}(y)$ of minimal

4: $\ell_1$-norm. This minimal element can be identified via linear programming algorithms. \\

5: We study an alternative method of determining $x$, as the limit of an 

6: {\em Iteratively Re-weighted Least Squares} (IRLS) algorithm.

7: The main step of this IRLS finds, for a given weight vector $w$, the element

8: in $\Phi^{-1}(y)$ with smallest $\ell_2(w)$-norm.  If $x^{(n)}$ is the solution at iteration step $n$, then the new weight $w^{(n)}$ is defined by 

9: $w^{(n)}_i:=\left[|x^{(n)}_i|^2+\epsilon_n^2\right]^{-1/2}$, $i=1,\dots,N$, for a decreasing

10: sequence of adaptively defined $\epsilon_n$; this  updated weight is then used to obtain $x^{(n+1)}$ and the process is repeated. We prove that when $\Phi$

11: satisfies the RIP conditions, the sequence $x^{(n)}$ converges for all 

12: $y$, regardless of

13: whether $\Phi^{-1}(y)$ contains a sparse vector. If there is a sparse 

14: vector in $ \Phi^{-1}(y)$, then the limit is this sparse vector, and

15: when $x^{(n)}$ is sufficiently  close to the limit, the remaining steps of the algorithm  converge exponentially fast ({\em linear convergence} in the terminology of numerical optimization).  

16: The same algorithm with the ``heavier'' weight

17: $w^{(n)}_i = \left[|x^{(n)}_i|^2+\epsilon_n^2\right]^{-1+\tau/2}$, $i=1,\dots,N$, where $0<\tau<1$, can recover sparse solutions as well;

18: more importantly, we show its local convergence is superlinear and approaches a 

19: {\em quadratic} rate for $\tau$ approaching to zero.

20: \end{abstract}

21: