1: \begin{abstract}

2: Iteratively Re-weighted Least Squares (IRLS) is a method for solving minimization problems involving non-quadratic cost functions, perhaps non-convex and non-smooth, which however can be described as the infimum over a family of quadratic functions. 

3: This transformation suggests an algorithmic scheme that solves a sequence of quadratic problems to be tackled efficiently by tools of numerical linear algebra. 

4: Its general scope and its usually simple implementation, transforming the initial non-convex and non-smooth minimization problem  into a more familiar and easily solvable quadratic optimization problem, make it a

5: versatile algorithm. 

6: However, despite its simplicity, versatility, and elegant analysis,  the complexity of IRLS 

7:  strongly depends on the way the solution of the successive quadratic optimizations is addressed. For the important special case of {\it compressed sensing} and sparse recovery problems in signal processing, we investigate theoretically and numerically how accurately one needs to solve the quadratic problems by means of the {\it conjugate gradient} (CG) method in each iteration in order to

8:  guarantee convergence. The use of the CG method may significantly speed-up the numerical solution of the quadratic subproblems, in particular,

9:  when fast matrix-vector multiplication (exploiting for instance the FFT) is available for the matrix involved.

10: In addition, we study convergence rates.

11:  Our modified IRLS method outperforms state of the art first order methods such as Iterative Hard Thresholding (IHT) or Fast Iterative Soft-Thresholding Algorithm (FISTA) in many situations, 

12:  especially in large dimensions. Moreover, IRLS is often able to recover sparse vectors from fewer measurements than required for IHT and FISTA. 

13: \keywords{Iteratively re-weighted least squares \and conjugate gradient method \and $\ltau$-norm minimization \and compressed sensing \and sparse recovery.}

14: \end{abstract}

15: