1: \begin{abstract}%

2: We consider the high-dimensional sparse linear regression problem of accurately estimating a sparse vector using a small number of linear measurements that are contaminated by noise.  It is well known that the standard cadre of computationally tractable sparse regression algorithms---such as the Lasso, Orthogonal Matching Pursuit (OMP), and their extensions---perform poorly when the measurement matrix contains highly correlated columns.  To address this shortcoming, we develop a simple greedy algorithm, called $\SW$, that iteratively \textit{swaps} variables until convergence.  $\SW$ is surprisingly effective in handling measurement matrices with high correlations.  In fact, we prove that $\SW$ outputs the true support, the locations of the non-zero entries in the sparse vector, under a relatively mild condition on the measurement matrix.  Furthermore, we show that $\SW$ can be used to boost the performance of \textit{any} sparse regression algorithm.  We empirically demonstrate the advantages of $\SW$ by comparing it with several state-of-the-art sparse regression algorithms.  

3: %Finally, we also analyze a natural extension of $\SW$ that swaps multiple variables, and thereby results in improved performance, at the cost of more computations.

4: \end{abstract}

5: