1: \begin{abstract}

2: 	We propose iterative \jbbR{projection} method\jbbRo{s} for solving square or rectangular consistent linear systems $\A\x = \bbold$.

3: 	\jbbRo{Existing projection methods use sketching matrices (possibly randomized) to generate a sequence of small projected subproblems, but even the smaller systems can be costly. We develop a process that appends one column to the sketching matrix each iteration and converges in a finite number of iterations %{independent} of

4: 	whether the sketch is 

5: 	random or deterministic. In general, our process generates orthogonal updates to the approximate solution $ \xk $. By choosing the sketch to be the set of all previous residuals, we obtain a simple recursive update and convergence in at most $\text{rank}(\A)$ iterations (in exact arithmetic). By choosing a sequence of identity columns for the sketch, we develop a generalization of the Kaczmarz method. In experiments on large sparse systems, our method (PLSS) \jbbRt{with residual sketches is competitive with

6: 	LSQR and LSMR, and %our method

7: 	with residual and identity sketches compares favorably with state-of-the-art randomized methods.}}

8: % $S^T\! Ax = S^T\! b$

9: 	\end{abstract}

10: