1: \begin{abstract}

2: The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems.  At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints.  This paper describes a block Kaczmarz algorithm that uses a randomized control scheme to choose the subset at each step.  This algorithm is the first block Kaczmarz method with an (expected) linear rate of convergence that can be expressed in terms of the geometric properties of the matrix and its submatrices.  The analysis reveals that the algorithm is most effective when it is given a good \emph{row paving} of the matrix, a partition of the rows into well-conditioned blocks.  The operator theory literature provides detailed information about the existence and construction of good row pavings.  Together, these results yield an efficient block Kaczmarz scheme that applies to many overdetermined least-squares problem.

3: %The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations $\mtx{A}\vct{x}=\vct{b}$.  The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution space given by a single row of the matrix $\mtx{A}$.  In this paper we analyze a block version of the method which projects the current iterate onto a subspace given by a block $\mtx{A}_\tau$ of the matrix rather than a single row.  Our approach utilizes a paving of the matrix $\mtx{A}$ to guarantee exponential convergence, and suggests that paving yields a significant improvement in performance in certain regimes.  We show that the paving can be constructed randomly in many cases which leads to a completely randomized block Kaczmarz algorithm.  Numerical experiments suggest that the block version with paving can indeed lead to advantages in practice.

4: \end{abstract}

5: