cbf82ff75f8c7849.tex
1: \begin{abstract}
2: %The famous randomized Kaczmarz method is a widely used algorithm for solving consistent linear system $Ax=b$. For inconsistent linear system, it was proved that, with randomized orthogonal projection, the randomized extended Kaczmarz (REK) method
3: %converges to the minimum $\ell_2 $-norm least squares solution $x_{\star}$ with an expected exponential rate.
4: In this paper, we analyze the convergence behavior of the randomized extended Kaczmarz (REK) method 
5: for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). The analysis shows that the larger the singular value of 
6: $A$ is, the faster the error decays in the corresponding right singular vector space, and as $k\rightarrow\infty$, $x_{k}-x_{\star}$ tends to the right singular vector corresponding to the smallest singular value of $A$, where $x_{k}$ is the $k$th approximation of the REK method and $x_{\star}$ is the minimum $\ell_2 $-norm least squares solution.
7: These results 
8: explain the phenomenon found in 
9: the extensive numerical experiments appearing in the literature that the REK method seems to converge faster in the beginning. A simple numerical example is provided to confirm the above findings.
10: \end{abstract}
11: