1: \begin{abstract}

2: For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$

3: with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization

4: based Krylov solver LSQR and its mathematically equivalent CGLS, the

5: Conjugate Gradient (CG) method implicitly applied to $A^TAx=A^Tb$,

6: are most commonly used, and CGME, the CG method applied to

7: $\min\|AA^Ty-b\|$ or $AA^Ty=b$ with $x=A^Ty$, and

8: LSMR, which is equivalent to the minimal residual (MINRES) method

9: applied to $A^TAx=A^Tb$, have also been choices.

10: These methods exhibit typical semi-convergence feature,

11: and the iteration number $k$ plays the role of the regularization parameter.

12: However, there has been no definitive answer to the long-standing fundamental

13: question:

14: {\em Can LSQR and CGLS find 2-norm filtering best possible regularized solutions}?

15: The same question is for CGME and LSMR too.

16: At iteration $k$, LSQR, CGME and LSMR compute {\em different} iterates from the

17: {\em same} $k$ dimensional Krylov subspace.

18: A first and fundamental step towards to answering the above question

19: is to {\em accurately} estimate the accuracy of the underlying

20: $k$ dimensional Krylov subspace approximating the $k$ dimensional dominant right

21: singular subspace of $A$. Assuming that the singular values of $A$ are simple,

22: we present a general $\sin\Theta$ theorem for the 2-norm distances between these

23: two subspaces and derive accurate estimates on them for severely, moderately

24: and mildly ill-posed problems. We also

25: establish some relationships between the smallest Ritz values and

26: these distances. Numerical experiments justify the sharpness of our

27: results.

28: \end{abstract}