1: \begin{abstract}

2: %\marginpar{\tiny to be rewritten}

3: We consider the following constrained Rayleigh quotient optimization problem (CRQopt)

4: $$

5: \min_{x\in \mathbb{R}^n} x^{\T}Ax\,\,\mbox{subject to}\,\, x^{\T}x=1\,\mbox{and}\,C^{\T}x=b,

6: $$

7: where $A$ is an $n\times n$ real symmetric matrix and $C$ is an $n\times m$ real matrix. 

8:       Usually, $m\ll n$.

9: The problem is also known as the constrained eigenvalue problem in the literature 

10: because it becomes an eigenvalue problem

11: if the linear constraint $C^{\T}x=b$ is removed. We start by equivalently transforming  CRQopt into

12: an optimization problem, called LGopt, of minimizing the Lagrangian multiplier of CRQopt, and then

13: an problem, called QEPmin, of finding the smallest eigenvalue of a quadratic eigenvalue problem.

14: Although such equivalences has been discussed 

15:       in the literature, it appears to be the first time that these equivalences are

16: rigorously justified.  Then we propose to numerically solve LGopt and QEPmin by

17: the Krylov subspace projection method via the Lanczos process. The basic idea, as the Lanczos method

18: for the symmetric eigenvalue problem,

19: is to first reduce LGopt and QEPmin by projecting them onto Krylov subspaces to yield problems of the same types but

20: of much smaller sizes, and then solve the reduced problems by some direct methods, which is

21: either a secular equation solver (in the case of LGopt) or an eigensolver (in the case of QEPmin).

22: The resulting algorithm is called the Lanczos algorithm.

23: We perform convergence analysis for the proposed method and obtain error bounds.

24: The sharpness of the error bound is demonstrated by artificial examples, although in applications the method often converges

25: much faster than the bounds suggest.

26: Finally, we apply the Lanczos algorithm to semi-supervised learning in the context of 

27:       constrained clustering. 

28: \end{abstract}

29: