d905b96ea4cb940f.tex
1: \begin{abstract} We study the minimization of  a quadratic over  Stiefel manifolds (the set of all orthogonal $r$-frames in $\IR^n$), which   has applications in high-dimensional
2: semi-supervised classification tasks. To reduce the computational complexity, sequential subspace methods(SSM) are employed to 
3: convert the high-dimensional minimization problems to low-dimensional ones.
4: In this paper, we are interested in attaining an optimal solution of good quality, i.e.,  
5: a ``qualified" critical point.  Qualified critical points are those critical points, at which the associated multiplier matrix meets some upper bound condition. 
6: These critical points enjoy the global optimality in special  quadratic problems. 
7: For a general quadratic,
8: %To attain an optimal solution of good quality, 
9:  SSM computes a sequence of  ``qualified critical points"   in its low-dimensional ``surrogate regularized models".  %One approximate qualified solution can be obtained by solving a sequence of local dimensional surrogate regularized models.
10: The convergence  to a qualified critical point is ensured, whenever
11: each SSM subspace is constructed by the following  vectors:
12: (i) a set of orthogonal unit vectors associated with the current iterate,  (ii) a set of vectors corresponding to the gradient of the objective, and (iii) a set of eigenvectors associated with the smallest $r$ eigenvalues of the system matrix. In addition, when Newton direction vectors are included in subspaces,  the convergence of SSM can be accelerated significantly. 
13: 
14: \end{abstract}
15: