06950c96fc68253d.tex
1: \begin{abstract}
2: Sparse PCA, an important variant of PCA,  attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the Riemannian optimization problem related to the ScoTLASS model for the sparse PCA which can impose orthogonality and sparsity simultaneously. %An accelerated Riemannian proximal gradient method (ARPG) is proposed to compute the solution to this problem. The proposed algorithm is an extension of FISTA to the manifold setting. 
3: We extend FISTA  from the Euclidean space to the Riemannian manifold to solve this problem, leading to the accelerated Riemannian proximal gradient method.
4: Since the optimization problem  is essentially non-convex, a safeguard strategy is introduced in the algorithm.  Moreover, a diagonal weighting strategy is also proposed which can further improve the computational efficiency of the Riemannian proximal methods.
5: Numerical evaluations establish the computational advantages of the proposed methods over the existing proximal gradient methods on manifold.
6: Convergence of the methods to stationary point has also been rigorously justified.\end{abstract}
7: