321fab293ebcd894.tex
1: \begin{abstract}
2: \vskip4pt
3: Sparse generalized eigenvalue problem plays a pivotal role in a large family of high-dimensional learning tasks, including sparse Fisher's discriminant analysis,  canonical correlation analysis, and  sufficient dimension reduction.  
4: However, the theory of sparse generalized eigenvalue problem remains largely unexplored. In this paper, we exploit a non-convex optimization perspective  to study this problem. In particular, we propose the truncated \underline{R}ayle\underline{i}gh \underline{fl}ow m\underline{e}thod (Rifle) to estimate the leading generalized eigenvector and show that it  converges linearly to a solution with the optimal statistical rate of convergence. Our~theory~involves two key ingredients: (i) a new analysis of the gradient descent method on non-convex objective functions, as well as (ii) a fine-grained characterization of the evolution of sparsity patterns along the solution path. Thorough numerical studies are provided to back up our theory. Finally, we apply our proposed method in the context of sparse sufficient dimension reduction to two gene expression data sets. 
5: 
6: 
7: 
8: 
9: 
10: \end{abstract}
11: