1: \begin{abstract}

2: We consider the task of classification in the high dimensional setting where

3: the number of features of the given data is significantly greater than the number of observations.

4: To accomplish this task, we propose a heuristic, called sparse zero-variance discriminant analysis (SZVD), for simultaneously performing linear discriminant analysis and feature selection on high dimensional data. 

5: This method combines classical zero-variance discriminant analysis, where

6: discriminant vectors are identified in the null space of the sample within-class covariance matrix,

7: with penalization applied to  induce sparse structures in the resulting vectors.

8: To approximately solve the resulting nonconvex problem, we develop a simple algorithm based on the alternating direction method of multipliers.  Further, we show that this algorithm is applicable to a larger class of penalized generalized eigenvalue problems,

9: including a particular relaxation of the sparse principal component analysis problem.

10: Finally, we establish theoretical guarantees for convergence

11: of our algorithm to stationary points of the original nonconvex problem, and empirically demonstrate the effectiveness of our heuristic

12: for classifying simulated data and

13: data drawn from applications in time-series classification.

14: 

15: 

16: \end{abstract}

17: