1c6a8a7d1130a19c.tex
1: \begin{abstract}
2: % Motivated by the great empirical success of coordinate-descent methods for convex optimization and the recent wave of interest in theoretical understanding of them, we consider coordinate-wise methods for the fundamental \textit{non-convex} problem of computing the leading eigenvector of a real symmetric matrix. Coordinate-wise updates are extremely appealing to this problem, since fast and standard algorithms are based on iteratively computing matrix vector products, which is analogues to a full gradient update in the convex setting, while coordinate-wise updates simply require to compute the inner product between a single row of the matrix and the vector, and hence require much cheaper iterations. Unfortunately, applying the vast knowledge on coordinate methods, obtained for the convex case, to the leading eigenvector problem is highly challenging, since the problem is inherently non-convex.
3: % We present the first efficient and globally-convergent coordinate-wise algorithm for leading eigenvector computation, which enables to directly leverage coordinate-wise update techniques that were analyzed for the convex setting to our non-convex problem. The global convergence rate of our method is significantly faster, mainly in terms of the condition number, than the previous fastest coordinate-wise method, which only enjoys local convergence guarantees. We verify our theoretical derivations via extensive numerical experiments over synthetic and real-world datasets.
4: We develop and analyze efficient "coordinate-wise" methods for finding the leading eigenvector, where each step involves only a vector-vector product.  We establish global convergence with overall runtime guarantees that are at least as good as Lanczos's method and dominate it for slowly decaying spectrum. Our methods are based on combining a shift-and-invert approach with coordinate-wise algorithms for linear regression. 
5: \end{abstract}
6: