1300141f68bc6d25.tex
1: \begin{abstract} 
2: Stochastic gradient descent (SGD) on a low-rank factorization~\cite{burer2003}
3: is commonly employed to speed up matrix problems including matrix
4: completion, subspace
5: tracking, and SDP relaxation. 
6: In this paper, we exhibit a step size scheme for SGD on
7: a low-rank least-squares problem, and 
8: we prove that, under broad sampling
9: conditions, our method converges globally from a random
10: starting point within $O(\epsilon^{-1} n \log n)$ steps with constant
11: probability for constant-rank problems.
12: Our modification of SGD relates it to stochastic power
13: iteration.  We also show experiments to illustrate the runtime
14: and convergence of the algorithm.
15: \end{abstract}
16: