1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file

2: A rank-$r$ matrix $\X \in \R^{m \times n}$ can be written as a product $\U \V^\top$, where $\U \in \R^{m \times r}$ and $\V \in \R^{n \times r}$. 

3: One could exploit this observation in optimization: \textit{e.g.}, consider the minimization of a convex function $f(\X)$ over rank-$r$ matrices, where the set of rank-$r$ matrices is modeled via the factorization $\U\V^\top$. 

4: %Such a heuristic has been widely used for specific problem instances, where the solution sought is (approximately) low-rank. 

5: Though such parameterization reduces the number of variables, and is more computationally efficient (of particular interest is the case $r \ll \min\{m, n\}$), it comes at a cost: $f(\U \V^\top)$ becomes a non-convex function w.r.t. $\U$ and $\V$. 

6: 

7: We study such parameterization for optimization of generic convex objectives $f$, and focus on first-order, gradient descent algorithmic solutions. We propose the \emph{Bi-Factored Gradient Descent} (\algo) algorithm, an efficient first-order method that operates on the $U, V$ factors. We show that when $f$ is (restricted) smooth, \algo has local sublinear convergence, and linear convergence when $f$ is both (restricted) smooth and (restricted) strongly convex. For several key applications, we provide simple and efficient initialization schemes that provide approximate solutions good enough for the above convergence results to hold.

8: \end{abstract}

9: