eb3f118c8897d551.tex
1: \begin{abstract}
2:   Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain
3:   because the feasible set is a non-smooth and non-convex algebraic variety.
4:   Existing techniques include projected gradient descent, fixed-rank
5:   optimization (over the maximal-rank stratum), and the LR parameterization.
6:   They all lack either global guarantees
7:   (the ability to accumulate only at critical points)
8:   or fast local convergence
9:   (e.g., if the limit has non-maximal rank).
10:   We seek optimization algorithms that enjoy both.
11: 
12:   \cite{khrulkov2018desingularization} parameterize the bounded-rank variety via
13:   a desingularization to recast the optimization problem onto a smooth manifold.
14:   Building on their ideas, we develop a Riemannian geometry for this desingularization, also with care for numerical considerations.
15:   We use it to secure global convergence to critical points
16:   with fast local rates, for a large range of algorithms.
17:   On matrix completion tasks, we find that this approach is comparable to others, while enjoying better general-purpose theoretical guarantees.
18: \end{abstract}
19: