1: \begin{abstract}
2: Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain
3: because the feasible set is a non-smooth and non-convex algebraic variety.
4: Existing techniques include projected gradient descent, fixed-rank
5: optimization (over the maximal-rank stratum), and the LR parameterization.
6: They all lack either global guarantees
7: (the ability to accumulate only at critical points)
8: or fast local convergence
9: (e.g., if the limit has non-maximal rank).
10: We seek optimization algorithms that enjoy both.
11:
12: \cite{khrulkov2018desingularization} parameterize the bounded-rank variety via
13: a desingularization to recast the optimization problem onto a smooth manifold.
14: Building on their ideas, we develop a Riemannian geometry for this desingularization, also with care for numerical considerations.
15: We use it to secure global convergence to critical points
16: with fast local rates, for a large range of algorithms.
17: On matrix completion tasks, we find that this approach is comparable to others, while enjoying better general-purpose theoretical guarantees.
18: \end{abstract}
19: