1: \begin{abstract}
2: This work is on constrained large-scale non-convex optimization where the constraint set implies a manifold structure.
3: %
4: Solving such problems is important in a multitude of fundamental machine learning tasks.
5: %
6: Recent advances on Riemannian optimization have enabled the convenient recovery of solutions by adapting unconstrained optimization algorithms over manifolds.
7: %
8: However, it remains challenging to scale up and meanwhile maintain stable convergence rates and handle saddle points.
9: %
10: We propose a new second-order Riemannian optimization algorithm, aiming at improving convergence rate and reducing computational cost.
11: %
12: It enhances the Riemannian trust-region algorithm that explores curvature information to escape saddle points through a mixture of subsampling and cubic regularization techniques.
13: %
14: We conduct rigorous analysis to study the convergence behavior of the proposed algorithm.
15: %
16: We also perform extensive experiments to evaluate it based on two general machine learning tasks using multiple datasets.
17: %
18: The proposed algorithm exhibits improved computational speed and convergence behavior compared to a large set of state-of-the-art Riemannian optimization algorithms.
19:
20: \keywords{Optimization \and Cubic Regularization \and Riemannian manifolds \and Subsampling}
21: % \PACS{PACS code1 \and PACS code2 \and more}
22: % \subclass{MSC code1 \and MSC code2 \and more}
23: \end{abstract}
24: