1: \begin{abstract}

2: Gradient dominance property is a condition weaker than strong convexity, yet it sufficiently ensures global convergence for first-order methods even in non-convex optimization. This property finds application in various machine learning domains, including matrix decomposition, linear neural networks, and policy-based reinforcement learning (RL). 

3:      In this paper, we study the stochastic homogeneous second-order descent method (SHSODM) for gradient-dominated optimization with $\alpha \in [1, 2]$ based on a recently proposed homogenization approach.

4:      % \cite{zhang2022homogenous}.

5:      % The primary advantage of HSODM lies in its iterative process, which involves solving an eigenvalue problem rather than a linear system. As a result, stochastic HSODM achieves not only cheaper computational cost but also a sample complexity to attain the global optimum that matches the best-known rate for second-order methods. 

6:      Theoretically, we show that SHSODM achieves a sample complexity of $O(\epsilon^{-7/(2 \alpha) +1})$ for $\alpha \in [1, 3/2)$ and $\Tilde{O}(\epsilon^{-2/\alpha})$ for $\alpha \in [3/2, 2]$. 

7:      % Moreover, stochastic HSODM also matches the best-known sample complexity under a relaxed version of the gradient dominance property seen in RL. 

8:      We further provide a SHSODM with a variance reduction technique enjoying an improved sample complexity of $O( \epsilon ^{-( 7-3\alpha ) /( 2\alpha )})$ for $\alpha \in [1,3/2)$. 

9:      Our results match the state-of-the-art sample complexity bounds for stochastic gradient-dominated optimization without \emph{cubic regularization}. Since the homogenization approach only relies on solving extremal eigenvector problems instead of Newton-type systems, our methods gain the advantage of cheaper iterations and robustness in ill-conditioned problems.

10:      Numerical experiments on several RL tasks demonstrate the efficiency of SHSODM compared to other off-the-shelf methods.

11: \end{abstract}

12: