1: \begin{abstract}
2: We focus on minimizing nonconvex finite-sum functions that typically arise in machine learning problems.
3: In an attempt to solve this problem, the adaptive cubic regularized Newton method has shown its strong global convergence guarantees and ability to escape from strict saddle points.
4: This method uses a trust region-like scheme to determine if an iteration is successful or not, and updates only when it is successful.
5:
6: In this paper, we suggest an algorithm combining negative curvature with the adaptive cubic regularized Newton method to update even at unsuccessful iterations.
7: We call this new method Stochastic Adaptive cubic regularization with Negative Curvature (SANC).
8: Unlike the previous method, in order to attain stochastic gradient and Hessian estimators, the SANC algorithm uses independent sets of data points of consistent size over all iterations.
9: It makes the SANC algorithm more practical to apply for solving large-scale machine learning problems.
10: To the best of our knowledge, this is the first approach that combines the negative curvature method with the adaptive cubic regularized Newton method.
11: Finally, we provide experimental results including neural networks problems supporting the efficiency of our method.
12: \end{abstract}
13: