8be096c005bb7ac7.tex
1: \begin{abstract}
2: We focus on minimizing nonconvex finite-sum functions that typically arise in machine learning problems. 
3: In an attempt to solve this problem, the adaptive cubic regularized Newton method has shown its strong global convergence guarantees and ability to escape from strict saddle points. 
4: This method uses a trust region-like scheme to determine if an iteration is successful or not, and updates only when it is successful. 
5: 
6: In this paper, we suggest an algorithm combining negative curvature with the adaptive cubic regularized Newton method to update even at unsuccessful iterations. 
7: We call this new method Stochastic Adaptive cubic regularization with Negative Curvature (SANC). 
8: Unlike the previous method, in order to attain stochastic gradient and Hessian estimators, the SANC algorithm uses independent sets of data points of consistent size over all iterations.
9: It makes the SANC algorithm more practical to apply for solving large-scale machine learning problems. 
10: To the best of our knowledge, this is the first approach that combines the negative curvature method with the adaptive cubic regularized Newton method. 
11: Finally, we provide experimental results including neural networks problems supporting the efficiency of our method.
12: \end{abstract}
13: