1: \begin{abstract}
2:
3: Many machine learning models depend on solving a large scale optimization problem.
4: Recently, sub-sampled Newton methods have emerged to attract much attention for optimization
5: due to their efficiency at
6: each iteration, rectified a weakness in the ordinary Newton method of suffering a high cost at each
7: iteration while commanding a high convergence rate.
8: In this work we
9: %cast sub-sampled Newton methods into the inexact Newton framework to
10: propose two new efficient Newton-type methods, \emph{Refined Sub-sampled Newton} and \emph{Refined Sketch Newton}.
11: Our methods exhibit a great advantage over existing sub-sampled Newton methods, especially when Hessian-vector multiplication can be calculated efficiently and Hessian matrix is ill-conditioned.
12: Specifically, the proposed methods are shown to converge superlinearly in general case and quadratically under a little stronger assumption.
13: The proposed methods can be generalized to a unifying framework for the convergence proof of several existing sub-sampled Newton methods, revealing new convergence properties.
14: Finally, we empirically evaluate the performance of our methods on several standard datasets and
15: the results show consistent improvement in computational efficiency.
16: \end{abstract}