0deb378dc7b2f310.tex
1: \begin{abstract}
2: 		
3: 		Many machine learning models depend on solving a large scale  optimization problem.
4: 		Recently, sub-sampled Newton methods have emerged to attract much attention for optimization
5: 		due to their efficiency  at
6: 		each iteration, rectified a weakness in the ordinary Newton method of suffering a high cost at each
7: 		iteration while commanding a high convergence rate.
8: 		In this work we
9: 		%cast sub-sampled Newton methods into the inexact Newton framework to
10: 		propose two new efficient Newton-type methods, \emph{Refined Sub-sampled Newton} and \emph{Refined Sketch Newton}.
11: 		Our methods  exhibit a great advantage over existing sub-sampled Newton methods, especially when Hessian-vector multiplication can be calculated efficiently and Hessian matrix is ill-conditioned.
12: 		Specifically, the proposed methods are shown to converge superlinearly in general case and quadratically  under a little stronger assumption.
13: 		The proposed methods can be generalized to a unifying framework for the convergence proof of several existing sub-sampled Newton methods, revealing new convergence properties.
14: 		Finally, we empirically evaluate the performance of our methods on several standard datasets and
15: 		the results show consistent improvement in computational efficiency.
16: 	\end{abstract}