1: \begin{abstract}

2: Motivated by machine learning problems over large data sets and distributed optimization over networks,

3: we develop and analyze a new method called incremental Newton method for minimizing the sum of a large number of strongly convex functions. We show that our method is globally convergent for a variable stepsize rule. We further show that under a gradient growth condition, convergence rate is linear  for both  variable and constant stepsize rules. By means of an example, we show that without the gradient growth condition, incremental Newton method cannot achieve linear convergence. Our analysis can be extended to study other incremental methods: in particular, we obtain a linear convergence rate result for the incremental Gauss-Newton algorithm under a variable stepsize rule.

4: %We develop and analyze a new method called incremental Newton method for minimizing the sum of a large number of strongly convex functions, motivated by machine learning problems over large data sets and distributed optimization over networks. Our method is globally convergent achieving linear convergence under a gradient growth assumption both for a variable stepsize rule and a constant stepsize rule. Our method and analysis admits straightforward extensions to quasi-Newton approaches and has implications for the linear convergence of related methods such as the incremental Gauss-Newton algorithm, which is also referred to as the EKF algorithm. 

5: \keywords{Incremental methods \and Convex optimization \and Newton method \and Gauss-Newton method \and Strong convexity \and EKF algorithm}

6: % \PACS{PACS code1 \and PACS code2 \and more}

7: % \subclass{MSC code1 \and MSC code2 \and more}

8: \end{abstract}

9: