1: \begin{abstract}
2:
3: %We study the problem of minimizing a sum of convex objective functions where the components of the objective are available at different nodes of a network. The use of distributed subgradient or gradient methods is widespread but they often suffer from slow convergence. In this paper we propose a decentralized network Newton (NN) method that achieves faster convergence. Similar to distributed gradient methods, NN solves a surrogate problem that is an approximate version of the original. The surrogate problem can be efficiently solved using an inexact Newton method that uses an approximation to the Newton step that can be computed in a decentralized manner. Theoretical analysis of NN shows a superlinear rate of convergence to a neighborhood of the optimal solution and demonstrates a tradeoff between accuracy of solutions and speed of convergence. Advantages with respect to distributed gradient descent are further studied through numerical analyses.
4:
5: %\red{Think about the case that the local objective functions are convex not strongly convex}\\
6:
7: We consider minimization of a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of distributed subgradient or gradient methods is widespread but they often suffer from slow convergence since they rely on first order information, which leads to a large number of local communications between nodes in the network. In this paper we propose the Network Newton (NN) method as a distributed algorithm that incorporates second order information via distributed evaluation of approximations to Newton steps. We also introduce adaptive (A)NN in order to establish exact convergence. Numerical analyses show significant improvement in both convergence time and number of communications for NN relative to existing (first order) alternatives.
8:
9:
10:
11: \end{abstract}
12: