ee5d6c6445cae800.tex
1: \begin{abstract}
2:  We consider distributed optimization problems where networked nodes cooperatively minimize
3:  the sum of their locally known convex costs. A popular class of methods to solve these problems
4:  are the distributed gradient methods, which are attractive due to their inexpensive iterations, but have a drawback
5:  of slow convergence rates. This motivates the incorporation of second order information in the distributed methods,
6:  but this task is challenging: although the Hessians which arise in the algorithm design respect the sparsity of the network,
7:  their inverses are dense, hence rendering distributed implementations difficult. We overcome this challenge and propose a class of distributed Newton-like
8:  methods, which we refer to as Distributed Quasi Newton (DQN). The DQN family approximates the Hessian inverse
9:  by: 1) splitting the Hessian into  its diagonal and  off-diagonal part, 2) inverting the diagonal part, and
10:  3) approximating the inverse of the off-diagonal part through a weighted linear function.
11:   The approximation is parameterized by the tuning variables which correspond to different splittings of the Hessian
12:  and by different weightings of the off-diagonal Hessian part. Specific choices of the tuning variables give rise
13:  to different variants of the proposed general DQN method -- dubbed DQN-0, DQN-1 and DQN-2 --
14:  which mutually trade-off communication and computational costs for convergence.
15:  Simulations demonstrate the effectiveness of the proposed DQN methods.% compare favorably with existing alternatives.
16: 
17: 
18: 
19: \vspace{3mm}
20: 
21: \noindent
22: {\bf Key words:} Distributed optimization, second order methods, Newton-like methods, linear convergence. \\ [2mm]
23: 
24: {\bf AMS subject classification.} 90C25, 90C53, 65K05
25: 
26: 
27: 
28: \end{abstract}
29: