1: \begin{abstract}
2: We consider distributed optimization problems where networked nodes cooperatively minimize
3: the sum of their locally known convex costs. A popular class of methods to solve these problems
4: are the distributed gradient methods, which are attractive due to their inexpensive iterations, but have a drawback
5: of slow convergence rates. This motivates the incorporation of second order information in the distributed methods,
6: but this task is challenging: although the Hessians which arise in the algorithm design respect the sparsity of the network,
7: their inverses are dense, hence rendering distributed implementations difficult. We overcome this challenge and propose a class of distributed Newton-like
8: methods, which we refer to as Distributed Quasi Newton (DQN). The DQN family approximates the Hessian inverse
9: by: 1) splitting the Hessian into its diagonal and off-diagonal part, 2) inverting the diagonal part, and
10: 3) approximating the inverse of the off-diagonal part through a weighted linear function.
11: The approximation is parameterized by the tuning variables which correspond to different splittings of the Hessian
12: and by different weightings of the off-diagonal Hessian part. Specific choices of the tuning variables give rise
13: to different variants of the proposed general DQN method -- dubbed DQN-0, DQN-1 and DQN-2 --
14: which mutually trade-off communication and computational costs for convergence.
15: Simulations demonstrate the effectiveness of the proposed DQN methods.% compare favorably with existing alternatives.
16:
17:
18:
19: \vspace{3mm}
20:
21: \noindent
22: {\bf Key words:} Distributed optimization, second order methods, Newton-like methods, linear convergence. \\ [2mm]
23:
24: {\bf AMS subject classification.} 90C25, 90C53, 65K05
25:
26:
27:
28: \end{abstract}
29: