1: \begin{abstract}

2: We study distributed optimization where nodes cooperatively minimize the sum  of their individual, locally known, convex costs $f_i(x)$'s,

3:   $x \in {\mathbb R}^d$ is global. Distributed augmented Lagrangian~(AL) methods have good empirical performance on

4:   several signal processing and learning applications, but there is limited understanding of their convergence rates and how it depends on the underlying network. This paper establishes globally linear (geometric) convergence rates of a class of deterministic and randomized distributed AL methods,

5:    when the $f_i$'s are twice continuously differentiable and have a bounded Hessian.

6:    We give explicit dependence of the convergence rates on the underlying network parameters. Simulations illustrate our analytical findings.

7: 

8: 

9: %We consider distributed optimization

10: %where $N$ nodes in the network

11: %minimize the sum of their

12: %individual convex costs $f_i(x)$

13: %with respect to a global variable $x \in {\mathbb R}^d.$

14: % Existing literature

15: % demonstrates that distributed augmented

16: %Lagrangian (AL) and alternating direction

17: %method of multipliers (ADMM) methods

18: %show excellent performance in practice.

19: %%Apart from the special case of consensus when $f_i(x)=\frac{1}{2}(x-a_i)^2$, $a_i\in \mathbb R$,

20: %%little convergence rate results have been established for such distributed methods.

21: % In this paper,

22: % assuming twice continuously differentiable $f_i$'s with bounded

23: % Hessian, we show the globally

24: % linear convergence rate for

25: % a family of distributed AL methods

26: %  as well as how the convergence rate depends on the

27: %  underlying network topology.

28: %  We further study local convergence

29: %  in the neighborhood of the solution,

30: %  and show that the algorithms

31: %  achieve the local linear convergence

32: %  independent of the Hessian's condition number.

33:  %

34: \end{abstract}

35: