1: \begin{abstract}

2: %Recently, there has been significant progress in distributed

3: %first order methods. (At least) two different types of methods,

4: %designed from very different perspectives, have been proposed

5: %that achieve both exact and linear convergence when a constant step size is used --

6: %a superior feature that was not achievable with prior methods.

7: %In this paper, we unify, generalize, and accelerate these exact distributed

8: %first order methods. We first carry out a novel unifying

9: %analysis that sheds light on how the

10: %different existing methods compare. The analysis reveals that

11: %a major difference between the methods is

12: %on how the past gradient of an associated augmented Lagrangian dual function is weighted.

13: % We then capitalize on the insights from the analysis

14: %to derive a novel method -- with an optimized past gradient weighting --

15: %that improves upon the existing methods. Finally, along an additional dimension,

16: %we incorporate both in the primal and dual updates of the proposed method Heavy-ball like inertia

17: %terms and demonstrate by numerical examples significant speed-ups due to inertia.

18: % Finally, we establish for the proposed generalized method, both in the presence and in the absence of inertia,

19: % global R-linear convergence rate under strongly convex costs with Lipschitz continuous gradients.

20: %

21: %

22: %

23: %

24: %

25: %\vspace{3mm}

26: %

27: %\noindent

28: %{\bf Keywords:} Distributed optimization, Consensus optimization, Exact distributed first order methods, R-linear convergence rate.  \\ [2mm]

29: %

30: %%{\bf AMS subject classification.}

31: %

32: %

33: %

34: %\end{abstract}

35: