ee48ba867ef0bf67.tex
1: \begin{abstract}
2: Recently, there has been significant progress in the development of distributed
3: first order methods. (At least) two different types of methods,
4: designed from very different perspectives, have been proposed
5: that achieve both \emph{exact} and \emph{linear} convergence when a constant step size is used --
6: a favorable feature that was not achievable by most prior methods.
7: In this paper, we unify, generalize, and improve convergence speed of these exact distributed
8: first order methods. We first carry out a novel unifying
9: analysis that sheds light on how the
10: different existing methods compare. The analysis reveals that
11: a major difference between the methods is
12: on how a past dual gradient of an associated augmented Lagrangian dual function is weighted.
13:  We then capitalize on the insights from the analysis
14: to derive a novel method -- with a tuned past gradient weighting --
15: that improves upon the existing methods.
16: %Finally, along an additional dimension,
17: %we incorporate both in the primal and dual updates of the proposed method Heavy-ball like inertia
18: %terms and demonstrate by numerical examples significant speed-ups due to inertia.
19:   We establish for the proposed generalized method
20:  global R-linear convergence rate under strongly convex costs with Lipschitz continuous gradients.
21: 
22: 
23: \end{abstract}
24: