1: \begin{abstract}

2: We consider distributed optimization in random networks where $N$ nodes cooperatively

3: minimize the sum $\sum_{i=1}^N f_i(x)$ of their individual convex costs.

4: Existing literature

5:  proposes distributed gradient-like methods that are computationally

6:  cheap and resilient to link failures, but have slow convergence rates.

7: In this paper, we propose accelerated distributed gradient methods

8: that: 1) are resilient to link failures; 2) computationally cheap; and 3) improve convergence rates over other gradient methods.

9: %and establish their convergence rate guarantees on random networks,

10: %in terms of the expected optimality gap in the cost function at arbitrary node~$i$.

11: We model the network by a sequence of independent, identically distributed random matrices

12: $\{W(k)\}$ drawn from the set of symmetric, stochastic matrices with positive diagonals.

13: The network is connected on average and the cost functions are convex, differentiable, with Lipschitz continuous and bounded gradients.

14: We design two distributed Nesterov-like gradient methods that modify the D--NG and D--NC methods that we proposed for static networks. We prove their convergence rates in terms of the expected optimality gap at the cost function. Let $k$ and $\mathcal K$ be the number of per-node gradient evaluations

15:  and per-node communications, respectively. Then the modified D--NG achieves rates~$O(\log k/k)$ and $O(\log \mathcal K/\mathcal K)$, and the modified D--NC rates~$O(1/k^2)$ and $O(1/\mathcal K^{2-\xi})$, where $\xi>0$ is arbitrarily small. For comparison, the standard distributed gradient method cannot do better than $\Omega(1/k^{2/3})$ and $\Omega(1/\mathcal K^{2/3})$, on the same class of cost functions (even for static networks).

16:  % Finally, we extend the modified D--NC method to constrained optimization

17:   % with compact constraint sets.

18:    Simulation examples illustrate our analytical findings.

19: \end{abstract}

20: