1: \begin{abstract}
2: The goal of decentralized optimization over a network is to optimize a
3: global objective formed by a sum of local (possibly nonsmooth) convex
4: functions using only local computation and communication. It arises
5: in various application domains, including distributed tracking and
6: localization, multi-agent co-ordination, estimation in sensor
7: networks, and large-scale optimization in machine learning. We
8: develop and analyze distributed algorithms based on dual averaging of
9: subgradients, and we provide sharp bounds on their convergence rates as a
10: function of the network size and topology. Our method of analysis
11: allows for a clear separation between the convergence of the
12: optimization algorithm itself and the effects of communication
13: constraints arising from the network structure. In particular, we
14: show that the number of iterations required by our algorithm scales
15: inversely in the spectral gap of the network. The sharpness of this
16: prediction is confirmed both by theoretical lower bounds and
17: simulations for various networks. Our approach includes both the
18: cases of deterministic optimization and communication, as well as
19: problems with stochastic optimization and/or communication.
20: \end{abstract}
21: