1: \begin{abstract}
2: We study distributed optimization in networked systems, where nodes cooperate to
3: find the optimal quantity of common interest, $x=x^\star$. The objective function of the corresponding
4: optimization problem is the sum of private (known only by a node,) convex, nodes' objectives and each node imposes a
5: private convex constraint on the allowed values of $x$. We solve this problem for generic connected
6: network topologies with asymmetric random link failures with a novel distributed, decentralized algorithm. We
7: refer to this algorithm as \textbf{AL--G} (augmented Lagrangian gossiping,)
8: and to its variants as \textbf{AL--MG} (augmented Lagrangian multi neighbor gossiping)
9: and \textbf{AL--BG} (augmented Lagrangian broadcast gossiping.) The \textbf{AL--G} algorithm is based on the augmented Lagrangian dual function. Dual variables are updated by the standard method of
10: multipliers, at a slow time scale. To update the primal variables, we propose a novel, Gauss-Seidel type, randomized algorithm, at a fast time scale.
11: \textbf{AL--G} uses unidirectional gossip communication, only between immediate neighbors in the network and is resilient to random link failures. For networks with reliable communication (i.e., no failures,) the simplified, \textbf{AL--BG} (augmented Lagrangian broadcast gossiping) algorithm reduces communication, computation and data storage cost. We prove convergence for all proposed algorithms
12: and demonstrate by simulations the effectiveness on two applications:
13: $l_1$--regularized logistic regression for classification and cooperative spectrum
14: sensing for cognitive radio networks.
15:
16:
17:
18:
19: %
20:
21: %
22: \end{abstract}
23: