1: \begin{abstract}

2: Given an {undirected} graph $\cG=(\cN,\cE)$ of agents $\cN=\{1,\ldots,N\}$ connected with edges in $\cE$, we study how to compute an optimal decision on which there is consensus among agents and that minimizes the sum of agent-specific private convex composite functions $\{\Phi_i\}_{i\in\cN}$ while respecting privacy requirements, where $\Phi_i\triangleq \xi_i + f_i$ belongs to agent-$i$. Assuming only agents connected by an edge can communicate, we propose a distributed proximal gradient method DPGA for {consensus optimization over both unweighted and weighted static (undirected) communication networks}. In one iteration, each agent-$i$ computes the prox map of $\xi_i$ and gradient of $f_i$, and this is followed by local communication with neighboring agents. We also study its stochastic gradient variant, SDPGA, which can only access to noisy estimates of $\grad f_i$ at each agent-$i$. This computational model abstracts a number of applications in distributed sensing, machine learning and statistical inference. We show ergodic convergence in both sub-optimality error and consensus violation for DPGA and SDPGA with rates $\cO(1/t)$ and $\cO(1/\sqrt{t})$, respectively.

3: %We implement PG-ADMM and SPG-ADMM on %two different, but equivalent,

4: %, and examine the effect of the underlying network topology on their convergence rate.

5: \vspace*{-2mm}

6: \end{abstract}

7: