1: \begin{abstract}

2: In this paper we develop  random block  coordinate gradient descent

3: methods for minimizing large scale linearly constrained separable

4: convex problems over networks.  Since we have coupled constraints in

5: the problem, we  devise an algorithm that updates in parallel $\tau

6: \geq 2$ (block) components per iteration.  Moreover, for this method

7: the computations can be performed in a distributed fashion according

8: to the structure of the network.   However, its complexity per

9: iteration  is usually  cheaper than of the full gradient method when

10: the number of nodes $N$ in the network is large. We prove that for

11: this method  we obtain in expectation an $\epsilon$-accurate

12: solution in at most $\mathcal{O}(\frac{N}{\tau \epsilon})$

13: iterations and thus the convergence rate depends linearly on the

14: number of (block) components $\tau$ to be updated. For strongly

15: convex functions  the new method converges linearly. We also focus

16: on how to choose the probabilities to make the randomized algorithm

17: to converge as fast as possible and we arrive at solving a sparse

18: SDP.  Finally, we describe several applications that fit in our

19: framework, in particular the convex feasibility problem.

20: Numerically, we show that the parallel  coordinate  descent method

21: with $\tau>2$  accelerates on its basic counterpart  corresponding

22: to $\tau=2$.

23: \end{abstract}