4eab418054f57a02.tex
1: \begin{abstract}
2:   In this paper, we study \emph{distributed big-data nonconvex} optimization in
3:   multi-agent networks.  We consider the (constrained) minimization of the sum
4:   of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus
5:   a convex (possibly) nonsmooth regularizer. Our interest is in big-data
6:   problems wherein there is a large number of variables to optimize. If treated
7:   by means of standard distributed optimization algorithms, these large-scale
8:   problems may be intractable, due to the prohibitive local computation and
9:   communication burden at each node.  We propose a novel distributed solution
10:   method whereby at each iteration agents optimize and then communicate  (in an uncoordinated fashion)
11:   only a subset of their decision variables. To deal with   non-convexity
12:   of the cost function, the novel scheme hinges on Successive Convex
13:   Approximation (SCA) techniques coupled with i) a tracking mechanism
14:   instrumental to locally estimate gradient averages; and ii) a novel
15:   \emph{block-wise} consensus-based protocol to perform local block-averaging
16:   operations and gradient tacking. Asymptotic convergence to stationary
17:   solutions of the nonconvex problem is established. Finally, numerical results
18:   show the effectiveness of the proposed algorithm and highlight how the block
19:   dimension impacts on the communication overhead and practical convergence
20:   speed. 
21: \end{abstract}
22: