d3fe47793cd1300f.tex
1: \begin{abstract}
2: The paper studies \emph{distributed Dictionary Learning (DL)} problems where 
3: %considers  the   Dictionary Learning  (DL) problem over large scale models, where
4: the    learning task is distributed over a multi-agent network with time-varying (nonsymmetric) connectivity. This formulation is relevant, for instance,  in
5: Big Data scenarios where  massive amounts of data are   collected/stored
6: in different spatial locations and it is unfeasible to aggregate and/or process all data in a fusion center, due to resource limitations, communication overhead or privacy considerations.
7: %The optimization problem is nonconvex, due to the bi-convex objective function. 
8: We develop a general \emph{distributed} algorithmic framework for the (nonconvex) DL problem and establish its asymptotic convergence.   The new  method hinges on Successive Convex Approximation (SCA) techniques coupled with i) a gradient tracking mechanism  instrumental
9: to locally estimate the missing global information; and ii) a consensus step, as a mechanism to distribute the computations   among the agents. To the best of our knowledge, this is the first distributed
10: algorithm with provable convergence for the DL problem and, more in
11: general, bi-convex optimization problems over (time-varying) directed graphs. 
12:  \end{abstract}%