1: \begin{abstract}
2: The paper studies \emph{distributed Dictionary Learning (DL)} problems where
3: %considers the Dictionary Learning (DL) problem over large scale models, where
4: the learning task is distributed over a multi-agent network with time-varying (nonsymmetric) connectivity. This formulation is relevant, for instance, in
5: Big Data scenarios where massive amounts of data are collected/stored
6: in different spatial locations and it is unfeasible to aggregate and/or process all data in a fusion center, due to resource limitations, communication overhead or privacy considerations.
7: %The optimization problem is nonconvex, due to the bi-convex objective function.
8: We develop a general \emph{distributed} algorithmic framework for the (nonconvex) DL problem and establish its asymptotic convergence. The new method hinges on Successive Convex Approximation (SCA) techniques coupled with i) a gradient tracking mechanism instrumental
9: to locally estimate the missing global information; and ii) a consensus step, as a mechanism to distribute the computations among the agents. To the best of our knowledge, this is the first distributed
10: algorithm with provable convergence for the DL problem and, more in
11: general, bi-convex optimization problems over (time-varying) directed graphs.
12: \end{abstract}%