1: \begin{abstract}

2: Distributed Optimization is an increasingly important

3:     subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic  optimization problem where the agents on a graph aim to asynchronously optimize a collective (additive) objective function consisting of  agents' individual (possibly non-convex) local objective functions. Each agent only has access to a noisy estimate of the gradient of its own function (one component of the sum of objective functions). We proposed an asynchronous distributed algorithm for such a class of problems. The algorithm combines  stochastic gradients with tracking in an asynchronous   push-sum framework and obtain the standard sublinear convergence rate for general non-convex functions, matching the rate of centralized stochastic gradient descent SGD. %We show that the consensus measure converges faster indicating asymptotic agreement with the centralized rate.

4:     Our experiments on a non-convex image classification task using convolutional neural network validate the convergence of our proposed algorithm across different number of nodes and graph connectivity percentages. 

5: \ignore{

6: Distributed Optimization is an increasingly important

7:     subject area with the rise of multi-agent control and optimization. We consider a decentralized optimization problem where the agents on a graph aim to asynchronously optimize a collective (additive) objective function consisting of  agents' individual (possibly non-convex) local objective functions. In particular, we propose a .... Combining ..., we obtain a sublinear convergence rate for general (non-convex) functions while we obtain a faster (I would specify what you mean by faster?) convergence rate in the convex setting. }

8:    

9: \end{abstract}

10: