1: \begin{abstract}

2:   In this work, we introduce an asynchronous decentralized accelerated stochastic gradient descent type of method for decentralized stochastic optimization, considering communication and synchronization are the major bottlenecks. 

3:   We establish $\mathcal{O}(1/\epsilon)$ (resp., $\mathcal{O}(1/\sqrt{\epsilon})$) communication complexity and $\mathcal{O}(1/\epsilon^2)$ (resp., $\mathcal{O}(1/\epsilon)$) sampling complexity for solving general convex (resp., strongly convex) problems.

4:   % We establish ${\cal O}\{1/\epsilon\}$ (resp. ${\cal O}\{1/\sqrt \epsilon\}$) rate of convergence when objective function is general convex (resp. strongly convex). 

5: \end{abstract}

6: