1: \begin{abstract}

2:   We show that asymptotically, completely asynchronous stochastic gradient

3:   procedures achieve optimal (even to constant factors) convergence rates

4:   for the solution of convex optimization problems under nearly the same

5:   conditions required for asymptotic optimality of standard stochastic

6:   gradient procedures. Roughly, the noise inherent to the stochastic

7:   approximation scheme dominates any noise from asynchrony. We also give

8:   empirical evidence demonstrating the strong performance of asynchronous,

9:   parallel stochastic optimization schemes, demonstrating that the

10:   robustness inherent to stochastic approximation problems allows

11:   substantially faster parallel and asynchronous solution methods.

12: \end{abstract}

13: