1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file

2:  Zeroth-order (derivative-free) optimization attracts a lot of attention in machine learning,  because   explicit gradient

3: calculations  may be computationally expensive or infeasible. To handle large scale problems both in volume and dimension, recently asynchronous doubly stochastic zeroth-order   algorithms were proposed. The  convergence rate of existing asynchronous doubly stochastic  zeroth order algorithms  is $O(\frac{1}{\sqrt{T}})$ (also for the sequential stochastic  zeroth-order optimization algorithms).  In this paper, we focus on the finite sums of smooth but not necessarily convex functions, and propose an asynchronous doubly stochastic   zeroth-order optimization algorithm using the accelerated technology of variance reduction  (AsyDSZOVR). Rigorous theoretical analysis show that  the convergence rate can be improved from $O(\frac{1}{\sqrt{T}})$  the  best result of existing algorithms  to  $O(\frac{1}{T})$. Also our theoretical results is an improvement to the ones of the sequential stochastic  zeroth-order optimization algorithms.

4: \end{abstract}

5: