1: \begin{abstract}

2: Zeroth-order (ZO) optimization is widely used to handle challenging tasks, such as query-based black-box adversarial attacks and reinforcement learning.

3: %To deal with the curse of dimensionality, 

4: Various attempts have been made to integrate prior information into the gradient estimation procedure based on finite differences, with promising empirical results. %and they have achieved excellent empirical performance. 

5: However, their convergence properties are not well understood. This paper makes an attempt to fill this gap by analyzing the convergence of prior-guided ZO algorithms under a greedy descent framework with various gradient estimators. %, under the smooth convex setting. 

6: We provide a convergence guarantee for the prior-guided random gradient-free (PRGF) algorithms. % as well as a typical method of History-PRGF. 

7: Moreover, to further accelerate over greedy descent methods, we present a new accelerated random search (ARS) algorithm that incorporates prior information, together with a convergence analysis.

8: % and provide its convergence guarantee. 

9: Finally, our theoretical results are confirmed by experiments on several numerical benchmarks as well as adversarial attacks. Our code is available at \url{https://github.com/csy530216/pg-zoo}.

10: \end{abstract}

11: