1: \begin{abstract}

2: Zeroth-order optimization is an important research topic in machine learning.

3: In recent years, it has become a key tool in black-box adversarial attack to neural network based image classifiers.

4: However, existing zeroth-order optimization algorithms rarely extract second-order information of the model function.

5: In this paper, we utilize the second-order information of the objective function and propose a novel \textit{Hessian-aware zeroth-order algorithm} called \texttt{ZO-HessAware}.

6: Our theoretical result shows that \texttt{ZO-HessAware} has an

7: improved zeroth-order convergence rate and query complexity under

8: structured Hessian approximation, where we propose a few approximation

9: methods for estimating Hessian.

10: Our empirical studies on the black-box adversarial attack problem validate that our algorithm can achieve improved success rates with a lower query complexity.

11: \end{abstract}

12: