1: \begin{abstract}

2: % Zeroth-order optimization algorithms that use only function values are useful in many real-world problems where the objective function is unknown or discontinuous.

3: Zeroth-order optimization is the process of minimizing an objective $f(x)$, given oracle access to evaluations at adaptively chosen inputs $x$. In this paper, we present two simple yet powerful GradientLess Descent (GLD) algorithms that do not rely on an underlying gradient estimate and are numerically stable. We analyze our algorithm from a novel geometric perspective and present a novel analysis that shows convergence within an $\epsilon$-ball of the optimum in $O(kQ\log(n)\log(R/\epsilon))$ evaluations, for {\it any monotone transform} of a smooth and strongly convex objective with latent dimension $k < n$, where the input dimension is $n$, $R$ is the diameter of the input space and $Q$ is the condition number. Our rates are the first of its kind to be both 1) poly-logarithmically dependent on dimensionality and 2) invariant under monotone transformations. We further leverage our geometric perspective to show that our analysis is optimal. Both monotone invariance and its ability to utilize a low latent dimensionality are key to the empirical success of our algorithms, as demonstrated on BBOB and MuJoCo benchmarks.

4: %Our algorithms are based on a simple observation that if the objective function has rounded level sets, then moving in a random direction has a significant probability of improving the function value.

5:  

6: %Most importantly, they have mathematical guarantees of exponential convergence on a broad family of functions.

7: % We run simple experiments to show that our algorithms are competitive with Nesterov's accelerated random search, which has exponential convergence guarantees on strongly convex and smooth functions.

8: \end{abstract}

9: