1: \begin{abstract}

2: We consider unconstrained randomized optimization of smooth convex objective functions in the gradient-free setting.

3: We analyze Random Pursuit (RP) algorithms with fixed (F-RP) and variable metric (V-RP). The algorithms only use zeroth-order information about the objective function and compute an approximate solution by repeated optimization over randomly chosen one-dimensional subspaces. The distribution of search directions is dictated by the chosen metric. 

4: %

5: Variable Metric RP uses novel variants of a randomized zeroth-order Hessian approximation scheme recently introduced by Leventhal and Lewis (D. Leventhal and A. S. Lewis., Optimization 60(3), 329--245, 2011). We here present (i) a refined analysis of the expected single step progress of RP algorithms and their global convergence on (strictly) convex functions and (ii) novel convergence bounds for V-RP on strongly convex functions. We also quantify how well the employed metric needs to match the local geometry of the function in order for the RP algorithms to converge with the best possible rate. % on strongly convex functions.

6: %On convex quadratic functions we prove (i) high probability bounds for the V-RP algorithm to achieve optimal convergence rates (almost) independently of the specific properties of the function and (ii) upper and lower bounds on the expected error in the Hessian approximation. 

7: Our theoretical results are accompanied by numerical experiments, comparing V-RP with the derivative-free schemes CMA-ES, Implicit Filtering, Nelder-Mead, NEWUOA, Pattern-Search and Nesterov's gradient-free algorithms.

8: 

9: %\keywords{gradient-free optimization \and convex optimization \and variable metric \and line search}

10: % \PACS{PACS code1 \and PACS code2 \and more}

11: % \subclass{MSC code1 \and MSC code2 \and more}

12: \end{abstract}

13: