1: \begin{abstract}

2:     Optimizing a function without using derivatives is a challenging paradigm, that precludes from using classical algorithms from nonlinear optimization and may thus seem 

3:     intractable other than by using heuristics. However, the field of derivative-free optimization has succeeded in producing algorithms that do not rely on derivatives and 

4:     yet are endowed with convergence guarantees. One class of such methods, called direct search, is particularly popular thanks to its simplicity of implementation, even 

5:     though its theoretical underpinnings are not always easy to grasp.

6: 

7:     In this work, we survey contemporary direct-search algorithms from a theoretical viewpoint, with the aim of highlighting the key theoretical features of 

8:     these methods. Our study goes beyond the classical, textbook cases and tackles the presence of nonsmoothness, noise, and constraints in the problem 

9:     at hand. In addition to reviewing classical results in the field, we provide new perspectives on existing results, as well as novel proofs that illustrate the 

10:     versatility of direct-search schemes. 

11: \end{abstract}

12: