1: \begin{abstract}

2: The Nelder--Mead algorithm, a longstanding

3: direct search method for unconstrained

4: optimization published in 1965, is designed to minimize

5: a scalar-valued function $f$ of $n$ real variables

6: using only function values, without any derivative information.

7: Each Nelder--Mead iteration is associated with a

8: nondegenerate simplex defined by $n + 1$ vertices and

9: their function values; a typical iteration produces a new simplex

10: by replacing the worst vertex by a new point.  

11: Despite the method's widespread use,

12: theoretical results have been limited:

13: for strictly convex objective functions of one variable

14: with bounded level sets,

15: the algorithm always converges to the minimizer;

16: for such functions of two variables,

17: the diameter of the simplex converges to zero,

18: but examples constructed by McKinnon show

19: that the algorithm may converge to a nonminimizing point.

20: 

21: This paper considers the {\sl restricted\/} Nelder--Mead algorithm,

22: a variant that does not allow expansion steps.

23: In two dimensions we show that, for any nondegenerate starting simplex and

24: any twice-continuously differentiable function

25: with positive definite Hessian and bounded level sets,

26: the algorithm always converges to the minimizer.

27: The proof is based on treating the method as a discrete dynamical system,

28: and relies on several techniques that are non-standard in convergence

29: proofs for unconstrained optimization.

30: \end{abstract}

31: