1: \begin{abstract}

2: The cross-entropy (CE) method is a popular stochastic method for optimization due to its simplicity and effectiveness.

3: Designed for rare-event simulations where the probability of a target event occurring is relatively small,

4: the CE-method relies on enough objective function calls to accurately estimate the optimal parameters of the underlying distribution. 

5: Certain objective functions may be computationally expensive to evaluate, and the CE-method could potentially get stuck in local minima.

6: This is compounded with the need to have an initial covariance wide enough to cover the design space of interest.

7: We introduce novel variants of the CE-method to address these concerns.

8: To mitigate expensive function calls, during optimization we use every sample to build a surrogate model to approximate the objective function.

9: The surrogate model augments the belief of the objective function with less expensive evaluations.

10: We use a Gaussian process for our surrogate model to incorporate uncertainty in the predictions which is especially helpful when dealing with sparse data.

11: To address local minima convergence, we use Gaussian mixture models to encourage exploration of the design space.

12: We experiment with evaluation scheduling techniques to reallocate true objective function calls earlier in the optimization when the covariance is the largest.

13: To test our approach, we created a parameterized test objective function with many local minima and a single global minimum. Our test function can be adjusted to control the spread and distinction of the minima.

14: Experiments were run to stress the cross-entropy method variants and results indicate that the surrogate model-based approach reduces local minima convergence using the same number of function evaluations.

15: \end{abstract}