1: \begin{abstract}
2:
3: Bayesian optimization is a powerful global optimization technique
4: for expensive black-box functions.
5: One of its shortcomings is that it requires auxiliary optimization
6: of an acquisition function at each iteration.
7: This auxiliary optimization can be costly and very hard to carry out in practice.
8: Moreover, it creates serious theoretical concerns,
9: as most of the convergence results assume that the exact optimum of
10: the acquisition function can be found.
11: In this paper, we introduce a new technique for efficient global optimization
12: that combines Gaussian process confidence bounds and
13: treed simultaneous optimistic optimization to eliminate the need
14: for auxiliary optimization of acquisition functions.
15: The experiments with global optimization benchmarks and a novel application to automatic information extraction demonstrate that the resulting technique is more efficient
16: than the two approaches from which it draws inspiration.
17: Unlike most theoretical analyses of Bayesian optimization with Gaussian processes, our finite-time convergence rate proofs do not require exact optimization of an acquisition function. That is, our approach eliminates the unsatisfactory assumption that a difficult, potentially NP-hard, problem has to be solved in order to obtain vanishing regret rates.
18: \end{abstract}
19: