1: \begin{abstract}

2: A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization.

3: Bayesian optimization (BO) is a powerful tool that models and optimizes such expensive ``black-box'' functions.

4: However, at the beginning of optimization, vanilla Bayesian optimization methods often suffer from slow convergence issue due to inaccurate modeling based on few trials.

5: To address this issue, researchers in the

6: BO community propose to incorporate the spirit of transfer learning to accelerate optimization process, which could borrow strength from the past tasks (source tasks) to accelerate the current optimization problem

7: (target task).

8: This survey paper first summarizes transfer learning methods for Bayesian optimization from four perspectives: initial points design, search space design, surrogate model, and acquisition function.

9: Then it highlights its methodological aspects and technical details for each approach.

10: Finally, it showcases a wide range of

11: applications and proposes promising future directions.

12: 

13: \end{abstract}

14: