1: \begin{abstract}

2: %\emph{Bayesian optimization} (BO) has become popular for sequential optimization of black-box functions. When BO is used to optimize a target function, we often have access to some previous evaluations of potentially related functions. This begs the question as to whether we can leverage these previous experiences to accelerate the current BO task through \emph{meta-learning} (meta-BO), while ensuring \emph{robustness} against potentially harmful dissimilar tasks that could sabotage the convergence of BO. This paper introduces a scalable, principled and robust meta-BO algorithm called \emph{robust meta-Gaussian process-upper confidence bound} (RM-GP-UCB). RM-GP-UCB utilizes a weighted combination of separate acquisition functions from individual tasks for query selection, hence achieving scalability in the number of previous tasks and observations for each previous task. We derive a robust theoretical convergence guarantee for RM-GP-UCB and show that it is asymptotically no-regret even when some or all previous tasks are dissimilar to the current task. Moreover, the theoretical guarantee allows RM-GP-UCB to optimize the weights assigned to the individual previous tasks, hence diminishing the impact of dissimilar tasks, in a principled way through regret minimization via online learning. Empirical evaluation shows that RM-GP-UCB performs effectively and consistently across various applications.

3: %\end{abstract}

4: