93bcf70d2e018649.tex
1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file
2:   This paper considers the robust and efficient implementation of
3:   Gaussian process regression with a Student-$t$ observation model.
4:   The challenge with the Student-$t$ model is the analytically
5:   intractable inference which is why several approximative methods
6:   have been proposed. The expectation propagation (EP) has been
7:   found to be a very accurate method in many empirical studies but
8:   the convergence of the EP is known to be problematic with models
9:   containing non-log-concave site functions such as the Student-$t$
10:   distribution. In this paper we illustrate the situations where
11:   the standard EP fails to converge and review different
12:   modifications and alternative algorithms for improving the
13:   convergence. We demonstrate that convergence problems may occur
14:   during the type-II maximum a posteriori (MAP) estimation of the
15:   hyperparameters and show that the standard EP may not converge in
16:   the MAP values in some difficult cases. We present a robust
17:   implementation which relies primarily on parallel EP updates and
18:   utilizes a moment-matching-based double-loop algorithm with
19:   adaptively selected step size in difficult cases. The predictive
20:   performance of the EP is compared to the Laplace, variational
21:   Bayes, and Markov chain Monte Carlo approximations.
22: %
23: %According to our knowledge no numerically robust implementation of the Student-$t$
24: %model has been presented.
25: %
26: %
27: %with artificial regression examples
28: %
29: \end{abstract}
30: