1: \begin{abstract}

2: Deep neural network ensembles are powerful tools for uncertainty quantification, which have recently been re-interpreted from a Bayesian perspective.

3: However, current methods inadequately leverage second-order information of the loss landscape, despite the recent availability of efficient Hessian approximations.

4: We propose a novel approximate Bayesian inference method that modifies deep ensembles to incorporate Stein Variational Newton updates.

5: Our approach uniquely integrates scalable modern Hessian approximations, achieving faster convergence and more accurate posterior distribution approximations.

6: We validate the effectiveness of our method on diverse regression and classification tasks, demonstrating superior performance with a significantly reduced number of training epochs compared to existing ensemble-based methods, while enhancing uncertainty quantification and robustness against overfitting.\footnote[2]{Our code is available here: \href{https://github.com/klemens-floege/svn_ensembles}{https://github.com/klemens-floege/svn\_ensembles}}

7: 

8: \end{abstract}

9: