1: \begin{abstract}

2: A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space.

3: Our work shows that successful SBI is possible by embracing the characteristic relationship between weight and function space, uncovering a systematic link between overparameterization and the difficulty of the sampling problem.

4: Through extensive experiments, we establish practical guidelines for sampling and convergence diagnosis. 

5: As a result, we present a deep ensemble initialized approach as an effective solution with competitive performance and uncertainty quantification.

6: \end{abstract}

7: