1: \begin{abstract}

2: Markov chain Monte Carlo (MCMC) methods

3: have not been broadly adopted in Bayesian neural networks (BNNs).

4: This paper initially reviews the main challenges in sampling

5: from the parameter posterior of a neural network via MCMC.

6: Such challenges culminate to lack of convergence

7: to the parameter posterior.

8: Nevertheless, this paper shows that

9: a non-converged Markov chain, generated via MCMC sampling from

10: the parameter space of a neural network,

11: can yield via Bayesian marginalization

12: a valuable posterior predictive distribution of the output of the neural network.

13: Classification examples based on multilayer perceptrons showcase

14: highly accurate posterior predictive distributions.

15: The postulate of limited scope

16: for MCMC developments in BNNs is partially valid;

17: an asymptotically exact parameter posterior seems less plausible,

18: yet an accurate posterior predictive distribution is a tenable research avenue.

19: \end{abstract}

20: