1: \begin{abstract}

2:     Stochastic variational inference is an established way to carry out approximate Bayesian inference for deep models.

3:     While there have been effective proposals for good initializations for loss minimization in deep learning, far less attention has been devoted to the issue of initialization of stochastic variational inference.

4:     %% Nevertheless, these methods struggle to converge to good solutions due to high difficulty of their optimization.

5:     We address this by proposing a novel layer-wise initialization strategy based on Bayesian linear models.

6:     %% Using Bayesian linear models, this work shows how we can initialize Bayesian neural networks and Bayesian convolutional neural networks (\bcnn) to help \svi to converge faster and better. 

7:     The proposed method is extensively validated on regression and classification tasks, including Bayesian \textsc{DeepNets} and \textsc{ConvNets}, showing faster and better convergence compared to alternatives inspired by the literature on initializations for loss minimization.

8:     %% We validate our proposal on several datasets, on regression and classification tasks, including \mnist and \cifart with \lenet and \alexnet\footnote{Source code for reproducible experiments can be found at \texttt{link removed for anonymous submission}}.

9: \end{abstract}

10: