1: \begin{abstract}In this paper, we consider fully-connected feed-forward deep neural networks where weights and biases are independent and identically distributed according to Gaussian distributions. Extending previous results \citep{matthews2018gaussian,matthews2018gaussianB,yang2019wide} we adopt a function-space perspective, i.e. we look at 

2: neural networks as infinite-dimensional random elements on the input space $\R^I$. Under suitable assumptions on the activation function we show that: i) a network defines a continuous stochastic process on the input space $\mathbb{R}^I$; ii) a network with re-scaled weights converges weakly to a continuous Gaussian Process in the large-width limit; iii) the limiting Gaussian Process has almost surely locally $\gamma$-H\"older continuous paths, for $0 < \gamma <1$. Our results contribute to recent theoretical studies on the interplay between infinitely-wide deep neural networks and Gaussian Processes by establishing weak convergence in function-space with respect to a stronger metric.

3: \end{abstract}

4: