1: \begin{abstract}

2: This paper deals with a class of neural SDEs and studies the limiting behavior of the associated sampled optimal control problems as the sample size grows to infinity. The neural SDEs with $N$ samples can be linked to the $N$-particle systems with centralized control. We analyze the Hamilton--Jacobi--Bellman equation corresponding to the $N$-particle system and establish regularity results which are uniform in $N$. The uniform regularity estimates are obtained by the stochastic maximum principle and the analysis of a backward stochastic Riccati equation. Using these uniform regularity results, we show the convergence of the minima of objective functionals and optimal parameters of the neural SDEs as the sample size $N$ tends to infinity. The limiting objects can be identified with suitable functions defined on the Wasserstein space of Borel probability measures. Furthermore, quantitative algebraic convergence rates are also obtained.

3: 

4: \vspace{0.3 cm}

5: 

6: \noindent{\textbf{2020 AMS Mathematics subject classification}: 49N80; 65C35; 49L12; 62M45.}

7: 

8: \vspace{0.3 cm}

9: 

10: \noindent{\textbf{Keywords}:}\quad{Mean field optimization; Neural networks; Mean field control; Propagation of chaos.}.

11: \end{abstract}

12: