1: \begin{abstract}

2: In a recent work, we introduced a rigorous framework to describe the

3: mean field limit of the gradient-based learning dynamics of multilayer

4: neural networks, based on the idea of a neuronal embedding. There

5: we also proved a global convergence guarantee for three-layer (as

6: well as two-layer) networks using this framework.

7: 

8: In this companion note, we point out that the insights in our previous

9: work can be readily extended to prove a global convergence guarantee

10: for multilayer networks of any depths. Unlike our previous three-layer

11: global convergence guarantee that assumes i.i.d. initializations,

12: our present result applies to a type of correlated initialization.

13: This initialization allows to, at any finite training time, propagate

14: a certain universal approximation property through the depth of the

15: neural network. To achieve this effect, we introduce a bidirectional

16: diversity condition.

17: \end{abstract}

18: