1: \begin{abstract}%

2: We study two-layer neural networks in the mean field limit,

3: where the number of neurons tends to infinity.

4: In this regime,

5: the optimization over the neuron parameters becomes the optimization

6: over the probability measures,

7: and by adding an entropic regularizer,

8: the minimizer of the problem is identified as a fixed point.

9: We propose a novel training algorithm named entropic fictitious play,

10: inspired by the classical fictitious play in game theory

11: for learning Nash equilibriums, to recover this fixed point,

12: and the algorithm exhibits a two-loop iteration structure.

13: Exponential convergence is proved in this paper

14: and we also verify our theoretical results by simple numerical examples.

15: \end{abstract}

16: