1: \begin{abstract}

2: In this paper we propose a Deep Learning architecture

3: to approximate diffeomorphisms diffeotopic to the

4: identity. 

5: We consider a control system

6: of the form $\dot x = \sum_{i=1}^lF_i(x)u_i$, with linear dependence

7: in the controls, and we use the corresponding flow

8: to approximate the action of a diffeomorphism on 

9: a compact ensemble of points. 

10: Despite the simplicity of the

11: control system, it has been recently shown that

12: a Universal Approximation Property holds.

13: The problem of minimizing the sum of the training 

14: error and of a regularizing term  

15: induces a gradient flow in the space of admissible

16: controls.

17: A possible training procedure

18: for the discrete-time neural network

19: consists in projecting

20: the gradient flow onto a finite-dimensional

21: subspace of the admissible controls.

22: An alternative approach

23: relies on an iterative method

24: based on Pontryagin Maximum Principle

25: for the numerical resolution of Optimal

26: Control problems. Here the maximization of the

27: Hamiltonian can be carried out with

28: an extremely low computational effort,

29: owing to the

30: linear dependence of the system in the

31: control variables.

32: Finally, we use tools from $\Gamma$-convergence to

33: provide an estimate of the expected generalization

34: error.  

35: \subsection*{Keywords}

36: Deep Learning,

37: Linear-Control System, $\Gamma$-convergence,

38: Gradient Flow, Pontryagin Maximum Principle.

39: \subsection*{MSC2020 classification}

40: Primary: 49M05, 49M25. Secondary: 68T07, 49J15.

41: \end{abstract}

42: