1: \begin{abstract}

2: We introduce a novel two-level overlapping additive Schwarz preconditioner for accelerating the training of scientific machine learning applications.

3:  The design of the proposed preconditioner is motivated by the nonlinear two-level overlapping additive Schwarz preconditioner. 

4: The neural network parameters are decomposed into groups (subdomains) with overlapping regions. 

5:  In addition, the network's feed-forward structure is indirectly imposed through a novel subdomain-wise synchronization strategy and a coarse-level training step. 

6:  Through a series of numerical experiments, which consider physics-informed neural networks and operator learning approaches, we demonstrate that the proposed two-level preconditioner significantly speeds up the convergence of the standard (LBFGS) optimizer while also yielding more accurate machine learning models.

7:  Moreover, the devised preconditioner is designed to take advantage of model-parallel computations, which can further reduce the training time.

8: \end{abstract}

9: