1: \begin{abstract}

2: Recently a new type of deep learning method has emerged, called physics-informed neural networks.

3: Despite their success in solving problems that are governed by partial differential equations, physics-informed neural networks are often difficult to train.

4: Frequently reported convergence issues are still poorly understood and complicate the inference of correct system dynamics.

5: In this paper, we shed light on the training process of physics-informed neural networks.

6: By trading between data- and physics-based constraints in the network training, we study the Pareto front in multi-objective optimization problems.

7: We use the diffusion equation and Navier-Stokes equations in various test environments to analyze the effects of system parameters on the shape of the Pareto front.

8: Additionally, we assess the effectiveness of state-of-the-art adaptive activation functions and adaptive loss weighting methods.

9: Our results demonstrate the prominent role of system parameters in the multi-objective optimization and contribute to understanding convergence properties of physics-informed neural networks.

10: \end{abstract}

11: