17cf90a062f4e6d8.tex
1: \begin{abstract}
2: We investigate the use of learnable activation functions in Physics-Informed Neural Networks (PINNs) for solving Partial Differential Equations (PDEs). 
3: Specifically, we compare the efficacy of traditional Multilayer Perceptrons (MLPs) with fixed and learnable activations against Kolmogorov-Arnold Networks (KANs), which employ learnable basis functions. 
4: Physics-informed neural networks (PINNs) have emerged as an effective method for directly incorporating physical laws into the learning process, offering a data-efficient solution for both the forward and inverse problems associated with PDEs.
5: However, challenges such as effective training and spectral bias, where low-frequency components are learned more effectively, often limit their applicability to problems characterized by rapid oscillations or sharp transitions.
6: % Our study explores the strengths and limitations of KANs and MLPs across diverse PDE scenarios. 
7: By employing different activation or basis functions on MLP and KAN, we assess their impact on convergence behavior and spectral bias mitigation, and the accurate approximation of PDEs. 
8: % Results indicate that KANs with B-spline basis functions demonstrate better performance in capturing localized high-frequency components compared to traditional MLPs. 
9: The findings offer insights into the design of neural network architectures that balance training efficiency, convergence speed, and test accuracy for PDE solvers. 
10: By evaluating the influence of activation or basis function choices, this work provides guidelines for developing more robust and accurate PINN models. 
11: The source code and pretrained models used in this study are made publicly available to facilitate reproducibility and future exploration.
12: \end{abstract}
13: