1: \begin{abstract}

2: Attention mechanisms are widely used to dramatically improve deep learning model performance in various fields.

3: However, their general ability to improve the performance of physiological signal deep learning model is immature. 

4: In this study, we experimentally analyze four attention mechanisms (e.g., squeeze-and-excitation, non-local, convolutional block attention module, and multi-head self-attention) and three convolutional neural network (CNN) architectures (e.g., VGG, ResNet, and Inception) for two representative physiological signal prediction tasks: the classification for predicting hypotension and the regression for predicting cardiac output (CO). 

5: We evaluated multiple combinations for performance and convergence of physiological signal deep learning model. 

6: Accordingly, the CNN models with the \textit{spatial} attention mechanism showed the best performance in the classification problem, whereas the \textit{channel} attention mechanism achieved the lowest error in the regression problem. 

7: Moreover, the performance and convergence of the CNN models with attention mechanisms were better than stand-alone self-attention models in both problems. 

8: Hence, we verified that convolutional operation and attention mechanisms are complementary and provide faster convergence time, despite the stand-alone self-attention models requiring fewer parameters.

9: \keywords{Physiological signal  \and Attention \and Deep learning.}

10: \end{abstract}

11: