1: \begin{abstract}

2: This paper describes an approach to detect idiomaticity only from the contextualized representation of a MWE over multilingual pretrained language models.

3: Our experiments find that larger models are usually more effective in idiomaticity detection. 

4: However, using a higher layer of the model may not guarantee a better performance.

5: In multilingual scenarios, the convergence of different languages are not consistent and rich-resource languages have big advantages over other languages.

6: \end{abstract}

7: