1: \begin{abstract}

2: Federated Learning (FL) is developed to learn a single global model across the decentralized data, while is susceptible when realizing client-specific personalization in the presence of statistical heterogeneity. 

3: However, studies focus on learning a robust global model or personalized classifiers, which yield divergence due to inconsistent objectives. 

4: This paper shows that it is possible to achieve flexible personalization after the convergence of the global model by introducing representation learning. 

5: In this paper, we first analyze and determine that non-IID data harms representation learning of the global model. 

6: Existing FL methods adhere to the scheme of jointly learning representations and classifiers, where the global model is an average of classification-based local models that are consistently subject to heterogeneity from non-IID data.

7: As a solution, we separate representation learning from classification learning in FL and propose \texttt{RepPer}, an independent two-stage personalized FL framework.

8: We first learn the client-side feature representation models that are robust to non-IID data and aggregate them into a global common representation model.

9: After that, we achieve personalization by learning a classifier head for each client, based on the common representation obtained at the former stage.

10: Notably, the proposed two-stage learning scheme of \texttt{RepPer} can be potentially used for lightweight edge computing that involves devices with constrained computation power.

11: Experiments on various datasets (CIFAR-10/100, CINIC-10) and heterogeneous data setup show that \texttt{RepPer} outperforms alternatives in flexibility and personalization on non-IID data.

12: \end{abstract}

13: