1: \begin{abstract}

2:   The prevalent personalized federated learning (PFL) usually pursues a trade-off between personalization and generalization 

3:   by maintaining a shared global model to guide the training process of local models. 

4:   However, the sole global model may easily transfer deviated context knowledge 

5:   to some local models when multiple latent contexts exist across the local datasets.

6:   In this paper, we propose a novel concept called \textit{contextualized generalization (CG)} to provide each client with fine-grained context knowledge that can better fit the local data distributions and facilitate faster model convergence, based on which we properly design a framework of PFL, dubbed \textit{CGPFL}.

7:   We conduct detailed theoretical analysis, in which the convergence guarantee is presented and $\mathcal{O}(\sqrt{K})$ speedup over most existing methods is granted. To quantitatively study the generalization-personalization trade-off, we introduce the `generalization error' measure and prove that the proposed \textit{CGPFL} can achieve a better trade-off than existing solutions. Moreover, our theoretical analysis further inspires a heuristic algorithm to find a near-optimal trade-off in \textit{CGPFL}. Experimental results on multiple real-world datasets show that our approach surpasses the state-of-the-art methods on test accuracy by a significant margin.

8: \end{abstract}

9: