1: \begin{abstract}

2: This paper addresses the challenge of mitigating data heterogeneity among clients within a Federated Learning (FL) framework.

3: The model-drift issue, arising from the non-iid nature of client data, often results in suboptimal personalization of a global model compared to locally trained models for each client.

4: To tackle this challenge, we propose a novel approach named FedD2S for Personalized Federated Learning (pFL), leveraging knowledge distillation.

5: FedD2S incorporates a deep-to-shallow layer-dropping mechanism in the data-free knowledge distillation process to enhance local model personalization.

6: Through extensive simulations on diverse image datasets—FEMNIST, CIFAR10, CINIC0, and CIFAR100—we compare FedD2S with state-of-the-art FL baselines.

7: The proposed approach demonstrates superior performance, characterized by accelerated convergence and improved fairness among clients.

8: The introduced layer-dropping technique effectively captures personalized knowledge, resulting in enhanced performance compared to alternative FL models. 

9: Moreover, we investigate the impact of key hyperparameters, such as the participation ratio and layer-dropping rate, providing valuable insights into the optimal configuration for FedD2S. The findings demonstrate the efficacy of adaptive layer-dropping in the knowledge distillation process to achieve enhanced personalization and performance across diverse datasets and tasks.

10: 

11: \begin{IEEEkeywords}

12: 	Personalized Federated Learning, Data-Free Knowledge Distillation.

13: \end{IEEEkeywords}

14: \end{abstract}

15: