70c98852019358d7.tex
1: \begin{abstract}
2: %The Federated Learning (FL) makes possible the training of a learning model without sharing data.
3: Federated Learning (FL) is a collaborative scheme to train a learning model across multiple participants without sharing data.
4: While FL is a clear step forward towards enforcing users’ privacy, different inference attacks have been developed.
5: In this paper, we quantify the utility and privacy trade-off of a FL scheme using private personalized layers.
6: While this scheme has been proposed as local adaptation to improve the accuracy of the model through local personalization, it has also the advantage to minimize the information about the model exchanged with the server. However, the privacy of such a scheme has never been quantified.
7: Our evaluations using motion sensor dataset show that personalized layers speed up the convergence of the model and slightly improve the accuracy for all users compared to a standard FL scheme while better preventing both attribute and membership inferences compared to a FL scheme using local differential privacy.
8: %The emergence of Federated Learning (FL) allows a group of users to train a machine learning model without sharing their data. However, different privacy attacks have been developed on this framework to infer different sensitive information on the data kept locally such as Attribute/Membership inference attacks. Recently different works highlighted defenses such Local Differential Privacy to overcome privacy issues. In this paper, we evaluate the impact on privacy/utility of using personalization layers on Federated Learning. The benefits of this scheme on utility specifically for heterogeneous data has already been shown, but the privacy impact has never been measured. We show that compared to other baselines, the use of personalization layers in Federated Learning mitigate the capacity of an attacker to retrieve information with both Attribute and Membership inference attack.
9: \end{abstract}
10: