08230800614c9d24.tex
1: \begin{abstract}
2: 
3: The increasing size of data generated by smartphones and IoT devices motivated the development of 
4: \emph{Federated Learning} (FL), a framework for on-device collaborative training of machine learning models. First efforts in FL focused on learning a single global model with good average performance across clients, but the global model may be arbitrarily bad for a given client, due to the inherent heterogeneity of local data distributions. 
5: Federated \emph{multi-task learning} (MTL) approaches can learn \emph{personalized models} by formulating an opportune penalized optimization problem.
6: The penalization term can capture complex relations among personalized models, but eschews clear statistical assumptions about local data distributions.
7: 
8: In this work, we propose to study federated MTL under the flexible assumption that each local data distribution is a \emph{mixture of unknown underlying distributions}.
9: This assumption encompasses most of the existing personalized FL approaches and leads to federated EM-like algorithms for both client-server and fully decentralized settings.
10: Moreover, it  provides a principled way to serve personalized models to clients not seen at training time. The algorithms' convergence is analyzed through a novel federated surrogate optimization framework, which can be of general interest.
11: Experimental results on FL benchmarks show that our approach provides models with higher accuracy and fairness than state-of-the-art methods.
12: 
13: \end{abstract}
14: