9a9d6ba5164f8798.tex
1: \begin{abstract}
2:     Federated learning~(FL) has recently become a hot research topic, in which Byzantine robustness, communication efficiency and privacy preservation are three important aspects. 
3:     However, the tension among these three aspects makes it hard to simultaneously take all of them into account. 
4:     In view of this challenge, we theoretically analyze the conditions that a communication compression method should satisfy to be compatible with existing Byzantine-robust methods and privacy-preserving methods. Motivated by the analysis results, we propose a novel communication compression method called \emph{consensus sparsification}~(ConSpar). {To the best of our knowledge, ConSpar is the first communication compression method that is designed to be compatible with both Byzantine-robust methods and privacy-preserving methods.} Based on ConSpar, we further propose a novel FL framework called \emph{FedREP}, which is Byzantine-\underline{r}obust, communication-\underline{e}fficient and \underline{p}rivacy-preserving. We theoretically prove the Byzantine robustness and the convergence of FedREP. Empirical results show that FedREP can significantly outperform communication-efficient privacy-preserving baselines. Furthermore, compared with Byzantine-robust communication-efficient baselines, FedREP can achieve comparable accuracy with the extra advantage of privacy preservation. 
5: \end{abstract}
6: