1: \begin{abstract}	

2: Federated learning (FL) has been recognized as a rapidly growing research area, where the model is trained over massively distributed clients under the orchestration of a parameter server (PS)  without sharing clients' data. This paper delves into a class of federated problems characterized by non-convex and non-smooth loss functions, that are prevalent in FL applications but challenging to handle due to  their intricate non-convexity and non-smoothness nature and the conflicting requirements on communication efficiency and privacy protection.

3: %

4: In this paper, we propose a novel federated primal-dual algorithm with bidirectional model sparsification tailored for non-convex and non-smooth FL problems, and  differential privacy is applied for strong privacy guarantee. Its unique insightful properties and some privacy and convergence analyses are also presented for the FL algorithm design guidelines. Extensive experiments on real-world data are conducted to demonstrate the effectiveness of the proposed algorithm and much superior performance than some state-of-the-art FL algorithms, together with the validation of all the analytical results and properties.

5: 

6: \vspace{0.15cm}

7: \noindent {\bfseries Keywords}$-$Federated learning, primal-dual method, non-convex and non-smooth optimization, differential privacy,   model sparsification.

8: \\\\

9: \end{abstract}

10: