1: \begin{abstract}

2: 

3: 

4: User-level differential privacy (DP) 

5: provides certifiable privacy guarantees

6: to the information that is specific to any user’s data in federated learning. 

7: Existing methods that ensure user-level DP come at the cost of severe accuracy decrease.

8: In this paper, we study the cause of model performance degradation in federated learning with user-level DP guarantee.

9: We find the key to solving this issue is to naturally restrict the norm of local updates before executing operations that guarantee DP. 

10: To this end, we propose two techniques, \textit{Bounded Local Update Regularization} and \textit{Local Update Sparsification}, to increase model quality without sacrificing privacy.

11: We  provide  theoretical  analysis  on  the  convergence  of our framework and give rigorous privacy guarantees. Extensive experiments show that our framework significantly improves the privacy-utility trade-off over the state-of-the-arts for federated learning with  user-level DP guarantee.

12: 

13: 

14: \end{abstract}

15: