1: \begin{abstract}

2: Federated learning (FL) 

3: on heterogeneous data (non-IID data)

4: has recently received great attention.

5: Most existing methods focus on studying the convergence guarantees for the global objective.

6: While

7: these methods can guarantee the decrease of the global objective in each communication round, they fail to ensure risk decrease for each client. 

8: In this paper,

9: to address the problem,

10: we propose \fed,

11: which introduces a consensus mechanism to enforce decreased risk for each client after each training round.

12: In particular,

13: we allow a slight adjustment to a client’s gradient on the

14: server side, which generates an acute angle between the corrected gradient and the original ones of other clients.

15: We theoretically show that the consensus mechanism can guarantee the convergence of the global objective.

16: To generalize the consensus mechanism to the partial participation FL scenario,

17: we devise a novel client sampling strategy to select the most representative clients for the global data distribution.

18: Training on these selected clients with the consensus mechanism could empirically lead to risk decrease for clients that are not selected.

19: Finally, we conduct extensive experiments on four benchmark datasets to show the superiority of \fed\ against other state-of-the-art methods in terms of effectiveness, efficiency and fairness.

20: For reproducibility,

21: we make our source code publicly available at: \url{https://github.com/fedcome/fedcome}.

22: \end{abstract}

23: