1: \begin{abstract}

2: Due to the remarkable performance in preserving data privacy for

3: decentralized data scenarios, 

4: Federated Learning (FL) has been considered as a promising distributed machine learning paradigm to deal with data silos problems.

5: Typically, conventional FL approaches

6: adopts a one-to-multi training scheme, where the 

7: cloud server keeps only one single global model for all the  involved clients for the purpose of 

8: model aggregation. 

9: However, this scheme suffers from inferior classification performance, since only one global model 

10: cannot always accommodate  all the incompatible convergence directions of local models, resulting in 

11: low convergence rate and classification accuracy. 

12: To address this issue, this paper presents an efficient

13: FL framework named \textit{FedCross}, which adopts a novel

14: multi-to-multi FL training scheme  based on 

15: our proposed similarity-based {\it multi-model} 

16: cross aggregation method. Unlike traditional 

17: FL methods,  in each  round of FL training, 

18: \textit{FedCross} uses  a small set of distinct

19: intermediate models to 

20: conduct weighted fusion under the guidance of model similarities.

21: In this way, the intermediate models 

22: used by \textit{FedCross} can 

23: sufficiently 

24: respect the convergence characteristics of clients, thus leading to much 

25: fewer conflicts in tuning the convergence directions of clients. 

26: Finally, in the deployment stage, 

27: \textit{FedCross} forms a global model 

28: for all the clients by performing the federated averaging 

29: on the trained immediate models. 

30: % experiment result

31: %

32: Experimental results on three well-known datasets demonstrate that, compared with state-of-the-art FL approaches, \textit{FedCross} can significantly improve FL accuracy in both IID and non-IID scenarios without causing 

33: additional communication overhead.

34: \end{abstract}

35: