1: \begin{abstract}

2: Although federated learning (FL) enables multiple clients (e.g., mobile devices) to train a global model while preserving their privacy, FL imposes computational-intensive training to clients  and may have slow convergence rate under non-independent and identically distributed (non-IID) datasets among clients. 

3: In this work, we incorporate split learning into FL and propose a MiniBatch-SplitFed algorithm.

4: With our proposed algorithm, the model is split at a  cut layer into two parts: a client-side model and a server-side model. Clients cooperatively train only the client-side model, so their training load can be reduced. We theoretically analyze the convergence rate of our proposed algorithm and  show that a smaller gradient divergence of the client-side model leads to a higher convergence rate. Perhaps counter-intuitive, our empirical result shows that a latter position of cut layer leads to a smaller gradient divergence. The aforementioned theoretical and empirical results lead to our conclusion that a latter position of cut layer leads to a better algorithm performance. This conclusion is also validated by our experimental results. Moreover, experimental results show that our proposed MiniBatch-SplitFed algorithm achieves a higher training accuracy than conventional FL, especially when the non-IID degree of the clients' datasets is high. The improvement  can be up to 75\%. 

5: 

6: \end{abstract}

7: