1: \begin{abstract}

2:   Federated learning is a new distributed machine learning framework, 

3:   where a bunch of heterogeneous clients collaboratively train a model 

4:   without sharing training data. 

5:   In this work, we consider a practical and ubiquitous issue 

6:   when deploying federated learning in mobile environments: 

7:   \emph{intermittent client availability}, 

8:   where the set of eligible clients may change during the training process. 

9:   Such intermittent client availability would seriously deteriorate 

10:   the performance of the classical Federated Averaging algorithm 

11:   (FedAvg for short). 

12:   Thus, we propose a simple distributed non-convex optimization algorithm, 

13:   called Federated Latest Averaging (FedLaAvg for short), 

14:   which leverages the latest gradients of all clients, 

15:   even when the clients are not available, 

16:   to jointly update the global model in each iteration. 

17:   Our theoretical analysis shows that FedLaAvg attains the 

18:   convergence rate of $O(E^{1/2}/(N^{1/4} T^{1/2}))$, 

19:   achieving a sublinear speedup with respect to 

20:   the total number of clients. 

21:   We implement FedLaAvg along with several baselines and evaluate them over 

22:   the benchmarking MNIST and Sentiment140 datasets. 

23:   The evaluation results demonstrate that FedLaAvg achieves more stable 

24:   training than FedAvg in both convex and non-convex settings

25:   and indeed reaches a sublinear speedup.

26: \end{abstract}

27: