61085a452d256286.tex
1: \begin{abstract}
2: The feasibility of federated learning is highly constrained by the server-clients infrastructure in terms of network communication. Most newly launched  smartphones and IoT devices are equipped with GPUs or sufficient computing hardware to run powerful AI models. However, in case of the original synchronous federated learning, client devices suffer waiting times and regular communication between clients and server is required. This implies more sensitivity to local model training times and irregular or missed updates, hence, less or limited scalability to large numbers of clients  and convergence rates measured in real time will suffer. We propose a new algorithm for asynchronous federated learning which eliminates waiting times and reduces overall network communication - we provide rigorous theoretical analysis for strongly convex objective functions and provide simulation results. By adding Gaussian noise we show how our algorithm can be made differentially private -- new theorems show how the aggregated added Gaussian noise is significantly reduced.
3: %Our analysis also  provides convergence results for original federated learning (which has not been done rigorously according to our best knowledge). 
4: %%the new algorithm to an image classification application and a text prediction application. 
5: %Our main idea is to combine the asynchronous Stochastic Gradient Descent (SGD) framework of Hogwild! for diminishing step sizes 
6: %%(also called learning rate) 
7: %with federated learning. This allows scalability to a larger number of clients and improves convergence rate in real time.
8: \end{abstract}
9: