65d377bd9e852753.tex
1: \begin{abstract}
2:     Recent advances in federated learning have shown that asynchronous variants can be faster and more scalable than their synchronous counterparts.
3:     However, their design does not include quantization, which is necessary in practice to deal with the communication bottleneck.
4:     To bridge this gap, we develop a novel algorithm, Quantized Asynchronous Federated Learning (QAFeL), which introduces a hidden-state quantization scheme to avoid the error propagation caused by direct quantization.
5:     QAFeL also includes a buffer to aggregate client updates, ensuring scalability and compatibility with techniques such as secure aggregation.
6:     Furthermore, we prove that QAFeL achieves an $\order{1/\sqrt{T}}$ ergodic convergence rate for stochastic gradient descent on non-convex objectives, which is the optimal order of complexity, without requiring bounded gradients or uniform client arrivals.
7:     We also prove that the cross-term error between staleness and quantization only affects the higher-order error terms.
8:     We validate our theoretical findings on standard benchmarks.
9: \end{abstract}
10: