1: \begin{abstract}
2: Federated Learning (FL) enables edge devices or \textit{clients} to collaboratively train machine learning (ML) models without sharing their private data. Much of the existing work in FL focuses on efficiently learning a model for a single task. In this paper, we study \textit{simultaneous training} of multiple FL models using a common set of clients. The few existing simultaneous training methods employ synchronous aggregation of client updates, which can cause significant delays because large models and/or slow clients can bottleneck the aggregation. On the other hand, a na\"ive asynchronous aggregation is adversely affected by stale client updates. We propose \(\nameofthealgorithm\), a buffered asynchronous federated simultaneous training algorithm that overcomes bottlenecks from slow models and adaptively allocates client resources across heterogeneous tasks. We provide theoretical convergence guarantees of \(\nameofthealgorithm\) for smooth non-convex objective functions. Extensive experiments over multiple real-world datasets demonstrate that our proposed method outperforms existing simultaneous FL approaches, achieving up to $46.0\%$ reduction in time to train multiple tasks to completion.
3: \end{abstract}
4: