1: \begin{abstract}

2: Federated learning often suffers from unstable and slow convergence due to heterogeneous characteristics of participating clients.

3: Such tendency is aggravated when the client participation ratio is low since the information collected from the clients at each round is prone to be more inconsistent.

4: To tackle the challenge, we propose a novel federated learning framework, which improves the stability of the server-side aggregation step, which is achieved by sending the clients an accelerated model estimated with the global gradient to guide the local gradient updates. 

5: Our algorithm naturally aggregates and conveys the global update information to participants with no additional communication cost and does not require to store the past models in the clients.

6: We also regularize local update to further reduce the bias and improve the stability of local updates.

7: We perform comprehensive empirical studies on real data under various settings and demonstrate the remarkable performance of the proposed method in terms of accuracy and communication-efficiency compared to the state-of-the-art methods, especially with low client participation rates.

8: Our code is available at \url{https://github.com/ninigapa0/FedAGM}

9: \end{abstract}

10: