1: \begin{abstract}

2:   Federated optimization (FedOpt), which targets at collaboratively training a learning model across a large number of distributed clients, 

3:   is vital for federated learning.

4:   {The primary concerns in FedOpt can be attributed to the model divergence and communication efficiency, which significantly affect the performance.}

5:   In this paper, we propose a new method,

6:   i.e., LoSAC, to learn from heterogeneous distributed data more efficiently.

7:   Its key algorithmic insight is to locally update the estimate for the global full gradient  after {each} regular local model update.

8:   Thus,

9:   LoSAC can keep clients' information refreshed in a more compact way. In particular, we have studied the convergence result for LoSAC.

10:   Besides, the bonus of LoSAC is the ability to defend the information leakage from the recent technique Deep Leakage Gradients (DLG). 

11:   Finally,

12:   experiments have verified the superiority of LoSAC

13:   comparing with state-of-the-art FedOpt algorithms. Specifically, LoSAC significantly improves communication efficiency by more than $100\%$ on average, mitigates the model divergence problem and equips with the defense ability against DLG.

14: \end{abstract}

15: