1: \begin{abstract}

2: Federated learning (FL) is a distributed learning protocol in which a server 

3: needs to aggregate a set of models learned some independent clients to proceed the

4: learning process.  At present, model averaging, known as FedAvg, is one of the most

5: widely adapted aggregation techniques.  However, it is known to yield the models with

6: degraded prediction accuracy and slow convergence.  In this work, we find out that

7: averaging models from different clients significantly diminishes the norm of the update

8: vectors, resulting in slow learning rate and low prediction accuracy.

9: Therefore, we propose a new aggregation method called FedNNNN. Instead of

10: simple model averaging, we adjust the norm of the update vector and introduce

11: momentum control techniques to improve the aggregation effectiveness of FL.

12: %As a demonstration, we evaluate FedNNNN on the MNIST, CIFAR10, and CIFAR100

13: As a demonstration, we evaluate FedNNNN on multiple datasets and scenarios with different 

14: %neural network models, and observe $1.7\%\sim 5.2\%$ accuracy improvement.

15: neural network models, and observe up to $5.4\%$ accuracy improvement.

16: 

17: \keywords{Federated Learning  \and Distributed Learning \and Deep Learning}

18: \end{abstract}

19: