1: \begin{abstract}

2: 

3: We present an analysis of the performance of Federated Learning in a paradigmatic natural-language processing task: Named-Entity Recognition (NER). For our evaluation, we use the language-independent CoNLL-2003 dataset as our benchmark dataset and a Bi-LSTM-CRF model as our benchmark NER model. We show that federated training reaches almost the same performance as the centralized model, though with some performance degradation as the learning environments become more heterogeneous. We also show the convergence rate of federated models for NER. Finally, we discuss existing challenges of Federated Learning for NLP applications that can foster future research directions.

4: 

5: % In this work, we evaluate the learning performance of a federated solution on the name entity recognition task. For our evaluation, we employ the language-independent CoNLL-2003 dataset as our benchmark dataset and a Bi-LSTM-CRF model as our benchmark model. We perform systematic analysis of the convergence of federated models compared to their centralized counterpart over a range of challenging data distributions. We conclude with our observations for efficient training of NER models in the context of federated training and discuss existing limitations that can foster future research directions.

6: 

7: \end{abstract}

8: