1: \begin{abstract}

2:   A key learning scenario in large-scale applications is that of

3:   \emph{federated learning}, where a centralized model is trained

4:   based on data originating from a large number of clients. We argue

5:   that, with the existing training and inference, federated models can

6:   be biased towards different clients. Instead, we propose a new

7:   framework of \emph{agnostic federated learning}, where the

8:   centralized model is optimized for any target distribution formed by

9:   a mixture of the client distributions. We further show that this

10:   framework naturally yields a notion of fairness. We present

11:   data-dependent Rademacher complexity guarantees for learning with

12:   this objective, which guide the definition of an algorithm for

13:   agnostic federated learning. We also give a fast stochastic

14:   optimization algorithm for solving the corresponding optimization

15:   problem, for which we prove convergence bounds, assuming a convex

16:   loss function and hypothesis set. We further empirically demonstrate

17:   the benefits of our approach in several datasets. Beyond federated

18:   learning, our framework and algorithm can be of interest to other

19:   learning scenarios such as cloud computing, domain adaptation,

20:   drifting, and other contexts where the training and test

21:   distributions do not coincide.

22: \end{abstract}

23: