68723b2c7612630f.tex
1: \begin{abstract}
2:     Motivated by federated learning, we consider the hub-and-spoke
3:     model of distributed optimization in which a central authority
4:     coordinates the computation of a solution among many agents while
5:     limiting communication.  We first study some past procedures for
6:     federated optimization, and show that their fixed points need not
7:     correspond to stationary points of the original optimization
8:     problem, even in simple convex settings with deterministic
9:     updates.  In order to remedy these issues, we introduce \fedsplit,
10:     a class of algorithms based on operator splitting procedures for
11:     solving distributed convex minimization with additive structure.
12:     We prove that these procedures have the correct fixed points,
13:     corresponding to optima of the original optimization problem, and
14:     we characterize their convergence rates under different settings.
15:     Our theory shows that these methods are provably robust to inexact
16:     computation of intermediate local quantities.  We complement our
17:     theory with some simple experiments that demonstrate the benefits
18:     of our methods in practice.
19:   \end{abstract}
20: