026c37335d708483.tex
1: \begin{abstract}
2: Federated learning enables multiple participants to collaboratively train a model without aggregating the training data.
3: Although the training data are kept within each participant and the local gradients can be securely synthesized, 
4: recent studies have shown that such privacy protection is insufficient.
5: The global model parameters that have to be shared for optimization are susceptible to leak  information about training data. %attacks such as model inversion and membership inference.
6: In this work, we propose \codename (\short) that enhances privacy of federated learning by eliminating the sharing of global model parameters.
7: \short exploits the fact that a gradient descent optimization can start with a set of discrete %\baigd{neighboring/adjacent} 
8: points and converges to another set at the neighborhood of the global minimum of the objective function.
9: It lets the participants independently train on their local data, and securely share the sum of local gradients to benefit each other.
10: We formally demonstrate \short’s privacy enhancement over traditional FL. We prove that less information is exposed in CGD compared to that of traditional FL. 
11: \short also guarantees desired model accuracy. We theoretically establish a convergence rate for \short. We prove that the loss of the proprietary models learned for each participant against a model learned by aggregated training data is bounded. 
12: Extensive experimental results on two real-world datasets demonstrate the performance of \short is comparable with the centralized learning, 
13: with marginal differences on validation loss~(mostly within  0.05) and  accuracy~(mostly within  1\%). 
14: \end{abstract}
15: