1: \begin{abstract}

2: {

3: Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences.

4: Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed datasets while satisfying a variety of privacy and system constraints. 

5: Different from conventional distributed optimization methods, FL needs to address several specific issues (e.g., non-i.i.d. data distributions and differential private noises), which pose a set of new challenges in the problem formulation, algorithm design, and convergence analysis.

6: In this paper, we will systematically review existing FL optimization research including their assumptions, formulations, methods, and theoretical results. 

7: Potential future directions are also discussed.

8: 

9: }

10: 

11: \end{abstract}

12: