1: \begin{abstract}

2: % We present a new communication efficient second order framework for Federated Learning called FLECS. Inspired by the paper \cite{islamov2021distributed} we 

3: 

4: Inspired by the recent work FedNL (Safaryan et al, FedNL: Making Newton-Type Methods Applicable to Federated Learning), we propose a new communication efficient second-order framework for Federated learning, namely FLECS. The proposed method reduces the high-memory requirements of FedNL by the usage of an L-SR1 type update for the Hessian approximation which is stored on the central server. A low dimensional `sketch' of the Hessian is all that is needed by each device to generate an update, so that memory costs as well as number of Hessian-vector products for the agent are low. Biased and unbiased compressions are utilized to make communication costs also low. Convergence guarantees for FLECS are provided in both the strongly convex, and nonconvex cases, and local linear convergence is also established under strong convexity. Numerical experiments confirm the practical benefits of this new FLECS algorithm.

5: 

6: % We present a new communication efficient second order method for nonconvex finite sum minimization. A distributed optimization set-up is assumed, with a central server connected to multiple devices/agents. The method, called FLECS, uses an L-SR1 type update for the Hessian approximation, coupled with a truncation step for numerical stability, which is stored on the central server.  

7: % Due to the inclusion of approximate second order information, FLECS enjoys fast local convergence, but it also maintains low per iteration communication costs. 

8: 

9: \end{abstract}

10: