1: \begin{abstract}

2: %Motivated by the increasing computational capabilities of wireless edge devices and the unprecedented volume of data generated by them, novel distributed machine learning methods have surfaced, including federated learning (FL). FL, a promising technology that orchestrates distributed training on edge devices through a parameter server (PS), holds special significance within the wireless community due to its communication efficiency and its ability to address the challenge of non-iid data distributions. To improve the convergence rate of FL, deploying 

3: Second-order methods are widely adopted to improve the convergence rate of learning algorithms. In federated learning (FL), these methods require the clients to share their local Hessian matrices with the parameter server (PS), which comes at a prohibitive communication cost. A classical solution to this issue is to approximate the global Hessian matrix from the first-order information. Unlike in idealized networks, this solution does not perform effectively in over-the-air FL settings, where the PS receives noisy versions of the local gradients. This paper introduces a novel second-order FL framework tailored for wireless channels. The pivotal innovation lies in the PS's capability to directly estimate the global Hessian matrix from the received noisy local gradients via a non-parametric method: the PS models the unknown Hessian matrix as a Gaussian process, and then uses the temporal relation between the gradients and Hessian along with the channel model to find a stochastic estimator for the global Hessian matrix. We refer to this method as \textbf{G}aussian \textbf{p}rocess-based Hessian modeling for wireless \textbf{FL} (GP-FL) and show that it exhibits a linear-quadratic convergence rate. Numerical experiments on various datasets demonstrate that GP-FL outperforms all classical baseline first and second order FL approaches. 

4: \end{abstract}

5: