1: \begin{abstract}

2:     Decentralized federated learning, inherited from decentralized learning, enables the edge devices to collaborate on model training in a peer-to-peer manner without the assistance of a server. 

3:     However, existing decentralized learning frameworks usually assume perfect communication among devices, where they can reliably exchange messages, \emph{e.g.}, gradients or parameters.

4:     But the real-world communication networks are prone to packet loss and transmission errors.

5:     Transmission reliability comes with a price. 

6:     The commonly-used solution is to adopt a reliable transportation layer protocol, \emph{e.g.}, transmission control protocol (TCP), which however leads to significant communication overhead and reduces connectivity among devices that can be supported.

7:     For a communication network with a lightweight and unreliable communication protocol, user datagram protocol (UDP), we propose  a robust decentralized stochastic gradient descent (SGD) approach, called Soft-DSGD, to address the unreliability issue.

8:     Soft-DSGD updates the model parameters with partially received messages and optimizes the mixing weights according to the link reliability matrix of communication links. 

9:     We prove that the proposed decentralized training system, even with unreliable communications, can still achieve the same asymptotic convergence rate as vanilla decentralized SGD with perfect communications.

10:     Moreover, numerical results confirm the proposed approach can leverage all available unreliable communication links to speed up  convergence.

11: \end{abstract}

12: