1: \begin{abstract}

2:  In prototype-based federated learning, the exchange of model parameters between clients and the 

3:     master server is replaced by transmission of prototypes or quantized versions of the 

4:     data samples to the aggregation server. A fully decentralized deployment of prototype-

5:     based learning, without a central agregartor of prototypes, is more robust upon network 

6:     failures and reacts faster to changes in the statistical distribution of the data, 

7:     suggesting potential advantages and quick adaptation in dynamic learning tasks, e.g., 

8:     when the data sources are IoT devices or when data is non-iid.  In this paper, we 

9:     consider the problem of designing a communication-efficient decentralized learning 

10:     system based on prototypes. We address the challenge of prototype redundancy by 

11:     leveraging on a twofold data compression technique, i.e., sending only update messages 

12:     if the prototypes are information-theoretically useful (via the Jensen-Shannon 

13:     distance), and using clustering on the prototypes to compress the update messages used 

14:     in the gossip protocol. We also use parallel instead of sequential gossiping, and 

15:     present an analysis of its age-of-information (AoI). Our experimental results show that, with 

16:     these improvements, the communications load can be substantially reduced without 

17:     decreasing the convergence rate of the learning algorithm. 

18: \end{abstract}

19: