1: \begin{abstract}

2: Decentralized learning is now attracting growing attention for parallel computation and privacy preservation.

3: Many recent works revealed that the underlying network topology with a faster consensus rate (a.k.a. spectral gap) leads to a better convergence rate and accuracy for decentralized learning.

4: However, a topology with a fast consensus rate, e.g., the exponential graph, generally has a large maximum degree,

5: which incurs significant communication costs.

6: Thus, seeking topologies with both a fast consensus rate and a small maximum degree is important.

7: In this work, we propose a novel topology combining both a fast consensus rate and a small maximum degree called the \proposed{$\left(k+1\right)$}.

8: For any number of nodes and maximum degree $k$, 

9: the \proposed{$(k+1)$} enables all nodes to reach the exact consensus after finite time iterations.

10: Due to this favorable property, 

11: the \proposed{$(k+1)$} endows Decentralized SGD (DSGD) with both a faster convergence rate and more communication efficiency than the exponential graph.

12: We conducted experiments with various topologies,

13: showing that the \proposed{$(k+1)$} enables various decentralized learning methods to achieve higher accuracy with better communication efficiency than the existing topologies.

14: \end{abstract}

15: