1: \begin{abstract}

2: \textcolor{blue}{Efficient learning and model compression algorithm

3: for deep neural network (DNN) is a key workhorse behind the rise of

4: deep learning (DL). In this work, we propose a message passing based

5: Bayesian deep learning algorithm called EM\nobreakdash-TDAMP to avoid

6: the drawbacks of traditional stochastic gradient descent (SGD) based

7: learning algorithms and regularization-based model compression methods.

8: Specifically, we formulate the problem of DNN learning and compression

9: as a sparse Bayesian inference problem, in which group sparse prior

10: is employed to achieve structured model compression. Then, we propose

11: an expectation maximization (EM) framework to estimate posterior distributions

12: for parameters (E-step) and update hyperparameters (M-step), where

13: the E-step is realized by a newly proposed turbo deep approximate

14: message passing (TDAMP) algorithm. We further extend the EM-TDAMP

15: and propose a novel Bayesian federated learning framework, in which

16: and the clients perform TDAMP to efficiently calculate the local posterior

17: distributions based on the local data, and the central server first

18: aggregates the local posterior distributions to update the global

19: posterior distributions and then update hyperparameters based on EM

20: to accelerate convergence. We detail the application of EM\nobreakdash-TDAMP

21: to Boston housing price prediction and handwriting recognition, and

22: present extensive numerical results to demonstrate the advantages

23: of EM\nobreakdash-TDAMP\@.}

24: \end{abstract}