1: \begin{abstract}

2: Collaborative training of neural networks leverages distributed data by exchanging gradient information between different clients.

3: Although training data entirely resides with the clients, recent work shows that training data can be reconstructed from such exchanged gradient information.

4: To enhance privacy, gradient perturbation techniques have been proposed.

5: However, they come at the cost of reduced model performance, increased convergence time, or increased data demand.

6: In this paper, we introduce PRECODE, a PRivacy EnhanCing mODulE that can be used as generic extension for arbitrary model architectures.

7: We propose a simple yet effective realization of PRECODE using variational modeling.

8: The stochastic sampling induced by variational modeling effectively prevents privacy leakage from gradients and in turn preserves privacy of data owners.

9: We evaluate PRECODE using state of the art gradient inversion attacks on two different model architectures trained on three datasets.

10: In contrast to commonly used defense mechanisms, we find that our proposed modification consistently reduces the attack success rate to $0\%$ while having almost no negative impact on model training and final performance.

11: As a result, PRECODE reveals a promising path towards privacy enhancing model extensions.

12: \end{abstract}

13: