1: \begin{abstract}

2:     Training \glspl{QNN} is a non-differentiable optimisation problem since weights and features are output by piecewise constant functions.

3:     The standard solution is to apply the \gls{STE}, using different functions during the inference and gradient computation steps.

4:     Several \gls{STE} variants have been proposed in the literature aiming to maximise the task accuracy of the trained network.

5:     In this paper, we analyse \gls{STE} variants and study their impact on \gls{QNN} training.

6:     We first observe that most such variants can be modelled as stochastic regularisations of stair functions; although this intuitive interpretation is not new, our rigorous discussion generalises to further variants.

7:     Then, we analyse \glspl{QNN} mixing different regularisations, finding that some suitably synchronised smoothing of each layer map is required to guarantee pointwise compositional convergence to the target discontinuous function.

8:     Based on these theoretical insights, we propose \gls{ANA}, a new algorithm to train \glspl{QNN} encompassing standard \gls{STE} and its variants as special cases.

9:     When testing \gls{ANA} on the CIFAR-10 image classification benchmark, we find that the major impact on task accuracy is not due to the qualitative shape of the regularisations but to the proper synchronisation of the different \gls{STE} variants used in a network, in accordance with the theoretical results.

10: \end{abstract}

11: