1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file

2: %Initializing the weights of neural networks close to zero is the common practice for training them. This practice fails if the network tries to learn the parity function. Contrastingly, using the right initialization, we show that the parity function and any other \emph{symmetric} function, i.e. a function that is invariant under permutations of its input (the corresponding group is $\mathbb{S}_n$), can be learned with neural networks. This demonstrates the importance of choosing an initialization (or an architecture) that accommodates the symmetries of a given learning problem.

3: %A natural question now follows, what other groups can be used to generate effective convergence guarantees and generalization bounds? 

4: This work provides an additional step in the theoretical

5: understanding of neural networks. We consider neural networks with one hidden layer and show that when learning symmetric functions, one can choose initial conditions so that standard SGD training efficiently produces generalization guarantees. We empirically verify this and show that this does not hold when the initial conditions are chosen at random. The proof of convergence investigates the interaction between the two layers of the network. Our results highlight the importance of using symmetry in the design of neural networks.

6: \end{abstract}

7: