1: \begin{abstract}

2:     Traditional set prediction models can struggle with simple datasets due to an issue we call the responsibility problem.

3:     We introduce a pooling method for sets of feature vectors based on sorting features across elements of the set.

4:     This can be used to construct a permutation-equivariant auto-encoder that avoids this responsibility problem.

5:     On a toy dataset of polygons and a set version of MNIST, we show that such an auto-encoder produces considerably better reconstructions and representations.

6:     Replacing the pooling function in existing set encoders with FSPool improves accuracy and convergence speed on a variety of datasets.

7: \end{abstract}

8: