5837c6376bd3a81b.tex
1: \begin{abstract}
2: The ability to generalize compositionally is key to understanding the potentially infinite number of sentences that can be constructed in a human language from only a finite number of words.
3: Investigating whether NLP models possess this ability has been a topic of interest: \SCAN\ \cite{lake2018generalization} is one task specifically proposed to test for this property.
4: Previous work has achieved impressive empirical results using a group-equivariant neural network that naturally encodes a useful inductive bias for \SCAN\ \citep{gordon2019permutation}.
5: Inspired by this, we introduce a novel group-equivariant architecture that incorporates a group-invariant hard alignment mechanism.
6: We find that our network's structure allows it to develop stronger equivariance properties than existing group-equivariant approaches.
7: We additionally find that it outperforms previous group-equivariant networks empirically on the \SCAN\ task.
8: Our results suggest that integrating group-equivariance into a variety of neural architectures is a potentially fruitful avenue of research, and demonstrate the value of careful analysis of the theoretical properties of such architectures.
9: \newline
10: \newline
11: \vspace{1.5em}
12: \hspace{.5em}\includegraphics[width=1.25em,height=1.25em]{github.png}\hspace{.75em}\parbox{\dimexpr\linewidth-10\fboxsep-10\fboxrule}{\url{https://github.com/rycolab/equivariant-transduction}}
13: \vspace{-.5em}
14: \end{abstract}
15: