1: \begin{abstract}

2: Despite ---or maybe because of--- their astonishing capacity to fit data, neural networks are believed to \update{have difficulties extrapolating} beyond training data distribution. 

3: This work shows that, for extrapolations based on finite transformation groups, a model's inability to extrapolate is unrelated to its capacity. 

4: Rather, the shortcoming is inherited from a learning hypothesis: \update{\em Examples not explicitly observed with infinitely many training examples have underspecified outcomes in the learner’s model.}

5: In order to endow neural networks with the ability to extrapolate over group transformations, we introduce a  learning framework \update{counterfactually-guided} by the learning hypothesis that {\em any group invariance to \update{(known)} transformation groups is mandatory even without evidence, unless the learner deems it inconsistent with the training data}.

6: Unlike existing invariance-driven methods for \update{(counterfactual) extrapolations}, this framework allows extrapolations from a single environment.

7: Finally, we introduce sequence and image extrapolation tasks that validate our framework and showcase the shortcomings of traditional approaches.

8: \end{abstract}

9: