1: \begin{abstract}
2: We observe the emergence of binary encoding within the latent space of deep-neural-network classifiers.
3: Such binary encoding is induced by introducing a linear penultimate layer, which is equipped during training with a loss function that grows as $\exp(\vec{x}^2)$, where $\vec{x}$ are the coordinates in the latent space.
4: %exhibits exponential growth from the origin.
5: The phenomenon we describe represents a specific instance of a well-documented occurrence known as \textit{neural collapse}, which arises in the terminal phase of training and entails the collapse of latent class means to the vertices of a simplex equiangular tight frame (ETF).
6: We show that binary encoding accelerates convergence toward the simplex ETF and enhances classification accuracy.
7: \end{abstract}
8: