1: \begin{abstract}

2: Deep Convolutional Neural Networks (CNN) enforce supervised information only at the output layer, and hidden layers

3: are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a

4: supervised feature learning approach, Label Consistent Neural Network, which enforces direct supervision in late hidden layers in a novel way.

5: We associate each neuron in a hidden layer with a particular class label and encourage it to be activated for input signals from the same class.

6: More specifically, we introduce a label consistency regularization called ``discriminative representation error'' loss

7: for late hidden layers and combine it with classification error loss to build our overall objective function.

8: This label consistency constraint alleviates the common problem of gradient vanishing and tends to faster

9: convergence; it also makes the features derived from late hidden layers discriminative enough for classification even

10: using a simple $k$-NN classifier, since input signals from the same class will have very similar

11: representations. Experimental results demonstrate that our approach achieves state-of-the-art performances on several public

12: benchmarks for action and object category recognition.

13: \end{abstract}

14: