1: \begin{abstract}

2: We present novel techniques to accelerate the convergence

3: of Deep Learning algorithms by conducting low overhead removal of

4: redundant neurons -- {\em apoptosis} of neurons -- which do not

5: contribute to model learning, during the training phase itself. We

6: provide in-depth theoretical underpinnings of our heuristics (bounding

7: accuracy loss and handling apoptosis of several neuron types), and

8: present the methods to conduct adaptive neuron apoptosis.

9: Specifically, we are able to improve the training time for several datasets by 2-3x,

10: while reducing the number of parameters by up to 30x (4-5x on average) on

11: datasets such as ImageNet classification.  For the Higgs Boson dataset,

12: our implementation improves the accuracy (measured by Area Under Curve

13: (AUC)) for classification from 0.88/1 to 0.94/1, while reducing the

14: number of parameters by 3x in comparison to existing literature. The

15: proposed methods

16: achieve a 2.44x speedup in comparison to the default (no apoptosis)

17: algorithm.

18: \end{abstract}

19: