1: \begin{abstract}

2: Structured weight pruning is a representative model compression technique of DNNs for hardware efficiency and inference accelerations. Previous works in this area leave great space for improvement since sparse structures with combinations of different structured pruning schemes are not exploited fully and efficiently. To mitigate the limitations, we propose SS-Auto, a single-shot, automatic structured pruning framework that can achieve row pruning and column pruning simultaneously. We adopt soft constraint-based formulation to alleviate the strong non-convexity of $\ell_0$-norm constraints used in state-of-the-art ADMM-based methods for faster convergence and fewer hyperparameters. Instead of solving the problem directly, a Primal-Proximal solution is proposed to avoid the pitfall of penalizing all weights equally, thereby enhancing the accuracy. Extensive experiments on CIFAR-10 and CIFAR-100 datasets demonstrate that the proposed framework can achieve ultra-high pruning rates while maintaining accuracy. Furthermore, significant inference speedup has been observed from the proposed framework through actual measurements on the smartphone.

3: 

4: \iffalse

5: State-of-the-art ADMM-based pruning methods rely on $\ell_0$ hard constraints that are strongly non-convex and contain a large amount of hyperparameters. To address the limitations of prior works

6: \textcolor{red}{[SL: What are the unique contributions of this paper? After going through it, I felt that the joint row-wise and column-wise pruning is the unique contribution, correct? Any useful insight  from the obtained sparse pattern can be considered as another contribution?]}

7: \fi

8: \end{abstract}

9: