1: \begin{abstract}

2: With the large rising of complex data, the nonconvex models such as nonconvex loss function and nonconvex regularizer

3: are widely used in machine learning and pattern recognition.

4: In this paper, we propose a class of mini-batch stochastic ADMMs (alternating direction method of multipliers)

5: for solving large-scale nonconvex nonsmooth problems. We prove that, given an appropriate mini-batch size,

6: the mini-batch stochastic ADMM without variance reduction (VR) technique is convergent and reaches a convergence rate of $O(1/T)$

7: to obtain a stationary point of the nonconvex optimization,

8: where $T$ denotes the number of iterations.

9: Moreover, we extend the mini-batch stochastic gradient method to

10: both the nonconvex SVRG-ADMM and SAGA-ADMM proposed in our initial manuscript \cite{huang2016stochastic},

11: and prove these mini-batch stochastic ADMMs also reaches the convergence rate of $O(1/T)$

12: without condition on the mini-batch size.

13: In particular, we provide a specific parameter selection for step size $\eta$ of stochastic gradients and

14: penalty parameter $\rho$ of augmented Lagrangian function.

15: Finally, extensive experimental results on both simulated and real-world data demonstrate the effectiveness of the proposed algorithms.

16: \end{abstract}