7c77ac749b58d0c7.tex
1: \begin{abstract}
2: In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth functions and a nonsmooth but possibly nonconvex function. The new framework is highly versatile. Firstly, it not only covers several existing algorithms such as SADMM, SVRG-ADMM, and SPIDER-ADMM but also guides us to design a novel accelerated hybrid stochastic ADMM algorithm, which utilizes a new hybrid estimator to trade-off variance and bias. Second, it enables us to exploit a more flexible dual stepsize in the convergence analysis. Under some mild conditions, our unified framework preserves $\mathcal{O}(1/T)$ sublinear convergence. Additionally, we establish the linear convergence under error bound conditions. Finally, numerical experiments
3: demonstrate the efficacy of the new algorithm for some nonsmooth and nonconvex problems.
4: \\\
5: \noindent {\bfseries Keywords}$-$ Nonconvex optimization, nonsmooth optimization, stochastic ADMM, hybrid stochastic estimator, accelerated gradient method, linear convergence rate. 
6: %\ifconfver
7: %\else
8: \\\\
9: %  \noindent {\bfseries EDICS}:  SAM-BEAM, SPC-INTF, SPC-APPL, SAM-APPL.% \fi
10: \end{abstract}
11: