3c6a49f44bd59c3d.tex
1: \begin{abstract}
2: This paper considers stochastic weakly convex optimization without the standard Lipschitz continuity assumption. Based on new adaptive regularization (stepsize) strategies, we show that a wide class of stochastic algorithms, including the stochastic subgradient method,  preserve the $\mathcal{O} ( 1 / \sqrt{K})$ convergence rate with constant failure rate.  Our analyses rest on rather weak assumptions: the Lipschitz parameter can be either bounded by a general growth function of $\norm{x}$ or locally estimated through independent random samples. 
3: % Our analysis allows arbitrary growth in the Lipschitz constant of stochastic model function and does not require solving subproblems. 
4: % We also extend our results to stochastic convex optimization. 
5: Numerical experiments demonstrate the efficiency and robustness of our proposed stepsize policies. 
6: \end{abstract}
7: