7ec2b40b89a0fb80.tex
1: \begin{abstract}
2: We consider randomized block coordinate stochastic mirror descent (RBSMD) methods for solving high-dimensional stochastic optimization problems with strongly convex objective functions. Our goal is to develop RBSMD schemes that achieve a rate of convergence with a minimum constant factor with respect to the choice of the stepsize sequence. To this end, we consider \fy{both subgradient and gradient RBSMD methods addressing nonsmooth and \ap{smooth} problems, respectively.} For each scheme, \fy{(i) }we develop self-tuned stepsize \fy{rules characterized} in terms of problem parameters and algorithm settings\fy{; (ii) we show} that the non-averaging iterate generated by the underlying RBSMD method converges to the optimal solution both in an almost sure and a mean sense; (iii) \ap{we show that  the mean squared error is minimized}. \fy{When} problem parameters are unknown, we develop a unifying self-tuned update rule that can be applied in both \fy{subgradient and gradient SMD methods, and show that for any arbitrary and small enough initial stepsize, a suitably defined error bound is minimized.} We provide constant factor comparisons with standard \fy{SMD and RBSMD} methods. Our numerical experiments performed on an SVM model display that the \fy{self-tuned schemes} are significantly robust with respect to the choice of problem parameters, and \fy{the }initial stepsize.
3: \end{abstract}
4: