9af2de499511eafe.tex
1: \begin{abstract}
2: %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
3: 
4: In this paper we consider online mirror descent (OMD) algorithms, a class of scalable online learning algorithms exploiting data geometric structures through mirror maps.
5: Necessary and sufficient conditions are presented in terms of the step size sequence $\{\eta_t\}_{t}$ for the convergence of an OMD algorithm with respect to the expected
6: Bregman distance induced by the mirror map. The condition is $\lim_{t\to\infty}\eta_t=0, \sum_{t=1}^{\infty}\eta_t=\infty$ in the case of positive variances.
7: It is reduced to $\sum_{t=1}^{\infty}\eta_t=\infty$ in the case of zero variances for which the linear convergence may be achieved by taking a constant step size sequence.
8: A sufficient condition on the almost sure convergence is also given. We establish tight error bounds under mild conditions on the mirror map, the loss function, and the regularizer.
9: Our results are achieved by some novel analysis on the one-step progress of the OMD algorithm
10: using smoothness and strong convexity of the mirror map and the loss function.
11: 
12: \medskip
13: \textbf{Keywords}: Mirror descent, Online learning, Bregman distance, Convergence analysis, Learning theory.
14: \end{abstract}%