1: \begin{abstract}

2:   We provide a variable metric stochastic approximation theory. In doing so, we provide a convergence theory

3:   for a large class of online variable metric methods including the recently introduced online versions of the BFGS algorithm and

4:   its limited-memory LBFGS variant. We also discuss the implications of our results for learning from

5:   expert advice.

6:     \end{abstract}

7: