df435be8a4f42fd7.tex
1: \begin{abstract}                          % Abstract of not more than 200 words.
2:   In this paper we present a novel quasi-Newton algorithm for use in
3:   stochastic optimisation. Quasi-Newton methods have had an enormous
4:   impact on deterministic optimisation problems because they afford rapid
5:   convergence and computationally attractive algorithms. In essence,
6:   this is achieved by learning the second-order (Hessian) information
7:   based on observing first-order gradients. We extend these ideas to
8:   the stochastic setting by employing a highly flexible model for the
9:   Hessian and infer its value based on observing noisy gradients. In
10:   addition, we propose a stochastic counterpart to standard
11:   line-search procedures and demonstrate the utility of this
12:   combination on maximum likelihood identification for general
13:   nonlinear state space models.
14: \end{abstract}
15: