1: \begin{abstract}

2: 		Recently, Stochastic Variational Inference (SVI) has been increasingly attractive thanks to its ability to find good posterior approximations of probabilistic models. 

3: 		It optimizes the variational objective with stochastic optimization, following noisy estimates of the natural gradient. 

4: 		However, almost all the state-of-the-art SVI algorithms are based on first-order optimization algorithm and often suffer from poor convergence rate. 

5: 		In this paper, we bridge the gap between second-order methods and stochastic variational inference by 

6: 		proposing a second-order based stochastic variational inference approach. 

7: 		In particular, firstly we derive the Hessian matrix of the variational objective. 

8: 		Then we devise two numerical schemes to 

9: 		%reduce the per-iteration cost and 

10: 		implement second-order SVI efficiently. 

11: 		Thorough empirical evaluations are investigated on both synthetic and real dataset to backup both the effectiveness and efficiency of the proposed approach. 

12: 	\end{abstract}

13: