1: \begin{abstract}

2: 

3: %The Bayesian paradigm is especially useful for scientific modeling of complex or hierarchical phenomena. Big Bayesian models are difficult to compute, but the Hamiltonian Monte Carlo algorithm enables inference for high-dimensional models with thousands of parameters.  Big models seem to be in direct conflict with big data---the same algorithm scales notoriously poorly with the number of data points.  We show that, by approximating the log-posterior gradient with a multi-output neural network, Hamiltonian Monte Carlo can handle both big data \emph{and} big models. The proposed neural network gradient Hamiltonian Monte Carlo achieves an up to 40-fold increase in efficiency when compared to its top competitors, all the while maintaining asymptotically exact inference.

4: 

5: Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the algorithm requires repeated gradient calculations, and these computations become increasingly burdensome as data sets scale. We present a method to substantially reduce the computation burden by using a neural network to approximate the gradient. First, we prove that the proposed method still maintains convergence to the true distribution though the approximated gradient no longer comes from a Hamiltonian system. Second, we conduct experiments on synthetic examples and real data to validate the proposed method.

6: 

7: \end{abstract}

8: