9250f726c90b1828.tex
1: \begin{abstract}
2: Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference.
3: %
4: One of the most important challenges for any MCMC method is speeding up the convergence of the Markov chain, which depends crucially on a suitable choice of the proposal density.
5: %
6: Adaptive Rejection Metropolis Sampling (ARMS) is a well-known MH scheme that generates samples from one-dimensional target densities making use of adaptive piecewise linear proposals constructed using support points taken from rejected samples.
7: %
8: %For multi-dimensional densities it can be applied within a Gibbs sampler to draw samples from the full conditional distribution.
9: %
10: In this work we pinpoint a crucial drawback of the adaptive procedure used in ARMS: support points might never be added inside regions where the proposal is below the target.
11: %
12: When this happens in many regions it leads to a poor performance of ARMS, and the sequence of proposals never converges to the target.
13: %
14: In order to overcome this limitation, we propose two alternative adaptive schemes that guarantee convergence to the target distribution.
15: %
16: These two new schemes improve the adaptive strategy of ARMS, thus allowing us to simplify the construction of the sequence of  proposals.
17: %We also suggest simpler procedures for constructing the proposal pdfs.}
18: %
19: %The first one is a direct modification of the ARMS procedure that incorporates support points inside regions where the proposal is below the target, while satisfying the diminishing adaptation property, one of the required conditions to assure the convergence of the Markov chain.
20: %
21: %The second one is an adaptive independent MH algorithm with the ability to learn from all previous samples except for the current state of the chain, thus also guaranteeing the convergence to the invariant density.
22: %
23: %
24: Numerical results show that the new algorithms outperform the standard ARMS and other techniques.
25: \end{abstract}
26: