7af82b686c52710a.tex
1: \begin{abstract}
2:   Using Markov chain Monte Carlo to sample from posterior
3:   distributions was the key innovation which made Bayesian data
4:   analysis practical.  Notoriously, however, MCMC is hard to tune,
5:   hard to diagnose, and hard to parallelize.  This pedagogical note
6:   explores variants on a universal {\em non}-Markov-chain Monte Carlo
7:   scheme for sampling from posterior distributions.  The basic idea is
8:   to draw parameter values from the prior distributions, evaluate the
9:   likelihood of each draw, and then copy that draw a number of times
10:   proportional to its likelihood.  The distribution after copying is
11:   an approximation to the posterior which becomes exact as the number
12:   of initial samples goes to infinity; the convergence of the
13:   approximation is easily analyzed, and is uniform over
14:   Glivenko-Cantelli classes.  While not {\em entirely} practical, the
15:   schemes are straightforward to implement (a few lines of R), easily
16:   parallelized, and require no rejection, burn-in, convergence
17:   diagnostics, or tuning of any control settings.  I provide
18:   references to the prior art which deals with some of the practical
19:   obstacles, at some cost in computational and analytical simplicity.
20: \end{abstract}
21: