1: \begin{abstract}
2: {\tcr{As a continuation of} a recent paper, dealing with finite Markov chains,
3: this paper proposes and analyzes a recursive algorithm for the approximation
4: of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain.
5: We then apply this method to the numerical approximation of the quasi-stationary distribution of
6: a diffusion process killed on the boundary of a compact set. }
7: %and to the {estimation of the spectral gap} of irreducible Markov processes.}
8: {Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting}.
9:
10: %In the continuity of a recent paper, we propose in this article to build and to study a recursive algorithm for the approximation of the Quasi-Stationary Distribution of a general Markov chain conditioned to stay in a compact set. Then, we apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set. We also obtain some (numerical) bounds for the rate of convergence (spectral gap) of irreducible Markov processes.
11: %\comment{new}
12: %\tableofcontents
13: \end{abstract}
14: