3916a2ef7aa5b3ac.tex
1: \begin{abstract}
2:   Our main result is to prove almost-sure convergence of a stochastic-approximation
3:   algorithm defined on the space of measures on a non-compact
4:   space. Our motivation is to apply this result to measure-valued P\'olya processes (MVPPs, also known as infinitely-many P\'olya urns). Our main idea is to use Foster-Lyapunov type criteria in a
5:   novel way to generalize stochastic-approximation methods to
6:   measure-valued Markov processes with a non-compact
7:   underlying space, overcoming in a fairly
8:   general context one of the major difficulties of existing studies
9:   on this subject.
10: 
11:   From the MVPPs point of view, our result implies almost-sure convergence of a large
12:   class of MVPPs; this convergence was only obtained until now for specific examples, with only convergence in probability established for general classes.
13:   Furthermore, our approach allows us to extend the definition of MVPPs by
14:   adding ``weights'' to the different colors of the
15:   infinitely-many-color urn.
16:   We also exhibit a link between non-``balanced'' MVPPs and quasi-stationary
17:   distributions of Markovian processes, which allows us to treat, for
18:   the first time in the literature, the non-balanced case. 
19: %  \footnote{\cec changed the order of the two last sentences.}
20: 
21: Finally, we show how our result can be applied to designing stochastic-approximation algorithms for the approximation of quasi-stationary distributions of discrete- and continuous-time Markov processes on non-compact spaces.
22: \end{abstract}
23: