1: \begin{abstract}
2: Our main result is to prove almost-sure convergence of a stochastic-approximation
3: algorithm defined on the space of measures on a non-compact
4: space. Our motivation is to apply this result to measure-valued P\'olya processes (MVPPs, also known as infinitely-many P\'olya urns). Our main idea is to use Foster-Lyapunov type criteria in a
5: novel way to generalize stochastic-approximation methods to
6: measure-valued Markov processes with a non-compact
7: underlying space, overcoming in a fairly
8: general context one of the major difficulties of existing studies
9: on this subject.
10:
11: From the MVPPs point of view, our result implies almost-sure convergence of a large
12: class of MVPPs; this convergence was only obtained until now for specific examples, with only convergence in probability established for general classes.
13: Furthermore, our approach allows us to extend the definition of MVPPs by
14: adding ``weights'' to the different colors of the
15: infinitely-many-color urn.
16: We also exhibit a link between non-``balanced'' MVPPs and quasi-stationary
17: distributions of Markovian processes, which allows us to treat, for
18: the first time in the literature, the non-balanced case.
19: % \footnote{\cec changed the order of the two last sentences.}
20:
21: Finally, we show how our result can be applied to designing stochastic-approximation algorithms for the approximation of quasi-stationary distributions of discrete- and continuous-time Markov processes on non-compact spaces.
22: \end{abstract}
23: