Stochastic approximation of quasi-stationary distributions on compact spaces and applications - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Accéder directement au contenu
Article Dans Une Revue The Annals of Applied Probability Année : 2018

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Résumé

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set and to the estimation of the spectral gap of irreducible Markov processes. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.
Fichier principal
Vignette du fichier
BCP_QSD_AAP_revision.pdf (903.05 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01334603 , version 1 (21-06-2016)
hal-01334603 , version 2 (05-12-2016)
hal-01334603 , version 3 (06-11-2017)

Identifiants

Citer

Michel Benaim, Bertrand Cloez, Fabien Panloup. Stochastic approximation of quasi-stationary distributions on compact spaces and applications. The Annals of Applied Probability, 2018, 28 (4), pp.2370-2416. ⟨10.1214/17-AAP1360⟩. ⟨hal-01334603v3⟩
369 Consultations
217 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More