Geodesic
Estimates for perturbations of general discounted Markov control chains
Raúl Montes-de-Oca1 ; Alexander Sakhanenko2 ; Francisco Salem-Silva3
1 Departamento de Matemáticas Universidad Autónoma Metropolitana–Iztapalapa Av. San Rafael Atlixco 186, Col. Vicentina México, D.F. 09340, Mexico
2 Facultad de Ciencias Físico Matemáticas Benemérita Universidad Autónoma de Puebla Av. San Claudio y Río Verde Col. San Manuel, Ciudad Universitaria Puebla, Pue. 72570, Mexico
3 Facultad de Ciencias Físico Matemáticas Benemérita Universidad Autónoma de Puebla Av. San Claudio y Río Verde, Col. San Manuel, Ciudad Universitaria Puebla Pue. 72570, Mexico
Applicationes Mathematicae, Tome 30 (2003) no. 3, pp. 287-304 Cet article a éte moissonné depuis la source Institute of Mathematics Polish Academy of Sciences

Voir la notice de l'article

We extend previous results of the same authors ([11]) on the effects of perturbation in the transition probability of a Markov cost chain for discounted Markov control processes. Supposing valid, for each stationary policy, conditions of Lyapunov and Harris type, we get upper bounds for the index of perturbations, defined as the difference of the total expected discounted costs for the original Markov control process and the perturbed one. We present examples that satisfy our conditions.
DOI : 10.4064/am30-3-4
Keywords: extend previous results authors effects perturbation transition probability markov cost chain discounted markov control processes supposing valid each stationary policy conditions lyapunov harris type get upper bounds index perturbations defined difference total expected discounted costs original markov control process perturbed present examples satisfy conditions

Raúl Montes-de-Oca 1 ; Alexander Sakhanenko 2 ; Francisco Salem-Silva 3

1 Departamento de Matemáticas Universidad Autónoma Metropolitana–Iztapalapa Av. San Rafael Atlixco 186, Col. Vicentina México, D.F. 09340, Mexico
2 Facultad de Ciencias Físico Matemáticas Benemérita Universidad Autónoma de Puebla Av. San Claudio y Río Verde Col. San Manuel, Ciudad Universitaria Puebla, Pue. 72570, Mexico
3 Facultad de Ciencias Físico Matemáticas Benemérita Universidad Autónoma de Puebla Av. San Claudio y Río Verde, Col. San Manuel, Ciudad Universitaria Puebla Pue. 72570, Mexico 
@article{10_4064_am30_3_4,
     author = {Ra\'ul Montes-de-Oca and Alexander Sakhanenko and Francisco Salem-Silva},
     title = {Estimates for perturbations
 of general discounted {Markov
} control chains},
     journal = {Applicationes Mathematicae},
     pages = {287--304},
     year = {2003},
     volume = {30},
     number = {3},
     doi = {10.4064/am30-3-4},
     language = {en},
     url = {http://geodesic.mathdoc.fr/articles/10.4064/am30-3-4/}
}
TY  - JOUR
AU  - Raúl Montes-de-Oca
AU  - Alexander Sakhanenko
AU  - Francisco Salem-Silva
TI  - Estimates for perturbations
 of general discounted Markov
 control chains
JO  - Applicationes Mathematicae
PY  - 2003
SP  - 287
EP  - 304
VL  - 30
IS  - 3
UR  - http://geodesic.mathdoc.fr/articles/10.4064/am30-3-4/
DO  - 10.4064/am30-3-4
LA  - en
ID  - 10_4064_am30_3_4
ER  - 
%0 Journal Article
%A Raúl Montes-de-Oca
%A Alexander Sakhanenko
%A Francisco Salem-Silva
%T Estimates for perturbations
 of general discounted Markov
 control chains
%J Applicationes Mathematicae
%D 2003
%P 287-304
%V 30
%N 3
%U http://geodesic.mathdoc.fr/articles/10.4064/am30-3-4/
%R 10.4064/am30-3-4
%G en
%F 10_4064_am30_3_4
Raúl Montes-de-Oca; Alexander Sakhanenko; Francisco Salem-Silva. Estimates for perturbations
 of general discounted Markov
 control chains. Applicationes Mathematicae, Tome 30 (2003) no. 3, pp. 287-304. doi: 10.4064/am30-3-4

Cité par Sources :