Geodesic
Growth rates and average optimality in risk-sensitive Markov decision chains
Kybernetika, Tome 44 (2008) no. 2, pp. 205-226.

Voir la notice de l'article provenant de la source Czech Digital Mathematics Library

In this note we focus attention on characterizations of policies maximizing growth rate of expected utility, along with average of the associated certainty equivalent, in risk-sensitive Markov decision chains with finite state and action spaces. In contrast to the existing literature the problem is handled by methods of stochastic dynamic programming on condition that the transition probabilities are replaced by general nonnegative matrices. Using the block-triangular decomposition of a collection of nonnegative matrices we establish necessary and sufficient conditions guaranteeing independence of optimal values on starting state along with partition of the state space into subsets with constant optimal values. Finally, for models with growth rate independent of the starting state we show how the methods work if we minimize growth rate or average of the certainty equivalent.
Classification : 60J10, 90C39, 90C40, 93E20
Keywords: risk-sensitive Markov decision chains; average optimal policies; optimal growth rates 
@article{KYB_2008__44_2_a5,
     author = {Sladk\'y, Karel},
     title = {Growth rates and average optimality in risk-sensitive {Markov} decision chains},
     journal = {Kybernetika},
     pages = {205--226},
     publisher = {mathdoc},
     volume = {44},
     number = {2},
     year = {2008},
     mrnumber = {2428220},
     zbl = {1154.90612},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/KYB_2008__44_2_a5/}
}
TY  - JOUR
AU  - Sladký, Karel
TI  - Growth rates and average optimality in risk-sensitive Markov decision chains
JO  - Kybernetika
PY  - 2008
SP  - 205
EP  - 226
VL  - 44
IS  - 2
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/KYB_2008__44_2_a5/
LA  - en
ID  - KYB_2008__44_2_a5
ER  - 
%0 Journal Article
%A Sladký, Karel
%T Growth rates and average optimality in risk-sensitive Markov decision chains
%J Kybernetika
%D 2008
%P 205-226
%V 44
%N 2
%I mathdoc
%U http://geodesic.mathdoc.fr/item/KYB_2008__44_2_a5/
%G en
%F KYB_2008__44_2_a5
Sladký, Karel. Growth rates and average optimality in risk-sensitive Markov decision chains. Kybernetika, Tome 44 (2008) no. 2, pp. 205-226. http://geodesic.mathdoc.fr/item/KYB_2008__44_2_a5/