Geodesic
Discounted Markov control processes induced by deterministic systems
Kybernetika, Tome 42 (2006) no. 6, pp. 647-664.

Voir la notice de l'article provenant de la source Czech Digital Mathematics Library

This paper deals with Markov Control Processes (MCPs) on Euclidean spaces with an infinite horizon and a discounted total cost. Firstly, MCPs which result from the deterministic controlled systems will be analyzed. For such MCPs, conditions that permit to establish the equation known in the literature of Economy as Euler’s Equation (EE) will be given. There will be also presented an example of a Markov Control Process with deterministic controlled system where, to obtain the optimal value function, EE applied to the value iteration algorithm will be used. Secondly, the MCPs which result from the perturbation of deterministic controlled systems with a random noise will be dealt with. There will be also provided the conditions which allow to obtain the optimal value function and the optimal policy of a perturbed controlled system, in terms of the optimal value function and the optimal policy of deterministic controlled system corresponding. Finally, several examples to illustrate the last case mentioned will be presented.
Classification : 90C40, 93E20
Keywords: discounted Markov control process; deterministic control system; Euler equation; deterministic control system perturbed by a random noise 
@article{KYB_2006__42_6_a1,
     author = {Cruz-Su\'arez, Hugo and Montes-de-Oca, Ra\'ul},
     title = {Discounted {Markov} control processes induced by deterministic systems},
     journal = {Kybernetika},
     pages = {647--664},
     publisher = {mathdoc},
     volume = {42},
     number = {6},
     year = {2006},
     mrnumber = {2296506},
     zbl = {1249.90312},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/KYB_2006__42_6_a1/}
}
TY  - JOUR
AU  - Cruz-Suárez, Hugo
AU  - Montes-de-Oca, Raúl
TI  - Discounted Markov control processes induced by deterministic systems
JO  - Kybernetika
PY  - 2006
SP  - 647
EP  - 664
VL  - 42
IS  - 6
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/KYB_2006__42_6_a1/
LA  - en
ID  - KYB_2006__42_6_a1
ER  - 
%0 Journal Article
%A Cruz-Suárez, Hugo
%A Montes-de-Oca, Raúl
%T Discounted Markov control processes induced by deterministic systems
%J Kybernetika
%D 2006
%P 647-664
%V 42
%N 6
%I mathdoc
%U http://geodesic.mathdoc.fr/item/KYB_2006__42_6_a1/
%G en
%F KYB_2006__42_6_a1
Cruz-Suárez, Hugo; Montes-de-Oca, Raúl. Discounted Markov control processes induced by deterministic systems. Kybernetika, Tome 42 (2006) no. 6, pp. 647-664. http://geodesic.mathdoc.fr/item/KYB_2006__42_6_a1/