Geodesic
Discrete-time Markov control processes with recursive discount rates
Kybernetika, Tome 52 (2016) no. 3, pp. 403-426 Cet article a éte moissonné depuis la source Czech Digital Mathematics Library

Voir la notice de l'article

This work analyzes a discrete-time Markov Control Model (MCM) on Borel spaces when the performance index is the expected total discounted cost. This criterion admits unbounded costs. It is assumed that the discount rate in any period is obtained by using recursive functions and a known initial discount rate. The classic dynamic programming method for finite-horizon case is verified. Under slight conditions, the existence of deterministic non-stationary optimal policies for infinite-horizon case is proven. Also, to find deterministic non-stationary $\epsilon-$optimal policies, the value-iteration method is used. To illustrate an example of recursive functions that generate discount rates, we consider the expected values of stochastic processes, which are solutions of certain class of Stochastic Differential Equations (SDE) between consecutive periods, when the initial condition is the previous discount rate. Finally, the consumption-investment problem and the discount linear-quadratic problem are presented as examples; in both cases, the discount rates are obtained using a SDE, similar to the Vasicek short-rate model.
This work analyzes a discrete-time Markov Control Model (MCM) on Borel spaces when the performance index is the expected total discounted cost. This criterion admits unbounded costs. It is assumed that the discount rate in any period is obtained by using recursive functions and a known initial discount rate. The classic dynamic programming method for finite-horizon case is verified. Under slight conditions, the existence of deterministic non-stationary optimal policies for infinite-horizon case is proven. Also, to find deterministic non-stationary $\epsilon-$optimal policies, the value-iteration method is used. To illustrate an example of recursive functions that generate discount rates, we consider the expected values of stochastic processes, which are solutions of certain class of Stochastic Differential Equations (SDE) between consecutive periods, when the initial condition is the previous discount rate. Finally, the consumption-investment problem and the discount linear-quadratic problem are presented as examples; in both cases, the discount rates are obtained using a SDE, similar to the Vasicek short-rate model.
DOI : 10.14736/kyb-2016-3-0403
Classification : 49L20, 93E20
Keywords: dynamic programming method; optimal stochastic control 
@article{10_14736_kyb_2016_3_0403,
     author = {Garc{\'\i}a, Yofre H. and Gonz\'alez-Hern\'andez, Juan},
     title = {Discrete-time {Markov} control processes with recursive discount rates},
     journal = {Kybernetika},
     pages = {403--426},
     year = {2016},
     volume = {52},
     number = {3},
     doi = {10.14736/kyb-2016-3-0403},
     mrnumber = {3532514},
     zbl = {1357.49110},
     language = {en},
     url = {http://geodesic.mathdoc.fr/articles/10.14736/kyb-2016-3-0403/}
}
TY  - JOUR
AU  - García, Yofre H.
AU  - González-Hernández, Juan
TI  - Discrete-time Markov control processes with recursive discount rates
JO  - Kybernetika
PY  - 2016
SP  - 403
EP  - 426
VL  - 52
IS  - 3
UR  - http://geodesic.mathdoc.fr/articles/10.14736/kyb-2016-3-0403/
DO  - 10.14736/kyb-2016-3-0403
LA  - en
ID  - 10_14736_kyb_2016_3_0403
ER  - 
%0 Journal Article
%A García, Yofre H.
%A González-Hernández, Juan
%T Discrete-time Markov control processes with recursive discount rates
%J Kybernetika
%D 2016
%P 403-426
%V 52
%N 3
%U http://geodesic.mathdoc.fr/articles/10.14736/kyb-2016-3-0403/
%R 10.14736/kyb-2016-3-0403
%G en
%F 10_14736_kyb_2016_3_0403
García, Yofre H.; González-Hernández, Juan. Discrete-time Markov control processes with recursive discount rates. Kybernetika, Tome 52 (2016) no. 3, pp. 403-426. doi: 10.14736/kyb-2016-3-0403

Cité par Sources :