Kolmogorov's equations for jump Markov processes and their applications to control problems
Teoriâ veroâtnostej i ee primeneniâ, Tome 66 (2021) no. 4, pp. 734-759
Voir la notice de l'article provenant de la source Math-Net.Ru
This paper describes the structure of solutions to Kolmogorov's equations for nonhomogeneous jump Markov processes and applications of these results to control of jump stochastic systems. These equations were studied by Feller [Trans. Amer. Math. Soc., 48 (1940), pp. 488–515], who clarified in 1945 in the errata to that paper that some of its results covered only nonexplosive Markov processes. In this work, which is largely of a survey nature,
the case of explosive processes is also considered. This paper is based on the invited talk presented by the authors at the conference “P. L. Chebyshev – 200,” and it describes the results of their joint studies with Manasa Mandava (1984–2019).
Keywords:
Kolmogorov's equations, jump Markov processes, optimal control.
@article{TVP_2021_66_4_a6,
author = {E. A. Feinberg and A. N. Shiryaev},
title = {Kolmogorov's equations for jump {Markov} processes and their applications to control problems},
journal = {Teori\^a vero\^atnostej i ee primeneni\^a},
pages = {734--759},
publisher = {mathdoc},
volume = {66},
number = {4},
year = {2021},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/TVP_2021_66_4_a6/}
}
TY - JOUR AU - E. A. Feinberg AU - A. N. Shiryaev TI - Kolmogorov's equations for jump Markov processes and their applications to control problems JO - Teoriâ veroâtnostej i ee primeneniâ PY - 2021 SP - 734 EP - 759 VL - 66 IS - 4 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/TVP_2021_66_4_a6/ LA - ru ID - TVP_2021_66_4_a6 ER -
%0 Journal Article %A E. A. Feinberg %A A. N. Shiryaev %T Kolmogorov's equations for jump Markov processes and their applications to control problems %J Teoriâ veroâtnostej i ee primeneniâ %D 2021 %P 734-759 %V 66 %N 4 %I mathdoc %U http://geodesic.mathdoc.fr/item/TVP_2021_66_4_a6/ %G ru %F TVP_2021_66_4_a6
E. A. Feinberg; A. N. Shiryaev. Kolmogorov's equations for jump Markov processes and their applications to control problems. Teoriâ veroâtnostej i ee primeneniâ, Tome 66 (2021) no. 4, pp. 734-759. http://geodesic.mathdoc.fr/item/TVP_2021_66_4_a6/