Geodesic
Algorithms for determining the state-time probabilities and the limit matrix in Markov chains
Buletinul Academiei de Ştiinţe a Republicii Moldova. Matematica, no. 1 (2011), pp. 66-82

Voir la notice de l'article provenant de la source Math-Net.Ru

New calculation procedures for finding the probabilities of state transitions of the system in Markov chains based on dynamic programming are developed and polynomial time algorithms for determining the limit state matrix in such processes are proposed. Computational complexity aspects and possible applications of the proposed algorithms for the stochastic optimization problems are characterized. 
@article{BASM_2011_1_a6,
     author = {Dmitrii Lozovanu and Stefan Pickl},
     title = {Algorithms for determining the state-time probabilities and the limit matrix in {Markov} chains},
     journal = {Buletinul Academiei de \c{S}tiin\c{t}e a Republicii Moldova. Matematica},
     pages = {66--82},
     publisher = {mathdoc},
     number = {1},
     year = {2011},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/BASM_2011_1_a6/}
}
TY  - JOUR
AU  - Dmitrii Lozovanu
AU  - Stefan Pickl
TI  - Algorithms for determining the state-time probabilities and the limit matrix in Markov chains
JO  - Buletinul Academiei de Ştiinţe a Republicii Moldova. Matematica
PY  - 2011
SP  - 66
EP  - 82
IS  - 1
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/BASM_2011_1_a6/
LA  - en
ID  - BASM_2011_1_a6
ER  - 
%0 Journal Article
%A Dmitrii Lozovanu
%A Stefan Pickl
%T Algorithms for determining the state-time probabilities and the limit matrix in Markov chains
%J Buletinul Academiei de Ştiinţe a Republicii Moldova. Matematica
%D 2011
%P 66-82
%N 1
%I mathdoc
%U http://geodesic.mathdoc.fr/item/BASM_2011_1_a6/
%G en
%F BASM_2011_1_a6
Dmitrii Lozovanu; Stefan Pickl. Algorithms for determining the state-time probabilities and the limit matrix in Markov chains. Buletinul Academiei de Ştiinţe a Republicii Moldova. Matematica, no. 1 (2011), pp. 66-82. http://geodesic.mathdoc.fr/item/BASM_2011_1_a6/