Nonlinearly perturbed

Dmitrii Silvestrov

Teoriâ slučajnyh processov, Tome 14 (2008) no. 4, pp. 129-164.

Résumé

This paper is a survey of results presented in the recent book [25]. This book is devoted to studies of quasi-stationary phenomena in nonlinearly perturbed stochastic systems. New methods of asymptotic analysis for nonlinearly perturbed stochastic processes based on new types of asymptotic expansions for perturbed renewal equation and recurrence algorithms for construction of asymptotic expansions for Markov type processes with absorption are presented. Asymptotic expansions are given in mixed ergodic (for processes) and large deviation theorems (for absorption times) for nonlinearly perturbed regenerative processes, semi-Markov processes, and Markov chains. Applications to analysis of quasi-stationary phenomena in nonlinearly perturbed queueing systems, population dynamics and epidemic models, and risk processes are presented. The book also contains an extended bibliography of works in the area.

Détail

Keywords: Nonlinear perturbation, quasi-stationary phenomenon, pseudo-stationary phenomenon, stochastic system, renewal equation, asymptotic expansion, ergodic theorem, limit theorem, large deviation, regenerative process, regenerative stopping time, semi-Markov process, queueing system, population dynamics, epidemic model, lifetime, risk process, ruin probability, Cramér-Lundberg approximation, diffusion approximation.Nonlinear perturbation, quasi-stationary phenomenon, pseudo-stationary phenomenon, stochastic system, renewal equation, asymptotic expansion, ergodic theorem, limit theorem, large deviation, regenerative process, regenerative stopping time, semi-Markov process, queueing system, population dynamics, epidemic model, lifetime, risk process, ruin probability, Cramér-Lundberg approximation, diffusion approximation.Nonlinearly perturbed stochastic processes.
Mots-clés : Markov chain, absorption time, Markov chain, absorption time

Bibliographie

[1] Abadov, Z. A., Asymptotical Expansions with Explicit Estimation of Constants for Exponential Moments of Sums of Random Variables Defined on a Markov Chain and their Applications to Limit Theorems for First Hitting Times, Candidate of Science dissertation, Kiev State University, 1984

[2] Anisimov, V. V., Switching Processes in Queuing Models, Applied Stochstic Models Series, ISTE and Wiley, London, 2008 | MR

[3] Asmussen, S., Applied Probability and Queues, Wiley Series in Probability and Mathematical Statistics, 51, Wiley, New York, 1987, 2003 | MR

[4] Asmussen, S., Ruin Probabilities, Advanced Series on Statistical Science Applied Probability, 2, World Scientific, Singapore, 2000 | DOI | MR

[5] Athreya, K. B., Ney, P., “A new approach to the limit theory of recurrent Markov chains”, Trans. Amer. Math. Soc., 245 (1978), 493–501 | DOI | MR | Zbl

[6] Bening, V. E., Korolev, V. Yu., Generalized Poisson Models and their Applications in Insurance and Finance, Modern Probability and Statistics, VSP, Utrecht, 2002 | Zbl

[7] Borovkov, A. A., Ergodicity and Stability of Stochastic Processes, Wiley Series in Probability and Statistics: Probability and Statistics, Wiley, New York, 1998 | MR | Zbl

[8] Theory Probab. Math. Statist., 52, 75–79 | MR

[9] Darroch, J., Seneta, E., “On quasi-stationary distributions in absorbing discrete-time finite Markov chains”, J. Appl. Probab., 2 (1965), 88–100 | DOI | MR | Zbl

[10] Select. Translat. Math. Statist. Probab., 1 (1961), 97–134 | MR | Zbl | Zbl

[11] Embrechts, P., Klüppelberg, C., Mikosch, T., Modelling Extremal Events for Insurance and Finance, Applications of Mathematics, 33, Springer, Berlin, 1997 | MR | Zbl

[12] Englund, E., “Perturbed renewal equations with application to $M/M$ queueing systems. 1”, Teor. \u{I}movirn. Mat. Stat., 60 (1999), 31–37 | MR | Zbl

[13] Englund, E., “Perturbed renewal equations with application to $M/M$ queueing systems. 2”, Teor.\u{I}movirn. Mat. Stat., 61 (1999), 21–32 ; Theory Probab. Math. Statist., 61, 21–32 | MR

[14] Englund, E., “Nonlinearly perturbed renewal equations with applications to a random walk”, Proceedings of the Third International School on Applied Statistics, Financial and Actuarial Mathematics (Feodosiya, 2000), Theory Stoch. Process., 6(22), no. 3-4, eds. Silvestrov, D., Yadrenko, M., Olenko A., Zinchenko, N., 2000, 33–60 | Zbl

[15] Englund, E., Nonlinearly Perturbed Renewal Equations with Applications, Ph.D. Dissertation, Umeå University, 2001

[16] Englund, E., Silvestrov, D. S., “Mixed large deviation and ergodic theorems for regenerative processes with discrete time”, Proceedings of the Second Scandinavian–Ukrainian Conference in Mathematical Statistics, Vol. I (Umeå, 1997), Theory Stoch. Process., 3(19), no. 1–2, eds. Jagers P., Kulldorff G., Portenko N., Silvestrov D., 1997, 164–176 | Zbl

[17] Feller, W., An Introduction to Probability Theory and Its Applications, v. I, II, Willey, New York, 1966 | MR | Zbl

[18] Gikhman, I. I., Skorokhod, A. V., Theory of Random Processes, Probability Theory and Mathematical Statistics, 3, Nauka, Moscow, 1975 | MR

[19] Gyllenberg, M., Silvestrov, D. S., “Quasi-stationary distributions of a stochastic metapopulation model”, J. Math. Biol., 33 (1994), 35–70 | DOI | MR | Zbl

[20] Gyllenberg, M., Silvestrov, D. S., “Quasi-stationary phenomena in semi-Markov models”, Proceedings of the Second International Symposium on Semi-Markov Models: Theory and Applications (Compiègne, 1998), eds. Janssen J., Limnios N., 1998, 87–93 | MR

[21] Gyllenberg, M., Silvestrov, D. S., “Quasi-stationary phenomena for semi-Markov processes”, Semi-Markov Models and Applications, eds. Janssen, J., Limnios, N., Kluwer, Dordrecht, 1999, 33–60 | DOI | MR | Zbl

[22] Gyllenberg, M., Silvestrov, D. S., “Cramér-Lundberg and diffusion approximations for nonlinearly perturbed risk processes”, Proceedings of the Second International School on Actuarial and Financial Mathematics (Kiev, 1999), Theory Stoch. Process., 5(21), no. 1-2, eds. Silvestrov, D., Yadrenko, M., Borisenko, O., Zinchenko, N., 1999b, 6–21 | MR | Zbl

[23] Gyllenberg, M., Silvestrov, D. S., “Nonlinearly perturbed regenerative processes and pseudo-stationary phenomena for stochastic systems”, Stoch. Process. Appl., 86 (2000), 1–27 | DOI | MR | Zbl

[24] Gyllenberg, M., Silvestrov, D. S., “Cramér–Lundberg approximation for nonlinearly perturbed risk processes”, Insur. Math. Econom., 26:1 (2000), 75–90 | DOI | MR | Zbl

[25] Gyllenberg, M., Silvestrov, D. S., Quasi-Stationary Phenomena in Nonlinearly Perturbed Stochastic Systems, De Gruyter Expositionsin Mathematics, 44, Walter de Gruyter, Berlin, 2008 | DOI | MR

[26] Hanen, A., “Théorèmes limites pour une suite de chaînes de Markov”, Ann. Inst. H. Poincaré, 18 (1963), 197–301 | MR | Zbl

[27] Ho, Y. C., Cao, X. R., Perturbation Analysis of Discrete Event Dynamic Systems, Internat. Ser. Engineering and Computer Science, Kluwer, Boston, 1991

[28] Kalashnikov, V. V., Mathematical Methods in Queuing Theory, Mathematics and its Applications, 271, Kluwer, Dordrecht, 1994 | MR | Zbl

[29] Kalashnikov, V. V., Geometric Sums: Bounds for Rare Events with Applications, Mathematics and its Applications, 413, Kluwer, Dordrecht, 1997 | MR | Zbl

[30] Kalashnikov, V. V., Rachev, S. T., Mathematical Methods for Construction of Queueing Models, Nauka, Moscow, 1988 ; The Wadsworth Brooks/Cole Operations Research Series, English edition, Wadsworth Brooks/ Cole | MR | Zbl

[31] Kartashov, M. V., Strong Stable Markov Chains, VSP, Utrechtand, 1996 | MR | Zbl

[32] Kijima, M., Markov Processes for Stochastic Modelling, Stochastic Modeling Series, Chapman Hall, London, 1997 | MR

[33] Kingman, J. F., “The exponential decay of Markovian transition probabilities”, Proc. London Math. Soc., 13:3 (1963), 337–358 | DOI | MR | Zbl

[34] Ukr. Math. J., 21, 705–710 | DOI | MR | Zbl

[35] Korolyuk, V. S., Korolyuk, V. V., Stochastic Models of Systems, Mathematics and its Applications, 469, Kluwer, Dordrecht, 1999 | MR | Zbl

[36] Koroliuk, V. S., Limnios, N., Stochastic Systems in Merging Phase Space, World Scientific, Singapore, 2005 | MR | Zbl

[37] Korolyuk, V. S., Penev, I. P., Turbin, A. F., “The asymptotic behavior of the distribution of the absorption time of a Markov chain”, Kibernetika, 1972, no. 2, 20–22 | MR | Zbl

[38] Korolyuk, V. S., Penev, I. P., Turbin, A. F., “Asymptotic expansion for the distribution of the absorption time of a weakly inhomogeneous Markov chain”, Analytic Methods of Investigation in Probability Theory, ed. Korolyuk, V.S., Akad. Nauk Ukr. SSR, Inst. Mat., Kiev, 1981, 97–105 | MR

[39] Korolyuk, V. S., Turbin, A. F., Semi-Markov Processes and Its Applications, Naukova Dumka, Kiev, 1976 | MR

[40] Korolyuk, V. S., Turbin, A. F., Mathematical Foundations of the State Lumping of Large Systems, Mathematics and its Applications, 264, English edition, Naukova Dumka, Kiev, 1978 | MR

[41] Cybernetics, 13, 902–914 | DOI | MR | Zbl

[42] Kovalenko, I. N., “Rare events in queuing theory – a survey”, Queuing Systems Theory Appl., 16:1-2 (1994), 1–49 | MR | Zbl

[43] Kovalenko, I. N., Kuznetsov, N. Yu., Pegg, P. A., Mathematical Theory of Reliability of Time Dependent Systems with Practical Applications, Wiley Series in Probability and Statistics, Wiley, New York, 1997 | MR | Zbl

[44] Latouche, G., Ramaswami, V., Introduction to Matrix Analytic Methods in Stochastic Modeling, ASA-SIAM Series on Statistics and Applied Probability, Society for Industrial and Applied Mathematics (SIAM), American Statistical Association, Philadelphia, PA, Alexandria, VA, 1999 | MR | Zbl

[45] Limnios, N., Oprişan, G., Semi-Markov Processes and Reliability, Statistics for Industry and Technology, Birkhäuser, Boston, 2001 | MR | Zbl

[46] Meyn, S. P., Tweedie, R. L., Markov Chains and Stochastic Stability, Communications and Control Engineering Series, Springer, London, 1993 | MR | Zbl

[47] Ni, Y., Silvetrov, D., Malyarenko, A., “Exponential asymptotics for nonlinearly perturbed renewal equation with non-polynomial perturbations”, Proceedings of the International School “Finance, Insurance, and Energy Markets – Sustainable Development” (Västerås, 2008), J. Numer. Appl. Math., 1(96), eds. Silvestrov, D., Dahlquist, E., Borosenko, O., Malyarenko, A., 2008, 173–197

[48] Nummelin, E., “A splitting techniques for certain Markov chains and its applications”, Z. Wahrsch. Verw. Gebiete, 43 (1978), 309–318 | DOI | MR | Zbl

[49] Theory Probab. Math. Statist., 8, 121–126 | MR | Zbl

[50] Rolski, T., Schmidli, H., Schmidt, V., Teugels, J., Stochastic Processes for Insurance and Finance, Wiley Series in Probability and Statistics, Wiley, New York, 1999 | DOI | MR | Zbl

[51] Seneta, E., Non-negative Matrices and Markov Chains, Springer Series in Statistics, Springer, New-York, 1981, 2006 | DOI | MR | Zbl

[52] Math. USSR–Sbornik, 40:1, 107–123 | DOI | MR | Zbl

[53] Math. USSR–Sbornik, 40:2, 211–225 | DOI | MR | Zbl

[54] Shurenkov, V. M., “Transient phenomena of renewal theory in asymptotic problems of the theory of random processes”, Probabilistic Methods of Infinite-Dimensional Analysis, Akad. Nauk Ukr. SSR, Inst. Mat., Kiev, 1980, 133–168 | MR

[55] Shurenkov, V. M., Degtyar, S. V., “Markov renewal theorems in a scheme of arrays”, Asymptotic Analysis of Random Evolutions, Akad. Nauk Ukr., Inst. Mat., Kiev, 1994, 270–305 | MR

[56] Silvestrov, D. S., “A generalization of the renewal theorem”, Dokl. Akad. Nauk. Ukr. SSR, Ser. A, 1976, no. 11, 978–982 | MR

[57] Theory Probab. Math. Statist., 18, 155–172 | MR

[58] Theory Probab. Math. Statist., 20, 113–130 | MR

[59] Silvestrov, D. S., Semi-Markov Processes with a Discrete State Space, Library for an Engineer in Reliability, Sovetskoe Radio, Moscow, 1980 | MR

[60] Theory Probab. Math. Statist., 52, 153–162 | MR | Zbl

[61] Theory Probab. Math. Statist., 62, 145–156 | MR | Zbl

[62] Silvestrov, D. S., “Nonlinearly perturbed Markov chains and large deviations for lifetime functionals”, Recent Advances in Reliability Theory: Methodology, Practice and Inference, eds. Limnios, N., Nikulin, M., Birkhäuser, Boston, 2000b, 135–144 | DOI | MR | Zbl

[63] Silvestrov, D. S., Limit Theorems for Randomly Stopped Stochastic Processes, Probability and Its Applications, Springer, London, 2004 | DOI | MR | Zbl

[64] Silvestrov, D. S., “Asymptotic expansions for quasi-stationary distributions of nonlinearly perturbed semi-Markov processes”, Proceedings of the International Conference “Modern Stochastics: Theory and Applications” (Kyiv, 2006), Theory Stoch. Process., 13(29), no. 1-2, eds. Mishura,Yu., Sakhno, L., 2007a, 267–271 | MR | Zbl

[65] Silvestrov, D. S., “Asymptotic expansions for distributions of the surplus prior and at the time of ruin”, Proceedings of the International Summer School “Insurance and Finance: Science, Practice, and Education” (Foros, 2007), Theory Stoch. Process., 13(29), no. 4, eds. Silvestrov, D., Borisenko, O., 2007b, 183–188 | MR | Zbl

[66] Silvestrov, D. S., Abadov, Z. A., “Asymptotic behaviour for exponential moments of sums of random variables defined on exponentially ergodic Markov chains”, Dokl. Acad. Nauk Ukr. SSR, Ser. A, 1984, no. 4, 23–25 | MR | Zbl

[67] | MR | Zbl

[68] Theory Probab. Math. Statist., 48, 125–130 | MR | Zbl

[69] Simon, H. A., Ando, A., “Aggregation of variables in dynamic systems”, Econometrica, 29 (1961), 111–138 | DOI | Zbl

[70] Solov’ev, A. D., “Analytical methods for computing and estimating reliability”, Problems of Mathematical Theory of Reliability, ed. Gnedenko, B.V., Radio i Svyaz’, Moscow, 1983, 9–112 | MR

[71] Stewart, G. W., Matrix algorithms, v. I, Basic Decompositions, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1998 | MR | Zbl

[72] Stewart, G. W., Matrix Algorithms, v. II, Eigensystems, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2001 | MR | Zbl

[73] Stewart, G. W., Sun, Ji Guang, Matrix Perturbation Theory, Computer Science and Scientific Computing, Academic Press, Boston, 1990 | MR | Zbl

[74] Vere-Jones, D., “Geometric ergodicity in denumerable Markov chains”, Quart. J. Math., 13 (1962), 7–28 | DOI | MR | Zbl

[75] Wentzell, A. D., Freidlin, M. I., Fluctuations in Dynamical Systems Subject to Small Random Perturbations, Probability Theory and Mathematical Statistics, 260, Nauka, Moscow, 1979 | MR

[76] Whitt, W., Stochastic-Process Limits. An Introduction to Stochastic Process Limits and their Application to Queues, Springer Series in Operations Research, Springer, New York, 2002 | MR | Zbl

[77] Yin, G. G., Zhang, Q., Continuous-time Markov Chains and Applications. A Singular Perturbation Approach, Applications of Mathematics, 37, Springer, New York, 1998 | MR | Zbl