Stochastic differential equations with random delays in the form of discrete Markov chains

I. E. Poloskov

Vestnik Udmurtskogo universiteta. Matematika, mehanika, kompʹûternye nauki, Tome 25 (2015) no. 4, pp. 501-516

Résumé

The paper provides an overview of the problems that lead to a necessity for analyzing models of linear and nonlinear dynamic systems in the form of stochastic differential equations with random delays of various types as well as some well-known methods for solving these problems. In addition, the author proposes some new approaches to the approximate analysis of linear and nonlinear stochastic dynamic systems. Changes of delays in these systems are governed by discrete Markov chains with continuous time. The proposed techniques for the analysis of systems are based on a combination of the classical steps method, an extension of the state space of a stochastic system under examination, and the method of statistical modeling (Monte Carlo). In this case the techniques allow to simplify the task and to transfer the source equations to systems of stochastic differential equations without delay. Moreover, for the case of linear systems the author has obtained a closed sequence of systems with increasing dimensions of ordinary differential equations satisfied by the functions of conditional expectations and covariances for the state vector. The above scheme is demonstrated by the example of a second-order stochastic system. Changes of the delay in this system are controlled by the Markov chain with five states. All calculations and graphics were performed in the environment of the mathematical package Mathematica by means of a program written in the source language of the package.

Détail

Keywords: stochastic dynamic system, random delay, modeling, state vector
Mots-clés : transition process.

Bibliographie

[1] Azbelev N. V., Maksimov V. P., Rakhmatullina L. F., Introduction to the theory of functional differential equations: Methods and applications, Hindawi Publishing Corporation, New York, 2007, 318 pp. | MR | Zbl

[2] El'sgol'ts L. E., Norkin S. B., Introduction to the theory and application of differential equations with deviating arguments, Academic Press, New York, 1973, XVI+357 pp. | MR | MR

[3] Hale J. K., Lunel S. M. V., Introduction to functional differential equations, Springer, New York, 1993, X+450 pp. | MR | Zbl

[4] Smith H., An introduction to delay differential equations with sciences applications to the life, Springer, New York, 2011, XI+172 pp. | MR | Zbl

[5] Tsar'kov E. F., Random perturbations of differential-functional equations, Zinatne, Riga, 1989, 421 pp. | MR

[6] Kushner H. J., Numerical methods for controlled stochastic delay systems, Birkhäuser, Boston, 2008, XX+282 pp. | MR | Zbl

[7] Mohammed S. E. A., Stochastic functional differential equations, Pitman Publishing, Boston–London, 1984, IX+245 pp. | MR | Zbl

[8] Gardiner C. W., Handbook of stochastic methods for physics, chemistry and the natural sciences, Springer-Verlag, Berlin, 1985, 442 pp. | MR | MR

[9] Pugachev V. S., Sinitsyn I. N., Stochastic differential systems: analysis and filtration, Nauka, Moscow, 1990, 630 pp. | MR

[10] Malanin V. V., Poloskov I. E., Random processes in nonlinear dynamic systems. Analytical and numerical methods of analysis, Regular and Chaotic Dynamics, Izhevsk, 2001, 160 pp.

[11] Klyatskin V. I., Dynamics of stochastic systems, Lecture course, Fizmatgiz, Moscow, 2003, 240 pp.

[12] Mao X., Stochastic differential equations and applications, Woodhead Publishing, Oxford, 2010, XVIII+422 pp. | MR

[13] Bellen A., Zennaro M., Numerical methods for delay differential equations, Oxford University Press, Oxford, 2003, XIV+395 pp. | MR | Zbl

[14] Shampine L. F., Gladwell I., Thompson S., Solving ODEs with Matlab, Cambridge University Press, Cambridge, 2003, 272 pp. | MR | Zbl

[15] Kloeden P. E., Platen E., Numerical solution of stochastic differential equations, Springer-Verlag, Berlin, 1995, XXXV+632 pp. | MR

[16] Milstein G. N., Tretyakov M. V., Stochastic numerics for mathematical physics, Springer-Verlag, Berlin–Heidelberg, 2004, XIX+594 pp. | MR | Zbl

[17] Solodov A. V., Solodova E. A., Systems with variable delay, Nauka, Moscow, 1980, 384 pp. | MR

[18] Skanavi G. I., Physics of dielectrics (stronger fields), GIFML, Moscow, 1958, 907 pp.

[19] Sysoev Yu. A., Plankovskii S. I., Loyan A. V., Koshelev N. N., “Excitation in a high arc plasma generator”, Aviatsionno-Kosmicheskaya Tekhnika i Tekhnologiya, 2006, no. 10, 61–66 (in Russian) http://nbuv.gov.ua/j-pdf/aktit_2006_10_16.pdf

[20] Prochazka I., Kral L., Blazej J., “Picosecond laser pulse distortion by propagation through a turbulent atmosphere”, Coherence and Ultrashort Pulse Laser Emission, ed. F. J. Duarte, InTech, Rijeka, Croatia, 2010, 445–448

[21] Forde J. E., Delay differential equation models in mathematical biology, PhD thesis, University of Michigan, 2005, 94 pp. | MR

[22] Crauel H., Son D. T., Siegmund S., “Difference equations with random delay”, Journal of Difference Equations and Applications, 15:7 (2009), 627–647 | DOI | MR | Zbl

[23] Lara-Sagah́on A. V., Kharchenko V., José M. V., “Stability analysis of a delay-difference SIS epidemiological model”, Applied Mathematical Sciences, 1:26 (2007), 1277–1298 | MR | Zbl

[24] Cooke K. L., Kuang Y., Li B., “Analysis of an antiviral immune response model with time delays”, Canadian Appl. Math. Quart., 6 (1998), 321–354 | MR | Zbl

[25] Poddubnyi V. V., Romanovich O. V., “Dynamic market model of Walras type with random delays in the supply of goods”, Modern branches of theoretical and applied sciences, Transactions on materials of the international scientific-practical conference, v. 21, Physics and Mathematics, Geography, Geology, Chernomor'e, Odessa, 2007, 20–26 (in Russian)

[26] Chang H.-J., Dye C.-Y., “An inventory model with stock-dependent demand under conditions of permissible delay in payments”, Journal of Statistics and Management Systems, 2:2/3 (1999), 117–126 | DOI | Zbl

[27] Shepp L., “A model for stock price fluctuations based on information”, IEEE Trans. on Information Theory, 48:6 (2002), 1372–1378 | DOI | MR | Zbl

[28] Huang D., Nguang S. K., Robust control for uncertain networked control systems with random delays, Springer, London, 2009, XII+168 pp. | MR

[29] Ge Y., Chen Q., Jiang M., Huang Y., “Modeling of random delays in networked control systems”, Journal of Control Science and Engineering, 2013 (2013), Article ID 383415, 9 pp. http://downloads.hindawi.com/journals/jcse/2013/383415.pdf | MR

[30] Lidskii E. A., “On the stability of system motions with random delays”, Differ. Uravn., 1:1 (1965), 96–101 (in Russian) | MR

[31] Kats I. Ya., “The stability on the first approximation of systems with random delay”, Prikl. Mat. Mekh., 31:3 (1967), 447–452 (in Russian) | MR

[32] Kolomiets V. G., Korenevskii D. G., “Excitation of oscillations in nonlinear systems with random delay”, Ukr. Mat. Zh., 18:3 (1966), 51–57 (in Russian) | MR | Zbl

[33] Korenevskii D. G., Kolomiets V. G., “Some questions in the theory of nonlinear oscillations of quasi-linear systems with random delay”, Matematicheskaya Fizika, 3, Kiev, 1967, 91–113 (in Russian)

[34] Novakovskaya L. I., “Construction of asymptotic solutions for the first order differential equations with random delay”, Ukr. Mat. Zh., 41:11 (1989), 1569–1563 (in Russian) | MR

[35] Krapivsky P. L., Luck J. M., Mallick K., On stochastic differential equations with random delay, 2011, arXiv: 1108.1298[cond-mat.stat-mech]

[36] Caraballo T., Kloeden P. E., Real J., “Discretization of asymptotically stable stationary solutions of delay differential equations with a random stationary delay”, Journal of Dynamics and Differential Equations, 18:4 (2006), 863–880 | DOI | MR | Zbl

[37] Zhang H., Feng G., Han C., “Linear estimation for random delay systems”, Systems Control Letters, 60:7 (2011), 450–459 | DOI | MR | Zbl

[38] Gao Sh.-L., “Generalized stochastic resonance in a linear fractional system with a random delay”, Journal of Statistical Mechanics: Theory and Experiment, 2012:12 (2012), P12011 | DOI | MR

[39] Mier-y-Teran-Romero L., Lindley B., Schwartz I. B., “Statistical multi-moment bifurcations in random-delay coupled swarms”, Phys. Rev. E, 86:5 (2012), 056202, 4 pp. | DOI

[40] Masoller C., Marti A. C., “Random delays and the synchronization of chaotic maps”, Phys. Rev. Letters, 94:13 (2005), 134102, 4 pp. | DOI

[41] Wu F., Yin G., Wang L. Y., “Moment exponential stability of random delay systems with two-time-scale Markovian switching”, Nonlinear Analysis: Real World Applications, 13:6 (2012), 2476–2490 | DOI | MR | Zbl

[42] Tikhonov V. I., Mironov M. A., Markov processes, Sov. Radio, Moscow, 1977, 488 pp. | MR

[43] Law A. M., Kelton W. D., Simulation modeling and analysis, 3d ed., McGraw-Hill, New York, 2000, 784 pp. | MR

[44] Mitropolskii Yu. A., The method of averaging in nonlinear mechanics, Naukova dumka, Kiev, 1970, 440 pp. | MR

[45] Kazmerchuk Y. I., Wu J. H., “Stochastic state-dependent delay differential equations with applications in finance”, Functional Differential Equations, 11:1/2 (2004), 77–86 | MR | Zbl

[46] Zaitsev V. V., Karlov-junior A. V., Telegin S. S., “The discrete time ‘predator–prey’ model”, Vestn. Samar. Gos. Univ., Estestvennonauchn. Ser., 2009, no. 6(72), 139–148 (in Russian)

[47] Poloskov I. E., “Phase space extension in the analysis of differential-difference systems with random input”, Automation and Remote Control, 63:9 (2002), 1426–1438 | DOI | MR | Zbl

[48] Poloskov I. E., “Symbolic-numeric algorithms for analysis of stochastic systems with different forms of aftereffect”, Proc. in Applied Math. and Mechanics (PAMM), 7:1 (2007), 2080011–2080012 | DOI

[49] Poloskov I. E., “Symbolic and numeric schemes of analysis of dynamic systems with aftereffect”, Vestn. Perm. Univ. Mat. Mekh. Informatika, 2011, no. 2(6), 51–58 (in Russian)

[50] Mangano S., Mathematica cookbook, O'Reilly Media, Inc., Cambridge, 2010, XXIV+800 pp.