On equations of the program iteration method

S. V. Chistyakov

Trudy Instituta matematiki i mehaniki, Trudy Instituta Matematiki i Mekhaniki UrO RAN, Tome 24 (2018) no. 1, pp. 288-296

Résumé

The program iteration method, which is inseparably associated with the name of A.G. Chentsov, first appeared in the study of the so-called zero-sum differential games. At early stages, only one of the two possible dual iterative procedures was considered - the maximin procedure. This can be explained by the special interest of the researchers in the so-called program maximin function, which is conveniently interpreted in geometric terms in games of pursuit. Nevertheless, the dual minimax iterative procedure is of no less interest. The program iteration method is mainly significant because it may be used as the basis for the development of a differential game theory in a closed compact form, which was shown earlier for a version of the method based on a certain modification of iterative operators. The key role in this theory belongs to the theorem that states the existence and uniqueness of a solution of the equation induced by a pair of such operators. In this case, the maximin iterative procedure is used to describe $\varepsilon$-optimal (in some cases, optimal) positional strategies of the first player, while the minimax procedure is used to describe $\varepsilon$-optimal (in some cases, optimal) positional strategies of the second player. This paper investigates the structure of the solution set of the generalized Isaacs-Bellman equation obtained with the use of historically first (not modified) operators of the program iteration method. A theorem that states the existence and uniqueness of the solution to this equation meeting a natural boundary condition is proved under certain assumptions. Thus, it is shown that the original version of the program iteration method can also be used in designing a closed-form differential game theory. However, here we use the so-called recursive strategies rather than positional ones. Such strategies, together with the program iteration method, play an essential role in the analysis of coalition-free differential games.

Détail

Keywords: zero-sum differential game, terminal payoff, program iteration method, generalized Isaacs-Bellman equation.

Bibliographie

[1] Chentsov A.G., “O strukture odnoi igrovoi zadachi sblizheniya”, Dokl. AN SSSR, 224:6 (1975), 1272–1275 | MR

[2] Chentsov A.G., “Ob igrovoi zadache sblizheniya v zadannyi moment vremeni”, Mat. sb., 99:3 (1976), 394–420 | MR

[3] Chistyakov S.V., Petrosyan L.O., “Ob odnom podkhode k resheniyu igr presledovaniya”, Vestn. LGU, 1977, no. 1, 77–82

[4] Chistyakov S.V., “K resheniyu igrovykh zadach presledovaniya”, Prikl. matematika i mekhanika, 41:5 (1977), 825–832 | MR

[5] Krasovskii N.N., Igrovye zadachi o vstreche dvizhenii, Nauka, M., 1970, 420 pp. | MR

[6] Chistyakov S., Nikitin F., “On value operators in differential games”, Appl. Math. Sci., 9:59 (2015), 2941–2952

[7] Chistyakov S.V., Operatory znacheniya antagonisticheskikh differentsialnykh igr, Izd-vo SPbGU, SPb, 1999, 62 pp.

[8] Nikitin F.F., Chistyakov S.V., “Teorema suschestvovaniya i edinstvennosti resheniya obobschennogo uravneniya Aizeksa - Bellmana”, Differents. uravneniya, 43:6 (2007), 743–752 | MR

[9] Chistyakov S.V., “O funktsionalnykh uravneniyakh v igrakh sblizheniya v zadannyi moment vremeni”, Prikl. matematika i mekhanika, 46:5 (1982), 874–877 | MR

[10] Chentsov A.G., Subbotin A.I., “An iterative procedure for constructing minimax and viscosity solutions to the Hamilton-Jacobi equations and its generalization”, Proc. Steklov Inst. Math., 224 (1999), 286–309 | MR

[11] Chistyakov S.V., Nikitin F. F., “On regular differential games of persuit with fixed duration”, Vestnik of St. Petersburg University. Ser. 10, 2014, no. 4, 17–24

[12] Chistyakov S.V., “Programmnye iteratsii i universalnye $\varepsilon$-optimalnye strategii v pozitsionnoi differentsialnoi igre”, Dokl. AN SSSR, 319:6 (1991), 1333–1335

[13] Nikitin F.F., “Viscosity solutions and programmed iteration method for Isaacs-Bellman equation”, Vestnik of St. Petersburg University. Ser. 10, 2014, no. 2, 84–92

[14] Chistyakov S.V., “O beskoalitsionnykh differentsialnykh igrakh”, Dokl. AN SSSR, 259:5 (1981), 1052–1055 | MR