Nonlocal improvement of controls in nonlinear discrete systems

O. V. Morzhin

The Bulletin of Irkutsk State University. Series Mathematics, Tome 19 (2017), pp. 150-163

Résumé

A nonlinear optimal control problem for discrete system with both control function and control parameters (parameters are at the system's right side and at the initial condition) is considered. For the given optimization problem, the problem of control's improvement is studied. It's developed a known approach for non-local improvement of control based on construction of the exact (without residual terms w.r.t. state and control variables) formula for the cost functional's increment under some special conjugate system. For the given optimization problem, it's considered the generalized Lagrangian following to the theory by V. F. Krotov. The function $\varphi(t,x)$ which plays an important role in the generalized Lagrangian is considered in this article in the linear w.r.t. $x$ form $\varphi(t,x) = \langle p(t), x \rangle$ where the function $p(t)$ is the solution of the mentioned conjugate system. Thus, first of all, the exact formula of the cost functional's increment is considered under the assumption on the solution $p(t)$ existence; and, secondly, the linear function $\varphi(t,x)$ is used here in connection with creation of the mentioned increment formula, and not for linear approximation of the generalized Lagrangian's increment. The corresponding condition of control's improvement is formulated in terms of the boundary value problem composed due to binding of the system given in the optimization problem together with the conjugate system. The obtained increment condition is similar to the increment conditions which were suggested before in the papers of the author for discrete problems without control parameters. There is an example of control's improvement in some problem where the control to be improved gives the maximum of the Pontryagin's function for all values of $t$. The boundary value improvement problem is solved with help of the shooting method, and the calculations are made analytically.

Détail

Keywords: discrete systems; optimal control; control functions and parameters; non-local improvement.

Bibliographie

[1] Antipina N. V., Dykhta V. A., “Linear Lyapunov–Krotov functions and sufficient conditions for optimality in the form of the maximum principle”, Russ. Math., 46:12 (2002), 9–20 | MR | Zbl

[2] Arguchintsev A. V., Dykhta V. A., Srochko V. A., “Optimal control: nonlocal conditions, computational methods, and the variational principle of maximum”, Russ. Math., 53:1 (2009), 1–35 | DOI | MR | Zbl

[3] Arguchintsev A. V., Poplevko V. P., “Optimal control of the initial conditions of a first-order canonical hyperbolic system on the basis of nonstandard increment formulas”, Russ. Math., 2008, no. 1, 3–10

[4] Baturin V. A., Urbanovich D. E., Approximate optimal control methods based on the extension principle, Nauka, Novosibirsk, 1997, 175 pp. (In Russian)

[5] Buldaev A. S., Perturbation methods in improvement and optimization problems for control systems, Buryat State Univ. Publ., Ulan-Ude, 2008, 256 pp. (In Russian)

[6] Buldaev A. S., “A boundary improvement problem for linearly controlled processes”, Autom. Remote Control, 72:6 (2011), 1221–1228 | DOI | MR | Zbl

[7] Buldaev A. S., Morzhin O. V., “Modification of the projecting method for nonlinear controls improvement”, Vestnik Buryatskogo gosudarstvennogo universiteta. Matematika i informatika, 2010, no. 9, 10–17 (In Russian)

[8] Buldaev A. S., Morzhin O. V., “Improvement of controls in nonlinear systems based on boundary value problems”, Izvestiya Irk. Gos. Univ., Ser. Matematika, 2:1 (2009), 94–107 | Zbl

[9] Buldaev A. S., Khishektueva I.-Kh. D., “The fixed point method in parametric optimization problems for systems”, Autom. Remote Control, 74:12 (2013), 1927–1934 | DOI | MR | Zbl

[10] Butkovsky A. G., The theory of optimal control for systems with distributed parameters, Nauka, M., 1965, 476 pp. (In Russian)

[11] Gabasov R., Kirillova F. M., Qualitative Theory of Optimal Processes, Nauka, M., 1971, 508 pp. (In Russian)

[12] Gurman Vladimir Iosifovich, Wikipedia (In Russian)

[13] Gurman V. I., The Extension Principle in Control Problems, 2nd ed., Fizmatlit, M., 1997, 288 pp. (In Russian)

[14] Gurman V. I., Baturin V. A., Danilina E. V., et al., New methods for improvement of control processes, Nauka, Novosibirsk, 1987, 184 pp. (In Russian)

[15] Gurman V. I., Baturin V. A., Moskalenko A. I., et al., Methods for improvement in computational experiments, Nauka, Novosibirsk, 1988, 184 pp. (In Russian)

[16] Gurman V. I., Baturin V. A., Rasina I. V., et al., Approximate methods of optimal control, Irkutsk Univ. Publ., Irkutsk, 1983, 180 pp. (In Russian)

[17] Dykhta V. A., “Positional strengthenings of a maximum principle and sufficient conditions for optimality”, Proc. Steklov Inst. Math., 293, suppl. 1 (2016), S43–S57 | DOI | MR | Zbl | Zbl

[18] Krotov Vadim Fedorovich, Wikipedia (In Russian)

[19] Krotov V. F., Bukreev V. Z., Gurman V. I., New Variational Methods in Flight Dynamics, Mashinostroenie, M., 1969, 288 pp. (In Russian)

[20] Krotov V. F., Gurman V. I., Optimal Control: Methods and Problems, Nauka, M., 1973, 448 pp. (In Russian)

[21] Morzhin O. V., “Nonlocal improvement of nonlinear controlled processes on the basis of sufficient optimality conditions”, Autom. Remote Control, 71:8 (2010), 1526–1539 | DOI | MR | Zbl

[22] Morzhin O. V., “Nonlocal improvement of controlling functions and parameters in nonlinear dynamical systems”, Autom. Remote Control, 73:11 (2012), 1822–1837 | DOI | MR | Zbl

[23] Morzhin O. V., “Nonlocal improvements of controls in nonlinear discrete optimal control problems”, 12th All-Russian Meeting on Control Problems, ICS RAS, M., 2014, 650–658 (In Russian) | Zbl

[24] Panteleev A. V., Bortakovsky A. S., Control theory in examples and tasks, Vyshaya shkola, M., 2003, 583 pp. (In Russian)

[25] Pontryagin L. S., Boltyanskii V. G., Gamkrelidze R. V., Mishchenko E. F., The Mathematical Theory of Optimal Processes, Pergamon Press, Oxford, 1964 | MR | Zbl

[26] Propoi A. I., Elements of the theory of optimal discrete processes, Nauka, M., 1973, 256 pp. (In Russian); ;

[27] Rozonoer L. I., “L. S. Pontryagin maximum principle in the theory of optimum systems. I–III”, Autom. Remote Control, 20 (1959), 1288–1302 ; 1405–1421 ; 1517–1532 | MR

[28] Srochko V. A., Iterative methods for solving optimal control problems, Fizmatlit, M., 2000, 160 pp. (In Russian)

[29] Srochko V. A., Antonik V. G., “Optimality conditions for extremal controls in bilinear and quadratic problems”, Russ. Math., 60:5 (2016), 75–80 | DOI | Zbl

[30] V. F. Krotov, Global methods in optimal control theory, Marcel Dekker, New York, 1996, 408 pp. | MR | Zbl