Feedback minimum principle: variational strengthening of the concept of extremality in optimal control

Vladimir A. Dykhta

The Bulletin of Irkutsk State University. Series Mathematics, Tome 41 (2022), pp. 19-39

Résumé

Existing maximum principles of Pontryagin’s type and related optimality conditions, such as, e.g., the ones derived by F. Clarke, B. Kaskosz and S. Lojasiewicz Jr., and H.J. Sussmann, can be strengthened up to global necessary optimality conditions in the form of so-called feedback minimum principle. This is possible for both classical and non-smooth optimal control problems without terminal constraints. The formulation of the feedback minimum principle (or related extremality conditions) remains within basic constructions of the mentioned maximum principles (the Hamiltonian or Pontryagin function, the adjoint differential equation or inclusion, and its solutions –– co-trajectories). At the same time, the actual maximum condition –– maximization of the Hamiltonian –– takes a variational form: any optimal trajectory of the addressed problem should be optimal for a specific “accessory” problem of dynamic optimization. The latter is stated over all tubes of Krasovskii-Subbotin constructive motions generated by feedback strategies, which are extremal with respect to a certain supersolution of the Hamilton-Jacobi equation. Such a supersolution can be represented explicitely in terms of the co-trajectory of a reference control process and the terminal cost function. In a general version, the feedback minimum principle operates with generalized solutions of the proximal Hamilton-Jacobi inequality for weakly decreasing ($u$-stable) functions.

Détail

Keywords: extremals, feedback, weakly decreasing functions.

Bibliographie

[1] Gamkrelidze R. V., Principles of optimal control theory, Mathematical Concepts and Methods in Science and Engineering, 7, Springer, NY, 1978, 175 pp. | DOI | MR | MR

[2] Gamkrelidze R. V., “The mathematical work of L.S. Pontryagin”, J. Math. Sci. (N.Y.), 100:5 (2000), 2447–2457 | DOI | MR

[3] Dykhta V. A., “Weakly monotone solutions of the Hamilton-Jacobi inequality and optimality conditions with positional controls”, Autom. Remote Control, 75:5 (2014), 829–844 | DOI | MR | Zbl

[4] Dykhta V. A., “Nonstandard duality and nonlocal necessary optimality conditions in nonconvex optimal control problems”, Autom. Remote Control, 75:11 (2014), 1906–1921 | DOI | MR | Zbl

[5] Dykhta V. A., “Variational necessary optimality conditions with feedback descent controls for optimal control problems”, Dokl. Math., 91:3 (2015), 394–396 | DOI | MR | Zbl

[6] Dykhta V. A., “Variational optimality conditions with feedback descent controls that strengthen the Maximum principle”, The Bulletin of Irkutsk State University. Series Mathematics, 8 (2014), 86–103 (in Russian) | Zbl

[7] Dykhta V. A., “Positional strengthenings of the maximum principle and sufficient optimality conditions”, Proc. Steklov Inst. Math., 293, suppl. 1 (2016), 43–57 | DOI | MR

[8] Dykhta V. A., Samsonyuk O. N., Hamilton-Jacobi inequalities and variational optimality conditions, Irkutsk St. Univ. Publ., Irkutsk, 2015, 150 pp. (in Russian)

[9] Clarke H., Optimization and nonsmooth analysis, SIAM, Philadelphia, 1987, 320 pp. | MR | MR

[10] Krasovskii N. N., Subbotin A. I., Positional differential games, Nauka Publ, M., 1974, 458 pp. (in Russian) | MR

[11] Milutin A. A., “Convex-valued Lipschitzian differential inclusions and the Pontryagin Maximum Principle”, J. Math. Sci. (N.Y.), 104:1 (2001), 881–888 | DOI | MR | Zbl

[12] Mordukhovich B.Sh., “Optimal control of difference, differential, and differential-difference inclusions”, J. Math. Sci. (N.Y.), 100:6 (2000), 2613–2632 | DOI | MR | Zbl

[13] Pontryagin L. S., Boltyanskii V. G., Gamkrelidze R. V., Mishchenko E. F., The mathematical theory of optimal processes, St. Publ. house of Phys. and Math. Lit., M., 1961, 391 pp. (in Russian) | MR

[14] Artstein Z., “Pontryagin maximum principle revisited with feedbacks”, Eur. J. Control, 17:1 (2011), 46–54 | DOI | MR | Zbl

[15] Clarke F. H., Ledyaev Yu. S., Stern R. J., Wolenski P. R., “Qualitative properties of trajectories of control systems: A survey”, J. Dynamical and Control Syst., 1:1 (1995), 1–48 | DOI | MR | Zbl

[16] Dykhta V. A., “On variational necessary optimality conditions with descent feedback controls strengthening Maximum principle”, Differential Equations and Optimal Control, Materials of the International Conference dedicated to the centenary of the birth of Academician Evgenii Frolovich Mishchenko (Moscow, June 7–9, 2022), Steklov Mathematical Institute RAS, 2022, 38–42 | MR

[17] Frankowska H., Kaśkosz B., “Linearization and boundary trajectories of nonsmooth control systems”, Can. J. Math., 11:3 (1988), 589–609 | DOI | MR

[18] Kaśkosz B., “Extremality, controllability, and abundant subsets of generalized control systems”, J. Optim. Theory Appl., 101:1 (1999), 73–108 | DOI | MR | Zbl

[19] Kaśkosz B., Lojasiewicz S., “A maximum principle for generalized control”, Nonlinear Analysis: Theory, Methods and Appl, 9:2 (1985), 109–130 | DOI | MR | Zbl

[20] Loewen P. D., Vinter R. B., “Pontryagin-type necessary conditions for differential inclusion problems”, Systems Control Lett., 9:9 (1997), 263–265 | DOI | MR

[21] Sussmann H., “A strong version of the Lojasiewicz maximum principle”, Optimal Control of Differential Equations, Lecture Notes in Pure and Applied Mathematics, ed. N. H. Pavel, M. Dekker Ink., N. Y., 1994, 1–17 | DOI | MR

[22] Vinter R. B., Optimal Control, Birkhäuser, Boston, 2010, 500 pp. | DOI | MR | Zbl