On the role of Lagrange multipliers and duality in ill-posed problems for constrained extremum.

M. I. Sumin

Vestnik rossijskih universitetov. Matematika, Tome 28 (2023) no. 144, pp. 414-435

Résumé

The important role of Lagrange multipliers and duality in the theory of ill-posed problems for a constrained extremum is discussed. The central attention is paid to the problem of stable approximate finding of a normal (minimum in norm) solution of the operator equation of the first kind $Az=u,$ $z\in {\mathcal D}\subseteq Z,$ where $A:\,Z\to U$ is a linear bounded operator, $u\in U$ is a given element, ${\mathcal D}\subseteq Z$ is a convex closed set, $Z,U$ are Hilbert spaces. As is known, this problem is classical for the theory of ill-posed problems. We consider two problems equivalent to it (from the point of view of the simultaneous existence of their unique solutions) for a constrained extremum, the first of which is the problem ($CE1$) with a functional inequality constraint $\|z\|^2\to\min,$ $\|Az-u\|^2\leq 0,$ $z\in {\mathcal D},$ and the second is the problem ($CE2$) with operator equality constraint $\|z\|^2\to\min,$ $Az=u,$ $z\in {\mathcal D}.$ First of all, we show that Tikhonov's regularization method can be naturally interpreted as a method of stable approximation of the exact solution by extremals of the Lagrange functional for problem ($CE1$) with simultaneous construction of a maximizing sequence of Lagrange multipliers in its dual problem. In this case, the Lagrange multiplier is the reciprocal of the regularization parameter in the Tikhonov method. In other words, the convergence theorem of the Tikhonov regularization method is given the form of a statement in the form of duality with respect to the problem ($CE1$). Next, we discuss the role of Tikhonov stabilization for general convex problems in solving problems for constrained extremum and a stable method based on Tikhonov stabilization of the problem dual to ($CE2$) for solving the original operator equation, which can be considered as a regularization method for the Lagrange multiplier rule for the problem ($CE2$). The paper discusses the features of each of the two above mentioned approaches to the regularization of solving the original operator equation.

Détail

Keywords: ill-posed problem, linear operator equation, regularizing algorithm, Tikhonov regularization method, constrained extremum, duality, generalized minimizing sequence, dual regularization, regularized Lagrange principle
Mots-clés : Lagrange multiplier rule

Bibliographie

[1] A. N. Tikhonov, “O reshenii nekorrektno postavlennykh zadach i metode regulyarizatsii”, Doklady AN SSSR, 151:3 (1963), 501–504 | Zbl

[2] A. N. Tikhonov, “O regulyarizatsii nekorrektno postavlennykh zadach”, Doklady AN SSSR, 153:1 (1963), 49–52 | Zbl

[3] A. N. Tikhonov, V. Ya. Arsenin, Metody resheniya nekorrektnykh zadach, Nauka, M., 1974; A. N. Tikhonov, V. Ya. Arsenin, Solutions of Ill-Posed Problems, Winston; Halsted Press, Washington; New York, 1977 | MR | Zbl

[4] Nekorrektnye zadachi estestvoznaniya, eds. A. N. Tikhonov, A. V. Goncharskii, Izd-vo MGU, M., 1987; Il-posed Problems in the Natural Science, Advances in Science and Technology in the USSR Mathematics and Mechanics, eds. A. N. Tikhonov, A. V. Goncharskii, Mir Publ., Moscow, 1989

[5] V. K. Ivanov, V. V. Vasin, V. P. Tanana, Teoriya lineinykh nekorrektnykh zadach i ee prilozheniya, Nauka, M., 1978; V. K. Ivanov, V. V. Vasin, V. P. Tanana, Theory of Linear Ill-Posed Problems and its Applications, v. 36, Inverse and Ill-Posed Problems, Walter de Gruyter, Utrecht, 2002 | MR

[6] A. N. Tikhonov, A. V. Goncharskii, V. V. Stepanov, A. G. Yagola, Regularizing Algorithms And Apriori Information, Nauka Publ., Moscow, 1983 (In Russian) | MR

[7] A. B. Bakushinskii, A. V. Goncharskii, Incorrect Tasks. Numerical Methods and Applications, Publishing House Moscow University, Moscow, 1989 (In Russian)

[8] F. P. Vasil’ev, Optimization Methods: in 2 books, MCCME, Moscow, 2011 (In Russian)

[9] M. I. Sumin, Incorrect Problems and Methods for Solving Them. Materials for Lectures for Students Senior Students, Publishing House of Nizhny Novgorod State University, Nizhny Novgorod, 2009 (In Russian)

[10] M. I. Sumin, “Lagrange principle and its regularization as a theoretical basis of stable solving optimal control and inverse problems”, Vestnik rossiyskikh universitetov. Matematika = Russian Universities Reports. Mathematics, 26:134 (2021), 151–171 (In Russian) | Zbl

[11] M. I. Sumin, “On ill-posed problems, extremals of the Tikhonov functional and the regularized Lagrange principles”, Vestnik rossiyskikh universitetov. Matematika = Russian Universities Reports. Mathematics, 27:137 (2022), 58–79 (In Russian) | Zbl

[12] M. I. Sumin, “Regulyarizatsiya v lineino vypukloi zadache matematicheskogo programmirovaniya na osnove teorii dvoistvennosti”, Zhurn. vychisl. matem. i matem. fiz., 47:4 (2007), 602–625 | MR | Zbl

[13] A. N. Tikhonov, “Ob ustoichivosti zadachi optimizatsii funktsionalov”, Zhurn. vychisl. matem. i matem. fiz., 6:4 (1966), 631–634

[14] M. I. Sumin, “Regulyarizovannaya parametricheskaya teorema Kuna–Takkera v gilbertovom prostranstve”, Zhurn. vychisl. matem. i matem. fiz., 51:9 (2011), 1594–1615 | MR | Zbl

[15] M. I. Sumin, “Ustoichivoe sekventsialnoe vypukloe programmirovanie v gilbertovom prostranstve i ego prilozhenie k resheniyu neustoichivykh zadach”, Zhurn. vychisl. matem. i matem. fiz., 54:1 (2014), 25–49 | DOI | MR | Zbl

[16] M. I. Sumin, “Why regularization of Lagrange principle and Pontryagin maximum principle is needed and what it gives”, Vestnik Tambovskogo universiteta. Seriya: estestvennye i tekhnicheskie nauki = Tambov University Reports. Series: Natural and Technical Sciences, 23:124 (2018), 757–772 (In Russian)

[17] M. I. Sumin, “Regularized Lagrange principle and Pontryagin maximum principle in optimal control and in inverse problems”, Trudy Inst. Mat. i Mekh. UrO RAN, 25, no. 1, 2019, 279–296 (In Russian)

[18] V. M. Alekseev, V. M. Tikhomirov, S. V. Fomin, Optimalnoe upravlenie, Nauka, M., 1979 ; V. M. Alekseev, V. M. Tikhomirov, S. V. Fomin, Optimal Control, Plenum Press, New York, 1987 | MR | MR

[19] M. I. Sumin, “Nondifferential Kuhn–Tucker theorems in constrained extremum problems via subdifferentials of nonsmooth analysis”, Vestnik rossiyskikh universitetov. Matematika = Russian Universities Reports. Mathematics, 25:131 (2020), 307–330 (In Russian)

[20] Zh. -P. Oben, Nelineinyi analiz i ego ekonomicheskie prilozheniya, Mir, M., 1988 ; J. -P. Aubin, L’Analyse non Linéaire et ses Motivations Économiques, Elsevier Masson, Paris–New York, 1984 | MR | MR

[21] Dzh. Varga, Optimalnoe upravlenie differentsialnymi i funktsionalnymi uravneniyami, Nauka, M., 1977; J. Warga, Optimal Control of Differential and Functional Equations, Academic Press, New York, 1972 | MR | Zbl

[22] M. I. Sumin, “On regularization of the classical optimality conditions in convex optimal control problems”, Trudy Inst. Mat. i Mekh. UrO RAN, 26, no. 2, 2020, 252–269 (In Russian)