Geodesic
Adaptive mirror descent algorithms for~convex~and strongly convex optimization problems with~functional constraints
Diskretnyj analiz i issledovanie operacij, Tome 26 (2019) no. 3, pp. 88-114

Voir la notice de l'article provenant de la source Math-Net.Ru

Under consideration are some adaptive mirror descent algorithms for the problems of minimization of a convex objective functional with several convex Lipschitz (generally, nonsmooth) functional constraints. It is demonstrated that the methods are applicable to the objective functionals of various levels of smoothness: The Lipschitz condition holds either for the objective functional itself or for its gradient or Hessian (while the functional itself can fail to satisfy the Lipschitz condition). The main idea is the adaptive adjustment of the method with respect to the Lipschitz constant of the objective functional (its gradient or Hessian), as well as the Lipschitz constant of the constraint. The two types of methods are considered: adaptive (not requiring the knowledge of the Lipschitz constants neither for the objective functional nor for constraints) and partially adaptive (requiring the knowledge of the Lipschitz constant for constraints). Using the restart technique, some methods are proposed for strongly convex minimization problems. Some estimates of the rate of convergence are obtained for all algorithms under consideration in dependence on the level of smoothness of the objective functional. Numerical experiments are presented to illustrate the advantages of the proposed methods for some examples. Tab. 3, bibliogr. 22.
Keywords: adaptive Mirror Descent, Lipschitz condition, Lipschitz gradient, Lipschitz Hessian, strongly convex function, the technique of restarts. 
@article{DA_2019_26_3_a4,
     author = {F. S. Stonyakin and M. Alkousa and A. N. Stepanov and A. A. Titov},
     title = {Adaptive mirror descent algorithms for~convex~and strongly convex optimization problems with~functional constraints},
     journal = {Diskretnyj analiz i issledovanie operacij},
     pages = {88--114},
     publisher = {mathdoc},
     volume = {26},
     number = {3},
     year = {2019},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/DA_2019_26_3_a4/}
}
TY  - JOUR
AU  - F. S. Stonyakin
AU  - M. Alkousa
AU  - A. N. Stepanov
AU  - A. A. Titov
TI  - Adaptive mirror descent algorithms for~convex~and strongly convex optimization problems with~functional constraints
JO  - Diskretnyj analiz i issledovanie operacij
PY  - 2019
SP  - 88
EP  - 114
VL  - 26
IS  - 3
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/DA_2019_26_3_a4/
LA  - ru
ID  - DA_2019_26_3_a4
ER  - 
%0 Journal Article
%A F. S. Stonyakin
%A M. Alkousa
%A A. N. Stepanov
%A A. A. Titov
%T Adaptive mirror descent algorithms for~convex~and strongly convex optimization problems with~functional constraints
%J Diskretnyj analiz i issledovanie operacij
%D 2019
%P 88-114
%V 26
%N 3
%I mathdoc
%U http://geodesic.mathdoc.fr/item/DA_2019_26_3_a4/
%G ru
%F DA_2019_26_3_a4
F. S. Stonyakin; M. Alkousa; A. N. Stepanov; A. A. Titov. Adaptive mirror descent algorithms for~convex~and strongly convex optimization problems with~functional constraints. Diskretnyj analiz i issledovanie operacij, Tome 26 (2019) no. 3, pp. 88-114. http://geodesic.mathdoc.fr/item/DA_2019_26_3_a4/