Adaptive mirror descent algorithms in convex programming problems with Lipschitz constraints
Trudy Instituta matematiki i mehaniki, Trudy Instituta Matematiki i Mekhaniki UrO RAN, Tome 24 (2018) no. 2, pp. 266-279
Voir la notice de l'article provenant de la source Math-Net.Ru
The paper is devoted to new modifications of recently proposed adaptive Mirror Descent methods for convex minimization problems in the case of several convex functional constraints. Methods for problems of two types are considered. In problems of the first type, the objective functional is Lipschitz (generally, nonsmooth). In problems of the second type, the gradient of the objective functional is Lipschitz. We also consider the case of a nonsmooth objective functional equal to the maximum of smooth functionals with Lipschitz gradient. In all the cases, the functional constraints are assumed to be Lipschitz and, generally, nonsmooth. The proposed modifications make it possible to reduce the running time of the algorithm due to skipping some of the functional constraints at nonproductive steps. We derive bounds for the convergence rate, which show that the methods under consideration are optimal from the viewpoint of lower oracle estimates. The results of numerical experiments illustrating the advantages of the proposed procedure for some examples are presented.
Keywords:
adaptive Mirror Descent, Lipschitz functional, Lipschitz gradient, productive step, nonproductive step.
@article{TIMM_2018_24_2_a24,
author = {F. S. Stonyakin and M. S. Alkousa and A. N. Stepanov and M. A. Barinov},
title = {Adaptive mirror descent algorithms in convex programming problems with {Lipschitz} constraints},
journal = {Trudy Instituta matematiki i mehaniki},
pages = {266--279},
publisher = {mathdoc},
volume = {24},
number = {2},
year = {2018},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/TIMM_2018_24_2_a24/}
}
TY - JOUR AU - F. S. Stonyakin AU - M. S. Alkousa AU - A. N. Stepanov AU - M. A. Barinov TI - Adaptive mirror descent algorithms in convex programming problems with Lipschitz constraints JO - Trudy Instituta matematiki i mehaniki PY - 2018 SP - 266 EP - 279 VL - 24 IS - 2 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/TIMM_2018_24_2_a24/ LA - ru ID - TIMM_2018_24_2_a24 ER -
%0 Journal Article %A F. S. Stonyakin %A M. S. Alkousa %A A. N. Stepanov %A M. A. Barinov %T Adaptive mirror descent algorithms in convex programming problems with Lipschitz constraints %J Trudy Instituta matematiki i mehaniki %D 2018 %P 266-279 %V 24 %N 2 %I mathdoc %U http://geodesic.mathdoc.fr/item/TIMM_2018_24_2_a24/ %G ru %F TIMM_2018_24_2_a24
F. S. Stonyakin; M. S. Alkousa; A. N. Stepanov; M. A. Barinov. Adaptive mirror descent algorithms in convex programming problems with Lipschitz constraints. Trudy Instituta matematiki i mehaniki, Trudy Instituta Matematiki i Mekhaniki UrO RAN, Tome 24 (2018) no. 2, pp. 266-279. http://geodesic.mathdoc.fr/item/TIMM_2018_24_2_a24/