Geodesic
Mirror Descent Methods with a Weighting Scheme for Outputs for Optimization Problems with Functional Constraints
Russian journal of nonlinear dynamics, Tome 20 (2024) no. 5, pp. 727-745

Voir la notice de l'article provenant de la source Math-Net.Ru

This paper is devoted to new mirror descent-type methods with switching between two types of iteration points (productive and nonproductive) for constrained convex optimization problems with several convex functional (inequality-type) constraints. We propose two methods (a standard one and its modification) with a new weighting scheme for points in each iteration of methods, which assigns smaller weights to the initial points and larger weights to the most recent points. Thus, as a result, it improves the convergence rate of the proposed methods (empirically). The proposed modification makes it possible to reduce the running time of the method due to skipping some of the functional constraints at nonproductive steps. We derive bounds for the convergence rate of the proposed methods with time-varying step sizes, which show that the proposed methods are optimal from the viewpoint of lower oracle estimates. The results of some numerical experiments, which illustrate the advantages of the proposed methods for some examples, such as the best approximation problem, the Fermat – Torricelli – Steiner problem, the smallest covering ball problem, and the maximum of a finite collection of linear functions, are also presented.
Keywords: convex optimization, nonsmooth problem, problem with functional constraints, mirror descent
Mots-clés : optimal convergence rate 
@article{ND_2024_20_5_a2,
     author = {M. S. Alkousa and F. S. Stonyakin and A. M. Abdo and M. M. Alcheikh},
     title = {Mirror {Descent} {Methods} with a {Weighting} {Scheme} for {Outputs} for {Optimization} {Problems} with {Functional} {Constraints}},
     journal = {Russian journal of nonlinear dynamics},
     pages = {727--745},
     publisher = {mathdoc},
     volume = {20},
     number = {5},
     year = {2024},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/ND_2024_20_5_a2/}
}
TY  - JOUR
AU  - M. S. Alkousa
AU  - F. S. Stonyakin
AU  - A. M. Abdo
AU  - M. M. Alcheikh
TI  - Mirror Descent Methods with a Weighting Scheme for Outputs for Optimization Problems with Functional Constraints
JO  - Russian journal of nonlinear dynamics
PY  - 2024
SP  - 727
EP  - 745
VL  - 20
IS  - 5
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/ND_2024_20_5_a2/
LA  - en
ID  - ND_2024_20_5_a2
ER  - 
%0 Journal Article
%A M. S. Alkousa
%A F. S. Stonyakin
%A A. M. Abdo
%A M. M. Alcheikh
%T Mirror Descent Methods with a Weighting Scheme for Outputs for Optimization Problems with Functional Constraints
%J Russian journal of nonlinear dynamics
%D 2024
%P 727-745
%V 20
%N 5
%I mathdoc
%U http://geodesic.mathdoc.fr/item/ND_2024_20_5_a2/
%G en
%F ND_2024_20_5_a2
M. S. Alkousa; F. S. Stonyakin; A. M. Abdo; M. M. Alcheikh. Mirror Descent Methods with a Weighting Scheme for Outputs for Optimization Problems with Functional Constraints. Russian journal of nonlinear dynamics, Tome 20 (2024) no. 5, pp. 727-745. http://geodesic.mathdoc.fr/item/ND_2024_20_5_a2/