Geodesic
Stochastic gradient algorithm based on the average aggregate functions
Vestnik KRAUNC. Fiziko-matematičeskie nauki, no. 5 (2016), pp. 112-125 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice de l'article

The paper proposes a new scheme for the gradient solution to minimize losses averaged problem. It is an analog circuit used in the SAG algorithm in the case when the risk is calculated using the arithmetic mean. An illustrative example of the construction of robust classification based on the maximization of the surrogate median indentation.
Keywords: Empirical risk, classification problem, averaging aggregation function, gradient based algorithm. 
@article{VKAM_2016_5_a16,
     author = {Z. M. Shibzukhov and M. A. Kazakov},
     title = {Stochastic gradient algorithm based on the average aggregate functions},
     journal = {Vestnik KRAUNC. Fiziko-matemati\v{c}eskie nauki},
     pages = {112--125},
     year = {2016},
     number = {5},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VKAM_2016_5_a16/}
}
TY  - JOUR
AU  - Z. M. Shibzukhov
AU  - M. A. Kazakov
TI  - Stochastic gradient algorithm based on the average aggregate functions
JO  - Vestnik KRAUNC. Fiziko-matematičeskie nauki
PY  - 2016
SP  - 112
EP  - 125
IS  - 5
UR  - http://geodesic.mathdoc.fr/item/VKAM_2016_5_a16/
LA  - ru
ID  - VKAM_2016_5_a16
ER  - 
%0 Journal Article
%A Z. M. Shibzukhov
%A M. A. Kazakov
%T Stochastic gradient algorithm based on the average aggregate functions
%J Vestnik KRAUNC. Fiziko-matematičeskie nauki
%D 2016
%P 112-125
%N 5
%U http://geodesic.mathdoc.fr/item/VKAM_2016_5_a16/
%G ru
%F VKAM_2016_5_a16
Z. M. Shibzukhov; M. A. Kazakov. Stochastic gradient algorithm based on the average aggregate functions. Vestnik KRAUNC. Fiziko-matematičeskie nauki, no. 5 (2016), pp. 112-125. http://geodesic.mathdoc.fr/item/VKAM_2016_5_a16/

[1] Vapnik V., The Nature of Statistical Learning Theory. Information Science and Statistics, Springer-Verlag, 2000 | MR

[2] Rousseeuw P. J., “Least Median of Squares Regression”, Journal of the American Statistical Association, 1984, no. 79, 871–880 | DOI | MR | Zbl

[3] Rousseeuw P. J., Leroy A. M., Robust Regression and Outlier Detection, John Wiley and Sons, New York | MR | Zbl

[4] Mesiar R., Komornikova M., Kolesarova A., Calvo T., “Aggregation functions”, Fuzzy Sets and Their Extensions: Representation, Aggregation and Models, Springer, Berlin-Heidelberg, 2008 | Zbl

[5] Grabich M., Marichal J.-L., Pap E., Aggregation Functions, Encyclopedia of Mathematics and its Applications, 127, Cambridge University Press, 2009 | MR

[6] Beliakov G. , Sola H., Calvo T. A, Practical Guide to Averaging Functions, Springer, 2016, 329 pp. | MR

[7] Calvo T., Beliakov G., “Aggregation functions based on penalties”, Fuzzy Sets and Systems, 161:10 (2010), 1420-1436 | DOI | MR | Zbl

[8] Shibzukhov Z. M., “Correct Aggregate Operations with Algorithms”, Pattern Recognition and Image Analysis, 24:3 (2014), 377–382 | DOI

[9] Shibzukhov Z. M., “Aggregation correct operations on algorithms”, Doklady Mathematics, 91:3 (2015), 391-393 | DOI | MR | Zbl

[10] Le Roux N., Schmidt M., Bach F. A, “Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets”, 2012, arXiv: 1202.6258

[11] Schmidt M., Le Roux N., Bach F., “Minimizing Finite Sums with the Stochastic Average Gradient”, 2013, arXiv: 1309.2388

[12] Shalev-Shwartz, Zhang T., “Stochastic dual coordin ate ascent methods for regularized loss minimization”, Journal of Machine Learning Research, 2013, no. 14, 567–599 | MR | Zbl