Optimization methods for generalized tensor contraction
Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 9 (2020) no. 2, pp. 19-39
Cet article a éte moissonné depuis la source Math-Net.Ru
Tensor contraction is one of major operations defined in tensor calculus, a separate branch of mathematics, which become a fundamental language of theory of relativity, mechanics, electrodynamics, and solid state physics. Effective implementation of tensor contraction is of considerable practical significance for such areas as solving of mathematical physics problems, machine learning, spectral element methods, quantum chemistry, data mining, and high performance computing. In the last twenty years, the number of optimization methods for tensor contraction has increased and continues to grow. In this article, the author reviews widespread approaches for optimization of tensor contraction, which are used on single processor as well as multiprocessor systems with distributed memory. The review contains the description of methods for optimization of matrix and matrix-vector multiplications, important particular cases of tensor contraction, which are used as a base for the most tensor contraction optimizations. The described optimizations can be applied during program compilation performed by production compilers. The information provided in this work could be useful for systematizing knowledge.
Keywords:
tensor contraction, linear algebra, high-performance computing.
@article{VYURV_2020_9_2_a1,
author = {R. A. Gareev},
title = {Optimization methods for generalized tensor contraction},
journal = {Vestnik \^U\v{z}no-Uralʹskogo gosudarstvennogo universiteta. Seri\^a Vy\v{c}islitelʹna\^a matematika i informatika},
pages = {19--39},
year = {2020},
volume = {9},
number = {2},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/VYURV_2020_9_2_a1/}
}
TY - JOUR AU - R. A. Gareev TI - Optimization methods for generalized tensor contraction JO - Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika PY - 2020 SP - 19 EP - 39 VL - 9 IS - 2 UR - http://geodesic.mathdoc.fr/item/VYURV_2020_9_2_a1/ LA - ru ID - VYURV_2020_9_2_a1 ER -
%0 Journal Article %A R. A. Gareev %T Optimization methods for generalized tensor contraction %J Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika %D 2020 %P 19-39 %V 9 %N 2 %U http://geodesic.mathdoc.fr/item/VYURV_2020_9_2_a1/ %G ru %F VYURV_2020_9_2_a1
R. A. Gareev. Optimization methods for generalized tensor contraction. Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 9 (2020) no. 2, pp. 19-39. http://geodesic.mathdoc.fr/item/VYURV_2020_9_2_a1/