The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors
Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 6, pp. 979-998
Voir la notice de l'article provenant de la source Math-Net.Ru
A tensor given by its canonical decomposition is approximated by another tensor (again, in the canonical decomposition) of fixed lower rank. For this problem, the structure of the Hessian matrix of the objective function is analyzed. It is shown that all the auxiliary matrices needed for constructing the quadratic model can be calculated so that the computational effort is a quadratic function of the tensor dimensionality (rather than a cubic function as in earlier publications). An economical version of the trust region Newton method is proposed in which the structure of the Hessian matrix is efficiently used for multiplying this matrix by vectors and for scaling the trust region. At each step, the subproblem of minimizing the quadratic model in the trust region is solved using the preconditioned conjugate gradient method, which is terminated if a negative curvature direction is detected for the Hessian matrix.
@article{ZVMMF_2010_50_6_a0,
author = {V. A. Kazeev and E. E. Tyrtyshnikov},
title = {The structure of the {Hessian} and the efficient implementation of {Newton's} method in the problem of the canonical approximation of tensors},
journal = {\v{Z}urnal vy\v{c}islitelʹnoj matematiki i matemati\v{c}eskoj fiziki},
pages = {979--998},
publisher = {mathdoc},
volume = {50},
number = {6},
year = {2010},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_6_a0/}
}
TY - JOUR AU - V. A. Kazeev AU - E. E. Tyrtyshnikov TI - The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors JO - Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki PY - 2010 SP - 979 EP - 998 VL - 50 IS - 6 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_6_a0/ LA - ru ID - ZVMMF_2010_50_6_a0 ER -
%0 Journal Article %A V. A. Kazeev %A E. E. Tyrtyshnikov %T The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors %J Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki %D 2010 %P 979-998 %V 50 %N 6 %I mathdoc %U http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_6_a0/ %G ru %F ZVMMF_2010_50_6_a0
V. A. Kazeev; E. E. Tyrtyshnikov. The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors. Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 6, pp. 979-998. http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_6_a0/