Approximate estimation using the accelerated maximum entropy method. Part 2. Study of the properties of estimates
Informacionnye tehnologii i vyčislitelnye sistemy, no. 1 (2023), pp. 71-81
Cet article a éte moissonné depuis la source Math-Net.Ru
In this paper, we investigate a method of approximate entropy estimation, designed to speed up the classical method of maximum entropy estimation due to the use of regularization in the optimization problem. This method is compared with the method of maximum likelihood and Bayesian estimation, both experimentally and in terms of theoretical calculations for some special cases. Estimation methods are tested on the example of a linear regression problem with errors of various types, including asymmetric distributions as well as a multimodal distribution in the form of a mixture of Gaussian components.
Keywords:
probabilistic mathematical model, maximum entropy method, linear regression, regularization, errors distribution.
@article{ITVS_2023_1_a6,
author = {Yu. A. Dubnov and A. V. Boulytchev},
title = {Approximate estimation using the accelerated maximum entropy method. {Part~2.} {Study} of the properties of estimates},
journal = {Informacionnye tehnologii i vy\v{c}islitelnye sistemy},
pages = {71--81},
year = {2023},
number = {1},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/ITVS_2023_1_a6/}
}
TY - JOUR AU - Yu. A. Dubnov AU - A. V. Boulytchev TI - Approximate estimation using the accelerated maximum entropy method. Part 2. Study of the properties of estimates JO - Informacionnye tehnologii i vyčislitelnye sistemy PY - 2023 SP - 71 EP - 81 IS - 1 UR - http://geodesic.mathdoc.fr/item/ITVS_2023_1_a6/ LA - ru ID - ITVS_2023_1_a6 ER -
%0 Journal Article %A Yu. A. Dubnov %A A. V. Boulytchev %T Approximate estimation using the accelerated maximum entropy method. Part 2. Study of the properties of estimates %J Informacionnye tehnologii i vyčislitelnye sistemy %D 2023 %P 71-81 %N 1 %U http://geodesic.mathdoc.fr/item/ITVS_2023_1_a6/ %G ru %F ITVS_2023_1_a6
Yu. A. Dubnov; A. V. Boulytchev. Approximate estimation using the accelerated maximum entropy method. Part 2. Study of the properties of estimates. Informacionnye tehnologii i vyčislitelnye sistemy, no. 1 (2023), pp. 71-81. http://geodesic.mathdoc.fr/item/ITVS_2023_1_a6/