Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions
Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 4, pp. 770-783
Voir la notice de l'article provenant de la source Math-Net.Ru
The classical EM algorithm for the restoration of the mixture of normal probability distributions cannot determine the number of components in the mixture. An algorithm called ARD EM for the automatic determination of the number of components is proposed, which is based on the relevance vector machine. The idea behind this algorithm is to use a redundant number of mixture components at the first stage and then determine the relevant components by maximizing the evidence. Experiments with model problems show that the number of clusters thus determined either coincides with the actual number or slightly exceeds it. In addition, clusterization using ARD EM turns out to be closer to the actual clusterization than that obtained by the analogs based on cross validation and the minimum description length principle.
@article{ZVMMF_2010_50_4_a13,
author = {D. P. Vetrov and D. A. Kropotov and A. A. Osokin},
title = {Automatic determination of the numbers of components in the {EM} algorithm for the restoration of a mixture of normal distributions},
journal = {\v{Z}urnal vy\v{c}islitelʹnoj matematiki i matemati\v{c}eskoj fiziki},
pages = {770--783},
publisher = {mathdoc},
volume = {50},
number = {4},
year = {2010},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/}
}
TY - JOUR AU - D. P. Vetrov AU - D. A. Kropotov AU - A. A. Osokin TI - Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions JO - Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki PY - 2010 SP - 770 EP - 783 VL - 50 IS - 4 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/ LA - ru ID - ZVMMF_2010_50_4_a13 ER -
%0 Journal Article %A D. P. Vetrov %A D. A. Kropotov %A A. A. Osokin %T Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions %J Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki %D 2010 %P 770-783 %V 50 %N 4 %I mathdoc %U http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/ %G ru %F ZVMMF_2010_50_4_a13
D. P. Vetrov; D. A. Kropotov; A. A. Osokin. Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions. Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 4, pp. 770-783. http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/