Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions
Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 4, pp. 770-783

Voir la notice de l'article provenant de la source Math-Net.Ru

The classical EM algorithm for the restoration of the mixture of normal probability distributions cannot determine the number of components in the mixture. An algorithm called ARD EM for the automatic determination of the number of components is proposed, which is based on the relevance vector machine. The idea behind this algorithm is to use a redundant number of mixture components at the first stage and then determine the relevant components by maximizing the evidence. Experiments with model problems show that the number of clusters thus determined either coincides with the actual number or slightly exceeds it. In addition, clusterization using ARD EM turns out to be closer to the actual clusterization than that obtained by the analogs based on cross validation and the minimum description length principle.
@article{ZVMMF_2010_50_4_a13,
     author = {D. P. Vetrov and D. A. Kropotov and A. A. Osokin},
     title = {Automatic determination of the numbers of components in the {EM} algorithm for the restoration of a mixture of normal distributions},
     journal = {\v{Z}urnal vy\v{c}islitelʹnoj matematiki i matemati\v{c}eskoj fiziki},
     pages = {770--783},
     publisher = {mathdoc},
     volume = {50},
     number = {4},
     year = {2010},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/}
}
TY  - JOUR
AU  - D. P. Vetrov
AU  - D. A. Kropotov
AU  - A. A. Osokin
TI  - Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions
JO  - Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki
PY  - 2010
SP  - 770
EP  - 783
VL  - 50
IS  - 4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/
LA  - ru
ID  - ZVMMF_2010_50_4_a13
ER  - 
%0 Journal Article
%A D. P. Vetrov
%A D. A. Kropotov
%A A. A. Osokin
%T Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions
%J Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki
%D 2010
%P 770-783
%V 50
%N 4
%I mathdoc
%U http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/
%G ru
%F ZVMMF_2010_50_4_a13
D. P. Vetrov; D. A. Kropotov; A. A. Osokin. Automatic determination of the numbers of components in the EM algorithm for the restoration of a mixture of normal distributions. Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 50 (2010) no. 4, pp. 770-783. http://geodesic.mathdoc.fr/item/ZVMMF_2010_50_4_a13/