Geodesic
Modification of random forest based approach for streaming data with concept drift
Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie, Tome 9 (2016) no. 4, pp. 86-95 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice de l'article

In this paper concept drift classification method was presented. Concept drift methods have potential in complex systems analysis and other processes which have stochastic nature like wind power. We present decision tree ensemble classification method based on the Random Forest algorithm for concept drift. Inspired by Accuracy Weighted Ensemble (AWE) method the weighted majority voting ensemble aggregation rule is employed. Base learner weight in our case is computed for each sample evaluation using base learners accuracy and intrinsic proximity measure of Random Forest. Our algorithm exploits ensemble pruning as a forgetting strategy. We present results of empirical comparison of our method and other state-of-the-art concept drift classifiers.
Keywords: decision tree; concept drift; ensemble learning; classification; random forest. 
@article{VYURU_2016_9_4_a7,
     author = {A. V. Zhukov and D. N. Sidorov},
     title = {Modification of random forest based approach for streaming data with concept drift},
     journal = {Vestnik \^U\v{z}no-Uralʹskogo gosudarstvennogo universiteta. Seri\^a, Matemati\v{c}eskoe modelirovanie i programmirovanie},
     pages = {86--95},
     year = {2016},
     volume = {9},
     number = {4},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VYURU_2016_9_4_a7/}
}
TY  - JOUR
AU  - A. V. Zhukov
AU  - D. N. Sidorov
TI  - Modification of random forest based approach for streaming data with concept drift
JO  - Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie
PY  - 2016
SP  - 86
EP  - 95
VL  - 9
IS  - 4
UR  - http://geodesic.mathdoc.fr/item/VYURU_2016_9_4_a7/
LA  - ru
ID  - VYURU_2016_9_4_a7
ER  - 
%0 Journal Article
%A A. V. Zhukov
%A D. N. Sidorov
%T Modification of random forest based approach for streaming data with concept drift
%J Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie
%D 2016
%P 86-95
%V 9
%N 4
%U http://geodesic.mathdoc.fr/item/VYURU_2016_9_4_a7/
%G ru
%F VYURU_2016_9_4_a7
A. V. Zhukov; D. N. Sidorov. Modification of random forest based approach for streaming data with concept drift. Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie, Tome 9 (2016) no. 4, pp. 86-95. http://geodesic.mathdoc.fr/item/VYURU_2016_9_4_a7/

[1] Tomin N., Zhukov A., Sidorov D., Kurbatsky V., Panasetsky D., Spiryaev V., “Random Forest Based Model for Preventing Large-Scale Emergencies in Power Systems”, International Journal of Artificial Intelligence, 13:1 (2015), 221–228

[2] Breiman L., “Random Forests”, Machine Learning, 45:1 (2001), 5–32 | DOI | Zbl

[3] Breiman L., “Bagging Predictors”, Machine Learning, 24:2 (1996), 123–140 | DOI | Zbl

[4] Ho Tin Kam, “The Random Subspace Method for Constructing Decision Forests”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20:8 (1998), 832–844 | DOI

[5] Žliobaitė I., Learning under Concept Drift: an Overview, 2010, arXiv: 1010.4784

[6] Haixun Wang, Wei Fan, Yu P. S., Han J., “Mining Concept-Drifting Data Streams Using Ensemble Classifiers”, Proceedings of SIGKDD (Washington, DC, USA, August 24–27, 2003), 226–235

[7] Gama J., Knowledge Discovery from Data Streams, CRC Press Publ., Singapore, 2010 | DOI | MR | Zbl

[8] Kuncheva L., “Classifier Ensembles for Changing Environment”, Multiple Classifier Systems, 5th Intl. Workshop, Springer-Verlag, 2004, 1–15 | DOI

[9] Haixun Wang, Wei Fan, Yu P. S., Han J., “Mining Concept-Drifting Data Streams Using Ensemble Classifiers”, Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2003, 226–235 | DOI

[10] Aiping Wang, Guowei Wan, Zhiquan Cheng, Sikun Li, “An Incremental Extremely Random Forest Classifier for Online Learning and Tracking”, Image Processing (ICIP), 2009 16th IEEE International Conference, IEEE, 2009, 1449–1452 | DOI

[11] Geurts P., Ernst D., Wehenkel L., “Extremely Randomized Trees”, Machine Learning, 63:1 (2006), 3–42 | DOI | Zbl

[12] Santner J., Saffari A., Leistneret C. et al., “On-Line Random Forests”, Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference, IEEE, 2009, 1393–1400

[13] Oza N. C., “Online Bagging and Boosting”, Systems, Man and Cybernetics, 2005 IEEE International Conference, v. 3, IEEE, 2005, 2340–2345 | DOI

[14] Abdulsalam H., Skillicorn D. B., Martin P., “Classification Using Streaming Random Forests”, IEEE Transactions on Knowledge and Data Engineering, 23:1 (2011), 22–36 | DOI

[15] Lakshminarayanan B., Roy D. M., Teh Yee Whye, “Mondrian Forests: Efficient Online Random Forests”, Advances in Neural Information Processing Systems, 2014, 3140–3148

[16] Kelly M. G., Hand D. J., Adams N. M., “The Impact of Changing Populations on Classifier Performance”, Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 1999, 367–371 | DOI

[17] Zhukov A., Kurbatsky V., Tomin N. et al., “Random Forest Based Model for Emergency State Monitoring in Power Systems”, Mathematical Method for Pattern Recognition, Book of Abstract of the 17th All-Russian Conference with Interneational Participation, Torus Press, Svetlogorsk, 2015, 274

[18] Scornet E., “Random Forests and Kernel Methods”, IEEE Transactions on Information Theory, 62:3 (2016), 1485–1500 | DOI | MR

[19] Blake C. L., Merz C. J., UCI Repository of Machine Learning Databases, 1998

[20] Brzezinski D., Mining Data Streams with Concept Drift, Diss. MS Thesis, Dept. of Computing Science and Management. Poznan University of Technology, 2010

[21] Brzezinski D., Stefanowski J., “Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm”, IEEE Transactions on Neural Networks and Learning Systems, 25:1 (2014), 81–94 | DOI | MR