Applying clustering analysis for discovering time series heterogeneity using Saint Petersburg morbidity rate as an illustration

V. M. Bure ; K. Yu. Staroverova

Vestnik Sankt-Peterburgskogo universiteta. Prikladnaâ matematika, informatika, processy upravleniâ, no. 4 (2016), pp. 44-50

Résumé

One of the machine learning approaches for unsupervised learning is clustering. Clustering has the task of exploring the structure of data with the aim of assigning a set of objects in such a way that objects belonging to the same group are more similar to each other than the objects drawn from different groups. Determining the number of clusters in a data set, searching for stable clusters, selection of dissimilarity measure and algorithm are significant tasks of cluster analysis. Multidimentional clustering is often used when an object is characterized by a vector. A dissimilarity measure or distance is selected with respect to the purpose and features of a certain task. But there are also such fields as economics, geology, medicine, sociology that are often presented by time series. Time series are random processes but not a random vector. That is why it is important to construct such a similarity (or dissimilarity) measure which would take into consideration that data are time-dependent. The research of morbidity rate of Saint Petersburg from 1999 to 2014 years and clustering of 18 districts are conducted. Several different similarity measures are used for clustering. Besides, an interesting aspect is clustering of multidimentional time series. There are two approaches. The first concept is to split multidimentional time series into several univariate time series, whilst the second one is to consider it as a whole unit that preserves the influence of data interdependence. Research is made with application of TSclust, tseries packages in R and missed algorithms are realised there. As a result of clustering of Saint Petersburg districts applying several similarity measures three stable clusters are found out but seven districts do not belong to any cluster. Refs 10. Figs 2.

Détail

Keywords: cluster analysis, clustering, time series similarity measure, stable clusters.

Bibliographie

[1] Lozkins A., Bure V. M., “The probabilistic method of finding the local-optimum of clustering”, Vestnik of Saint Petersburg University. Series 10. Applied mathematics. Computer science. Control processes, 2016, no. 1, 28–38 (In Russian)

[2] Aldenderfer M. S., Blashfield R. K., Cluster analysis. Cluster, factor, discriminant function analysis, ed. I. S. Enukov, Finansi i statistica Publ., M., 1989, 215 pp. (In Russian)

[3] Dmitriev A. P., Zubriyanova N. S., “Statistical research of dinamics of morbidity rate of Penza Region population”, University proceedings. Volga region. Medical sciences, 2008, no. 2, 89–98 (In Russian)

[4] Staroverova K. U., “Research of behavior of Saint Petersburg morbidity rate”, Scientific research results, Proceedings of the Intern. scientific and research conference, Aeterna Publ., Tyumen, 2016, 11–14 (In Russian)

[5] Staroverova K. U., “Time series clustering in R”, Control processes and stability, 3:1 (2016), 317–323 (In Russian)

[6] Montero P., Vilar J., “TSclust: An R package for time series clustering”, Journal of Statistical Software, 62:1 (2015), 1–43

[7] Douzal Chouakria A., Nagabhushan P. N., “Adaptive dissimilarity index for measuring time series proximity”, Advances in Data Analysis and Classification, 1:1 (2007), 1–43 | DOI | MR

[8] Yang K., Shahabi C., “A PCA-based similarity measure for multivariate time series”, MMDB'04 Proceedings of the 2nd ACM Intern. workshop on Multimedia databases, 2004, 65–74 | DOI

[9] Li S. J., Zhu Y. L., Zhang X. H., Wan D., “BORDA counting method based similarity analysis of multivariate hydrological time series”, Journal of Hydraulic Engineering, 40:3 (2009), 378–384

[10] Wang J., Zhu Y., Li S., Wang D., Zhang P., “Multivariate time series similarity searching”, The Scientific World Journal, 2014 (2014), 851017, 8 pp.