Geodesic
Classification of russian texts by genres based on modern embeddings and rhythm
Modelirovanie i analiz informacionnyh sistem, Tome 29 (2022) no. 4, pp. 334-347

Voir la notice de l'article provenant de la source Math-Net.Ru

The article investigates modern vector text models for solving the problem of genre classification of Russian-language texts. Models include ELMo embeddings, BERT language model with pre-training and a complex of numerical rhythm features based on lexico-grammatical features. The experiments were carried out on a corpus of 10,000 texts in five genres: novels, scientific articles, reviews, posts from the social network Vkontakte, news from OpenCorpora. Visualization and analysis of statistics for rhythm features made it possible to identify both the most diverse genres in terms of rhythm: novels and reviews, and the least ones: scientific articles. Subsequently, these genres were classified best with the help of rhythm features and the neural network-classifier LSTM. Clustering and classifying texts by genre using ELMo and BERT embeddings made it possible to separate one genre from another with a small number of errors. The multiclassification F-score reached 99%. The study confirms the efficiency of modern embeddings in the tasks of computational linguistics, and also allows to highlight the advantages and limitations of the complex of rhythm features on the material of genre classification.
Keywords: stylometry, natural language processing, rhythm features, ELMo.
Mots-clés : genres, text classification, BERT 
@article{MAIS_2022_29_4_a2,
     author = {K. V. Lagutina},
     title = {Classification of russian texts by genres based on modern embeddings and rhythm},
     journal = {Modelirovanie i analiz informacionnyh sistem},
     pages = {334--347},
     publisher = {mathdoc},
     volume = {29},
     number = {4},
     year = {2022},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/MAIS_2022_29_4_a2/}
}
TY  - JOUR
AU  - K. V. Lagutina
TI  - Classification of russian texts by genres based on modern embeddings and rhythm
JO  - Modelirovanie i analiz informacionnyh sistem
PY  - 2022
SP  - 334
EP  - 347
VL  - 29
IS  - 4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/MAIS_2022_29_4_a2/
LA  - ru
ID  - MAIS_2022_29_4_a2
ER  - 
%0 Journal Article
%A K. V. Lagutina
%T Classification of russian texts by genres based on modern embeddings and rhythm
%J Modelirovanie i analiz informacionnyh sistem
%D 2022
%P 334-347
%V 29
%N 4
%I mathdoc
%U http://geodesic.mathdoc.fr/item/MAIS_2022_29_4_a2/
%G ru
%F MAIS_2022_29_4_a2
K. V. Lagutina. Classification of russian texts by genres based on modern embeddings and rhythm. Modelirovanie i analiz informacionnyh sistem, Tome 29 (2022) no. 4, pp. 334-347. http://geodesic.mathdoc.fr/item/MAIS_2022_29_4_a2/