Geodesic
Finding the presence of borrowings in scientific works based on Markov chains
Vestnik Sankt-Peterburgskogo universiteta. Prikladnaâ matematika, informatika, processy upravleniâ, Tome 19 (2023) no. 1, pp. 43-50

Voir la notice de l'article provenant de la source Math-Net.Ru

The study aims to develop optimal approaches to the search for borrowings in scientific works. The article discusses the stages of searching for the presence of borrowings, such as preprocessing, rough filtering of texts, searching for similar texts, and searching for borrowings. The main focus is on the description of approaches and techniques that can be effectively implemented at each stage. For example, for the preprocessing stage, it may be converting text characters from uppercase to lowercase, removing punctuation marks, and removing stop words. For the stage of rough text filtering, it is filters by topic and word frequency. It may be calculating the importance of words in the context of the text and representing the word as a vector in multidimensional space to determine the proximity measure for the stage of finding similar texts. Finally, it is a search for an exact match, paraphrases and a measure of similarity of expressions for the stage of finding borrowings. The scientific novelty lies in using Markov chains to find the similarity of texts for the second and third stages of the search for borrowings proposed by authors. As a result, the example shows the technique of using Markov chains for text representation, searching for the most frequently occurring words, building a graph of a Markov chain of words, and the prospects for using Markov chains of texts for rough filtering and searching for similar texts.
Keywords: search for borrowings, algorithms for finding borrowings, originality checker software.
Mots-clés : Markov chains 
@article{VSPUI_2023_19_1_a3,
     author = {R. R. Saakyan and I. A. Shpekht and G. A. Petrosyan},
     title = {Finding the presence of borrowings in scientific works based on {Markov} chains},
     journal = {Vestnik Sankt-Peterburgskogo universiteta. Prikladna\^a matematika, informatika, processy upravleni\^a},
     pages = {43--50},
     publisher = {mathdoc},
     volume = {19},
     number = {1},
     year = {2023},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VSPUI_2023_19_1_a3/}
}
TY  - JOUR
AU  - R. R. Saakyan
AU  - I. A. Shpekht
AU  - G. A. Petrosyan
TI  - Finding the presence of borrowings in scientific works based on Markov chains
JO  - Vestnik Sankt-Peterburgskogo universiteta. Prikladnaâ matematika, informatika, processy upravleniâ
PY  - 2023
SP  - 43
EP  - 50
VL  - 19
IS  - 1
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/VSPUI_2023_19_1_a3/
LA  - ru
ID  - VSPUI_2023_19_1_a3
ER  - 
%0 Journal Article
%A R. R. Saakyan
%A I. A. Shpekht
%A G. A. Petrosyan
%T Finding the presence of borrowings in scientific works based on Markov chains
%J Vestnik Sankt-Peterburgskogo universiteta. Prikladnaâ matematika, informatika, processy upravleniâ
%D 2023
%P 43-50
%V 19
%N 1
%I mathdoc
%U http://geodesic.mathdoc.fr/item/VSPUI_2023_19_1_a3/
%G ru
%F VSPUI_2023_19_1_a3
R. R. Saakyan; I. A. Shpekht; G. A. Petrosyan. Finding the presence of borrowings in scientific works based on Markov chains. Vestnik Sankt-Peterburgskogo universiteta. Prikladnaâ matematika, informatika, processy upravleniâ, Tome 19 (2023) no. 1, pp. 43-50. http://geodesic.mathdoc.fr/item/VSPUI_2023_19_1_a3/