Geodesic
A Distributed Dictionary --- Based Morphological Analysis Framework for Russian Language Processing
Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie, no. 13 (2012), pp. 119-127

Voir la notice de l'article provenant de la source Math-Net.Ru

This article describes an approach to scaling service morphological parsing of words of natural language processing of various collections of documents in Russian. An overview and critical analysis of existing solutions. The requirements workbench vocabulary morphological analyzer were established. The distributed architecture of the web service morphological analysis, designed to a handle large collections of documents in Russian, presented the form of a structural model. This architecture is implemented as a prototype system in the programming language Ruby. The structure used in the morphological dictionary of a relational schema. Tests of this method in a distributed computing environment showed linear scalability of the proposed solutions. The configuration of the experiment involves the generation of the system load as a HTTP requests, system load balancing working nodes of a distributed system, application servers with a functioning database analyzer and morphological dictionary, as well as a caching node to reduce costs when you run queries to the dictionary. Applying this approach provides a linear increase in performance in distributed systems, automated processing of large volumes of text.
Keywords: distributed computing, natural language processing, corpus linguistics, data-intensive computing, morphological analysis. 
@article{VYURU_2012_13_a11,
     author = {D. A. Ustalov and M. L. Goldstein},
     title = {A {Distributed} {Dictionary} --- {Based} {Morphological} {Analysis} {Framework} for {Russian} {Language} {Processing}},
     journal = {Vestnik \^U\v{z}no-Uralʹskogo gosudarstvennogo universiteta. Seri\^a, Matemati\v{c}eskoe modelirovanie i programmirovanie},
     pages = {119--127},
     publisher = {mathdoc},
     number = {13},
     year = {2012},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VYURU_2012_13_a11/}
}
TY  - JOUR
AU  - D. A. Ustalov
AU  - M. L. Goldstein
TI  - A Distributed Dictionary --- Based Morphological Analysis Framework for Russian Language Processing
JO  - Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie
PY  - 2012
SP  - 119
EP  - 127
IS  - 13
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/VYURU_2012_13_a11/
LA  - ru
ID  - VYURU_2012_13_a11
ER  - 
%0 Journal Article
%A D. A. Ustalov
%A M. L. Goldstein
%T A Distributed Dictionary --- Based Morphological Analysis Framework for Russian Language Processing
%J Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie
%D 2012
%P 119-127
%N 13
%I mathdoc
%U http://geodesic.mathdoc.fr/item/VYURU_2012_13_a11/
%G ru
%F VYURU_2012_13_a11
D. A. Ustalov; M. L. Goldstein. A Distributed Dictionary --- Based Morphological Analysis Framework for Russian Language Processing. Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ, Matematičeskoe modelirovanie i programmirovanie, no. 13 (2012), pp. 119-127. http://geodesic.mathdoc.fr/item/VYURU_2012_13_a11/