Geodesic
Architecture of a distributed computing system with tasks containerization and prioritization
Informacionnye tehnologii i vyčislitelnye sistemy, no. 4 (2023), pp. 5-18.

Voir la notice de l'article provenant de la source Math-Net.Ru

This article describes an architecture of a distributed system, which can speed up the process of obtaining results for such tasks. The system comprises a backend server, control service (supervisor), a set of worker nodes and a database. To abstract from particular languages and tools required for computational algorithms, these algorithms are executed in Docker containers. The system supports several strategies for tasks prioritization to operate efficiently under heavy load introduced by multiple users. To make use of the system, the user only needs to build a Docker image with an encapsulated algorithm, describe the input dataset in a JSON file and upload them via web interface. The system can be deployed in any public cloud. In this article, we provide a detailed description of the system architecture and numerical results obtained from computations on various clouds and local platforms. We show the influence of different prioritization strategies on the duration of computations under a moderate workload.
Keywords: parallel computing; container virtualization; cloud computing. 
@article{ITVS_2023_4_a1,
     author = {A. Sokolov and A. A. Larionov and V. M. Vishnevsky and A. A. Mukhtarov},
     title = {Architecture of a distributed computing system with tasks containerization and prioritization},
     journal = {Informacionnye tehnologii i vy\v{c}islitelnye sistemy},
     pages = {5--18},
     publisher = {mathdoc},
     number = {4},
     year = {2023},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/ITVS_2023_4_a1/}
}
TY  - JOUR
AU  - A. Sokolov
AU  - A. A. Larionov
AU  - V. M. Vishnevsky
AU  - A. A. Mukhtarov
TI  - Architecture of a distributed computing system with tasks containerization and prioritization
JO  - Informacionnye tehnologii i vyčislitelnye sistemy
PY  - 2023
SP  - 5
EP  - 18
IS  - 4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/ITVS_2023_4_a1/
LA  - ru
ID  - ITVS_2023_4_a1
ER  - 
%0 Journal Article
%A A. Sokolov
%A A. A. Larionov
%A V. M. Vishnevsky
%A A. A. Mukhtarov
%T Architecture of a distributed computing system with tasks containerization and prioritization
%J Informacionnye tehnologii i vyčislitelnye sistemy
%D 2023
%P 5-18
%N 4
%I mathdoc
%U http://geodesic.mathdoc.fr/item/ITVS_2023_4_a1/
%G ru
%F ITVS_2023_4_a1
A. Sokolov; A. A. Larionov; V. M. Vishnevsky; A. A. Mukhtarov. Architecture of a distributed computing system with tasks containerization and prioritization. Informacionnye tehnologii i vyčislitelnye sistemy, no. 4 (2023), pp. 5-18. http://geodesic.mathdoc.fr/item/ITVS_2023_4_a1/