Efficient submission of hybrid parallel tasks in grid
Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 2 (2013) no. 3, pp. 32-47 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice de l'article

The method of efficient submission of hybrid tasks using both MPI and OpenMP technologies is considered. For flexible control of parameters of the parallel tasks submission to supercomputers (SC), the specification of the task description language was expanded. Support of the new attributes was implemented for all key components of the infrastructure. Interaction of the submission web service with a local resource manager is organized through special handlers for tasks of different types (single, openmp, mpi or hybrid). This provides transmission of the correct parameters for reservation of resources and task submission to the local SC-manager. The provided solution was tested on a grid testbed deployed on the basis of GridNNN middleware.
Keywords: parallel computing; distributed computing; grid; hybrid tasks.
@article{VYURV_2013_2_3_a1,
     author = {A. P. Kryukov and M. M. Stepanova and N. V. Prikhodko and L. V. Shamardin and A. P. Demichev},
     title = {Efficient submission of hybrid parallel tasks in grid},
     journal = {Vestnik \^U\v{z}no-Uralʹskogo gosudarstvennogo universiteta. Seri\^a Vy\v{c}islitelʹna\^a matematika i informatika},
     pages = {32--47},
     year = {2013},
     volume = {2},
     number = {3},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VYURV_2013_2_3_a1/}
}
TY  - JOUR
AU  - A. P. Kryukov
AU  - M. M. Stepanova
AU  - N. V. Prikhodko
AU  - L. V. Shamardin
AU  - A. P. Demichev
TI  - Efficient submission of hybrid parallel tasks in grid
JO  - Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika
PY  - 2013
SP  - 32
EP  - 47
VL  - 2
IS  - 3
UR  - http://geodesic.mathdoc.fr/item/VYURV_2013_2_3_a1/
LA  - ru
ID  - VYURV_2013_2_3_a1
ER  - 
%0 Journal Article
%A A. P. Kryukov
%A M. M. Stepanova
%A N. V. Prikhodko
%A L. V. Shamardin
%A A. P. Demichev
%T Efficient submission of hybrid parallel tasks in grid
%J Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika
%D 2013
%P 32-47
%V 2
%N 3
%U http://geodesic.mathdoc.fr/item/VYURV_2013_2_3_a1/
%G ru
%F VYURV_2013_2_3_a1
A. P. Kryukov; M. M. Stepanova; N. V. Prikhodko; L. V. Shamardin; A. P. Demichev. Efficient submission of hybrid parallel tasks in grid. Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 2 (2013) no. 3, pp. 32-47. http://geodesic.mathdoc.fr/item/VYURV_2013_2_3_a1/

[1] M. M. Stepanova, O. L. Stesik, “Running Parallel Jobs on the Grid”, Distributed Computing and Grid Technologies in Science and Education: Proceedings of 5th International Conference (Dubna, 16-21 July, 2012), JINR, Dubna, 2012, 383–387

[2] V. A. Ilyin, V. V. Korenkov, A. P. Kryukov, “GridNNN: Status and the Perspectives”, Distributed Computing and Grid-Technologies in Science and Education: Proceedings of the 5th International.Conference (Dubna, 16-21 July, 2012), Dubna, JINR, 2012, 332–336

[3] S. Burke, S. Campana, E. Lanciotti, et al., gLite 3.2 User Guide., Manual Series. CERN-LCG-GDEIS-722398, 2012 } {\tt http://edms.cern.ch/document/722398

[4] MPI-Start } {\tt http://grid.ifca.es/wiki/Middleware/MpiStart

[5] Extended Resource Specification Language, Reference Manual for ARC versions 0.8 and above. 2013 } {\tt .../arc-ui.pdf

[6] MPI: A Message-Passing Interface Standard. Version 2.2. } {\tt http://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf

[7] OpenMP Application Program Interface. Version 3.1. } {\tt http://www.openmp.org/mp-documents/OpenMP3.1.pdf

[8] I. Makris, Mixed Mode Programming on Clustered SMP Systems, M.Sc. Thesis in High Performance Computing, The University of Edinburgh, 2005, 108 pp.

[9] R. Rabenseifner, G. Hager, G. Jost, “Hybrid MPI/OpenMP parallel programming on clusters of multi-core SMP nodes”, Proceedings of 17th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (Nov.), 2009, 427–236

[10] A. Rane, D. Stanzione, “Experiences in tuning performance of hybrid MPI/OpenMP applications on quad-core systems”, Proceedings of 10th LCI International Conference on High-Performance Clustered Computing (Jan), 2009, 1–10

[11] E. A. Glazkova, N. N. Popova, “The Analysis of Efficiency of Hybrid Parallel Programming on the Example of the System BLUE GENE/P”, Proccedings of the All-Russia Scientific Conference “Scientific Service in the Internet” (Novorossiisk, Russia, September, 21–26, 2009), Moscow University Publishing, Moscow, 2009, 36–39

[12] P. Balaji, MPI Forum Hybrid Programming Working Group } {\tt http://meetings.mpi-forum.org/mpi3.0 hybrid.php

[13] A. P. Kryukov, A. P. Demichev, V. A. Ilyin, L. V. Shamardin, “Basic approaches to creation of grid-infrastructure of national nanotechnological network”, Computing Technologies in Natural Sciences. Perspective computer systems: devices, methods and concepts: Seminar works (Tarusa, 24.03.2011), Publishing of ICR RAS, Moscow, 2011, 51–68

[14] A. P. Demichev, V. A. Ilyin, A. P. Kryukov, L. V. Shamardin, “Implementation of the program interface of the Pilot grid-service on the basis of architectural style REST”, Numerical methods and programming. Advanced Computing, 11 (2010), 62–65