Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators
Numerical methods and programming, Tome 14 (2013) no. 4, pp. 122-134.

Voir la notice de l'article provenant de la source Math-Net.Ru

An optimization of communications within multi-level parallelization based on a combination of MPI, OpenMP and OpenCL is proposed to fit all kinds of modern supercomputer architectures including hybrid systems with GPU and Intel Xeon Phi accelerators. A general-purpose scheduler that simplifies a heterogeneous implementation is discussed. The scheduler controls queues of computing and communication OpenCL tasks. It uses an interdependency graph of a target computing algorithm as input. The use of the scheduler is demonstrated on an example of a finite-volume CFD algorithm for unstructured meshes. In particular, the scheduler has been used to simplify an implementation of an overlapped communication scheme. The implementation of the CFD algorithm with MPI and CPU-GPU communications overlapped with computations is described and its parallel efficiency is demonstrated.
Keywords: gas dynamics, scheduler, parallel computing, GPU, OpenCL, MPI.
@article{VMP_2013_14_4_a16,
     author = {P. B. Bogdanov and A. A. Efremov and A. V. Gorobets and S. A. Sukov},
     title = {Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators},
     journal = {Numerical methods and programming},
     pages = {122--134},
     publisher = {mathdoc},
     volume = {14},
     number = {4},
     year = {2013},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VMP_2013_14_4_a16/}
}
TY  - JOUR
AU  - P. B. Bogdanov
AU  - A. A. Efremov
AU  - A. V. Gorobets
AU  - S. A. Sukov
TI  - Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators
JO  - Numerical methods and programming
PY  - 2013
SP  - 122
EP  - 134
VL  - 14
IS  - 4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/VMP_2013_14_4_a16/
LA  - ru
ID  - VMP_2013_14_4_a16
ER  - 
%0 Journal Article
%A P. B. Bogdanov
%A A. A. Efremov
%A A. V. Gorobets
%A S. A. Sukov
%T Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators
%J Numerical methods and programming
%D 2013
%P 122-134
%V 14
%N 4
%I mathdoc
%U http://geodesic.mathdoc.fr/item/VMP_2013_14_4_a16/
%G ru
%F VMP_2013_14_4_a16
P. B. Bogdanov; A. A. Efremov; A. V. Gorobets; S. A. Sukov. Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators. Numerical methods and programming, Tome 14 (2013) no. 4, pp. 122-134. http://geodesic.mathdoc.fr/item/VMP_2013_14_4_a16/