Job Digest: an approach to dynamic analysis of job characteristics on supercomputers
Numerical methods and programming, Tome 13 (2012) no. 4, pp. 160-166
Voir la notice de l'article provenant de la source Math-Net.Ru
With the scale of supercomputing systems and applications growing fast, the difficulty of developing performance efficient applications also grows rapidly. The reason for this is an extensive number of factors that potentially influence the application performance. Hardware and software specifics of the supercomputer, peculiarities of the application, interference of jobs running simultaneously – everything needs to be taken into account when trying to achieve high performance. With supercomputers constantly evolving, all these specifics become more and more complicated. This indicates the demand for a specific tool that would allow seeing where and, what is more important, why does the performance loss happen. In this paper we give an overview of the developed toolkit and discuss in detail one of the approaches aimed at studying the application behavior during the job run. This approach studies the dynamic characteristics of jobs that are gathered by monitoring tools. Its aim is to provide system administrators and users with overall job characteristics in order to get both overall and detailed analysis of every separate job run. This approach and the generated detailed report have been named “Job Digest”.
Keywords:
supercomputer, performance, efficiency study, monitoring, parallel computing, dynamic job characteristics, high performance computing.
@article{VMP_2012_13_4_a13,
author = {A. V. Adinetz and P. A. Bryzgalov and Vad. V. Voevodin and S. A. Zhumatii and D. A. Nikitenko and K. S. Stefanov},
title = {Job {Digest:} an approach to dynamic analysis of job characteristics on supercomputers},
journal = {Numerical methods and programming},
pages = {160--166},
publisher = {mathdoc},
volume = {13},
number = {4},
year = {2012},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/VMP_2012_13_4_a13/}
}
TY - JOUR AU - A. V. Adinetz AU - P. A. Bryzgalov AU - Vad. V. Voevodin AU - S. A. Zhumatii AU - D. A. Nikitenko AU - K. S. Stefanov TI - Job Digest: an approach to dynamic analysis of job characteristics on supercomputers JO - Numerical methods and programming PY - 2012 SP - 160 EP - 166 VL - 13 IS - 4 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/VMP_2012_13_4_a13/ LA - ru ID - VMP_2012_13_4_a13 ER -
%0 Journal Article %A A. V. Adinetz %A P. A. Bryzgalov %A Vad. V. Voevodin %A S. A. Zhumatii %A D. A. Nikitenko %A K. S. Stefanov %T Job Digest: an approach to dynamic analysis of job characteristics on supercomputers %J Numerical methods and programming %D 2012 %P 160-166 %V 13 %N 4 %I mathdoc %U http://geodesic.mathdoc.fr/item/VMP_2012_13_4_a13/ %G ru %F VMP_2012_13_4_a13
A. V. Adinetz; P. A. Bryzgalov; Vad. V. Voevodin; S. A. Zhumatii; D. A. Nikitenko; K. S. Stefanov. Job Digest: an approach to dynamic analysis of job characteristics on supercomputers. Numerical methods and programming, Tome 13 (2012) no. 4, pp. 160-166. http://geodesic.mathdoc.fr/item/VMP_2012_13_4_a13/