HOPLANG: advancement of the monitoring data stream processing language
Numerical methods and programming, Tome 13 (2012) no. 3, pp. 126-131
Voir la notice de l'article provenant de la source Math-Net.Ru
The efficiency analysis of supercomputer applications is a very actual problem. The main aim of HOPSA project is the efficiency analysis using monitoring data. Because supercomputer applications are large, the amount of monitoring data is also very large. One of the most widespread tool for large data amounts is the pair formed Hadoop and PIG. Hadoop is a very famous toolkit for the distributed data processing and PIG is a language for creating requests to Hadoop. However, it was found that this pair is not suitable for HOPSA project aims. Any request is processed for a very long time because of long compiling, the data streams are not supported, very few databases are supported, and there is no support for database indices. Thus, a special language for huge monitoring data streams is required. We develop such a language named HopLang. Just now, HopLang can process real monitoring data. This paper describes the last half-year language advance and some future plans.
Keywords:
parallel processing; monitoring; supercomputing.
@article{VMP_2012_13_3_a20,
author = {A. V. Adinetz and P. A. Bryzgalov and Vad. V. Voevodin and S. A. Zhumatii and D. A. Nikitenko and K. S. Stefanov},
title = {HOPLANG: advancement of the monitoring data stream processing language},
journal = {Numerical methods and programming},
pages = {126--131},
publisher = {mathdoc},
volume = {13},
number = {3},
year = {2012},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/VMP_2012_13_3_a20/}
}
TY - JOUR AU - A. V. Adinetz AU - P. A. Bryzgalov AU - Vad. V. Voevodin AU - S. A. Zhumatii AU - D. A. Nikitenko AU - K. S. Stefanov TI - HOPLANG: advancement of the monitoring data stream processing language JO - Numerical methods and programming PY - 2012 SP - 126 EP - 131 VL - 13 IS - 3 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/VMP_2012_13_3_a20/ LA - ru ID - VMP_2012_13_3_a20 ER -
%0 Journal Article %A A. V. Adinetz %A P. A. Bryzgalov %A Vad. V. Voevodin %A S. A. Zhumatii %A D. A. Nikitenko %A K. S. Stefanov %T HOPLANG: advancement of the monitoring data stream processing language %J Numerical methods and programming %D 2012 %P 126-131 %V 13 %N 3 %I mathdoc %U http://geodesic.mathdoc.fr/item/VMP_2012_13_3_a20/ %G ru %F VMP_2012_13_3_a20
A. V. Adinetz; P. A. Bryzgalov; Vad. V. Voevodin; S. A. Zhumatii; D. A. Nikitenko; K. S. Stefanov. HOPLANG: advancement of the monitoring data stream processing language. Numerical methods and programming, Tome 13 (2012) no. 3, pp. 126-131. http://geodesic.mathdoc.fr/item/VMP_2012_13_3_a20/