OpenMP + MPI parallel implementation of a numerical method for solving a kinetic equation

V. A. Titarev   ; S. V. Utyuzhnikov   ; A. V. Chikitkin

Žurnal vyčislitelʹnoj matematiki i matematičeskoj fiziki, Tome 56 (2016) no. 11, pp. 1949-1959

Résumé

A two-level OpenMP + MPI parallel implementation is used to numerically solve a model kinetic equation for problems with complex three-dimensional geometry. The scalability and robustness of the method are demonstrated by computing the classical gas flow through a circular pipe of finite length and the flow past a reentry vehicle model. It is shown that the two-level model significantly speeds up the computations and improves the scalability of the method.

Bibliographie

[1] Titarev V. A., “Neyavnyi chislennyi metod rascheta prostranstvennykh techenii razrezhennogo gaza na nestrukturirovannykh setkakh”, Zh. vychisl. matem. i matem. fiz., 50:10 (2010), 1811–1826 | MR | Zbl

[2] Titarev V. A., “Efficient deterministic modelling of three-dimensional rarefied gas flows”, Commun. Comput. Phys., 12:1 (2012), 161–192 | DOI | MR

[3] Dumbser M., Titarev B. A., Utyuzhnikov S. V., “Neyavnyi mnogoblochnyi metod resheniya kineticheskogo uravneniya na nestrukturirovannykh setkakh”, Zh. vychisl. matem. i matem. fiz., 53:5 (2013), 767–782 | DOI | MR | Zbl

[4] Titarev V. A., Dumbser M., Utyuzhnikov S. V., “Construction and comparison of parallel implicit kinetic solvers in three spatial dimensions”, J. Comput. Phys., 256 (2014), 17–33 | DOI | MR

[5] Abalakin I. V., Bakhvalov P. A., Gorobets A. V., Duben' A. P., Kozubskaya T. K., “Parallelnyi programmnyi kompleks NOISETTE dlya krupnomasshtabnykh raschetov zadach aerodinamiki i aeroakustiki”, Vych. met. i programmirovanie, 13:3 (2012), 110–125 | MR

[6] Gorobets A. V., “Parallelnaya tekhnologiya chislennogo modelirovaniya zadach gazovoi dinamiki algoritmami povyshennoi tochnosti”, Zh. vychis. matem. i matem. fiz., 4:55 (2015), 641–652 | DOI | MR | Zbl

[7] Shakhov E. M., “Ob obobschenii relaksatsionnogo kineticheskogo uravneniya Kruka”, Izv. AN SSSR. Mekhan. zhidk. i gaza, 1968, no. 5, 142–145 | MR

[8] Titarev V. A., “Programmnyi kompleks Nesvetai-ZD modelirovaniya prostranstvennykh techenii odnoatomnogo razrezhennogo gaza”, Nauka i obrazovanie. MGTU im. N. E. Baumana. Elekt. zh., 2014, no. 6, 124–154 | MR | Zbl

[9] Titarev V. A., “Conservative numerical methods for model kinetic equations”, Computers and Fluids, 36:9 (2007), 1446–1459 | DOI | MR | Zbl

[10] Mieussens L., “Discrete-velocity models and numerical schemes for the Boltzmann-BGK equation in plane and axisymmetric geometries”, J. Comput. Phys., 162:2 (2000), 429–466 | DOI | MR | Zbl

[11] Gusarov A. V., Smurov I., “Gas-dynamic boundary conditions of evaporation and condensation: numerical analysis of the Knudsen layer”, Phys. Fluids, 14:12 (2002), 4242–4255 | DOI | MR

[12] Men'shov I. S., Nakamura Y., “An implicit advection upwind splitting scheme for hypersonic air flows in thermochemical nonequilibrium”, A Collection of Technical Papers of 6th Int. Symp. on CFD (Lake Tahoe, Nevada, 1995), v. 2, 815

[13] Gropp W., Lusk E., Skjellum A., Using MPI: Portable parallel programming with the message-passing interface, Second edition, The MIT Press, 1999

[14] Dumbser M., Kaser M., Titarev V. A., Togo E. F., “Quadrature-free non-oscillatory finite volume schemes on unstructured meshes for nonlinear hyperbolic systems”, J. Comput. Phys., 226 (2007), 204–243 | DOI | MR | Zbl

[15] Kolobov V. I., Arslanbekov R. R., Aristov V. V., Frolova A. A., Zabelok S. A., “Unified solver for rarefied and continuum flows with adaptive mesh and algorithm refinement”, J. Comput. Phys., 223 (2007), 589–608 | DOI | Zbl

[16] Chorley M. J., Walker D. W., “Performance analysis of a hybrid MPI/OpenMP application on multi-core clusters”, J. Comput. Sci., 47 (2010), 168–174 | DOI

[17] Gorobets A. V., Zheleznyakov A. O., Sukov S. A., Bogdanov P. V., Chetverushkin B. N., “Rasshirenie dvukhurovnevogo rasparallelivaniya MPI + OpenMP posredstvom OpenCL dlya gazodinamicheskikh raschetov na geterogennykh sistemakh”, Vestn. YuUrGU. Ser. Matem. modelirovanie i programmirovanie, 2011, no. 9, 76–86

[18] Sharipov F., “Benchmark problems in rarefied gas dynamics”, Vacuum, 86:11, Special Is. “Vacuum Gas Dynamics: Theory, experiments and practical applications” (2012), 1697–1700 | DOI

[19] Karypis G., Kumar V., “Multilevel k-way partitioning scheme for irregular graphs”, J. Parallel Distrib. Comput., 48 (1998), 96–129 | DOI | MR

[20] Kaporin I. E., Milyukova O. Yu., “Massivno-parallelnyi algoritm predobuslovlennogo metoda sopryazhennykh gradientov dlya chislennogo resheniya sistem lineinykh algebraicheskikh uravnenii”, Sb. trudov otdela problem prikladnoi optimizatsii VTs RAN, ed. V. G. Zhadan, Izd-vo VTs RAN, M., 2011, 132–157

[21] Vaganov A. V., Drozdov S. M., Kosykh A. P., Nersesov G. G., Chelysheva I. F., Yumashev V. L., “Chislennoe modelirovanie aerodinamiki krylatogo vozvraschaemogo kosmicheskogo apparata”, Uchenye zapiski TsAGI, XL:2 (2009), 3–15 | MR | Zbl

[22] Arslanbekov R. R., Kolobov V. I., Frolova A. A., “Kinetic solvers with adaptive mesh in phase space”, Physical Review E, 88 (2013), 063301 | DOI

[23] Baranger C., Claudel J., Herouard N., Mieussens L., “Locally refined discrete velocity grids for stationary rarefied flow simulations”, J. Comput. Phys., 257 (2014), 572–593 | DOI | MR

[24] Garanzha V. A., Kudryavtseva L. N., Utyuzhnikov S. V., “Variational method for untangling and optimization of spatial meshes”, J. Comp. and Appl. Math., 269 (2014), 24–41 | DOI | MR | Zbl