Geodesic
Classification of multimodal lung disease data based on late fusion of modalities
Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 13 (2024) no. 1, pp. 74-86

Voir la notice de l'article provenant de la source Math-Net.Ru

With the development of technology, high-quality X-rays have become available for the diagnosis of lung diseases with the help of radiologists. However, the diagnostic process takes a lot of time and depends on the availability of specialists in a medical institution. At the same time, patient information may include not only chest X-rays of different quality, but also the results of medical tests, doctor's notes and prescriptions, information about taking medications, and others. In this study, we propose a model for the classification of pulmonary diseases based on multimodal data on clinical studies of patients and radiographic images. When preparing the data, we used various methods of generating artificial samples for both images and tabular data on the results of laboratory studies. We have proposed a method for establishing a correspondence for generated samples between modals. The proposed multimodal model has a late fusion architecture. We conducted experiments on datasets with one modality and two modalities. Our model showed accuracy 5.5% higher than models based on single-modality (91.3% vs. 86.11% on a dataset of 1,156 patients).
Mots-clés : multimodal data, late fusion.
Keywords: lung diseases, deep learning 
@article{VYURV_2024_13_1_a4,
     author = {O. N. Ivanova and S. Kumar and M. L. Zymbler and E. V. Ivanova},
     title = {Classification of multimodal lung disease data based on late fusion of modalities},
     journal = {Vestnik \^U\v{z}no-Uralʹskogo gosudarstvennogo universiteta. Seri\^a Vy\v{c}islitelʹna\^a matematika i informatika},
     pages = {74--86},
     publisher = {mathdoc},
     volume = {13},
     number = {1},
     year = {2024},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/VYURV_2024_13_1_a4/}
}
TY  - JOUR
AU  - O. N. Ivanova
AU  - S. Kumar
AU  - M. L. Zymbler
AU  - E. V. Ivanova
TI  - Classification of multimodal lung disease data based on late fusion of modalities
JO  - Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika
PY  - 2024
SP  - 74
EP  - 86
VL  - 13
IS  - 1
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/VYURV_2024_13_1_a4/
LA  - ru
ID  - VYURV_2024_13_1_a4
ER  - 
%0 Journal Article
%A O. N. Ivanova
%A S. Kumar
%A M. L. Zymbler
%A E. V. Ivanova
%T Classification of multimodal lung disease data based on late fusion of modalities
%J Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika
%D 2024
%P 74-86
%V 13
%N 1
%I mathdoc
%U http://geodesic.mathdoc.fr/item/VYURV_2024_13_1_a4/
%G ru
%F VYURV_2024_13_1_a4
O. N. Ivanova; S. Kumar; M. L. Zymbler; E. V. Ivanova. Classification of multimodal lung disease data based on late fusion of modalities. Vestnik Ûžno-Uralʹskogo gosudarstvennogo universiteta. Seriâ Vyčislitelʹnaâ matematika i informatika, Tome 13 (2024) no. 1, pp. 74-86. http://geodesic.mathdoc.fr/item/VYURV_2024_13_1_a4/