The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Uncertainty-Aware Dynamic Fusion for Multimodal Clinical Prediction Tasks
Abstract
Multimodal fusion offers significant potential for enhancing medical diagnosis, particularly in the Intensive Care Unit (ICU), where integrating diverse data sources is crucial. Traditional static fusion models often fail to account for sample-wise variations in modality importance, which can impact prediction accuracy. To address this issue, we propose a dynamic Uncertainty-Aware Weighting (UAW) strategy that adaptively adjusts the importance of different modalities based on their reliability. This strategy is coupled with an Expert Ensemble Fusion (EEF) module, which leverages self-attention mechanisms and modality-specific FeedForward Networks (FFNs) to preserve and integrate critical information from various modalities. The proposed method demonstrates its efficacy through extensive experiments on phenotype classification and mortality prediction tasks, showing improved accuracy and robustness in handling diverse clinical data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In this review, only 6 studies addressed the issue of missing modalities [20,48,69,110–112].”
From Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review (2026) · cites this paper as [110]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-022-01899-x · Cited by 3,401 · cited 1×
“MIMIC-IV contains clinical time-series EHR data from ICU wards [21], and MIMIC-CXR contains Chest X-ray images.”
MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports
Johnson, A. E. W., Pollard, T. J., Berkowitz, S. J., Greenbaum, N. R., Lungren, M. P., Deng, C.-Y., Mark, R. G., & Horng, S. (2019) · Scientific Data · doi:10.1038/s41597-019-0322-0 · Cited by 1,816
Predicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084
Energy-based Out-of-distribution DetectionPreprint
Liu, W., Wang, X., Owens, J. D., & Li, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03759 · Cited by 744
Zhou, H.-Y., Yu, Y., Wang, C., Zhang, S., Gao, Y., Pan, J., Shao, J., Lu, G., Zhang, K., & Li, W. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01045-x · Cited by 343
MMTM: Multimodal Transfer Module for CNN Fusion
Joze, H. R. V., Shaban, A., Iuzzolino, M. L., & Koishida, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01330 · Cited by 337
Deep multimodal fusion of image and non-image data in disease diagnosis and prognosis: a review
Cui, C., Yang, H., Wang, Y., Zhao, S., Asad, Z., Coburn, L. A., Wilson, K. T., Landman, B. A., & Huo, Y. (2023) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/acc2fe · Cited by 256
Huang, S.-C., Pareek, A., Zamanian, R., Banerjee, I., & Lungren, M. P. (2020) · Scientific Reports · doi:10.1038/s41598-020-78888-w · Cited by 246
Multimodal Deep Learning for Prognosis Prediction in Renal Cancer
Schulz, S., Woerl, A.-C., Jungmann, F., Glasner, C., Stenzel, P., Strobl, S., Fernandez, A., Wagner, D., Haferkamp, A., Mildenberger, P., et al. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.788740 · Cited by 129
Yao, W., Yin, K., Cheung, W. K., Liu, J., & Qin, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29578 · Cited by 78
Duanmu, H., Huang, P., Brahmavar, S., Lin, S. K., Ren, T., Kong, J., Wang, F., & Duong, T. Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59713-9_24 · Cited by 76
Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transform
Pölsterl, S., Wolf, T. N., & Wachinger, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87240-3_66 · Cited by 68
Holste, G., Partridge, S. C., Rahbar, H., Biswas, D., Lee, C. I., & Alessio, A. M. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00368 · Cited by 64
Provable Dynamic Fusion for Low-Quality Multimodal DataPreprint
Zhang, Q., Wu, H., Zhang, C., Hu, Q., Fu, H., Zhou, J. T., & Peng, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.02050 · Cited by 53
Shao, J., Ma, J., Yu, Y., Zhang, S., Wang, W., Li, W., & Wang, C. (2024) · The Innovation · doi:10.1016/j.xinn.2024.100648 · Cited by 48
MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray imagesPreprint
Hayat, N., Geras, K. J., & Shamout, F. E. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.07027 · Cited by 41
MIRACLE: Causally-Aware Imputation via Learning Missing Data MechanismsPreprint
Kyono, T., Zhang, Y., Bellot, A., & van der Schaar, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03187 · Cited by 27
Self-citationChen, E., Kansal, A., Chen, J., Jin, B. T., Reisler, J., Kim, D. A., & Rajpurkar, P. (2023) · neural information processing systems · doi:10.52202/075280-1984 · Cited by 11
Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-trainingPreprint
Yang, J., Su, B., Zhao, W. X., & Wen, J.-R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.19654 · Cited by 1
Research works printed but not linked: 2
- Johnson, 2020, Mimic-iv, 49
- Tibshirani, 1993, An introduction to the bootstrap, Monographs on statistics and applied probability, 57, 1
Cited by
Sorted by citations
Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review
Yang, M., Shi, N., Chen, H., Po, E. Y. P., Ng, P. Y., Lai, P. C. K., Wu, Y.-C., & Fong, D. Y. T. (2026) · Health Data Science · doi:10.34133/hds.0356 · Cited by 3
“In this review, only 6 studies addressed the issue of missing modalities [ 20 , 48 , 69 , 110 – 112 ].”
Bakumenko, A., Hoelscher, J., Smith, D. H., Bakumenko, S., Masino, A. J., & Obeid, J. S. (2026) · Research Square · doi:10.21203/rs.3.rs-9217081/v1 · Cited by 1
Laboratory Test-Guided Medical Image Generation for Multi-Modal Disease Prediction
Xu, J., Lyu, F., Zhu, Y., & Yuen, P. C. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3660978
Deep learning for multivariate time series analysis in electronic health records: a scoping review
Hernandez-Diaz, C. A., Vázquez, B., & Fuentes-Pineda, G. (2026) · Evolutionary Intelligence · doi:10.1007/s12065-026-01246-8
Metadata
- Authors
- Guo, J., Cheng, Y., He, W., Zhang, Y., Feng, R., & Zhang, X.
- Affiliations
- Fudan University (CN)
- Venue
- ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2025-04-06
- Pages
- 1-5
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W4408345869
- Cited by
- 3
- References
- 23
- Citations by year
- 2026: 3
- FWCI
- 2.84
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Funders
- National Natural Science Foundation of China
- Science and Technology Commission of Shanghai Municipality
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- multimodal fusion, self-attention, intensive care unit, clinical prediction, mortality prediction, phenotype classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
