The DOI matches its Crossref record; 79 of the 80 references it cites were found in a registry or an index.
Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing
Open accessAbstract
Self-supervised learning in vision-language processing (VLP) exploits semantic alignment between imaging and text modalities. Prior work in biomedical VLP has mostly relied on the alignment of single image and report pairs even though clinical notes commonly refer to prior images. This does not only introduce poor alignment between the modalities but also a missed opportunity to exploit rich self-supervision through existing temporal content in the data. In this work, we explicitly account for prior images and reports when available during both training and fine-tuning. Our approach, named BioViL-T, uses a CNN-Transformer hybrid multi-image encoder trained jointly with a text model. It is designed to be versatile to arising challenges such as pose variations and missing input images across time. The resulting model excels on downstream tasks both in single- and multi-image setups, achieving state-of-the-art (SOTA) performance on (I) progression classification, (II) phrase grounding, and (III) report generation, whilst offering consistent improvements on disease classification and sentence-similarity tasks. We release a novel multi-modal temporal benchmark dataset, MS-CXR-T, to quantify the quality of vision-language representations in terms of temporal semantics. Our experimental results show the advantages of incorporating prior images and reports to make most use of the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Comparison to previous imaging studies is crucial for tracking the development of disease or impact of treatment, and references to prior studies are frequent in radiology reporting. 16,17”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such references can be removed to reduce hallucinations when prior studies are not available, 9,14,18 or used in conjunction with prior images to enable descriptions of change.17,19,20”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [17]
The cited source says what the claim attributes to it.
In the citing paper
“Comparison to previous imaging studies is crucial for tracking the development of disease or impact of treatment, and references to prior studies are frequent in radiology reporting. 16,17”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [17]
The cited source says what the claim attributes to it.
In the citing paper
“It is not possible to quantitatively compare to models trained to generate other sections, such as Impression 17 or both Findings and Impression together.15,58”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [17]
The cited source says what the claim attributes to it.
In the citing paper
“It is not possible to quantitatively compare to models trained to generate other sections, such as Impression 17 or both Findings and Impression together.15,58”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [58]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Empirically, in the MIMIC-CXR dataset, when the Comparison section is equivalent to 'No comparison available', references to prior studies are rarely observed, in contrast to the background rate of 40% in the full MIMIC-CXR dataset.17”
From MAIRA-2: Grounded Radiology Report Generation (2024) · cites this paper as [17]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
Research works printed but not linked: 6
- brown, 2020, Language models are few-shot learners Advances in neural information processing systems, 33, 1877
- boecking, 2022, MS-CXR: Making the most of text semantics to improve biomedical vision-language processing (version 0.1), PhysioNet
- 2020, American College of Radiology (ACR), ACR practice guideline for communication of diagnostic imaging findings
- johnson, 2019, MIMIC-CXR database (version 2 0 0) PhysioNet
- wu, 2021, Chest imagenome dataset (version 1.0.0), PhysioNet
- endo, 2021, Retrieval-based chest x-ray report generation using a pre-trained contrastive language-image model, Machine Learning for Health, 209
Cited by
Sorted by citations
Advances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 557
Towards Generalist Biomedical AI
Tu, T., Azizi, S., Driess, D., Schaekermann, M., Amin, M., Chang, P.-C., Carroll, A., Lau, C., Tanno, R., Ktena, I., et al. (2024) · NEJM AI · doi:10.1056/aioa2300138 · Cited by 483
The current and future state of AI interpretation of medical images
Rajpurkar, P., & Lungren, M. P. (2023) · New England Journal of Medicine · doi:10.1056/nejmra2301725 · Cited by 443
Self-citationVision-language models for medical report generation and visual question answering: a review
Hartsock, I., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1430984 · Cited by 298
Collaboration between clinicians and vision–language models in radiology report generation
Tanno, R., Barrett, D. G. T., Sellergren, A., Ghaisas, S., Dathathri, S., See, A., Welbl, J., Lau, C., Tu, T., Azizi, S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03302-1 · Cited by 186
CLIP in medical imaging: A survey
Zhao, Z., Liu, Y., Wu, H., Wang, M., Li, Y., Wang, S., Teng, L., Liu, D., Cui, Z., Wang, Q., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103551 · Cited by 248
Multimodal generative AI for medical image interpretation
Rao, V. M., Hla, M., Moor, M., Adithan, S., Kwak, S., Topol, E. J., & Rajpurkar, P. (2025) · Nature · doi:10.1038/s41586-025-08675-y · Cited by 134
Multimodal Large Language Models in Medical Imaging: Current State and Future Directions
Nam, Y., Kim, D., Kyung, S., Seo, J., Song, J. M., Kwon, J., Kim, J., Jo, W., Park, H. J., Sung, J., et al. (2025) · Korean Journal of Radiology · doi:10.3348/kjr.2025.0599 · Cited by 106
Exploring scalable medical image encoders beyond text supervision
Pérez-García, F., Sharma, H., Bond-Taylor, S., Bouzid, K., Salvatelli, V., Ilse, M., Bannur, S., Castro, D. C., Schwaighofer, A., Lungren, M. P., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00965-w · Cited by 115
Self-citationAutomated Radiology Report Generation: A Review of Recent Advances
Sloan, P., Clatworthy, P. L., Simpson, E., & Mirmehdi, M. (2024) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2024.3408456 · Cited by 106
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82
Self-citationArtificial Intelligence in Cardiovascular Care—Part 2: Applications
Jain, S. S., Elias, P., Poterucha, T., Randazzo, M., Lopez Jimenez, F., Khera, R., Perez, M., Ouyang, D., Pirruccello, J., Salerno, M., et al. (2024) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2024.03.401 · Cited by 74
Has multimodal learning delivered universal intelligence in healthcare? A comprehensive survey
Lin, Q., Zhu, Y., Mei, X., Huang, L., Ma, J., He, K., Peng, Z., Cambria, E., & Feng, M. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102795 · Cited by 86
Reale-Nosei, G., Amador-Domínguez, E., & Serrano, E. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103264 · Cited by 72
Huang, W., Li, C., Zhou, H.-Y., Yang, H., Liu, J., Liang, Y., Zheng, H., Zhang, S., & Wang, S. (2024) · Nature Communications · doi:10.1038/s41467-024-51749-0 · Cited by 62
Semi-Supervised Medical Report Generation via Graph-Guided Hybrid Feature Consistency
Zhang, K., Jiang, H., Zhang, J., Huang, Q., Jianping Fan, B., Yu, J., & Han, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3273390 · Cited by 64
Medical multimodal multitask foundation model for lung cancer screening
Niu, C., Lyu, Q., Carothers, C. D., Kaviani, P., Tan, J., Yan, P., Kalra, M. K., Whitlow, C. T., & Wang, G. (2025) · Nature Communications · doi:10.1038/s41467-025-56822-w · Cited by 72
Buess, L., Keicher, M., Navab, N., Maier, A., & Arasteh, S. T. (2025) · Biomedical Engineering Letters · doi:10.1007/s13534-025-00497-1 · Cited by 79
BrainSegFounder: Towards 3D foundation models for neuroimage segmentation
Cox, J., Liu, P., Stolte, S. E., Yang, Y., Liu, K., See, K. B., Ju, H., & Fang, R. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103301 · Cited by 79
Efficiency and Quality of Generative AI–Assisted Radiograph Reporting
Huang, J., Wittbrodt, M. T., Teague, C. N., Karl, E., Galal, G., Thompson, M., Chapa, A. R., Chiu, M.-L., Herynk, B. A., Linchangco, R., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.13921 · Cited by 60
LongFormer: Longitudinal Transformer for Alzheimer’s Disease Classification with Structural MRIs
Chen, Q., Fu, Q., Bai, H., & Hong, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00354 · Cited by 52
MedBLIP: Bootstrapping Language-Image Pretraining from 3D Medical Images and Texts
Chen, Q., & Hong, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0908-6_6 · Cited by 80
Sellergren, A., Kazemzadeh, S., Jaroensri, T., Kiraly, A., Traverse, M., Kohlberger, T., Xu, S., Jamil, F., Hughes, C., Lau, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.05201 · Cited by 49
Sun, K., Xue, S., Sun, F., Sun, H., Luo, Y., Wang, L., Wang, S., Guo, N., Liu, L., Zhao, T., et al. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103265 · Cited by 69
Zambrano Chaves, J. M., Huang, S.-C., Xu, Y., Xu, H., Usuyama, N., Zhang, S., Wang, F., Xie, Y., Khademi, M., Yang, Z., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-58344-x · Cited by 45
“For synthetic reports without reference ground truths, we use a similarity comparison (cosine similarity) between the embeddings of corresponding CXR images and synthetic reports, as determined by BiomedCLIP-CXR and BioViL-T 68 .”
Self-citationToken-Mixer: Bind Image and Text in One Embedding Space for Medical Image Reporting
Yang, Y. Q., Yu, J., Fu, Z., Zhang, K., Yu, T., Wang, X., Jiang, H., Lv, J., Huang, Q., & Han, W. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3412402 · Cited by 45
Radiology and multi-scale data integration for precision oncology
Paverd, H., Zormpas-Petridis, K., Clayton, H., Burge, S., & Crispin-Ortuzar, M. (2024) · npj Precision Oncology · doi:10.1038/s41698-024-00656-0 · Cited by 41
A survey of deep-learning-based radiology report generation using multimodal inputs
Wang, X., Figueredo, G. P., Li, R., Zhang, W. E., Chen, W., & Chen, X. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103627 · Cited by 65
Ardic, N., & Dinc, R. (2025) · Health Informatics Journal · doi:10.1177/14604582251366141 · Cited by 32
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts
Chen, Z., Diao, S., Wang, B., Li, G., & Wan, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02139 · Cited by 34
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification
Lai, H., Yao, Q., Jiang, Z., Wang, R., He, Z., Tao, X., & Zhou, S. K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01059 · Cited by 42
A Comprehensive Study of GPT-4V’s Multimodal Capabilities in Medical ImagingPreprint
Li, Y., Liu, Y., Wang, Z., Liang, X., Liu, L., Wang, L., Cui, L., Tu, Z., Wang, L., & Zhou, L. (2023) · medRxiv · doi:10.1101/2023.11.03.23298067 · Cited by 28
Towards Generalist Biomedical AI
Tu, T., Azizi, S., Driess, D., Schaekermann, M., Amin, M., Chang, P.-C., Carroll, A., Lau, C., Tanno, R., Ktena, I., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.14334 · Cited by 483
Longitudinal data and a semantic similarity reward for chest X-ray report generation
Nicolson, A., Dowling, J., Anderson, D., & Koopman, B. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101585 · Cited by 36
Wu, J., He, K., Mao, R., Shang, X., & Cambria, E. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103283 · Cited by 29
Chest X-Ray Report Generation Using Abnormality Guided Vision Language Model
Edirisinghe, D., Nimalsiri, W., Hennayake, M., Meedeniya, D., & Lim, G. (2025) · IEEE Access · doi:10.1109/access.2025.3606961 · Cited by 28
A Comprehensive Review of Multimodal Large Language Models for Medical Imaging and Omics Data
Vavekanand, R. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10504-y · Cited by 29
Phan, V. M. H., Xie, Y., Qi, Y., Liu, L., Liu, L., Zhang, B., Liao, Z., Wu, Q., To, M., & Verjans, J. W. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01092 · Cited by 26
A comprehensive survey of AI agents in healthcare
Xu, G., Li, X., Chen, Y., Duan, Y., Wu, S., Yu, H., Chiu, C.-H., Ni, J., Tang, N., Li, T. J.-J., et al. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105045 · Cited by 41
A systematic evaluation of GPT-4V's multimodal capability for chest X-ray image analysis
Liu, Y., Li, Y., Wang, Z., Liang, X., Liu, L., Wang, L., Cui, L., Tu, Z., Wang, L., & Zhou, L. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100099 · Cited by 25
Park, S. J., Lee, E. S., Shin, K. S., Lee, J. E., & Ye, J. C. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103021 · Cited by 27
Exploring the Boundaries of GPT-4 in Radiology
Liu, Q., Hyland, S. L., Bannur, S., Bouzid, K., Castro, D. C., Wetscherek, M. T., Tinn, R., Sharma, H., Pérez‐García, F., Schwaighofer, A., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.891 · Cited by 42
Self-citationIntegrating language into medical visual recognition and reasoning: A survey
Lu, Y., & Wang, A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103514 · Cited by 32
Spatio-Temporal and Retrieval-Augmented Modeling for Chest X-Ray Report Generation
Yang, Y. Q., You, X., Zhang, K., Fu, Z., Wang, X., Ding, J., Sun, J., Zhou, Y., Huang, Q., Han, W., et al. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3554498 · Cited by 25
Gubbala, S. (2026) · Learning and analytics in intelligent systems · doi:10.1007/978-3-032-29501-9_39 · Cited by 20
Anatomical Structure-Guided Medical Vision-Language Pre-training
Li, Q., Yan, X., Xu, J., Yuan, R., Zhang, Y., Feng, R., Shen, Q., Zhang, X., & Wang, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72120-5_8 · Cited by 20
HERGen: Elevating Radiology Report Generation with Longitudinal Data
Wang, F., Du, S., & Yu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73001-6_11 · Cited by 33
EchoFM: Foundation Model for Generalizable Echocardiogram Analysis
Kim, S., Jin, P., Song, S., Chen, C., Li, Y., Ren, H., Li, X., Liu, T., & Li, Q. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3580713 · Cited by 35
RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning
Hou, W., Cheng, Y., Xu, K., Li, W., & Liu, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.140 · Cited by 27
Controllable Chest X-Ray Report Generation from Longitudinal Representations
Serra, F., Wang, C., Deligianni, F., Dalton, J., & O’Neil, A. Q. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.325 · Cited by 25
MAIRA-2: Grounded Radiology Report Generation
Bannur, S., Bouzid, K., Castro, D. C., Schwaighofer, A., Thieme, A., Bond-Taylor, S., Ilse, M., Pérez-García, F., Salvatelli, V., Sharma, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.04449 · Cited by 19
“MAIRA-2 is built with a similar architecture to MAIRA-1 (Hyland et al., 2023), based on the LLaVA framework (Liu et al., 2023b;a).”
BackgroundMethodResultInfluentialSelf-citationA Review of Non-Fully Supervised Deep Learning for Medical Image Segmentation
Zhang, X., Wang, J., Wei, J., Yuan, X., & Wu, M. (2025) · Information · doi:10.3390/info16060433 · Cited by 16
Automatic Medical Report Generation: Methods and Applications
Li, G., Tahir, A. M., Zhang, D., Wang, Z. J., & Ward, R. K. (2024) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.20240044 · Cited by 20
RadEdit: Stress-Testing Biomedical Vision Models via Diffusion Image Editing
Pérez‐García, F., Bond-Taylor, S., Sanchez, P. P., van Breugel, B., Castro, D. C., Sharma, H., Salvatelli, V., Wetscherek, M. T., Richardson, H., Lungren, M. P., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73254-6_21 · Cited by 19
Self-citationTowards Interpretable Radiology Report Generation via Concept Bottlenecks Using a Multi-agentic RAG
Alam, H., Srivastav, D., Kadir, M. A., & Sonntag, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88714-7_18 · Cited by 23
Angeloni, M., Rizzi, D., Schoen, S., Caputo, A., Merolla, F., Hartmann, A., Ferrazzi, F., & Fraggetta, F. (2025) · Genome Medicine · doi:10.1186/s13073-025-01484-y · Cited by 16
Medical multimodal large language models: A systematic review
Hu, Y., Xu, C., Lin, B., Yang, W., & Tang, Y. Y. (2025) · Intelligent Oncology · doi:10.1016/j.intonc.2025.09.005 · Cited by 14
A topic modeling‐based bibliometric exploration of automatic summarization research
Chen, X., Xie, H., Tao, X., Xu, L., Wang, J., Dai, H., & Wang, F. L. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1540 · Cited by 14
A Systematic Review and Implementation Guidelines of Multimodal Foundation Models in Medical ImagingPreprint
Huang, S.-C., Jensen, M., Yeung, S. Y., Lungren, M. P., Poon, H., & Chaudhari, A. S. (2025) · Research Square · doi:10.21203/rs.3.rs-5537908/v1 · Cited by 17
Self-citationLearning neuroimaging models from health system-scale data
Lyu, Y., Harake, E. S., Chowdury, A., Banerjee, S., Gologorsky, R., Liu, S., Meißner, A.-K., Rao, A., Zhao, C., Kondepudi, A., et al. (2026) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01608-0 · Cited by 16
Multimodal Foundation Models for Medical Imaging - A Systematic Review and Implementation GuidelinesPreprint
Huang, S.-C., Jensen, M., Yeung, S. Y., Lungren, M. P., Poon, H., & Chaudhari, A. S. (2024) · medRxiv · doi:10.1101/2024.10.23.24316003 · Cited by 15
Self-citationAI-Driven Digital Pathology: Deep Learning and Multimodal Integration for Precision Oncology
Jang, H., & Lee, S. H. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms27010379 · Cited by 13
ChEX: Interactive Localization and Region Description in Chest X-Rays
Müller, P., Kaissis, G. A., & Rueckert, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72664-4_6 · Cited by 19
Thieme, A., Rajamohan, A. M., Cooper, B., Groombridge, H., Simister, R. J., Wong, B., Woznitza, N., Pinnock, M. A., Wetscherek, M. T., Morrison, C. P., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3716500 · Cited by 12
Self-citationECAMP: Entity-centered Context-aware Medical Vision Language Pre-training
Wang, R., Yao, Q., Jiang, Z., Lai, H., He, Z., Tao, X., & Zhou, S. K. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103690 · Cited by 17
Enabling Multi-modal Conversational Interface for Clinical Imaging
Dayanandan, K., & Lall, B. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650805 · Cited by 9
Recent Advances in Medical Image Classification
Dao, L., & Ly, N. Q. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150727 · Cited by 14
Song, S., Tang, H., Yang, H., & Li, X. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3591364 · Cited by 13
Foundation Models Meet Medical Image Interpretation
Jiao, L., Hao, J., Li, R., Li, L., Liu, X., Liu, F., Ma, W., Chen, P., Huang, Z., Yang, J., et al. (2026) · Research · doi:10.34133/research.1024 · Cited by 12
Vavekanand, R., & Kumar, T. (2026) · Signal Image and Video Processing · doi:10.1007/s11760-026-05214-8 · Cited by 9
Al-Jebrni, A. H., Jiang, Z., Qin, Y., Qiu, Y., Jiang, N., Li, G., Zheng, Y., Wong, T. Y., Kim, S., Jung, Y., et al. (2026) · Computational Visual Media · doi:10.26599/cvm.2026.9450530 · Cited by 9
MAGDA: Multi-agent Guideline-Driven Diagnostic Assistance
Bani-Harouni, D., Navab, N., & Keicher, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73471-7_17 · Cited by 10
Medical Report Generation via Multimodal Spatio-Temporal Fusion
Mei, X., Mao, R., Cai, X., Yang, L., & Cambria, E. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681377 · Cited by 8
Li, Y., Kong, C., Zhao, G., & Zhao, Z. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11337-0 · Cited by 7
Multimodal transformers for joint diagnosis and retrieval from chest X-rays and radiology reports
Jahanian, M., Karimi, A., Eraghi, N. O., & Zarafshan, F. (2025) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2025.101672 · Cited by 7
Kim, H., Karaman, B. K., Zhao, Q., Wang, A. Q., Sabuncu, M. R., Initiative, A. D. N., Weiner, M. W., Aisen, P. S. S., Petersen, R. C., Jack, C. R., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2411492122 · Cited by 8
Artificial Intelligence in Pathology: Advancing Large Models for Scalable Applications
Xiao, Z., Feng, B., Yang, J., Sun, G., Shen, Y., Xu, S., Yang, L., Xu, H., Zhang, M., & Wang, S. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095814 · Cited by 9
Clothing Purification with Causality Meets Vision-Language Pretraining Models
Yang, Z., Zhu, H., Lei, N., Fernando, B., & Wang, Z. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02548-7 · Cited by 8
NeoCLIP: a self-supervised foundation model for the interpretation of neonatal radiographs
Huang, Y., Sharma, P. K., Palepu, A. K., Greenbaum, N. R., Beam, A. L., & Beam, K. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01922-6 · Cited by 7
Intelligent analysis of chest X-ray based on multi-modal instruction tuning
Yao, J., Wang, J., Xiao, Z., Hao, X., & Jiang, X. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100172 · Cited by 7
Generative AI and foundation models in medical image
Oda, M. (2025) · Radiological Physics and Technology · doi:10.1007/s12194-025-00968-1 · Cited by 7
Systematic Literature Review on Medical Image Captioning Using CNN-LSTM and Transformer-Based Models
Fadhilah, H., & Utama, N. P. (2025) · JURNAL MASYARAKAT INFORMATIKA · doi:10.14710/jmasif.16.1.73127 · Cited by 9
Islam, K., Paul, R., Wang, S., Zhao, Y., Adhikary, P. P., Li, Q., Qin, X., & Liu, Y. (2025) · Microsystems & Nanoengineering · doi:10.1038/s41378-025-00874-x · Cited by 6
Medical Large Vision Language Models with Multi-image Visual Ability
Yang, X., Miao, J., Yuan, Y., Wang, J., Dou, Q., Li, J., & Heng, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04971-1_38 · Cited by 6
Phenotyping of Histology Imaging Data with Histomics
Neha, F., Bhati, D., & Shukla, D. K. (2026) · AI · doi:10.3390/ai7060228 · Cited by 5
MemControl: Mitigating Memorization in Diffusion Models via Automated Parameter Selection
Dutt, R., Bohdal, O., Sanchez, P. P., Tsaftaris, S. A., & Hospedales, T. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00441 · Cited by 8
Lu, Z., Xu, N., Tian, H., Wang, L., & Liu, A.-A. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3602970 · Cited by 5
Yang, Z., & Shen, L. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00454 · Cited by 4
Yan, J., Gu, X., & Chen, Y. (2025) · Remote Sensing · doi:10.3390/rs17142481 · Cited by 6
Ren, G., Hou, M., Yang, X., Huang, Y., Li, D., Zhang, N., Liu, P., Ye, H., Chen, Z., & Chen, H. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02044-9 · Cited by 4
Helmy, H., Hosseini, A., Ibrahim, A., Mirza, A. B., Sadek, A., & Serag, A. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2626117 · Cited by 4
Automated Spinal MRI Labelling from Reports Using a Large Language Model
Park, R. Y., Windsor, R., Jamaludin, A., & Zisserman, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72086-4_10 · Cited by 4
Chen, K., Kuo, M., Lee, C., Liao, H.-C., Tsai, D., Lin, S.-A., Hsiang, C.-W., Chang, C.-K., Ko, K., Hsu, Y., et al. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02263-3 · Cited by 4
Application of Vision-Language Models for Assessing Osteoarthritis
Felfeliyan, B., Zhou, Y., Ghosh, S., Küpper, J., Liu, S., Hareendranathan, A. R., & Jaremko, J. L. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635386 · Cited by 4
Unified Medical Image Pre-training in Language-Guided Common Semantic Space
He, X., Yang, Y., Jiang, X., Luo, X., Hu, H. R., Zhao, S., Li, D., Yang, Y., & Qiu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73004-7_8 · Cited by 5
Scaling Chest X-Ray Foundation Models From Mixed Supervisions for Dense Prediction
Wang, F., & Yu, L. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3589928 · Cited by 5
Generative AI for developing foundation models in radiology and imaging: engineering perspectives
Lee, J., Kyung, S., & Kim, N. (2025) · Biomedical Engineering Letters · doi:10.1007/s13534-025-00517-0 · Cited by 3
Noh, W.-J., Pi, S.-W., & Lee, B.-D. (2026) · Scientific Reports · doi:10.1038/s41598-025-34799-2 · Cited by 5
Kulsoom, U., Glavin, F. G., & Bendechache, M. (2025) · IEEE Access · doi:10.1109/access.2025.3582728 · Cited by 5
MM-CLIP:Multi-granularity Mammography CLIP for Breast Cancer Diagnosis
Wei, H., & Fan, H. (2025) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1145/3725988.3726002 · Cited by 3
Metadata
- Authors
- Bannur, S., Hyland, S., Liu, Q., Pérez-García, F., Ilse, M., Castro, D. C., Boecking, B., Sharma, H., Bouzid, K., Thieme, A., Schwaighofer, A., Wetscherek, M., Lungren, M. P., Nori, A., Alvarez-Valle, J., & Oktay, O.
- Affiliations
- Microsoft (United States) (US)
- Microsoft Health Futures
- ORCID
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 15016-15027
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386075916
- Cited by
- 227
- References
- 80
- Citations by year
- 2026: 93 · 2025: 85 · 2024: 40 · 2023: 9
- FWCI
- 24.28
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- temporal structure, self-supervised learning, clinical reports, phrase grounding, report generation, chest radiography
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
