A Multimodal Biomedical Foundation Model Trained from Fifteen Million Image–Text Pairs

Zhang, Sheng, Xu, Yanbo, Usuyama, Naoto, Xu, Hanwen, Bagga, Jaspreet, Tinn, Robert, Preston, Sam, Rao, Rajesh +16 more·2025·NEJM AI

Cited by (283)

Items 201–283 of 283

  1. Attention-based Multiple Instance Learning for Classification of Inflammatory Activity in Crohn’s Disease Patients from MR Enterography
    Seohyun Hwang, H.S. Lee, Nieun Seo, Joon Seok Lim, Helen Hong · 2026 · Journal of the Korea Computer Graphics Society
  2. Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting
    Yijie Hong, Xiaofei Yin, Xinzhong Wang, Ya Guo, Huijia Zhu, Sufeng Duan · 2026 · International Conference on Multimedia Retrieval
  3. An expert-level vision-language model for multitask diagnostic morphology in clinical laboratories
    Han Liu, Yuhan Zhu, Shunbo Li, Qinli Pu, Liping Yang, Weixian Chen, Juan Hu · 2026 · npj Digital Medicine
  4. ST2HE: enhancing spatial transcriptomics interpretability via virtual staining for histological annotation
    Zhentao Liu, Arun Das, Wen Meng, Yu‐Chiao Chiu, Shou‐Jiang Gao, Yufei Huang · 2026 · Briefings in Bioinformatics
  5. Task-Aware Multimodal Large Language Models for Distributed Acoustic Sensing–Based Seismic Monitoring
    Honglin Guo, Zimeng Zhao, Chao Li, Yuting Su, Huayong Yang, Weizhi Nie · 2026 · IEEE Transactions on Multimedia
  6. Evo-RAD: Navigating Rare Retinal Disease Diagnosis via Self-evolving Agentic Retrieval
    Wangding Xia, Ye Du, Jiashi Lin, Meng Wang, Danli Shi, Shujun Wang · 2026 · Lecture notes in computer science
  7. BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming
    Jiaxiang Liu, Hu T, Juwei Guan, Yujie Wu, Yusong Wang, Yao Mu, Zuozhu Liu, Mingkun Xu · 2026 · Lecture notes in computer science
  8. Academia and industry in the age of artificial intelligence: a narrative review
    Elmer Victor Bernstam, Todd R. Johnson, Fares Alahdab · 2026 · BMJ Digital Health & AI
  9. CytoCLIP: Learning Cytoarchitectural Characteristics in Developing Human Brain Using Contrastive Language Image Pre-Training
    Pralaypati Ta, Sriram Venkatesaperumal, Keerthi Ram, Mohanasankar Sivaprakasam · 2026 · Neuroinformatics
  10. Encoding Versus Linear Use of Patient Characteristics in Chest X-Ray Foundation Models on MIMIC-CXR
    Y I Kim, Yangwon Kim, Yoojin Nam, NamJoon Kim, Pa Hong · 2026 · Diagnostics
  11. CheX-DFuseNet-X: Explainable Dynamic CNN-ViT Fusion for Multi-Label Chest X-Ray Classification
    Dilakshan Chandrasena, Pushpika Liyanaarachchi · 2026 · IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE)
  12. Rethinking Medical VQA Models: Towards Data-Efficient Learning
    Shuning He, Da Ren, Haiwei Pan, Kejia Zhang, Qing Li · 2026 · Computational Visual Media
  13. Edge-Guided ControlNet Synthetic Chest X-ray Augmentation and Ensemble Classification
    Negar Abbasi, Nada Y. Philip, Tariq Rahim · 2026 · International Conference on Communications
  14. Fusion Direction Matters: Alignment-Adaptive Cross-Modal Fusion for Medical Image Segmentation
    Zihao Guo, Haoyu Yang, Hongyan Yin, Jiaming Xu · 2026 · Lecture notes in computer science
  15. Application of deep learning in prognostic prediction of non-small cell lung cancer
    Xiaoqi Lun · 2026 · Frontiers in Cell and Developmental Biology
  16. CLEAR: an auditable foundation model for radiology grounded in clinical concepts
    Tianyu Han, Riga Wu, Yu Tian, Firas Khader, Lisa C. Adams, Keno K. Bressem, Christos A. Davatzikos, Jakob Nikolas Kather, Li Shen, David A. Mankoff et al. · 2026 · Nature Biomedical Engineering
  17. Chest-X-ray based deep feature-driven framework for anemia detection insights from a large hospital cohort
    Hao-Chun Liao, Dung‐Jang Tsai, Shan‐Yueh Chang, Chin Lin, Shih-Hua Lin, Wen‐Hui Fang · 2026 · BioData Mining
  18. Meta-Cobi: A Metadata-Augmented Vision-Language Framework for Multi-view Canine Body Condition Scoring
    Jae-Eon Ahn, Ju-Won Seo, Kang-Min Kim, O‐Joun Lee · 2026 · Communications in computer and information science
  19. Causal gradient intervention for debiased and evidence-grounded medical visual question answering
    Bing Liu, Ziyuan Yang, Lijun Liu, Jiaman Ding, Wei Peng · 2026 · Medical Image Analysis
  20. Towards a unified foundation model for medical imaging
    Kai Jin, Andrzej E. Grzybowski · 2026 · The Lancet Digital Health
  21. Text-prompted foundation-model segmentation of intrapartum fetal ultrasound: a controlled methodological study with F-TPA-SAM2
    杨之源, Qinghua Meng, Bentao Jiang, Dongren Liu, Jing Qiu · 2026 · Frontiers in Medicine
  22. DRGCD: A graph-structured and language-guided diffusion model for Diabetic Retinopathy classification
    Yu Chen, TingBo Bao, Jun Long, Liu Yang · 2026 · Biomedical Signal Processing and Control
  23. Generation of chest CT pulmonary nodule images by latent diffusion models using the LIDC-IDRI dataset
    Kaito Urata, Maiko Nagao, Atsushi Teramoto, Kazuyoshi Imaizumi, Masashi Kondo, Hiroshi Fujita · 2026 · International Journal of Computer Assisted Radiology and Surgery
  24. REFLEX-Med: Reinforcement with Label-Free Explainability for Unified Medical Reasoning
    Luyao Tang, Zheyuan Cai, Qinong Tian, Zi Li, Quande Liu, Kyongtae Tyler Bae, Cheng Chen · 2026 · Multidimensional Signal Processing Workshop
  25. Text Conditioned Implicit Visual Chain-of-Reasoning for Unsupervised 3D Medical Image Registration
    Muhammad Zafar Iqbal, Anwaar Ulhaq, Srimannarayana Grandhi, Zafar Saeed · 2026 · Lecture notes in computer science
  26. A clinical multimodal vision language foundation model with fine-grain explainability
    Yang Bai, Haoran Cheng, Yang Zhou, Jun Zhou, Arun James Thirunavukarasu, Yuhe Ke, Jie Yao, Kanae Fukutsu, Chrystie Wan Ning Quek, Ashley Shuen Ying Hong et al. · 2026 · Nature Medicine
  27. MedLoRA: Low-Rank Few-Shot Adaptation of Vision-Language Models for Medical Images
    Bingyuan Bai, Tzu‐Ching Shih, Kazunori Miyata · 2026 · Communications in computer and information science
  28. Single-share local semantic tampering in a HiNet-assisted Shamir secret image sharing workflow under a privileged insider threat: Reconstruction integrity risk analysis
    Chang-Kun Liu, Hong-Mei Yang, Bin Yan, Ya-Dong Liu, Yu-Hao Song · 2026 · Journal of Information Security and Applications
  29. MMDC-CLIP-F: Vision-language multi-view mammogram density classification with uncertainty assessment
    Jacob Schaffer, Wandong Zhang, Tianqi Ni, Yimin Yang, Ameya Madhav Kulkarni, Ashirbani Saha · 2026 · Neurocomputing
  30. Benchmarking Foundation Models for Pulmonary Embolism Diagnosis and Prognosis to Reveal Demographic Disparities
    Milan Mohan, Saketh Lingisetty, Umar Ahmad, Avi Kumar, Shankar Harikrishnan, Sanjana Chamarty, Kiran Nijjer, Adnan Ahmed · 2026 · Lecture notes in computer science
  31. Output Steering for Latent Diffusion-Based MRI-to-CT Synthesis
    Efe Özdilek, Fuat Arslan, Boran İsmet Macun, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
  32. Rotational Post-Training Quantization for Biomedical Vision-Language Models
    Parsa Yousefinezhad, Efe Özdilek, Aykut Koç, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
  33. Few-Shot Spatial Adaptation in Medical Vision-Language Models
    M. Arda Aydın, Furkan Genç, Efe Özdilek, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
  34. CT Image Reconstruction with Vision Mamba
    Bilal Kabaş, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
  35. Multimodal Document Classification Across Domains and Methods: A Systematic Review
    Hosam Lafi Aljuhani, Mohamed Yehia Dahab, Yousef S. Alsenani · 2026 · Engineering Technology & Applied Science Research
  36. Time-Aware Semantic Prototypes for Weakly-Supervised Endomicroscopy Video Classification
    Ilán Carretero, Pablo Meseguer, Irene Zammarchi, C L Pugliano, Giovanni Santacroce, Bisi Bode Kolawole, Ujwala Bhangale Chaudhari, Rocío del Amor, Enrico Grisan, Marietta Iacucci et al. · 2026 · Proceedings - International Conference on Image Processing
  37. BiomedQSD: Enhancing Few-Shot Adaptation in Biomedical Images Classification
    Weihong Zhu, Rongsheng Xie · 2026 · International Conference on Computer Vision, Image and Deep Learning (CVIDL)
  38. TC3-VLM: A Vision–Language Model for Tactical Combat Casualty Care
    Junseob Kim, Jade Chng, Ayman Ali, Victor M. Moas, Sunil Hwang, Rishikesan Kamaleswaran · 2026 · IEEE Access
  39. Multi-instance multi-label learning: Theory, taxonomy, and modern methods—A critical survey
    Syed Umaid Ahmed, Muhammad Atif Tahir, Muhammad Waqas Sheikh · 2026 · Neurocomputing
  40. Real-time detection of High-Risk Laryngeal Lesions using Laryngoscopic Image-Based AI-Assisted Triage: A Comparative Study of Multiple Vision Foundation Models
    Junyi Wang, Tianjian Zhang, Xing Huang, Ying Wang, Sisi Zhang, Yu Zhou, Yunrong Ti, Xu Yingpeng, Chuanyao Lin, Xiaoyun Qian · 2026 · Research Square
  41. Artificial Intelligence in Neuromuscular Diseases: Opportunities for a Data-Scarce Field
    Shang Ma, Sushan Luo, Huahua Zhong · 2026 · Neurology and Therapy
  42. Fair fine-tuning of medical vision-language models via learned textual embedding of sensitive attributes
    Xiangyu Sun, Xiaoguang Zou, Yuanquan Wu, Shaoting Zhang, Guotai Wang · 2026 · Pattern Recognition
  43. AI for Opportunistic Identification of BMD and Bone Microarchitecture: A Narrative Review
    Katharina Ziegeler, Sharmila Majumdar · 2026 · Calcified Tissue International
  44. Vision Systems for Safety-Critical and High-Risk Domains
    Khalil Omar, Hussam Nawwaf Fakhouri, Faten Fatehi Hamad · 2026 · Advances in computational intelligence and robotics book series
  45. Trustworthy medical concept recalibration through logic-aware multimodal evidence fusion
    Lei Zhao, Chunzheng Zhu, Zhan Gao, Pengchen Liang, Xiaoyun Liang, Alex Chit-Yuen Cheng, Chi‐Man Pun · 2026 · Information Fusion
  46. Unified Transformer with cross-attention and conditional TransMix for lung infection severity assessment from CT and X-ray
    Bouthaina Slika, Fadi Dornaika, Fares Bougourzi, Karim Hammoudi · 2026 · Biomedical Signal Processing and Control
  47. GridVQA-X: A Diagnostic Framework for Evaluating Multimodal Explainability Methods
    Sujay Belsare, Sudarshan Nikhil, Sushant Kumar, Ponnurangam Kumaraguru, Chirag Agarwal · 2026 · Lecture notes in computer science
  48. PhenoLIP: Phenotype Guided Medical Vision–Language Pretraining
    Cheng Liang, Chaoyi Wu, Weike Zhao, Ya Zhang, Yanfeng Wang, Weidi Xie · 2026 · Lecture notes in computer science
  49. Clinical-Inspired Multi-view Retrieval with Spatial Residual Attention and Concept-Driven Explainability in Medical Images
    Nguyen Tu, Pham Nguyen Hai Long, Vo Hoai Viet · 2026 · Communications in computer and information science
  50. Selection of complete few-shot support sets through matched local estimation and provenance-balanced weighting
    Lingjia Zhang, Tong Liu · 2026 · SSRN Electronic Journal
  51. Large Language Model Benchmarks in Medical Tasks
    Lawrence K.Q. Yan, Qian Niu, Ming Li, Yichao Zhang, Caitlyn Heqi Yin, Cheng Fei, Benji Peng, Ziqian Bi, Pohsun Feng, Keyu Chen et al. · 2026 · Medicine Advances
  52. Reasoning-aware multimodal retrieval-augmented generation for evidence-grounded clinical decision support
    Bao T. Nguyen, Hung Viet Pham, Thien Khai Tran, Son Vu Truong Dao · 2026 · Intelligence-Based Medicine
  53. Interpretable Medical Image Diagnosis via VLM-Based Concept Alignment and Graph Reasoning
    Yilan Hu, Haoyu Xie, Dan Liang, Xinhua Wei, Hui Zhou, Hong Zhou, Bingsheng Huang · 2026 · Lecture notes in computer science
  54. ECG-CoCa: Physiology-Informed Contrastive and Generative Framework for ECG Interpretation
    Xinyue Liu, Yiming Lei, Shiwei Li, Zhiyi Zhu, Zhenghui Hu, Qingjie Liu · 2026 · Lecture notes in computer science
  55. Preoperative Simulation of Personalized Breast Reconstruction via Implant Prior Controllable Diffusion
    Yizhi Wang, Tianze Yu, Hengjie Yu, Maoling Liu, Wenxuan Pan, Zhongxiang Ding, Peifen Fu, Yaochu Jin · 2026 · Lecture notes in computer science
  56. Spatiotemporal Modeling of Longitudinal MRI with Causal Graph Reasoning for Breast Cancer pCR Prediction
    Haiwei Lin, Bin Huang, Meng Wang, Ya Ren, Zhou Liu, Bingsheng Huang · 2026 · Lecture notes in computer science
  57. Fibers of Asymmetric Similarity: A Framework for Clinical and Imaging Data
    Johanna P. Müller, Matthew Baugh, Robert Wright, Thomas George Day, Reza Razavi, Bernhard Kainz · 2026 · Lecture notes in computer science
  58. A Multi-Backbone Pipeline Combining Biomedical Foundation Models and CNNs for Explainable Triage of Cutaneous Ulcers
    Alessio Luschi, Linda Tognetti, Gabriele Cevenini, Pietro Rubegni, Ernesto Iadanza · 2026 · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany
  59. A Versatile Prompt-Driven Framework for Brain Segmentation, Parcellation, and Surface Reconstruction from Diverse Modalities
    Zifeng Lian, Jiameng Liu, Shui Cao, Zhichao Liang, Feng Shi, Dinggang G. Shen · 2026 · Lecture notes in computer science
  60. Beyond text: quantifying the impact of figure-guided retrieval in biomedical RAG systems
    R J Venkatesh, Sudhakaran Gajendran, C. U. Om Kumar · 2026 · Frontiers in Artificial Intelligence
  61. Advances in Multimodal Artificial Intelligence in Radiology: Data Integration, Foundation Models, and Clinical Applications—A Narrative Review
    Ghada Alfattni · 2026 · Healthcare
  62. Separating Ranking Signal, Incremental Feature Value, and Evaluation-Induced Optimism in Breast MRI Treatment-Effect Analysis: Foundation Model and Radiomic Representations
    Hisashi Nakano, Takehiro Shiinoki · 2026 · Journal of Imaging Informatics in Medicine
  63. AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $$\alpha $$-Corrected Binary Cross Entropy and Factorized Latent Supervision
    Jianzhong You, Yuan Gao, Chris McIntosh · 2026 · Lecture notes in computer science
  64. AI-driven quality enhancement of medical datasets: a closed-loop framework of synthesis, annotation, quality control, and integration
    Tao Tian, Siyuan Zhang, Xuchen Yang, Rui Shi · 2026 · Frontiers in Medicine
  65. Fetal Ultrasound Plane Classification with FetalCLIP Embeddings and Linear Classifiers
    Kristina Ćaleta, Ana Brkić, Nenad Veček, Mihaela Vranić, Jelena Božek · 2026 · International Symposium ELMAR (ELMAR)
  66. Bridging the Spatial Blind Spot in Pathology Foundation Models for Tumor Localization
    Guoshuai Xu, Kai Zhang · 2026 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  67. Benchmarking the Gap Between Multimodal Generalized and Domain-Specific Models in Identifying Malaria from Blood Test Imagery
    Demetrius Howard Setiawan, Stanley Dirk Nente, Ivan Sebastian Edbert, Samson Ndruru · 2026 · International Conference on ICT for Smart Society (ICISS)
  68. Hierarchical diffusion-guided consistency learning framework for knee anterior cruciate ligament classification
    Hancang Mi, Hong‐Seng Gan, Hengjie Ma, Özgür TOSUN, Atakan Bayır, Özge Ertem, Kazım Ayberk Sinci, İlker Özgür Koska, Muhammad Hanif Ramlee · 2026 · Biomedical Signal Processing and Control
  69. Generative Vision-Language Multiple Instance Learning for Weakly Supervised Neonatal Fundus Screening and Reporting
    Xiao Zhang, Guangshuang Tan, Jie Hu, Shichao Kan, Bing Jiang, Yixiong Liang · 2026
  70. Trajectory-Based Robustness Characterization for Medical Vision-Language Models Using Perturbation Response Curves
    Iksan Bukhori, Mahda Laina Arnumukti, Kok Beng Gan, Kok Swee Sim · 2026 · IEEE International Conference on Signal and Image Processing Applications (ICSIPA)
  71. A Two-Branch Hybrid Model for Imbalanced Lumbar Disc Grading and Zero-Shot Label Extension
    Trung Kien Ha, Trong Nhan Phan · 2026 · Lecture notes in computer science
  72. Foundation Models and Multimodal Learning for Medical Data with Applications in Oncology
    Asim Waqas, Aakash Tripathi, Siddharth Sivaram, Farzana Ali, Shiba Kuanar, Yashbir Singh, Hanieh Ajami, Orhan Ünal, Yuankai Huo, Abdussalam Elhanashi et al. · 2026 · Journal of Imaging Informatics in Medicine
  73. Concept-Enhanced Hypergraph-Guided Medical Image Retrieval Using CUI Semantics
    Muhammad Saad, Md. Hasan Emam, Md. Ibrahim Sani, Sifat Momen · 2026 · IEEE Access
  74. Robust Prediction-Reliability Assessment in Biomedical Sensing and Classification Under Data Scarcity Using Conformal Prediction and Statistical Randomization
    Yu-Qi Zhou, Xiang-Hao Zhan · 2026 · Italian National Conference on Sensors
  75. LiteMedRAG: Selective Retrieval-Augmented Compact Medical Visual Question Answering
    Daniel Ayo Oladele, Malusi Sibiya · 2026 · Lecture notes in computer science
  76. MIRAGE: Modality-Aware 3D Vision-Language Model for Liver Lesion Diagnosis in MRI via Volumetric-Text Alignment
    Haowen Zhu, Jingyang Zhang, Chunfeng Yang · 2026 · International Joint Conference on Neural Networks (IJCNN)
  77. Class-Conditional Center Alignment for Robust Vision–Language Contrastive Learning in Glaucoma Screening
    Xiaoyu Liu, Qi Wang · 2026 · International Joint Conference on Neural Networks (IJCNN)
  78. Multimodal artificial intelligence for vascular aging: toward proactive detection and management
    Ziyun Wang, Yiwen Dai, Chenxi Li, Yujian Hu, Zhengyao Ding, Zhengxing Huang, Ting Chen · 2026 · The Journal of Cardiovascular Aging
  79. Report-Calibrated Concept Bottleneck Learning for Interpretable High-Grade Pattern Diagnosis
    Yabin Li, Yin Luo, Minghui Wang, Ao Li · 2026 · International Conference on Artificial Intelligence Technologies and Applications (ICAITA)
  80. Vision–language foundation models for multimodal medical image understanding and report generation: a narrative review with quantitative synthesis
    Shahid Mehmood, Farman Matloob Khan, Abeer A. K. Alharbi, Abdul Khader Jilani Saudagar, Mona Alkhattabi, Muhammad Adnan Khan, Muhammad Amir Khan · 2026 · Frontiers in Medicine
  81. Domain-Specific Encoders Don’t Always Win: Parameter-Efficient Adaptation of Compact VLMs to Medical Imaging
    Matheus Mattioli, Jurandy Almeida · 2026 · Lecture notes in computer science
  82. Blank-Image Ablations Can Mislead: A Mismatched-Image Control for Visual-Requirement Audits in Medical-VQA—Evidence from ERA-TurkMed, A Turkish Generative System
    Esra Balık, Mehmet Kaya · 2026 · Journal of Imaging Informatics in Medicine
  83. EAR-Med: Evidence-Anchored Reinforcement Learning for Visual Reasoning in Medical Multimodal Large Language Models
    Xinchong Wang · 2026