A Multimodal Biomedical Foundation Model Trained from Fifteen Million Image–Text Pairs
Zhang, Sheng, Xu, Yanbo, Usuyama, Naoto, Xu, Hanwen, Bagga, Jaspreet, Tinn, Robert, Preston, Sam, Rao, Rajesh +16 more·2025·NEJM AI
Cited by (283)
Items 201–283 of 283
- Attention-based Multiple Instance Learning for Classification of Inflammatory Activity in Crohn’s Disease Patients from MR EnterographySeohyun Hwang, H.S. Lee, Nieun Seo, Joon Seok Lim, Helen Hong · 2026 · Journal of the Korea Computer Graphics Society
- Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic ForgettingYijie Hong, Xiaofei Yin, Xinzhong Wang, Ya Guo, Huijia Zhu, Sufeng Duan · 2026 · International Conference on Multimedia Retrieval
- An expert-level vision-language model for multitask diagnostic morphology in clinical laboratoriesHan Liu, Yuhan Zhu, Shunbo Li, Qinli Pu, Liping Yang, Weixian Chen, Juan Hu · 2026 · npj Digital Medicine
- ST2HE: enhancing spatial transcriptomics interpretability via virtual staining for histological annotationZhentao Liu, Arun Das, Wen Meng, Yu‐Chiao Chiu, Shou‐Jiang Gao, Yufei Huang · 2026 · Briefings in Bioinformatics
- Task-Aware Multimodal Large Language Models for Distributed Acoustic Sensing–Based Seismic MonitoringHonglin Guo, Zimeng Zhao, Chao Li, Yuting Su, Huayong Yang, Weizhi Nie · 2026 · IEEE Transactions on Multimedia
- Evo-RAD: Navigating Rare Retinal Disease Diagnosis via Self-evolving Agentic RetrievalWangding Xia, Ye Du, Jiashi Lin, Meng Wang, Danli Shi, Shujun Wang · 2026 · Lecture notes in computer science
- BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual ReprogrammingJiaxiang Liu, Hu T, Juwei Guan, Yujie Wu, Yusong Wang, Yao Mu, Zuozhu Liu, Mingkun Xu · 2026 · Lecture notes in computer science
- Academia and industry in the age of artificial intelligence: a narrative reviewElmer Victor Bernstam, Todd R. Johnson, Fares Alahdab · 2026 · BMJ Digital Health & AI
- CytoCLIP: Learning Cytoarchitectural Characteristics in Developing Human Brain Using Contrastive Language Image Pre-TrainingPralaypati Ta, Sriram Venkatesaperumal, Keerthi Ram, Mohanasankar Sivaprakasam · 2026 · Neuroinformatics
- Encoding Versus Linear Use of Patient Characteristics in Chest X-Ray Foundation Models on MIMIC-CXRY I Kim, Yangwon Kim, Yoojin Nam, NamJoon Kim, Pa Hong · 2026 · Diagnostics
- CheX-DFuseNet-X: Explainable Dynamic CNN-ViT Fusion for Multi-Label Chest X-Ray ClassificationDilakshan Chandrasena, Pushpika Liyanaarachchi · 2026 · IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE)
- Rethinking Medical VQA Models: Towards Data-Efficient LearningShuning He, Da Ren, Haiwei Pan, Kejia Zhang, Qing Li · 2026 · Computational Visual Media
- Edge-Guided ControlNet Synthetic Chest X-ray Augmentation and Ensemble ClassificationNegar Abbasi, Nada Y. Philip, Tariq Rahim · 2026 · International Conference on Communications
- Fusion Direction Matters: Alignment-Adaptive Cross-Modal Fusion for Medical Image SegmentationZihao Guo, Haoyu Yang, Hongyan Yin, Jiaming Xu · 2026 · Lecture notes in computer science
- Application of deep learning in prognostic prediction of non-small cell lung cancerXiaoqi Lun · 2026 · Frontiers in Cell and Developmental Biology
- CLEAR: an auditable foundation model for radiology grounded in clinical conceptsTianyu Han, Riga Wu, Yu Tian, Firas Khader, Lisa C. Adams, Keno K. Bressem, Christos A. Davatzikos, Jakob Nikolas Kather, Li Shen, David A. Mankoff et al. · 2026 · Nature Biomedical Engineering
- Chest-X-ray based deep feature-driven framework for anemia detection insights from a large hospital cohortHao-Chun Liao, Dung‐Jang Tsai, Shan‐Yueh Chang, Chin Lin, Shih-Hua Lin, Wen‐Hui Fang · 2026 · BioData Mining
- Meta-Cobi: A Metadata-Augmented Vision-Language Framework for Multi-view Canine Body Condition ScoringJae-Eon Ahn, Ju-Won Seo, Kang-Min Kim, O‐Joun Lee · 2026 · Communications in computer and information science
- Causal gradient intervention for debiased and evidence-grounded medical visual question answeringBing Liu, Ziyuan Yang, Lijun Liu, Jiaman Ding, Wei Peng · 2026 · Medical Image Analysis
- Towards a unified foundation model for medical imagingKai Jin, Andrzej E. Grzybowski · 2026 · The Lancet Digital Health
- Text-prompted foundation-model segmentation of intrapartum fetal ultrasound: a controlled methodological study with F-TPA-SAM2杨之源, Qinghua Meng, Bentao Jiang, Dongren Liu, Jing Qiu · 2026 · Frontiers in Medicine
- DRGCD: A graph-structured and language-guided diffusion model for Diabetic Retinopathy classificationYu Chen, TingBo Bao, Jun Long, Liu Yang · 2026 · Biomedical Signal Processing and Control
- Generation of chest CT pulmonary nodule images by latent diffusion models using the LIDC-IDRI datasetKaito Urata, Maiko Nagao, Atsushi Teramoto, Kazuyoshi Imaizumi, Masashi Kondo, Hiroshi Fujita · 2026 · International Journal of Computer Assisted Radiology and Surgery
- REFLEX-Med: Reinforcement with Label-Free Explainability for Unified Medical ReasoningLuyao Tang, Zheyuan Cai, Qinong Tian, Zi Li, Quande Liu, Kyongtae Tyler Bae, Cheng Chen · 2026 · Multidimensional Signal Processing Workshop
- Text Conditioned Implicit Visual Chain-of-Reasoning for Unsupervised 3D Medical Image RegistrationMuhammad Zafar Iqbal, Anwaar Ulhaq, Srimannarayana Grandhi, Zafar Saeed · 2026 · Lecture notes in computer science
- A clinical multimodal vision language foundation model with fine-grain explainabilityYang Bai, Haoran Cheng, Yang Zhou, Jun Zhou, Arun James Thirunavukarasu, Yuhe Ke, Jie Yao, Kanae Fukutsu, Chrystie Wan Ning Quek, Ashley Shuen Ying Hong et al. · 2026 · Nature Medicine
- MedLoRA: Low-Rank Few-Shot Adaptation of Vision-Language Models for Medical ImagesBingyuan Bai, Tzu‐Ching Shih, Kazunori Miyata · 2026 · Communications in computer and information science
- Single-share local semantic tampering in a HiNet-assisted Shamir secret image sharing workflow under a privileged insider threat: Reconstruction integrity risk analysisChang-Kun Liu, Hong-Mei Yang, Bin Yan, Ya-Dong Liu, Yu-Hao Song · 2026 · Journal of Information Security and Applications
- MMDC-CLIP-F: Vision-language multi-view mammogram density classification with uncertainty assessmentJacob Schaffer, Wandong Zhang, Tianqi Ni, Yimin Yang, Ameya Madhav Kulkarni, Ashirbani Saha · 2026 · Neurocomputing
- Benchmarking Foundation Models for Pulmonary Embolism Diagnosis and Prognosis to Reveal Demographic DisparitiesMilan Mohan, Saketh Lingisetty, Umar Ahmad, Avi Kumar, Shankar Harikrishnan, Sanjana Chamarty, Kiran Nijjer, Adnan Ahmed · 2026 · Lecture notes in computer science
- Output Steering for Latent Diffusion-Based MRI-to-CT SynthesisEfe Özdilek, Fuat Arslan, Boran İsmet Macun, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
- Rotational Post-Training Quantization for Biomedical Vision-Language ModelsParsa Yousefinezhad, Efe Özdilek, Aykut Koç, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
- Few-Shot Spatial Adaptation in Medical Vision-Language ModelsM. Arda Aydın, Furkan Genç, Efe Özdilek, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
- CT Image Reconstruction with Vision MambaBilal Kabaş, Valiyeh Ansarian Nezhad, Tolga Çukur · 2026 · Signal Processing and Communications Applications Conference (SIU)
- Multimodal Document Classification Across Domains and Methods: A Systematic ReviewHosam Lafi Aljuhani, Mohamed Yehia Dahab, Yousef S. Alsenani · 2026 · Engineering Technology & Applied Science Research
- Time-Aware Semantic Prototypes for Weakly-Supervised Endomicroscopy Video ClassificationIlán Carretero, Pablo Meseguer, Irene Zammarchi, C L Pugliano, Giovanni Santacroce, Bisi Bode Kolawole, Ujwala Bhangale Chaudhari, Rocío del Amor, Enrico Grisan, Marietta Iacucci et al. · 2026 · Proceedings - International Conference on Image Processing
- BiomedQSD: Enhancing Few-Shot Adaptation in Biomedical Images ClassificationWeihong Zhu, Rongsheng Xie · 2026 · International Conference on Computer Vision, Image and Deep Learning (CVIDL)
- TC3-VLM: A Vision–Language Model for Tactical Combat Casualty CareJunseob Kim, Jade Chng, Ayman Ali, Victor M. Moas, Sunil Hwang, Rishikesan Kamaleswaran · 2026 · IEEE Access
- Multi-instance multi-label learning: Theory, taxonomy, and modern methods—A critical surveySyed Umaid Ahmed, Muhammad Atif Tahir, Muhammad Waqas Sheikh · 2026 · Neurocomputing
- Real-time detection of High-Risk Laryngeal Lesions using Laryngoscopic Image-Based AI-Assisted Triage: A Comparative Study of Multiple Vision Foundation ModelsJunyi Wang, Tianjian Zhang, Xing Huang, Ying Wang, Sisi Zhang, Yu Zhou, Yunrong Ti, Xu Yingpeng, Chuanyao Lin, Xiaoyun Qian · 2026 · Research Square
- Artificial Intelligence in Neuromuscular Diseases: Opportunities for a Data-Scarce FieldShang Ma, Sushan Luo, Huahua Zhong · 2026 · Neurology and Therapy
- Fair fine-tuning of medical vision-language models via learned textual embedding of sensitive attributesXiangyu Sun, Xiaoguang Zou, Yuanquan Wu, Shaoting Zhang, Guotai Wang · 2026 · Pattern Recognition
- AI for Opportunistic Identification of BMD and Bone Microarchitecture: A Narrative ReviewKatharina Ziegeler, Sharmila Majumdar · 2026 · Calcified Tissue International
- Vision Systems for Safety-Critical and High-Risk DomainsKhalil Omar, Hussam Nawwaf Fakhouri, Faten Fatehi Hamad · 2026 · Advances in computational intelligence and robotics book series
- Trustworthy medical concept recalibration through logic-aware multimodal evidence fusionLei Zhao, Chunzheng Zhu, Zhan Gao, Pengchen Liang, Xiaoyun Liang, Alex Chit-Yuen Cheng, Chi‐Man Pun · 2026 · Information Fusion
- Unified Transformer with cross-attention and conditional TransMix for lung infection severity assessment from CT and X-rayBouthaina Slika, Fadi Dornaika, Fares Bougourzi, Karim Hammoudi · 2026 · Biomedical Signal Processing and Control
- GridVQA-X: A Diagnostic Framework for Evaluating Multimodal Explainability MethodsSujay Belsare, Sudarshan Nikhil, Sushant Kumar, Ponnurangam Kumaraguru, Chirag Agarwal · 2026 · Lecture notes in computer science
- PhenoLIP: Phenotype Guided Medical Vision–Language PretrainingCheng Liang, Chaoyi Wu, Weike Zhao, Ya Zhang, Yanfeng Wang, Weidi Xie · 2026 · Lecture notes in computer science
- Clinical-Inspired Multi-view Retrieval with Spatial Residual Attention and Concept-Driven Explainability in Medical ImagesNguyen Tu, Pham Nguyen Hai Long, Vo Hoai Viet · 2026 · Communications in computer and information science
- Selection of complete few-shot support sets through matched local estimation and provenance-balanced weightingLingjia Zhang, Tong Liu · 2026 · SSRN Electronic Journal
- Large Language Model Benchmarks in Medical TasksLawrence K.Q. Yan, Qian Niu, Ming Li, Yichao Zhang, Caitlyn Heqi Yin, Cheng Fei, Benji Peng, Ziqian Bi, Pohsun Feng, Keyu Chen et al. · 2026 · Medicine Advances
- Reasoning-aware multimodal retrieval-augmented generation for evidence-grounded clinical decision supportBao T. Nguyen, Hung Viet Pham, Thien Khai Tran, Son Vu Truong Dao · 2026 · Intelligence-Based Medicine
- Interpretable Medical Image Diagnosis via VLM-Based Concept Alignment and Graph ReasoningYilan Hu, Haoyu Xie, Dan Liang, Xinhua Wei, Hui Zhou, Hong Zhou, Bingsheng Huang · 2026 · Lecture notes in computer science
- ECG-CoCa: Physiology-Informed Contrastive and Generative Framework for ECG InterpretationXinyue Liu, Yiming Lei, Shiwei Li, Zhiyi Zhu, Zhenghui Hu, Qingjie Liu · 2026 · Lecture notes in computer science
- Preoperative Simulation of Personalized Breast Reconstruction via Implant Prior Controllable DiffusionYizhi Wang, Tianze Yu, Hengjie Yu, Maoling Liu, Wenxuan Pan, Zhongxiang Ding, Peifen Fu, Yaochu Jin · 2026 · Lecture notes in computer science
- Spatiotemporal Modeling of Longitudinal MRI with Causal Graph Reasoning for Breast Cancer pCR PredictionHaiwei Lin, Bin Huang, Meng Wang, Ya Ren, Zhou Liu, Bingsheng Huang · 2026 · Lecture notes in computer science
- Fibers of Asymmetric Similarity: A Framework for Clinical and Imaging DataJohanna P. Müller, Matthew Baugh, Robert Wright, Thomas George Day, Reza Razavi, Bernhard Kainz · 2026 · Lecture notes in computer science
- A Multi-Backbone Pipeline Combining Biomedical Foundation Models and CNNs for Explainable Triage of Cutaneous UlcersAlessio Luschi, Linda Tognetti, Gabriele Cevenini, Pietro Rubegni, Ernesto Iadanza · 2026 · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany
- A Versatile Prompt-Driven Framework for Brain Segmentation, Parcellation, and Surface Reconstruction from Diverse ModalitiesZifeng Lian, Jiameng Liu, Shui Cao, Zhichao Liang, Feng Shi, Dinggang G. Shen · 2026 · Lecture notes in computer science
- Beyond text: quantifying the impact of figure-guided retrieval in biomedical RAG systemsR J Venkatesh, Sudhakaran Gajendran, C. U. Om Kumar · 2026 · Frontiers in Artificial Intelligence
- Advances in Multimodal Artificial Intelligence in Radiology: Data Integration, Foundation Models, and Clinical Applications—A Narrative ReviewGhada Alfattni · 2026 · Healthcare
- Separating Ranking Signal, Incremental Feature Value, and Evaluation-Induced Optimism in Breast MRI Treatment-Effect Analysis: Foundation Model and Radiomic RepresentationsHisashi Nakano, Takehiro Shiinoki · 2026 · Journal of Imaging Informatics in Medicine
- AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $$\alpha $$-Corrected Binary Cross Entropy and Factorized Latent SupervisionJianzhong You, Yuan Gao, Chris McIntosh · 2026 · Lecture notes in computer science
- AI-driven quality enhancement of medical datasets: a closed-loop framework of synthesis, annotation, quality control, and integrationTao Tian, Siyuan Zhang, Xuchen Yang, Rui Shi · 2026 · Frontiers in Medicine
- Fetal Ultrasound Plane Classification with FetalCLIP Embeddings and Linear ClassifiersKristina Ćaleta, Ana Brkić, Nenad Veček, Mihaela Vranić, Jelena Božek · 2026 · International Symposium ELMAR (ELMAR)
- Bridging the Spatial Blind Spot in Pathology Foundation Models for Tumor LocalizationGuoshuai Xu, Kai Zhang · 2026 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
- Benchmarking the Gap Between Multimodal Generalized and Domain-Specific Models in Identifying Malaria from Blood Test ImageryDemetrius Howard Setiawan, Stanley Dirk Nente, Ivan Sebastian Edbert, Samson Ndruru · 2026 · International Conference on ICT for Smart Society (ICISS)
- Hierarchical diffusion-guided consistency learning framework for knee anterior cruciate ligament classificationHancang Mi, Hong‐Seng Gan, Hengjie Ma, Özgür TOSUN, Atakan Bayır, Özge Ertem, Kazım Ayberk Sinci, İlker Özgür Koska, Muhammad Hanif Ramlee · 2026 · Biomedical Signal Processing and Control
- Generative Vision-Language Multiple Instance Learning for Weakly Supervised Neonatal Fundus Screening and ReportingXiao Zhang, Guangshuang Tan, Jie Hu, Shichao Kan, Bing Jiang, Yixiong Liang · 2026
- Trajectory-Based Robustness Characterization for Medical Vision-Language Models Using Perturbation Response CurvesIksan Bukhori, Mahda Laina Arnumukti, Kok Beng Gan, Kok Swee Sim · 2026 · IEEE International Conference on Signal and Image Processing Applications (ICSIPA)
- A Two-Branch Hybrid Model for Imbalanced Lumbar Disc Grading and Zero-Shot Label ExtensionTrung Kien Ha, Trong Nhan Phan · 2026 · Lecture notes in computer science
- Foundation Models and Multimodal Learning for Medical Data with Applications in OncologyAsim Waqas, Aakash Tripathi, Siddharth Sivaram, Farzana Ali, Shiba Kuanar, Yashbir Singh, Hanieh Ajami, Orhan Ünal, Yuankai Huo, Abdussalam Elhanashi et al. · 2026 · Journal of Imaging Informatics in Medicine
- Concept-Enhanced Hypergraph-Guided Medical Image Retrieval Using CUI SemanticsMuhammad Saad, Md. Hasan Emam, Md. Ibrahim Sani, Sifat Momen · 2026 · IEEE Access
- Robust Prediction-Reliability Assessment in Biomedical Sensing and Classification Under Data Scarcity Using Conformal Prediction and Statistical RandomizationYu-Qi Zhou, Xiang-Hao Zhan · 2026 · Italian National Conference on Sensors
- LiteMedRAG: Selective Retrieval-Augmented Compact Medical Visual Question AnsweringDaniel Ayo Oladele, Malusi Sibiya · 2026 · Lecture notes in computer science
- MIRAGE: Modality-Aware 3D Vision-Language Model for Liver Lesion Diagnosis in MRI via Volumetric-Text AlignmentHaowen Zhu, Jingyang Zhang, Chunfeng Yang · 2026 · International Joint Conference on Neural Networks (IJCNN)
- Class-Conditional Center Alignment for Robust Vision–Language Contrastive Learning in Glaucoma ScreeningXiaoyu Liu, Qi Wang · 2026 · International Joint Conference on Neural Networks (IJCNN)
- Multimodal artificial intelligence for vascular aging: toward proactive detection and managementZiyun Wang, Yiwen Dai, Chenxi Li, Yujian Hu, Zhengyao Ding, Zhengxing Huang, Ting Chen · 2026 · The Journal of Cardiovascular Aging
- Report-Calibrated Concept Bottleneck Learning for Interpretable High-Grade Pattern DiagnosisYabin Li, Yin Luo, Minghui Wang, Ao Li · 2026 · International Conference on Artificial Intelligence Technologies and Applications (ICAITA)
- Vision–language foundation models for multimodal medical image understanding and report generation: a narrative review with quantitative synthesisShahid Mehmood, Farman Matloob Khan, Abeer A. K. Alharbi, Abdul Khader Jilani Saudagar, Mona Alkhattabi, Muhammad Adnan Khan, Muhammad Amir Khan · 2026 · Frontiers in Medicine
- Domain-Specific Encoders Don’t Always Win: Parameter-Efficient Adaptation of Compact VLMs to Medical ImagingMatheus Mattioli, Jurandy Almeida · 2026 · Lecture notes in computer science
- Blank-Image Ablations Can Mislead: A Mismatched-Image Control for Visual-Requirement Audits in Medical-VQA—Evidence from ERA-TurkMed, A Turkish Generative SystemEsra Balık, Mehmet Kaya · 2026 · Journal of Imaging Informatics in Medicine
- EAR-Med: Evidence-Anchored Reinforcement Learning for Visual Reasoning in Medical Multimodal Large Language ModelsXinchong Wang · 2026