The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image Recognition
Abstract
In recent years, the growing utilization of medical imaging is placing an increasing burden on radiologists. Deep learning provides a promising solution for automatic medical image analysis and clinical decision support. However, large-scale manually labeled datasets required for training deep neural networks are difficult and expensive to obtain for medical images. The purpose of this work is to develop label-efficient multimodal medical imaging representations by leveraging radiology reports. We propose an attention-based framework for learning global and local representations by contrasting image sub-regions and words in the paired report. In addition, we propose methods to leverage the learned representations for various downstream medical image recognition tasks with limited labels. Our results demonstrate high-performance and label-efficiency for image-text retrieval, classification (finetuning and zerosshot settings), and segmentation on different datasets.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although gathering such large datasets will pose a substantial challenge, these data will generally not require costly expert labels, given the success of self-supervision 9,54 .”
From Foundation models for generalist medical artificial intelligence (2023) · cites this paper as [54]
In the citing paper
“By leveraging radiology reports, Huang et al. demonstrated the model’s ability to localize chest abnormalities on chest x-rays without segmentation labels and revealed the possibility of zero-shot learning by converting the classification classes into textual captions and framing the image classification task as measuring the image-text similarity107.”
From Self-supervised learning for medical image classification: a systematic review and implementation guidelines (2023) · cites this paper as [107]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Self-citationDeep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., & He, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00143 · Cited by 1,923
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Research works printed but not linked: 1
- frome, 2013, DeViSE A deep visual-semantic embedding model [J]
Cited by
Sorted by citations
Items 201–300 of 493
Bias and Generalizability of Foundation Models Across Datasets in Breast Mammography
Germani, É., Selin-Türk, I., Zeineddine, F., Mourad, C. J., & Albarqouni, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05185-1_3 · Cited by 7
Noh, W.-J., Pi, S.-W., & Lee, B.-D. (2026) · Scientific Reports · doi:10.1038/s41598-025-34799-2 · Cited by 5
TA-MedSAM: Text-augmented improved MedSAM for pulmonary lesion segmentation
Tang, S., Wang, S., Xiang, G., Zhao, J., & Wang, Y. (2026) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2026.102698 · Cited by 5
Tackling the complexity of cancer with generative models
Conard, A. M., Hughes, M., Hall, J., Tenenholtz, N., Zimmermann, E., Crawford, L. A., Amini, A. P., & Severson, K. (2026) · Cell · doi:10.1016/j.cell.2026.03.027 · Cited by 5
Attention-driven visual emphasis for medical volumetric image visualization
Li, M., Jung, Y., Song, S., & Kim, J. (2024) · The Visual Computer · doi:10.1007/s00371-024-03596-9 · Cited by 5
Standard plane localization using denoising diffusion model with multi-scale guidance
Dou, H., Huang, Y., Huang, Y., Yang, X., Zhen, C., Zhang, Y., Xiong, Y., Huang, W., & Ni, D. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.108619 · Cited by 6
Matryoshka Learning With Metric Transfer for Image-Text Matching
Wang, P., Zhang, L., Mao, Z., Lyu, N., & Zhang, Y. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3558996 · Cited by 5
Grounded knowledge-enhanced medical vision–language pre-training for chest X-ray
Deng, Q., Huang, Z., Wang, Y., Wang, Z., Wang, Z., Zhang, X., Dou, Q., Hui, Y. Y., & Hui, E. S. K. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108416 · Cited by 7
FLeak-Seg: Automated Fundus Fluorescein Leakage Segmentation via Cross-Modal Attention Learning
Wen, Y., Chen, L., Qiao, L., Deng, Y., Chen, H., Zhang, T., & Zhou, C. (2022) · IEEE Multimedia · doi:10.1109/mmul.2022.3142986 · Cited by 5
AHIVE: Anatomy-Aware Hierarchical Vision Encoding for Interactive Radiology Report Retrieval
Yan, S., Cheung, W. K., Tsang, I. W.-H., Chin, K., Tong, T. M., Cheung, K. C., & See, S. C. W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01358 · Cited by 5
Unified Medical Image Pre-training in Language-Guided Common Semantic Space
He, X., Yang, Y., Jiang, X., Luo, X., Hu, H. R., Zhao, S., Li, D., Yang, Y., & Qiu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73004-7_8 · Cited by 5
Zhu, G., Qin, Z., Xiong, H., Kumari, S., Alenazi, M. J. F., Guo, Y., & Chen, C. (2025) · Information Sciences · doi:10.1016/j.ins.2024.121868 · Cited by 6
Decoupled contrastive learning for multilingual multimodal medical pre-trained model
Li, Q. Y., Qiu, C., Liu, H., Gu, J., & Luo, D. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129809 · Cited by 5
Yu, Y., Wang, J., Liu, W., Mien, I. H., Krishnaswamy, P., Yang, X., & Cheng, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130018 · Cited by 5
Novel Class Discovery in Chest X-rays via Paired Images and Text
Zhou, J., Liu, Y., & Chen, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28598 · Cited by 5
Zou, Y., & Yin, Z. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00023 · Cited by 4
Yang, Z., & Shen, L. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00454 · Cited by 4
Self-citationOpen source ML framework algorithms for biophysical models
Andrikov, D. A. (2025) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-025-01621-z · Cited by 4
Ning, J., Xing, X., Zhang, S., Ma, X., & Yang, G. (2025) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi60581.2025.10981008 · Cited by 4
Zhao, J., & Li, S. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103677 · Cited by 4
Scaling Chest X-Ray Foundation Models From Mixed Supervisions for Dense Prediction
Wang, F., & Yu, L. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3589928 · Cited by 5
All-in-one medical image-to-image translation
Han, L., Tan, T., Huang, Y., Dou, H., Zhang, T., Gao, Y., Wang, X., Lu, C., Liang, X., Sun, Y., et al. (2025) · Cell Reports Methods · doi:10.1016/j.crmeth.2025.101138 · Cited by 6
Chen, R., Min, W., Han, Q., Li, J., Li, L., & Wu, H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112263 · Cited by 4
Chen, Y., Xu, S., Sellergren, A., Matias, Y., Hassidim, A., Shetty, S., Golden, D. I., Yuille, A., & Yang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04978-0_8 · Cited by 5
RetFiner: A Vision-Language Refinement Scheme for Retinal Foundation Models
Fecso, R., Morano, J., Schmidt-Erfurth, U. M., & Bogunović, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04971-1_51 · Cited by 4
Wang, Y., Sun, Y., Tan, T., Hao, C., Cui, Y., Su, X., Xie, W., Shen, L., & Yu, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04981-0_61 · Cited by 5
Self-citationGlobal and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECG
Selivanov, A., Müller, P., Turgut, Ö., Stolt-Ansó, N., & Rueckert, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04927-8_21 · Cited by 4
A General Framework for Efficient Medical Image Analysis via Shared Attention Vision Transformer
Liu, Y., Wen, Y., Yang, L., He, L., & Zhou, M. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3644949 · Cited by 4
MV-MLM: Bridging Multi-View Mammography and Language for Breast Cancer Diagnosis and Risk Prediction
Zheng, S.-F., Lee, H., Kooi, T., & Diba, A. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00131 · Cited by 4
HyPCA-Net: Advancing Multimodal Fusion in Medical Image Analysis
Dhar, J., Pandey, M. K., Chakladar, D. D., Haghighat, M., Alavi, A., Mistry, S., & Zaidi, N. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00183 · Cited by 4
Ding, T., Zou, Y., Chen, C., Shah, M., & Tian, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37038-9_12 · Cited by 4
Automatic visual recognition for leaf disease based on enhanced attention mechanism
Yao, Y., Deng, X., Zhang, X., Li, J., Sun, W., & Zhang, G. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2365 · Cited by 4
Sultana, J., Qin, R., & Yin, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0901-7_9 · Cited by 4
Li, X., Liu, L., Chen, Z., Liu, Y., & Liu, H. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107188 · Cited by 4
Using Multiple Instance Learning to Build Multimodal Representations
Wang, P., Wells, W. M., Berkowitz, S., Horng, S., & Golland, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34048-2_35 · Cited by 4
Nuntachit, N., & Sugunnasil, P. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4030030 · Cited by 4
Multi-modal Contrastive-Generative Pre-training for Fine-grained Skin Disease Diagnosis
Ma, L., Zhao, J., Wang, G., Guo, Y., & Xu, F. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385898 · Cited by 4
Huang, W., Li, C., Zhou, H.-Y., Liu, J., Yang, H., Liang, Y., Shi, G., Zheng, H., & Wang, S. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635303 · Cited by 5
Yang, C., Jin, Q., Du, F., Guo, J., & Zhou, Y. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01717-4 · Cited by 3
Zhong, D., Li, X., Zhiyong, H., Wang, S., Yu, Z. W., Hou, M., Yan, Y., & Liu, Y.-S. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108318 · Cited by 3
Multi-Grained Vision-and-Language Model for Medical Image and Text Alignment
Yan, H., Yang, X., Bai, L., Li, J., & Liang, J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3590930 · Cited by 4
MedLangViT: A Language–Vision Network for Medical Image Segmentation
Wang, Y., Su, J., Li, X., & Nakahara, E. (2025) · Electronics · doi:10.3390/electronics14153020 · Cited by 3
Integrating text and medical images for segmentation using interpretable graph neural network
Chai, S., Jain, R. K., Mo, S., Liu, J., Teng, S., Tateyama, T., Lin, L., & Chen, Y. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109404 · Cited by 3
Retrieval-augmented multimodal deep learning for interpretable lung nodule malignancy prediction
Hou, R., Chai, S., Jain, R. K., Li, Y., Liu, J., Teng, S., Shi, X., Lin, L., & Chen, Y. (2026) · Displays · doi:10.1016/j.displa.2026.103525 · Cited by 3
Ou, W., Chen, Y., Liang, L., Gou, J., Xiong, J., Zhang, J., Lai, L., & Zhang, L. (2025) · Multimedia Systems · doi:10.1007/s00530-024-01649-6 · Cited by 4
Study-level cross-modal retrieval of chest x-ray images and reports with adapter-based fine-tuning
Chen, Y., Ou, W., Gao, Z., Lai, L., Yang, W., & Chen, Q. (2025) · Physics in Medicine and Biology · doi:10.1088/1361-6560/adaf05 · Cited by 3
Improving a segment anything model for segmenting low-quality medical images via an adapter
Bai, C., Wang, J., Han, X., & Wu, Z. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104425 · Cited by 3
Suo, J., Dong, K., He, K., He, K., & Qionghai, D. (2025) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01456-y · Cited by 5
GTGM: Generative Text-Guided 3D Vision-Language Pretraining for Medical Image Segmentation
Chen, Y., Liu, C., Huang, W., Liu, X., Shi, H., Cheng, S. L., Arcucci, R., & Xiong, Z. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00699 · Cited by 3
Zeng, J., Niu, K., Lu, Y. L., Pei, S., Zhou, Y., & Guo, Z. (2022) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai56018.2022.00170 · Cited by 3
Lei, H., Huang, H., Yang, B., Cui, G., Wang, R., Wu, D., & Li, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-7074-2_11 · Cited by 3
Cap2Seg: leveraging caption generation for enhanced segmentation of COVID-19 medical images
Zhao, W., Li, F., Diao, Y., Fan, P., & Chen, Z. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1439122 · Cited by 3
Du, Y., Chang, B., & Dvornek, N. C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72390-2_44 · Cited by 4
Multimodal Medical Image Binding via Shared Text Embeddings
Liu, Y., Xi, S., Liu, S., Ding, H., Jin, C., Zhong, C., He, J., Liu, C. C., & Shen, Y. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00162 · Cited by 7
Report-Concept Textual-Prompt Learning for Enhancing X-ray Diagnosis
Zhao, X., Liu, Z., Лю, Ф., Li, G., Dou, Y., & Peng, S. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681568 · Cited by 3
Self-supervised learning for early detection of neurodegenerative diseases with small data
Jiang, H. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/166402 · Cited by 3
A Study on DL for Pulmonary Embolism Prediction Harnessing Multimodal Data
Amudha, T. K., Sunitha, R., & Syam, M. E. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-2082-8_16 · Cited by 2
Learning Multi-Scale Knowledge-Guided Features for Text-Guided Face Recognition
Hasan, M. M., Sami, S. M., Nasrabadi, N. M., & Dawson, J. M. (2024) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2024.3466216 · Cited by 2
Gowda, S. N., & Clifton, D. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72120-5_40 · Cited by 2
Robust image representation learning via low-rank consistency regularization for subspace clustering
Abhadiomhen, S. E., Okereke, G. E., Nzeh, R., Ezeora, N. J., Abhadionmhen, O. A., & Asogwa, C. N. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-03869-3 · Cited by 2
Multimodal Retrieval Method for Images and Diagnostic Reports Using Cross-Attention
Sata, I., Amagasaki, M., & Kiyama, M. (2025) · AI · doi:10.3390/ai6020038 · Cited by 3
Jiang, X., Zhou, Z. J., Wang, H., Wang, G., & Fang, Z. (2025) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi60581.2025.10980866 · Cited by 2
Text-guided cross-position attention for image analysis: Case of medical image
Lee, G., Choi, S. T., Kim, S. H., Chung, J., Cho, J., & Cho, J. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110297 · Cited by 2
A medical information extraction model with contrastive tuning and tagging layer training
Wang, X. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110465 · Cited by 2
Automated Pneumothorax Segmentation with a Spatial Prior Contrast Adapter
Jia, Y., & Rashed, E. A. (2025) · Applied Sciences · doi:10.3390/app15126598 · Cited by 2
Song, T., Lin, Q., Zeng, X., Cao, Y., Man, Z., Liu, C., Cai, Z., Gui, C., & Huang, X. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108359 · Cited by 2
Liu, H., Wei, D., Peng, Q., Huang, Y., Wu, X., Zheng, Y., & Wang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96625-5_15 · Cited by 3
A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?
Silva-Rodríguez, J., Dolz, J., & Ayed, I. B. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96625-5_20 · Cited by 2
SeLIP: Similarity enhanced contrastive language image pretraining for multi-modal head MRI
Liu, Z., Yang, D. S., Zhang, M., Sun, H., Wu, H., Wang, H., Shen, W., Chai, C., & Xia, S. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108519 · Cited by 4
Bao, Y., Liu, Z., Jin, H. Z., Wang, H., Wang, W., & Lin, G. N. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c01774 · Cited by 2
Aljaddouh, B., Malathi, D., & Alaswad, F. (2025) · Biomedical Engineering Letters · doi:10.1007/s13534-025-00535-y · Cited by 3
Revolutionizing Precise Low Back Pain Diagnosis via Contrastive Learning
Le, T. B., Vo, H. N. K., Mai, T.-H., & Phan, T. N. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4960-3_32 · Cited by 2
Ahmed, T., Ahmed, A., Imran, A. S., Ullah, M., Manaf, A., & Soylu, A. (2026) · IEEE Access · doi:10.1109/access.2026.3655022 · Cited by 3
Meta-Entity Driven Triplet Mining for Aligning Medical Vision-Language Models
Yilmaz, M., Öztürk, Ş., Kara, M., Yavuz, M. T., Gümeler, E., Koç, A., & Çukur, T. (2026) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2026.3678306 · Cited by 2
A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images
Mekali, V., Sowbhagya, M. P., Aparna, H. D., Deepa Mathew, K., Singh, V., Nikam, N. N., Dongre, G. B., & Bhosale, Y. H. (2026) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.17163 · Cited by 2
MiT-DAUnet: MiT Enhanced Dual Attention Unet for Medical Segmentation
Chandrudu, K., Srikanth, P., Sambanna, K., Ganji, S. J., & Shivakeshav, S. (2026) · National Conference on Communications · doi:10.1109/ncc68160.2026.11478935 · Cited by 2
HiMix : Hierarchical Visual-Textual Mixing Network for Lesion Segmentation
Hwang, S., Sim, J., & Kim, W. H. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00517 · Cited by 2
Medical Referring Image Segmentation via Next-Token Mask Prediction
Chen, X., Wang, Y., Pang, G., Hao, J., Yue, C., Zhou, L., & Li, Y. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3705770 · Cited by 2
Representation Learning with Semantic-Aware Instance and Sparse Token Alignments
Bui, P.-N., Nguyen, T. D., Bum, J., Le, D.-T., & Choo, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31583-0_30 · Cited by 2
DinoDental : Benchmarking DINOv3 as a Unified Vision Encoder for Dental Image Analysis
Tang, K., Yang, X., Zheng, M., Liu, X., Li, X., Guo, X., Chen, R., Shen, L., & Meng, H. (2026) · Expert Systems · doi:10.1111/exsy.70451 · Cited by 2
Self-citationZhong, X., Batmanghelich, K. N., & Sun, L. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00097 · Cited by 2
Design as Desired: Utilizing Visual Question Answering for Multimodal Pre-training
Su, T., Li, J., Zhang, X., Jin, H., Chen, H., Wang, Q., Lv, F., Zhao, B., & Hu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72083-3_56 · Cited by 2
Khan, A. U., Garrett, J., Bradshaw, T., Salkowski, L. R., Jeong, J., Tariq, A., & Banerjee, I. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72390-2_55 · Cited by 2
Xiao, S., Zhang, Y., Jiang, L., & Wang, Z. (2024) · International Conference on Computational Intelligence and Applications (ICCIA) · doi:10.1109/iccia62557.2024.10719240 · Cited by 2
Ye, Y., Zhang, J., & Shi, H. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-8496-7_20 · Cited by 2
Ren, X., Ji, G., Chu, S., Yoshida, S., Zhao, J., Jia, B., & Qiang, Y. (2025) · Journal of X-Ray Science and Technology · doi:10.1177/08953996241296400 · Cited by 2
Hyperbolic vision language representation learning on chest radiology images
Zhang, Z., Qiao, Z., Han, L., Yang, H. B., Qian, Z., & Wu, J. (2025) · Health Information Science and Systems · doi:10.1007/s13755-025-00341-x · Cited by 2
Semantic-Driven Global-Local Cooperative Contrastive Learning for Medical Report Generation
Ye, S., Meng, M., Feng, D. D., & Kim, J. (2023) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta60407.2023.00042 · Cited by 2
MOSAIC: A Multimodal Self-supervised Transformer for Medical Image Diagnosis
Oubelkas, F., Benhaili, Z., Moumoun, L., & Jamali, A. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-95330-9_5 · Cited by 2
Hierarchical Contrastive Learning for Precise Whole-Body Anatomical Localization in PET/CT Imaging
Gao, Y., Shu, Y., Yu, M., Chen, Y., Liu, J., Zhong, S., Zhang, W., Zhan, Y., Zhou, X. S., Wang, X., et al. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3599197 · Cited by 2
Chen, Q., Yao, X., Ye, H., & Hong, Y. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3609739 · Cited by 3
Semantic-Aware Hard Negative Mining for Medical Vision-Language Contrastive Pretraining
Li, Y., Cheng, Y., Pan, Y., He, W., Wang, Q., Feng, R., & Zhang, X. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754991 · Cited by 2
An Effective Pre-trained Visual Encoder for Medical Visual Question Answering
Huang, Y., Wang, X., & Su, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46677-9_32 · Cited by 2
Bai, S., Deng, Z., Yang, J., Gong, Z., Gao, W., Shao, L., Li, F., Wei, W., & Ma, L. (2024) · Bioengineering · doi:10.3390/bioengineering11090950 · Cited by 2
Iyer, N. S., Gulati, A., Banerjee, O., Logé, C., Farhat, M. R., Saenz, A. D., & Rajpurkar, P. (2022) · medRxiv · doi:10.1101/2022.11.19.22282519 · Cited by 2
Automated Brain Abnormality Detection using a Self-Supervised Text-Vision FrameworkPreprint
Wood, D. A., Guilhem, E., Kafiabadi, S., Busaidi, A. A., Hammam, A., Mansoor, N. M., Townend, M., Agarwal, S., Wei, Y., Mazumder, A., et al. (2024) · doi:10.22541/au.171571444.45086524/v1 · Cited by 2
LLM-driven medical document analysis: Enhancing trustworthy pathology and differential diagnosis
Kang, L., Fu, X., Terrades, O. R., Vazquez-Corral, J., Valveny, E., & Karatzas, D. (2026) · Lecture Notes in Computer Science · doi:10.1007/978-3-032-04624-6_36 · Cited by 1
Vision-Language Pre-training from Synthetic Data
Liu, C. (2024) · Springer eBooks · doi:10.1007/978-3-031-80965-1_6 · Cited by 1
Zhang, X., Zheng, X., Dong, M., & Zhang, M. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107891 · Cited by 2
Anatomy-Aware Mixture of Experts for Medical Vision-Language Pre-training
Shi, K., Pan, H., & Zhang, K. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0027-7_10 · Cited by 1
Metadata
- Authors
- Huang, S.-C., Shen, L., Lungren, M. P., & Yeung, S.
- Affiliations
- Stanford University (US)
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 3922-3931
- OpenAlex
- W3201906559
- Cited by
- 489
- References
- 41
- Citations by year
- 2026: 122 · 2025: 195 · 2024: 106 · 2023: 51 · 2022: 14 · 2021: 1
- FWCI
- 14.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- multimodal representation learning, label-efficient learning, medical image recognition, radiology reports, image-text retrieval, zero-shot classification, medical image segmentation, limited labeled data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review