The DOI matches its Crossref record; 194 of the 202 references it cites were found in a registry or an index.
Vision-Language Models for Vision Tasks: A Survey
Open accessAbstract
Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition paradigm. To address the two challenges, Vision-Language Models (VLMs) have been intensively investigated recently, which learns rich vision-language correlation from web-scale image-text pairs that are almost infinitely available on the Internet and enables zero-shot predictions on various visual recognition tasks with a single VLM. This paper provides a systematic review of visual language models for various visual recognition tasks, including: (1) the background that introduces the development of visual recognition paradigms; (2) the foundations of VLM that summarize the widely-adopted network architectures, pre-training objectives, and downstream tasks; (3) the widely-adopted datasets in VLM pre-training and evaluations; (4) the review and categorization of existing VLM pre-training methods, VLM transfer learning methods, and VLM knowledge distillation methods; (5) the benchmarking, analysis and discussion of the reviewed methods; (6) several research challenges and potential research directions that could be pursued in the future VLM studies for visual recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With the rise of multi-modal forgeries, recent approaches leverage deep learning models such as transformers [8] and visionlanguage models [9] to improve detection capabilities.”
From Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges (2024) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“As LLMs expand in the kinds of stimuli they can interpret -e.g.visual (OpenAI, 2023b;Zhang, Huang, et al., 2024;Gemini Team et al., 2024) -and the ways in which they can interact with the world -e.g.embodiment and tool use (Mialon et al., 2023) -, the space of transferable paradigms increases.”
From Machine Psychology (2023) · cites this paper as Zhang, Huang, et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Regarding improvements in symbolic or numeric reasoning, another technique is to prompt LLMs to use code for solving tasks (Zhang, Ge, et al., 2024).”
From Machine Psychology (2023) · cites this paper as Zhang, Ge, et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Research works printed but not linked: 5
- 10.5555/3524938.3525087 · DOI
- Radford, 2018, Improving language understanding by generative pre-training, OpenAI Blog
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1
- 10.1109/cvpr52688.2022.01553 · DOI · Paper page
- Ordonez, Im2Text: Describing images using 1 million captioned photographs, 1143
Cited by
Sorted by citations
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Liu, F., Chen, D., Guan, Z., Zhou, X., Zhu, J., Ye, Q., Fu, L., & Zhou, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3390838 · Cited by 507
The Segment Anything Model (SAM) for remote sensing applications: From zero to one shot
Osco, L. P., Wu, Q., de Lemos, E. L., Gonçalves, W. N., Ramos, A. P. M., Li, J., & Marcato, J. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103540 · Cited by 405
Foundation Models Defining a New Era in Vision: A Survey and Outlook
Awais, M., Naseer, M., Khan, S., Anwer, R. M., Cholakkal, H., Shah, M., Yang, M.-H., & Khan, F. S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3506283 · Cited by 304
Multimodal Alignment and Fusion: A Survey
Li, S., & Tang, H. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02667-1 · Cited by 267
Foundation Models for Remote Sensing and Earth Observation: A survey
Xiao, A., Xuan, W., Wang, J., Huang, J., Tao, D., Lu, S., & Yokoya, N. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3576766 · Cited by 186
Self-citationUAVs meet LLMs: Overviews and perspectives towards agentic low-altitude mobility
Tian, Y., Lin, F., Li, Y., Zhang, T., Zhang, Q., Fu, X., Huang, J., Dai, X., Wang, Y., Tian, C., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103158 · Cited by 139
Self-citationUni-MoE: Scaling Unified Multimodal LLMs With Mixture of Experts
Li, Y., Jiang, S., Hu, B., Wang, L., Zhong, W., Luo, W., Ma, L., & Zhang, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3532688 · Cited by 136
Vision-Language Models in medical image analysis: From simple fusion to general large models
Li, X., Li, L., Jiang, Y., Wang, H., Qiao, X., Feng, T., Luo, H., & Zhao, Y. J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102995 · Cited by 93
Multimodal Artificial Intelligence in Medical Diagnostics
Jandoubi, B., & Akhloufi, M. A. (2025) · Information · doi:10.3390/info16070591 · Cited by 97
A Survey of Label-Efficient Deep Learning for 3D Point Clouds
Xiao, A., Zhang, X., Shao, L., & Lu, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3416302 · Cited by 85
Self-citationVision-Language Models for Edge Networks: A Comprehensive Survey
Sharshar, A., Khan, L. U., Ullah, W., & Guizani, M. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3579032 · Cited by 92
Multi-Modal LLMs in Agriculture: A Comprehensive Review
Sapkota, R., Qureshi, R., Hadi, M. U., Hassan, S. Z., Sadak, F., Shoman, M., Sajjad, M., Dharejo, F. A., Paudel, A., Li, J., et al. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3612154 · Cited by 81
Graph Retrieval-Augmented Generation for Large Language Models: A Survey
Procko, T. T., & Ochoa, O. (2024) · 2024 Conference on AI, Science, Engineering, and Technology (AIxSET) · doi:10.1109/aixset62544.2024.00030 · Cited by 125
Li, Z., Wu, X., Du, H., Liu, F., Nghiem, H. T., & Shi, G. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00147 · Cited by 91
Hagendorff, T., Dasgupta, I., Binz, M., Chan, S. C. Y., Lampinen, A., Wang, J. X., Akata, Z., & Schulz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13988 · Cited by 68
A Perspective on Foundation Models in Chemistry
Choi, J., Nam, G., Choi, J., & Jung, Y. (2025) · JACS Au · doi:10.1021/jacsau.4c01160 · Cited by 84
Few-shot adaptation of multi-modal foundation models: a survey
Liu, F., Zhang, T., Dai, W., Zhang, C., Cai, W., Zhou, X., & Chen, D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10915-y · Cited by 75
A Systematic Review on Long-Tailed Learning
Zhang, C., Almpanidis, G., Fan, G., Deng, B., Zhang, Y., Liu, J., Kamel, A., Soda, P., & da Gama, J. M. P. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3539314 · Cited by 78
Huang, Z., Hu, J., Li, X., He, Y., Zhao, X., Peng, B., Wu, B., Huang, X., & Cheng, G. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.02685 · Cited by 62
Ravi Raj, K. G., & Kos, A. (2025) · Sensors · doi:10.3390/s25041033 · Cited by 77
Generalizable and explainable deep learning for medical image computing: An overview
Chaddad, A., Hu, Y., Wu, Y., Wen, B., & Kateb, R. (2024) · Current Opinion in Biomedical Engineering · doi:10.1016/j.cobme.2024.100567 · Cited by 61
Foundation models in ophthalmology
Chia, M. A., Antaki, F., Zhou, Y., Turner, A. W., Lee, A., & Keane, P. A. (2024) · British Journal of Ophthalmology · doi:10.1136/bjo-2024-325459 · Cited by 61
Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study
Nakao, T., Miki, S., Nakamura, Y., Kikuchi, T., Nomura, Y., Hanaoka, S., Yoshikawa, T., & Abe, O. (2024) · JMIR Medical Education · doi:10.2196/54393 · Cited by 55
The Potential of Visual ChatGPT for Remote Sensing
Osco, L. P., de Lemos, E. L., Gonçalves, W. N., Ramos, A. P. M., & Marcato, J. (2023) · Remote Sensing · doi:10.3390/rs15133232 · Cited by 52
Guo, R., Wei, J., Sun, L., Yu, B., Chang, G., Liu, D., Zhang, S., Yao, Z., Xu, M., & Bu, L. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108709 · Cited by 58
A survey of efficient fine-tuning methods for Vision-Language Models — Prompt and Adapter
Xing, J., Liu, J., Wang, J., Sun, L., Chen, X., Gu, X., & Wang, Y. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.01.012 · Cited by 51
Advances in artificial intelligence: a review for the creative industries
Anantrasirichai, N., Zhang, F., & Bull, D. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11494-w · Cited by 62
Object detection with multimodal large vision-language models: An in-depth review
Sapkota, R., & Karkee, M. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103575 · Cited by 61
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
Privacy Preserving Prompt Engineering: A Survey
Edemacu, K., & Wu, X. (2025) · ACM Computing Surveys · doi:10.1145/3729219 · Cited by 72
Fan, J., Yin, Y., Wang, T., Dong, W., Zheng, P., & Wang, L. (2025) · Frontiers of Engineering Management · doi:10.1007/s42524-025-4136-9 · Cited by 53
Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models
Zhou, Y., Yan, H., Ding, K., Cai, T., & Zhang, Y. (2024) · Sensors · doi:10.3390/s24186109 · Cited by 54
Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 49
Self-citationWhen Geoscience Meets Foundation Models: Toward a general geoscience artificial intelligence system
Zhang, H., Xu, J., Cui, H., Li, L., Yang, Y., Tang, C., & Boers, N. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3496478 · Cited by 59
CLIPSyntel: CLIP and LLM Synergy for Multimodal Question Summarization in Healthcare
Ghosh, A., Acharya, A., Jain, R., Saha, S., Chadha, A. R., & Sinha, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30206 · Cited by 50
Multi-modal Time Series Analysis: A Tutorial and Survey
Jiang, Y., Ning, K., Pan, Z., Shen, X., Ni, J., Yu, W., Schneider, A., Chen, H., Nevmyvaka, Y., & Song, D. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736567 · Cited by 52
IoT-LLM: A framework for enhancing large language model reasoning from real-world sensor data
An, T., Zhou, Y., Zou, H., & Yang, J. (2025) · Patterns · doi:10.1016/j.patter.2025.101429 · Cited by 64
Remote Sensing Spatiotemporal Vision–Language Models: A comprehensive survey
Liu, C., Zhang, J. Q., Chen, K., Wang, M., Zou, Z., & Shi, Z. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3598283 · Cited by 54
Self-citationChen, Q. H., & Yin, X. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103478 · Cited by 43
Danish, S., Sadeghi‐Niaraki, A., Khan, S. U., Dang, L. M., Tightiz, L., & Moon, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103623 · Cited by 45
Review of Phonocardiogram Signal Analysis: Insights from the PhysioNet/CinC Challenge 2016 Database
Zhu, B., Zhou, Z., Yu, S., Liang, X., Xie, Y., & Sun, Q. (2024) · Electronics · doi:10.3390/electronics13163222 · Cited by 37
DualCoOp++: Fast and Effective Adaptation to Multi-Label Recognition With Limited Annotations
Hu, P., Sun, X., Sclaroff, S., & Saenko, K. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3346405 · Cited by 42
FSVLM: A Vision-Language Model for Remote Sensing Farmland Segmentation
Wu, H., Du, Z., Zhong, D., Wang, Y., & Tao, C. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3532960 · Cited by 40
A Survey on Efficient Vision‐Language Models
Shinde, G., Ravi, A., Dey, E., Sakib, S., Rampure, M., & Roy, N. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70036 · Cited by 46
RemoteSAM: Towards Segment Anything for Earth Observation
Yao, L., Liu, F., Chen, D., Zhang, C., Wang, Y., Chen, Z., Xu, W., Di, S., & Zheng, Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754950 · Cited by 44
Zanella, M., & Ayed, I. B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02245 · Cited by 38
Wang, L., Dong, S., Chen, Y., Meng, X., Fang, S., & Fei, S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3477548 · Cited by 32
Harnessing Text Insights With Visual Alignment for Medical Image Segmentation
Zeng, Q., Luo, H., Lu, Z., Xie, Y., Wang, Z., Zhang, Y., & Xia, Y. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3601359 · Cited by 33
Benchmark Evaluations, Applications, and Challenges of Large Vision Language Models: A SurveyPreprint
Li, Z., Wu, X., Du, H., Nghiem, H. T., & Shi, G. (2025) · Qeios · doi:10.32388/gxr68q · Cited by 33
Domain generalization for semantic segmentation: a survey
Rafi, T. H., Mahjabin, R., Ghosh, E., Ko, Y. W., & Lee, J. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10817-z · Cited by 31
Anomaly detection for industrial applications: challenges, solutions, and future directions
Alzarooni, A., Iqbal, E., Khan, S. U., Javed, S., Moyo, B., & Abdulrahman, Y. (2025) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2025.2599548 · Cited by 39
A feasibility study of automating radiotherapy planning with large language model agents
Wang, Q., Wang, Z., Li, M., Ni, X., Tan, R., Zhang, W., Wubulaishan, M., Wang, W., Yuan, Z., Zhang, Z., et al. (2025) · Physics in Medicine & Biology · doi:10.1088/1361-6560/adbff1 · Cited by 28
CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language Alignment
Javed, S., Mahmood, A., Ganapathi, I. I., Dharejo, F. A., Werghi, N., & Bennamoun, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01088 · Cited by 31
Text generation and multi-modal knowledge transfer for few-shot object detection
Du, Y., Liu, F., Jiao, L., Li, S., Hao, Z., Li, P., Wang, J., Wang, H., & Liu, X. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111283 · Cited by 28
Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation
Zhang, Y., Guo, M.-H., Wang, M., & Hu, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00315 · Cited by 27
Prompt-Based Concept Learning for Few-Shot Class-Incremental Learning
Li, S., Liu, F., Jiao, L., Li, L., Chen, P., Liu, X., & Ma, W. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3525545 · Cited by 27
Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI
Lee, G.-G., & Zhaı, X. (2025) · TechTrends · doi:10.1007/s11528-024-01035-z · Cited by 27
Rajendran, P., Yang, Y., Niedermayr, T. R., Gensheimer, M. F., Beadle, B. M., Le, Q., Xing, L., & Dai, X. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.110740 · Cited by 31
Quantum Machine Learning: Towards Hybrid Quantum-Classical Vision Models
Rizvi, S. M. A., Paracha, U. I., Khalid, U., Lee, K., & Shin, H. (2025) · Mathematics · doi:10.3390/math13162645 · Cited by 27
Zheng, J., Ye, Z., Wen, Y., Huang, J., Zhang, Z., Li, Q., Hu, Q., Xu, B., Zhao, L., & Fu, H. (2026) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2026.3658493 · Cited by 31
Self-citationIntegrating Sustainable Big AI: Quantum Anonymous Semantic Broadcast
Tariq, S., Khalid, U., Arfeto, B. E., Duong, T. Q., & Shin, H. (2024) · IEEE Wireless Communications · doi:10.1109/mwc.007.2300503 · Cited by 27
Integrating language into medical visual recognition and reasoning: A survey
Lu, Y., & Wang, A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103514 · Cited by 32
SAIA: a seamless Slurm-native solution for HPC-based services
Doosthosseini, A., Decker, J., Nolte, H., & Kunkel, J. M. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08508-3 · Cited by 36
Jiang, F., Pan, C., Dong, L., Wang, K., Debbah, M. A., Niyato, D. T., & Han, Z. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3660844 · Cited by 56
Rajendran, P., Chen, Y., Qiu, L., Niedermayr, T., Liu, W., Buyyounouski, M., Bagshaw, H., Han, B., Yang, Y., Kovalchuk, N., et al. (2024) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2024.07.2149 · Cited by 30
CILP-FGDI: Exploiting Vision-Language Model for Generalizable Person Re-Identification
Zhao, H., Qi, L., & Geng, X. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3536608 · Cited by 25
Zhao, Y., Wang, P., Zhao, Y., Du, H., & Yang, H. (2025) · Nature Communications · doi:10.1038/s41467-025-64574-w · Cited by 33
Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review
Lisondra, M., Benhabib, B., & Nejat, G. (2026) · Robotics · doi:10.3390/robotics15030055 · Cited by 32
AgriFM: A multi-source temporal remote sensing foundation model for Agriculture mapping
Li, W., Liang, S., Chen, K., Chen, Y., Ma, H., Xu, J., Ma, Y., Zhang, Y., Guan, S., Fang, H., et al. (2026) · Remote Sensing of Environment · doi:10.1016/j.rse.2026.115234 · Cited by 37
RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Model
Li, S., Wang, J., Dai, R., Ma, W., Ng, W. Y., Hu, Y., & Li, Z. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246030 · Cited by 25
To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions
Tanneberg, D., Ocker, F., Hasler, S., Deigmoeller, J., Belardinelli, A., Wang, C., Wersing, H., Sendhoff, B., & Gienger, M. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801517 · Cited by 33
HSE: A plug-and-play module for unified fault diagnosis foundation models
Li, Q., Chen, B., Chen, Q., Li, X., Qin, Z., & Chu, F. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103277 · Cited by 26
Real-time safety detection on construction sites using a vision-language and NLP-based model
Sivanraj, S., Uduwage, D. N. L. S., & Tripathi, M. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103889 · Cited by 23
Zhao, C., Liu, G., Zhang, R., Liu, Y., Wang, J., Kang, J., Niyato, D. T., Li, Z., Shen, X., Han, Z., et al. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3658762 · Cited by 31
ChatEarthNet: a global-scale image–text dataset empowering vision–language geo-foundation models
Yuan, Z., Xiong, Z., Mou, L., & Zhu, X. X. (2025) · Earth system science data · doi:10.5194/essd-17-1245-2025 · Cited by 36
Wong, S. M., Leung, H.-F., & Wong, K. Y. (2024) · Research Square · doi:10.21203/rs.3.rs-4063228/v1 · Cited by 23
MapReader: a framework for learning a visual language model for map analysis
Zhang, Y., Zhang, W., Zeng, Z., Jiang, K., Li, J., Min, W., Luo, W., Guan, Q., Lin, J., & Yu, W. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2455112 · Cited by 22
FusDreamer: Label-Efficient Remote Sensing World Model for Multimodal Data Classification
Wang, J., Song, W., Chen, H., Ren, J., & Zhao, H. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3554862 · Cited by 22
GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphs
Zhu, Y., Shi, H., Wang, X. C., Liu, Y., Wang, Y., Peng, B., Hong, C., & Tang, S. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714801 · Cited by 46
Huang, G., Xu, Z., Liu, L., Chen, J., He, Z., & Liu, F. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110806 · Cited by 23
Ho, Y., Li, L., & Mostafavi, A. (2024) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.13310 · Cited by 27
Context-Aware Local–Global Semantic Alignment for Remote Sensing Image–Text Retrieval
Chen, X., Zheng, X., & Lu, X. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3552304 · Cited by 21
Multimodal AI and Large Language Models for Orthopantomography Radiology Report Generation and Q&A
Dasanayaka, C., Dandeniya, K., Dissanayake, M. B., Gunasena, C., & Jayasinghe, R. D. (2025) · Applied System Innovation · doi:10.3390/asi8020039 · Cited by 24
Zeinaty, C. E., Hamidouche, W., Herrou, G., & Ménard, D. (2025) · ACM Computing Surveys · doi:10.1145/3744339 · Cited by 26
Optimizing large vision-language models for context-aware construction safety assessment
Kim, T., Kim, S., Chern, W., Park, S., Kim, D., & Kim, H. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106510 · Cited by 23
Ethological computational psychiatry: Challenges and opportunities
Monosov, I. E., Zimmermann, J., Frank, M. J., Mathis, M. W., & Baker, J. T. (2024) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2024.102881 · Cited by 21
Visual Instruction Tuning towards General-Purpose Multimodal Large Language Model: A Survey
Huang, J., Zhang, J., Jiang, K. Y., Qiu, H., Zhang, X., Shao, L., Lu, S., & Tao, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02572-7 · Cited by 44
Self-citationBaker, Q. B., Hammad, M., AL-Smadi, M., Al-Jarrah, H., Al-Hamouri, R., & Al-Zboon, S. A. (2024) · Journal of Imaging · doi:10.3390/jimaging10100250 · Cited by 20
RescueADI: Adaptive Disaster Interpretation in Remote Sensing Images With Autonomous Agents
Liu, Z., Zhao, D., Yuan, B., & Jiang, Z. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3532594 · Cited by 23
MammoVLM: A generative large vision–language model for mammography-related diagnostic assistance
Cao, Z., Deng, Z., Ma, J., Hu, J., & Ma, L. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102998 · Cited by 21
Logits DeConfusion with CLIP for Few-Shot Learning
Li, S., Liu, F., Hao, Z., Wang, X., Li, L., Liu, X., Chen, P., & Ma, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02366 · Cited by 26
Chen, X., Xu, P., Li, Y., Zhang, W., Song, F., He, M., & Shi, D. (2024) · iScience · doi:10.1016/j.isci.2024.110021 · Cited by 22
Efficient Prompt Tuning of Large Vision-Language Model for Fine-Grained Ship Classification
Lan, L., Wang, F., Zheng, X., Wang, Z., & Liu, X. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3509721 · Cited by 20
End-to-End Autonomous Driving in CARLA: A Survey
Ozaibi, Y. A., Hina, M. D., & Ramdane-Chérif, A. (2024) · IEEE Access · doi:10.1109/access.2024.3473611 · Cited by 20
Review on applications of computer vision techniques for pipeline inspection
Liu, Y., Moghaddas, S. A., Shi, S., Huang, Y., Kong, J., & Bao, Y. (2025) · Measurement · doi:10.1016/j.measurement.2025.117370 · Cited by 19
Leveraging Vision-Language Models for Manufacturing Feature Recognition in Computer-Aided Designs
Khan, M. T., Chen, L., Ng, Y. H., Feng, W., Tan, N. Y. J., & Moon, S. K. (2025) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4069266 · Cited by 27
A Survey on Video Temporal Grounding With Multimodal Large Language Model
Wu, J., Liu, W., Liu, Y., Liu, M., Nie, L., Lin, Z., & Chen, C. W. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3615586 · Cited by 26
Shi, Z., Landrum, E., O'Connell, A., Kian, M., Pinto-Alva, L., Shrestha, K., Zhu, X., & Matarić, M. J. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31245 · Cited by 29
Visual–language foundation models in medicine
Liu, C., Jin, Y., Guan, Z., Li, T., Qin, Y., Qian, B., Jiang, Z., Wu, Y.-L., Wang, X., Zheng, Y. F., et al. (2024) · The Visual Computer · doi:10.1007/s00371-024-03579-w · Cited by 25
MFCLIP: Multi-Modal Fine-Grained CLIP for Generalizable Diffusion Face Forgery Detection
Zhang, Y., Wang, T., Yu, Z., Gao, Z., Shen, L., & Chen, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3576577 · Cited by 27
Metadata
- Authors
- Zhang, J., Huang, J., Jin, S., & Lu, S.
- Affiliations
- Nanyang Technological University (SG)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-08
- Volume
- 46
- Issue
- 8
- Pages
- 5625-5644
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4392172801
- Cited by
- 1,051
- References
- 202
- Citations by year
- 2026: 432 · 2025: 486 · 2024: 124
- FWCI
- 132.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- vision-language models, visual recognition, zero-shot learning, transfer learning, knowledge distillation, image-text dataset, pre-training objectives, network architecture, benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
