The DOI matches its Crossref record; 194 of the 202 references it cites were found in a registry or an index.
Vision-Language Models for Vision Tasks: A Survey
Open accessAbstract
Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition paradigm. To address the two challenges, Vision-Language Models (VLMs) have been intensively investigated recently, which learns rich vision-language correlation from web-scale image-text pairs that are almost infinitely available on the Internet and enables zero-shot predictions on various visual recognition tasks with a single VLM. This paper provides a systematic review of visual language models for various visual recognition tasks, including: (1) the background that introduces the development of visual recognition paradigms; (2) the foundations of VLM that summarize the widely-adopted network architectures, pre-training objectives, and downstream tasks; (3) the widely-adopted datasets in VLM pre-training and evaluations; (4) the review and categorization of existing VLM pre-training methods, VLM transfer learning methods, and VLM knowledge distillation methods; (5) the benchmarking, analysis and discussion of the reviewed methods; (6) several research challenges and potential research directions that could be pursued in the future VLM studies for visual recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With the rise of multi-modal forgeries, recent approaches leverage deep learning models such as transformers [8] and visionlanguage models [9] to improve detection capabilities.”
From Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges (2024) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“As LLMs expand in the kinds of stimuli they can interpret -e.g.visual (OpenAI, 2023b;Zhang, Huang, et al., 2024;Gemini Team et al., 2024) -and the ways in which they can interact with the world -e.g.embodiment and tool use (Mialon et al., 2023) -, the space of transferable paradigms increases.”
From Machine Psychology (2023) · cites this paper as Zhang, Huang, et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Regarding improvements in symbolic or numeric reasoning, another technique is to prompt LLMs to use code for solving tasks (Zhang, Ge, et al., 2024).”
From Machine Psychology (2023) · cites this paper as Zhang, Ge, et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Flagged first, then by citations
8 of the 202 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- 10.5555/3524938.3525087 · DOI
- Radford, 2018, Improving language understanding by generative pre-training, OpenAI Blog
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1
- 10.1109/cvpr52688.2022.01553 · DOI · Paper page
- Ordonez, Im2Text: Describing images using 1 million captioned photographs, 1143
Cited by
Sorted by citations
Items 101–200 of 1,002
VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Model
Wang, S., Cao, X., Zhang, J., Yuan, Z., Shan, S., Chen, X., & Gao, W. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3683747 · Cited by 49
Self-citationMultiple Information Prompt Learning for Cloth-Changing Person Re-Identification
Wei, S., Gao, Z., Ma, C., Zhao, Y., Guan, W., & Chen, S. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3531217 · Cited by 19
Surgical video workflow analysis via visual-language learning
Li, P., Shu, X., Feng, C.-M., Feng, Y., Zuo, W., & Tang, J. (2025) · npj Health Systems · doi:10.1038/s44401-024-00010-3 · Cited by 21
Li, X., Sun, Y., Lin, J., Li, L., Feng, T., & Yin, S. (2025) · Artificial Intelligence Science and Engineering · doi:10.23919/aise.2005.000007 · Cited by 20
From Fragment to One Piece: A Review on AI-Driven Graphic Design
Zou, X., Zhang, W., & Zhao, N. (2025) · Journal of Imaging · doi:10.3390/jimaging11090289 · Cited by 25
Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extraction
Khan, M. T., Chen, L., Ng, Y. H., Feng, W., Tan, N. Y. J., & Moon, S. K. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-0887-7_31 · Cited by 18
GUing: A Mobile GUI Search Engine using a Vision-Language Model
Wei, J., Courbis, A.-L., Lambolais, T., Xu, B., Bernard, P. L., Dray, G., & Maalej, W. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3702993 · Cited by 25
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
Gong, R., Yang, Y., Gu, S., Huang, Y., Lv, C., Zhang, Y., Tao, D., & Liu, X. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-industry.12 · Cited by 33
Stueker, E. H., Kolbinger, F. R., Saldanha, O. L., Digomann, D., Pistorius, S. R., Oehme, F., van Treeck, M., Ferber, D., Loeffler, C. M. L., Weitz, J., et al. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000003069 · Cited by 17
Kim, S., Nguyen, T. P., & Yoon, J. (2025) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-025-00769-2 · Cited by 17
AI-enabled scientific revolution in the age of generative AI: second NSF workshop report
Karpatne, A., Deshwal, A., Jia, X., Ding, W. Y., Steinbach, M. S., Zhang, A., & Kumar, V. (2025) · npj Artificial Intelligence · doi:10.1038/s44387-025-00018-6 · Cited by 17
Visual Grounding in 2D and 3D: A unified perspective and survey
Guo, K., Huang, Y., Jia, T., Song, X., Sun, S., Wei, H., Han, X.-F., Huang, S., Strisciuglio, N., & Li, S. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103625 · Cited by 19
Foundation Models and Biometrics: A Survey and Outlook
Shahreza, H. O., & Marcel, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3602233 · Cited by 20
Multimodal Driver Condition Monitoring System Operating in the Far-Infrared Spectrum
Knapik, M., Cyganek, B., & Balon, T. (2024) · Electronics · doi:10.3390/electronics13173502 · Cited by 17
Multimodal Integration in Large Language Models: A Case Study with Mistral LLMPreprint
Sulaiman, N., & Hamzah, F. (2024) · doi:10.31219/osf.io/9y5ds · Cited by 17
Malagoli, E., & Persio, L. D. (2025) · Mathematics · doi:10.3390/math13060893 · Cited by 19
Wang, B., Han, J., Zhao, X., Yin, Y., Chen, L., & Childs, P. (2025) · Design and Artificial Intelligence · doi:10.1016/j.daai.2025.100006 · Cited by 17
Automating traffic model enhancement with AI research agent
Guo, X., Yang, X., Peng, M., Lu, H., Zhu, M., & Yang, H. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105187 · Cited by 18
Hou, X., Wang, W., Yang, L., Lin, H., Feng, J., Min, H., & Zhao, X. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3619807 · Cited by 16
Zhang, Q., Wang, S., Zhang, T., Ren, G., Zhang, L., Wang, Y., Zheng, B., Li, J., & Zheng, H. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.111227 · Cited by 19
Liu, C., Tang, D., Zhu, H., Zhang, Z., Wang, L., & Nie, Q. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.11.019 · Cited by 16
Generative artificial intelligence in chemical engineering spans multiple scales
Decardi‐Nelson, B., Alshehri, A. S., & You, F. (2024) · Frontiers in Chemical Engineering · doi:10.3389/fceng.2024.1458156 · Cited by 16
ViDDAR: Vision Language Model-Based Task-Detrimental Content Detection for Augmented Reality
Xiu, Y., Scargill, T., & Gorlatova, M. A. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549147 · Cited by 21
Distraction is All You Need for Multimodal Large Language Model Jailbreaking
Yang, Z., Fan, J., Yan, A., Gao, E., Lin, X., Li, T., Mo, K., & Dong, C. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00884 · Cited by 16
Automating the Enterprise with Foundation Models
Wornow, M., Narayan, A., Opsahl-Ong, K., McIntyre, Q., Shah, N., & Ré, C. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3681954.3681964 · Cited by 15
Tomita, K., Nishida, T., Kitaguchi, Y., Kitazawa, K., & Miyake, M. (2025) · Clinical ophthalmology · doi:10.2147/opth.s494480 · Cited by 17
Integrating Vision‐Language Models for Accelerated High‐Throughput Nutrition Screening
Ma, P., Wu, Y., Yu, N., Jia, X., He, Y., Zhang, Y., Michael Backes, A., Wang, Q., & Wei, C. (2024) · Advanced Science · doi:10.1002/advs.202403578 · Cited by 15
Contextual Emotion Recognition using Large Vision Language Models
Etesam, Y., Yalçın, Ö. N., Zhang, C., & Lim, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802538 · Cited by 23
Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy
Pattnayak, P., Patel, H. L., Kumar, B., Agarwal, A., Banerjee, I., Panda, S., & Kumar, T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-14041-8_4 · Cited by 30
Libra: Leveraging Temporal Images for Biomedical Radiology Analysis
Zhang, X., Meng, Z., Lever, J., & Ho, E. S. L. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.888 · Cited by 19
Causal Interventional Prompt Tuning for Few-Shot Out-of-Distribution Generalization
Wen, J., Liu, Y. X., Huang, C., Liu, C., Xu, Y. D., & Cao, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3621250 · Cited by 16
EASI-Tex: Edge-Aware Mesh Texturing from Single Image
Perla, S. R. K., Wang, Y., Amiri, A. M., & Zhang, H. (2024) · ACM Transactions on Graphics · doi:10.1145/3658222 · Cited by 22
Self-supervised visual–textual prompt learning for few-shot grading of gastric intestinal metaplasia
Chen, X., Zheng, X., Li, Z., Ma, M., & Zhang, M. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112303 · Cited by 14
Zhang, Y., Miao, C., Luo, M., Li, J., Deng, W., Yao, W., Li, Z., Hu, B., Feng, W., Gong, T., et al. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688984 · Cited by 16
Fergus, P., Chalmers, C., Matthews, N., Nixon, S., Burger, A., Hartley, O., Sutherland, C. S., Lambin, X., Longmore, S. N., & Wich, S. A. (2024) · Sensors · doi:10.3390/s24248122 · Cited by 16
Zheng, Z., Wu, H., Lv, L., Bardou, D., Niu, S., & Yu, G. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07409-1 · Cited by 14
KAID: Knowledge-Aware Interactive Distillation for Vision-Language Models
Zhang, D., Wang, F., Li, B., Zhao, Z., Gao, J., & Li, X. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755008 · Cited by 17
MedSumm: A Multimodal Approach to Summarizing Code-Mixed Hindi-English Clinical Queries
Ghosh, A., Acharya, A., Jha, P., Saha, S., Gaudgaul, A., Majumdar, R., Chadha, A. R., Jain, R., Sinha, S., & Agarwal, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56069-9_8 · Cited by 13
Leveraging Large Vision-Language Model for Better Automatic Web GUI Testing
Wang, S., Wang, S., Fan, Y., Li, X., & Liu, Y. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00022 · Cited by 18
Consistent prompt learning for vision-language models
Zhang, Y., & Tian, X. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.112974 · Cited by 15
Multimodal artificial intelligence models for radiology
Tariq, A., Banerjee, I., Trivedi, H., & Gichoya, J. W. (2025) · BJR|Artificial Intelligence · doi:10.1093/bjrai/ubae017 · Cited by 14
Enhancing cross-domain generalization by fusing language-guided feature remapping
Qiao, Z., Shi, D., Jin, S., Shi, Y., Jing, L., & Qiu, C. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103029 · Cited by 14
Self-citationTowards deployment-centric multimodal AI beyond vision and language
Liu, X., Zhang, J., Zhou, S., van der Plas, T. L., Vijayaraghavan, A., Grishina, A., Zhuang, M., Schofield, D., Tomlinson, C., Wang, Y., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01116-5 · Cited by 16
Self-citationLearning Positive–Negative Prompts for Open-Set Remote Sensing Scene Classification
Sun, H., Chen, H., Chen, W., Wang, C., Xie, W., & Lu, X. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3599188 · Cited by 13
SwiftSketch: A Diffusion Model for Image-to-Vector Sketch Generation
Arar, E., Frenkel, Y., Cohen‐Or, D., Shamir, A., & Vinker, Y. (2025) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3721238.3730612 · Cited by 12
Li, M., Gan, V. J. L., & Wang, B. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106455 · Cited by 12
Liu, D., Bai, J., Zhang, Z., Zhang, Y., Zhang, Z., Zhao, J., & An, P. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749497 · Cited by 15
What Matters in Constructing a Visual Servoing Scheme: A Review of Key Issues and Solutions
Xu, F., Wang, H., & Gao, H. (2025) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2025.3605943 · Cited by 12
Hu, L., He, W. P., Zhang, L., & Zhang, H. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3624074 · Cited by 12
Industrial Language-Image Dataset (ILID): Adapting Vision Foundation Models for Industrial Settings
Moenck, K., Thieu, D. T., Koch, J., & Schüppstuhl, T. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.10.084 · Cited by 13
From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave
Fuchs, M., Genty, É., Bangerter, A., Zuberbühler, K., Odobez, J., & Coţofrei, P. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02484-6 · Cited by 12
IDEA: Image description enhanced CLIP-adapter for image classification
Ye, Z., Jiang, F., Wang, Q., Huang, K., & Huang, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112224 · Cited by 17
Self-citationA Survey of Large Language Models in Mental Health Disorder Detection on Social Media
Ge, Z., Hu, N., Li, D., Wang, Y., Qi, S., Xu, Y., Han, S., & Zhang, J. Y. (2025) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew67478.2025.00027 · Cited by 15
Self-citationMultimodal AI for UAV: Vision–Language Models in Human– Machine Collaboration
Krupáš, M., Urblík, Ľ., & Zolotová, I. (2025) · Electronics · doi:10.3390/electronics14173548 · Cited by 12
LeapVAD: A Leap in Autonomous Driving via Cognitive Perception and Dual-Process Thinking
Ma, Y., Wei, T., Zhong, N., Mei, J., Hu, T., Wen, L., Yang, X., Shi, B., & Liu, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3626711 · Cited by 25
Foundation Model-Based Spectral–Spatial Transformer for Hyperspectral Image Classification
Huang, L., Chen, Y., & He, X. Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3456129 · Cited by 14
VLLFL: A Vision-Language Model Based Lightweight Federated Learning Framework for Smart AgriculturePreprint
Li, L., Huang, Y., Li, J., Chen, D., Pu, L., & Yao, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6828983 · Cited by 12
Sparks of Large Audio Models: A Survey and Outlook
Latif, S., Shoukat, M., Shamshad, F., Usama, M., Ren, Y., Cuayáhuitl, H., Wang, W., Zhang, X., Togneri, R., Cambria, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.12792 · Cited by 17
“…immense potential, these expansive AI models signify a new technological wave that promises a rich ecosystem of real-world applications and have already found extensive applications in various sectors such as vision [23, 24], language, health, education, robotics, and governance, among others.”
BackgroundWhen Generative Artificial Intelligence Meets Extended Reality: A Systematic Review
Ning, X., Zhuo, Y., Wang, X., Sio, C.-I., & Lee, L. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2565392 · Cited by 13
Liu, S., Xie, J., Wang, X., & Qiao, X. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103174 · Cited by 11
Vision-Language Models for Highway Roadside Safety Management: A Comparative Study
Sadeghi, M., Mansouri, A., & Erfani, A. (2025) · Journal of Management in Engineering · doi:10.1061/jmenea.meeng-7141 · Cited by 11
Herrera-Granda, I. D., Alemany, M. M. E., Peluffo-Ordóñez, D. H., Herrera-Granda, E. P., & D’Ambrosio, G. (2026) · IEEE Access · doi:10.1109/access.2026.3657974 · Cited by 11
Nasir, M. F., Rehman, M. U., & Hussain, I. (2026) · Frontiers in Plant Science · doi:10.3389/fpls.2025.1735096 · Cited by 11
Cali, Ü., Halden, U., Andoni, M., Çatak, F. Ö., Chen, S., Couraud, B., Kantar, E., Knapper, S., Küçükdemiral, İ. B., Kusetoğulları, H., et al. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11545-2 · Cited by 12
Learning to Learn Better Visual Prompts
Wang, F., Huang, W., Yang, S., Fan, Q., & Lan, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28343 · Cited by 12
Vision-language pre-training via modal interaction
Cheng, H., Ye, H., Zhou, X., Liu, X., Chen, F., & Wang, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110809 · Cited by 12
Duan, Y., Gu, Z., Ying, Z., Qi, L., Meng, C., & Shi, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680860 · Cited by 12
Would Deep Generative Models Amplify Bias in Future Models?
Chen, T., Hirota, Y., Otani, M., García, N., & Nakashima, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01030 · Cited by 18
GIST: Improving Parameter Efficient Fine-Tuning via Knowledge Interaction
Ruan, J., Gao, J., Xie, M., Xiang, S., Yu, Z., Liu, T., Fu, Y., & Qu, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680843 · Cited by 15
DRC-Coder: Automated DRC Checker Code Generation Using LLM Autonomous Agent
Chang, C.-C., Ho, C.-T., Li, Y., Chen, Y., & Ren, H. M. (2025) · International Symposium on Physical Design · doi:10.1145/3698364.3705347 · Cited by 16
CLIP-Driven Transformer for Weakly Supervised Object Localization
Chen, Z., Shen, Y., Cao, L., Zhang, S., & Ji, R. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3548704 · Cited by 11
VaVLM: Toward Efficient Edge-Cloud Video Analytics With Vision-Language Models
Zhang, Y., Wang, H., Bai, Q., Liang, H., Zhu, P., Muntean, G., & Li, Q. (2025) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2025.3549983 · Cited by 14
Yao, F., Yue, Y., Liu, Y., Wang, Z., Jin, L., Zhao, B., Zhao, J., Sun, X., & Fu, K. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3697634 · Cited by 11
A temporal–spectral fusion transformer with subject-specific adapter for enhancing RSVP-BCI decoding
Li, X., Wei, W., Qiu, S., & He, H. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106844 · Cited by 12
Integrating advanced vision-language models for context recognition in risks assessment
Rodriguez-Juan, J., Ortiz-Pérez, D., García‐Rodríguez, J., Tomás, D., & Nalepa, G. J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129131 · Cited by 11
Duan, L., Xiu, Y., & Gorlatova, M. A. (2025) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw66409.2025.00039 · Cited by 10
Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems
Wilson, E., Sendhilnathan, N., Burlingham, C. S., Mansour, Y., Cavin, R., Tetali, S. D., Fernandes, A. S., & Proulx, M. J. (2025) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3715669.3727349 · Cited by 10
UP-Person: Unified Parameter-Efficient Transfer Learning for Text-Based Person Retrieval
Liu, Y., Li, Y., Lan, X., Yang, W., Liu, Z., & Liao, Q. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3588406 · Cited by 10
A survey on physical adversarial attacks against face recognition systems
Wang, M., Zhou, J., Li, T., Meng, G., & Chen, K. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132485 · Cited by 10
Envisioning Medclip: A Deep Dive into Explainability for Medical Vision-Language Models
Hashmi, A. U. R., Mahapatra, D., & Yaqub, M. K. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635843 · Cited by 9
Exploring the Zero-Shot Capabilities of Vision-Language Models for Improving Gaze Following
Gupta, A., Vuillecard, P., Farkhondeh, A., & Odobez, J. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00066 · Cited by 12
Yuan, Z., Xie, F., & Ji, T. (2024) · International Conference on Robotics and Computer Vision (ICRCV) · doi:10.1109/icrcv62709.2024.10758606 · Cited by 10
Lei, K., & Qi, Z. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3534228 · Cited by 9
Large Language Models as Few-Shot Defect Detectors for Additive Manufacturing
Fang, Q., Xiong, G., Wang, F., Shen, Z., Dong, X., & Wang, F. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865554 · Cited by 10
MIF: Multi-source information fusion for few-shot classification with CLIP
Chen, J., Yuan, H., & Xie, B. (2025) · Pattern Recognition Letters · doi:10.1016/j.patrec.2025.03.025 · Cited by 9
Evaluation of Thermal Comfort in Urban Commercial Space with Vision–Language-Model-Based Agent Model
Zhang, D., Xiong, Z., & Zhu, X. (2025) · Land · doi:10.3390/land14040786 · Cited by 9
Lee, J.-H., & Rew, J. (2025) · Sensors · doi:10.3390/s25103020 · Cited by 9
VL-PAW: A Vision–Language Dataset for Pear, Apple and Weed
Yu, G.-H., Anh, L. H., Vu, D. T., Lee, J., Rahman, Z. U., Lee, H.-Z., Jo, J.-A., & Kim, J. Y. (2025) · Electronics · doi:10.3390/electronics14102087 · Cited by 12
Prompting Vision-Language Model for Nuclei Instance Segmentation and Classification
Yao, J., Guo, G., Zheng, Z., Xie, Q., Han, L., Zhang, D., & Han, J. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3579214 · Cited by 9
Medical Knowledge Intervention Prompt Tuning for Medical Image Classification
Du, Y., Yu, N., & Wang, S. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3584841 · Cited by 9
Cheng, Z., Ma, Y., Lang, J., Zhang, K., Zhong, T., Wang, Y. J., & Zhou, F. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736982 · Cited by 9
Chen, B., Chen, K., Yang, M., Zou, Z., & Shi, Z. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3612420 · Cited by 9
Wang, Y., Cui, J., Zhai, C., Tao, X., & Li, Y. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.104320 · Cited by 11
Foundation Models Meet Medical Image Interpretation
Jiao, L., Hao, J., Li, R., Li, L., Liu, X., Liu, F., Ma, W., Chen, P., Huang, Z., Yang, J., et al. (2026) · Research · doi:10.34133/research.1024 · Cited by 12
Zhang, T., 徐林攀, Zhang, X., Han, X., Zhu, J., Zhang, L., Wang, G., & Jiao, L. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.03.013 · Cited by 9
AWM-Fuse: Multi-Modality Image Fusion for Adverse Weather via Global and Local Text Perception
Li, X., Liu, H., Li, X., Ye, T., Kuang, Z., & Li, H. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3690324 · Cited by 9
S3A: Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignment
Zhang, S., Naseer, M., Chen, G., Shen, Z., Khan, S. H., Zhang, K., & Khan, F. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28557 · Cited by 9
Chen, Y.-Y., Jhong, S.-Y., Lin, H.-C., & Wu, Y.-C. (2025) · IEEE Multimedia · doi:10.1109/mmul.2025.3525559 · Cited by 8
Soekamto, Y. S., Lim, A. P., Limanjaya, L. C., Purwanto, Y. K., Lee, S., & Kang, D.-K. (2025) · Sensors · doi:10.3390/s25020449 · Cited by 8
Video Fire Recognition Using Zero-Shot Vision-Language Models Guided by a Task-Aware Object Detector
Gragnaniello, D., Greco, A., Sansone, C., & Vento, B. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3721291 · Cited by 8
Metadata
- Authors
- Zhang, J., Huang, J., Jin, S., & Lu, S.
- Affiliations
- Nanyang Technological University (SG)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-08
- Volume
- 46
- Issue
- 8
- Pages
- 5625-5644
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4392172801
- Cited by
- 1,051
- References
- 202
- Citations by year
- 2026: 432 · 2025: 486 · 2024: 124
- FWCI
- 132.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- vision-language models, visual recognition, zero-shot learning, transfer learning, knowledge distillation, image-text dataset, pre-training objectives, network architecture, benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review