The DOI matches its Crossref record; 138 of the 145 references it cites were found in a registry or an index.
Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Open accessAbstract
The exponential growth of large language models (LLMs) has opened up numerous possibilities for multi-modal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal AGI, has not kept pace with LLMs. In this work, we design a large-scale vision-language foun-dation model (Intern VL), which scales up the vision foun-dation model to 6 billion parameters and progressively aligns it with the LLM, using web-scale image-text data from various sources. This model can be broadly applied to and achieve state-of-the-art performance on 32 generic visual-linguistic benchmarks including visual perception tasks such as image-level or pixel-level recognition, vision-language tasks such as zero-shot image/video classification, zero-shot image/video-text retrieval, and link with LLMs to create multi-modal dialogue systems. It has powerful visual capabilities and can be a good alternative to the ViT-22B. We hope that our research could contribute to the development of multi-modal large models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Context-aware modeling is widely used across various domains, including natural language processing [219], computer vision [220], and recommendation systems [221], where it can substantially boost both system performance and user experience.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [219]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Research works printed but not linked: 23
- Achiam, 2023, Gpt-4 technical report, arXiv preprint
- Bai, 2023, Qwen tech-nical report, arXiv preprint
- Bai, 2023, Qwen-vl: A frontier large vision-language model with versatile abilities, arXiv preprint
- Byeon, 2022, Coyo-700m: Image-text pair dataset
- Carlsson, 2022, Cross-lingual and multilingual clip, LREC, 6848
- Chen, 2023, Shikra: Unleashing multi-modal 11ms referential dialogue magic, arXiv preprint
- Dosovitskiy, 2020, An image is worth 16×16 words: Transformers for image recognition at scale, ICLR
- Goyal, 2017, Making the v in vq a matter: El-evating the role of image understanding in visual question answering, CVPR, 6904
- 2023, Introducing idefics: An open reproduction of state-of-the-art visual language model
- Ilharco, 2021, Open-clip. Zenodo. Version 0.1
- 2023, Clip benchmark: Clip-like model evaluation
- Li, 2023, Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models, 19730
- Li, 2019, Coco-en for cross-lingual image tagging, captioning, and retrieval, TMM, 21, 2347
- Liu, 2023, Aligning large multi-modal model with robust instruction tuning, arXiv preprint
- Sawada, 2022, Construction and public release of language image pretraining models in japanese, MIRU
- Oquab, 2023, Dinov2: Learning robust visual features with-out supervision, TMLR
- Schuhmann, 2022, Laion coco:600m synthetic captions from laion2b-en
- Sun, 2024, Generative pretraining in mul-timodality, ICLR
- Sun, 2023, Moss: Training conversationallanguage models from synthetic data, arXiv preprint, 7
- Taori, 2023, Alpaca: A strong, replicable instruction-following model, Stanford Center for Research on Foundation Models, 3, 7
- Team, 2023, Internlm: A multilingual language model with progressively enhanced capabilities
- Xie, 2022, Zero and r2d2: A large-scale chi-nese cross-modal benchmark and a vision-language frame-work, arXiv preprint
- Zhu, 2023, Ghost in the minecraft: Generally capable agents for open-world enviroments via large language models with text-based knowledge and memory, arXiv preprint
Cited by
Sorted by citations
Items 101–200 of 843
Ishaq, A., Lahoud, J., More, K., Thawakar, O., Thawkar, R., Dissanayake, D., Ahsan, N., Li, Y., Khan, F. S., Cholakkal, H., et al. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247360 · Cited by 14
Docopilot: Improving Multimodal Models for Document-Level Understanding
Duan, Y., Chen, Z., Hu, Y., Wang, W., Ye, S., Shi, B., Lu, L., Hou, Q., Lü, T., Li, H., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00381 · Cited by 15
Self-citationCityVLM: Towards sustainable urban development via multi-view coordinated vision–language model
Wang, J., Xuan, W., Qi, H., Chen, Z., Chen, H., Zheng, Z., Xia, J., Zhong, Y., & Yokoya, N. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.11.030 · Cited by 15
Self-citationFu, T., Liu, T., Han, Q., Dai, G., Yan, S., Yang, H., Ning, X., & Wang, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02103 · Cited by 13
TB-Net: Intra- and inter-video correlation learning for continuous sign language recognition
Liu, J., Xue, W., Zhang, K., Yuan, T., & Chen, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102438 · Cited by 13
Xu, J., Wu, M., Hu, X., Fu, C., Dou, Q., & Heng, P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72649-1_9 · Cited by 16
CLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMs
Ouali, Y., Bulat, A., Martínez, B., & Tzimiropoulos, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_23 · Cited by 23
Schneider, F., & Sitaram, S. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.250 · Cited by 13
Frontiers in Intelligent Colonoscopy
Ji, G.-P., Liu, J., Xu, P., Barnes, N. M., Khan, F. S., Khan, S. H., & Fan, D.-P. (2026) · Machine Intelligence Research · doi:10.1007/s11633-025-1597-6 · Cited by 19
Sun, Y., & Zhou, T. (2025) · IEEE Access · doi:10.1109/access.2025.3591447 · Cited by 14
EEE-Bench: A Comprehensive Multimodal Electrical And Electronics Engineering Benchmark
Li, M., Zhong, J., Chen, T., Lai, Y., & Psounis, K. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01245 · Cited by 12
Towards bias-aware visual question answering: Rectifying and mitigating comprehension biases
Chen, C., Han, D., Guo, Z., & Chang, C. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125817 · Cited by 12
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering
Tang, J., Liu, Q., Ye, Y., Lu, J., Wei, S., Wang, A.-L., Lin, C., Feng, H., Zhen, Z., Wang, Y., et al. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.404 · Cited by 12
BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devices
Lü, X., Chen, Y., Chen, C., Tan, H. S., Chen, B., Xie, Y., Hu, R., Tan, G., Wu, R., Hu, Y., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00392 · Cited by 12
Vinci: A Real-time Smart Assistant Based on Egocentric Vision-language Model for Portable Devices
Huang, Y., Xu, J., Pei, B., Yang, L., Zhang, M., He, Y., Guo, C., Chen, X., Wang, Y., Nie, Z., et al. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749513 · Cited by 37
Self-citationLeapVAD: A Leap in Autonomous Driving via Cognitive Perception and Dual-Process Thinking
Ma, Y., Wei, T., Zhong, N., Mei, J., Hu, T., Wen, L., Yang, X., Shi, B., & Liu, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3626711 · Cited by 25
Deep learning model with pathological knowledge for detection of colorectal neuroendocrine tumor
Zheng, K., Duan, J., Wang, R., Chen, H., He, H., Zheng, X., Zhao, Z., Jing, B., Zhang, Y., Liu, S., et al. (2024) · Cell Reports Medicine · doi:10.1016/j.xcrm.2024.101785 · Cited by 13
Data augmented large language models for medical record generation
Zhang, X., Zhao, G., Ren, Y., Wang, W., Cai, W., Zhao, Y., Zhang, X., & Liu, J. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05934-9 · Cited by 13
Self-citationClotheDreamer: Text-guided garment generation with 3D gaussians
Liu, Y., Tang, J., Chu, Z., Zhu, J., Wang, C., & Huang, D. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06596-x · Cited by 20
Patnaik, S., Jain, R., Krishnamurthy, B., & Sarkar, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02207 · Cited by 11
LLMI3D: MLLM-Based 3D Perception From a Single 2D Image
Yang, F., Zhao, S., Zhang, Y., Chen, H., Lu, H., Han, J., & Ding, G. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3654407 · Cited by 17
Tian, K., Mao, J., Zhang, Y., Jiang, J., Zhou, Y., & Tu, Z. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00480 · Cited by 34
Yao, F., Yue, Y., Liu, Y., Wang, Z., Jin, L., Zhao, B., Zhao, J., Sun, X., & Fu, K. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3697634 · Cited by 11
M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models
Li, C., Shangguan, Z., Zhao, Y., Li, D., Liu, Y., & Cohan, A. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.904 · Cited by 8
Xin, C., Hartel, A., & Kasneci, E. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125124 · Cited by 11
Yang, C., Dong, X., Zhu, X., Su, W., Wang, J., Tian, H., Chen, Z., Wang, W., Lu, L., & Dai, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02322 · Cited by 16
Self-citationAnderer, K., Müller, K., Strobel, L., Wölfel, M., Niehues, J., & Gerling, K. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746349 · Cited by 14
Yuan, L., Wang, J., Sun, H., Zhang, Y., & Lin, Y. (2025) · Qeios · doi:10.32388/x26ilu · Cited by 15
MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior AnalysisPreprint
Xu, T. G., Zhou, T., Wang, Y., Yang, P., Tang, S., Shao, K., Tang, Z., Liu, Y., Chen, X., Liu, Y., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.27.645630 · Cited by 13
Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection
Yang, L., Zheng, Z., Chen, B., Zhao, Z., Lin, C., & Shen, C. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01364 · Cited by 9
OpenAD: Open-World Autonomous Driving Benchmark for 3D Object Detection
Xia, Z., Li, J., Lin, Z., Wang, X., Wang, Y., & Yang, M.-H. (2025) · neural information processing systems · doi:10.52202/085713-4084 · Cited by 18
Multi-Modal Large Language Model with RAG Strategies in Soccer Commentary Generation
Li, X., He, Y., Zu, S., Li, Z., Shi, T., Xie, Y., & Zhang, K. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00604 · Cited by 9
Beyond the Hype: A Dispassionate Look at Vision–Language Models in Medical Scenario
Yang, N., Zhou, H., Xing, X., & Yang, G. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3558857 · Cited by 9
Dar, S. S., Kaurav, B., Jain, A., Raghaw, C. S., Rehman, M. Z. U., & Kumar, N. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106480 · Cited by 9
Tomato Leaf Disease Identification Framework FCMNet Based on Multimodal Fusion
Deng, S., Zhu, J., Hu, Y., He, M., & Xia, Y. (2025) · Plants · doi:10.3390/plants14152329 · Cited by 9
Parikh, C., Rawat, D., T., R. R., Ghosh, T., & Sarvadevabhatla, R. K. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01770 · Cited by 9
Emulating human-like adaptive vision for efficient and flexible machine visual perception
Wang, Y., Yang, Y., Yue, Y., Wang, H., Jiang, H., Han, Y., Ni, Z., Pu, Y., Shi, M., Lu, R., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01130-7 · Cited by 15
SARLANG-1M: A Benchmark for Vision–Language Modeling in SAR Image Understanding
Wei, Y., Xiao, A., Ren, Y., Zhu, Y., Chen, H., Xia, J., & Yokoya, N. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3652099 · Cited by 19
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model
Shi, Y., Zhu, X., Wang, K., Hu, Y., Guo, C., Li, M., & Wu, J. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11357048 · Cited by 9
Self-citationExplore How to Inject Beneficial Noise in MLLMs
Zhu, R., Huang, S., Jiao, Z., & Zhang, H. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i34.40153 · Cited by 9
Mdp 3 : a Training-Free Approach for List-Wise Frame Selection in Video-Llms
Sun, H., Lu, S., Wang, H., Chen, Q.-G., Xu, Z., Luo, W., Zhang, K., & Li, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02233 · Cited by 9
Yu, J., Zhang, Y., Zhang, Z., Zhao, Y., Zhao, G., Sun, F., Zhang, F., Liu, Q., Sun, J., Liang, J., et al. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688990 · Cited by 13
Progressive Multimodal Reasoning via Active Retrieval
Dong, G., Zhang, C., Deng, M., Zhu, Y., Dou, Z., & Wen, J.-R. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.180 · Cited by 9
Integrate the Temporal Scheme for Unsupervised Video Summarization via Attention Mechanism
Bang, V. Q., & Viet, V. H. (2025) · IEEE Access · doi:10.1109/access.2025.3546149 · Cited by 8
Jiang, C., Zhang, P., Ni, Y., Wang, X., Peng, H., Liu, S., Fei, M., He, Y., Xiao, Y., Huang, J., et al. (2025) · The Visual Computer · doi:10.1007/s00371-025-03829-5 · Cited by 9
Joshi, K. S., Li, X., Windisch, T., & König, M. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130513 · Cited by 8
Embodied Scene Understanding for Vision Language Models via MetaVQA
Wang, W., Duan, C., Peng, Z., Liu, Y., & Zhou, B. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02091 · Cited by 13
Self-citationJTD-UAV: MLLM-Enhanced Joint Tracking and Description Framework for Anti-UAV Systems
Wang, Y., Zhao, J., Fan, Z., Zhang, X., Wu, X., Zhang, Y., Jin, L., Li, X., Wang, G., Jia, M., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00160 · Cited by 9
Token Activation Map to Visually Explain Multimodal LLMs
Li, Y., Wang, H., Ding, X., Wang, H., & Li, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00012 · Cited by 8
Ma, J., Deng, Y., Chen, C., Du, N., Lu, H., & Yang, Z. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i6.32636 · Cited by 8
EvoChart: A Benchmark and a Self-Training Approach Towards Real-World Chart Understanding
Huang, M., Lai, H., Zhang, X., Wu, W., Ma, J., Zhang, L., & Liu, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i4.32383 · Cited by 9
ReceiptQA: A Question-Answering Dataset for Receipt Understanding
Abdalla, M. I., Kasem, M. S., Mahmoud, M., Yagoub, B., Senussi, M. F., Abdallah, A., Kang, S. H., & Kang, H. (2025) · Mathematics · doi:10.3390/math13111760 · Cited by 10
AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Images
Li, Y., Wu, S., Sun, W., Zhang, Z., Zhu, Y., Zhang, Z., Duan, H., Min, X., & Zhai, G. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3639620 · Cited by 14
VSLLaVA: A pipeline for Large Multimodal Foundation Models in industrial vibration signal analysis
Li, Q., Zhang, X., Huang, J., He, H., Zhang, F., Qin, Z., & Chu, F. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105023 · Cited by 7
Multi-Modal CLIP-Informed Protein Editing
Yin, M., Zhou, H., Zhu, Y., Lin, M., Wu, Y., Wu, J., Xu, H., Hsieh, C., Hou, T., Chen, J., et al. (2024) · Health Data Science · doi:10.34133/hds.0211 · Cited by 13
Self-citationEnhancing knowledge distillation for semantic segmentation through text-assisted modular plugins
Wu, L., Zhang, S., Zhang, C., Zhao, Z., Liang, J., & Yang, W. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2024.111329 · Cited by 7
Wang, Y., Shao, Y., Yu, Z., & Wang, Z. (2025) · Applied Sciences · doi:10.3390/app15031577 · Cited by 7
A Comparative Study of Vision Language Models for Italian Cultural Heritage
Vitaloni, C., Shullani, D., & Baracchi, D. (2025) · Heritage · doi:10.3390/heritage8030095 · Cited by 7
Addressing Ambiguous Queries in Video Retrieval with Advanced Temporal Search
Gia, B. T., Khanh, T. B. C., Thanh, T. L. T., Tran, K., Trong, H. H., Doan, T. T., Le, K., Do, T., Le, D.-D., & Ngo, T. D. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4291-5_14 · Cited by 7
Bao, L. L., Phong, H. N., Tien, T. N., Thuan, P. N., Minh, T. H., Doan, T. T., Le, K., Do, T., Le, D.-D., & Ngo, T. D. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4291-5_17 · Cited by 7
R-Bench: Are Your Large Multimodal Model Robust to Real-World Corruptions?
Li, C., Zhang, J., Zhang, Z., Wu, H., Tian, Y., Sun, W., Lu, G. S., Min, X., Liu, X., Lin, W., et al. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3558652 · Cited by 7
PathVLM-Eval: Evaluation of open vision language models in histopathology
Gilal, N. U., Zegour, R., Al-Thelaya, K., Özer, E., Agus, M., Schneider, J., & Boughorbel, S. (2025) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2025.100455 · Cited by 7
Liang, J., Huang, W., Wan, G., Yang, Q., & Ye, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02437 · Cited by 7
Pan, X., Bai, Y., Zou, K., Zhou, Y., Zhou, J., Fu, H., Tham, Y. C., & Liu, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103631 · Cited by 8
Song, W., Nabahirwa, E., Zhang, M., Fang, Y., & Ni, Z. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-00895-z · Cited by 12
A Token-Level Text Image Foundation Model for Document Understanding
Guan, T., Wang, Z., Fu, P., Guo, Z., Shen, W., Zhou, K., Yue, T., Duan, C., Sun, H., Jiang, Q., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02155 · Cited by 16
Colmdriver: Llm-Based Negotiation Benefits Cooperative Autonomous Driving
Liu, C., Liu, G. H., Wang, Z., Yang, J., & Chen, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02407 · Cited by 7
Hu, X., Xing, Z., Wang, T., Fu, C., & Heng, P. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02744-z · Cited by 7
MMInstruct: a high-quality multi-modal instruction tuning dataset with extensive diversity
Liu, Y., Cao, Y. Q., Gao, Z., Wang, W., Chen, Z., Wang, W., Tian, H., Lu, L., Zhu, X., Lu, T., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4187-3 · Cited by 34
Self-citationLarge Language Models for Video Surveillance Applications
Silva, U. D., Fernando, L., Lau, B. P. L., Koh, Z., Joyce, S. C., Yuen, B., & Yuen, C. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902892 · Cited by 7
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation
Huang, J., Chen, L., Guo, T., Fu, Z., Zhao, Y., Wu, B., Yuan, Y., Zhao, H., Guo, Z., Zhang, Y., et al. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.247 · Cited by 8
Onohara, S., Miyai, A., Imajuku, Y., Egashira, K., Baek, J., Yue, X., Neubig, G., & Aizawa, K. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.43 · Cited by 12
Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM
Song, D., Lai, S., Wang, M., Chen, S., Sun, L., & Wang, B. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.556 · Cited by 21
Enhancing vision-language models through pre-training-free knowledge fusion with TransferCVLM
Choi, D., Kim, J.-J., & Lee, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113986 · Cited by 8
Wu, Q., Zhou, Y., Ye, W., Sun, X., & Ji, R. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02702-1 · Cited by 7
Zhang, J., & Zhang, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103206 · Cited by 6
Yang, L., Yang, H., He, X., Huang, W., & Lv, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113704 · Cited by 6
Zhu, G., Tang, M., Ma, Y., Hu, Z., Yu, C., Zhang, X., Hu, H., Guan, Q., & Yao, Y. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2506533 · Cited by 6
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review
Fu, P., Guan, T., Wang, Z., Guo, Z., Duan, C., Sun, H., Chen, B., Jiang, Q., Ma, J., Zhou, K., et al. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1023 · Cited by 8
A Simple yet Effective Layout Token in Large Language Models for Document Understanding
Zhu, Z., Luo, C., Shao, Z., Gao, F., Xing, H., Zheng, Q., & Zhang, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01349 · Cited by 6
Jung, J., Kim, E., Kim, S., Lee, J. H., Kim, B., & Chang, B. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01330 · Cited by 10
Liu, J., Wu, J., Gao, X., Hu, J., Xiong, B., Liu, X., Zhao, C., Pei, H., Feng, H., Li, Y., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02474 · Cited by 7
Self-citationKim, J., Kim, H., Lee, H., & Ro, Y. M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00318 · Cited by 6
VLsI: Verbalized Layers-to-Interactions from Large to Small Vision Language Models
Lee, B., Hachiuma, R., Wang, Y.-C. F., Ro, Y. M., & Wu, Y.-H. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02751 · Cited by 10
Medical Large Vision Language Models with Multi-image Visual Ability
Yang, X., Miao, J., Yuan, Y., Wang, J., Dou, Q., Li, J., & Heng, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04971-1_38 · Cited by 6
SARCLIP: The First Vision–Language Foundation Model for SAR Image
Wang, P., Lu, Z., Li, Y., Ding, B., & Zhang, D. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3630131 · Cited by 7
WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning
Mundada, G., Vishe, Y., Namburi, A., Xu, X., Novack, Z., McAuley, J., & Wu, J. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.853 · Cited by 11
Self-citationSheng, Z., Huang, Z., Qu, Y., Chen, J., Luo, Y., Chen, Y., Leng, Y., & Chen, S. (2026) · CHAIN · doi:10.23919/chain.2026.000005 · Cited by 9
Alliance: All-in-One Spectral-Spatial-Frequency Awareness Foundation Model
Zhao, B., Li, W., Wang, J., Zhang, Y., Yang, H., Zhao, H., Tao, R., & Du, Q. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3639595 · Cited by 6
Multiple Large AI Models’ Consensus for Object Detection—A Survey
Iwanowski, M., & Gahbler, M. (2025) · Applied Sciences · doi:10.3390/app152412961 · Cited by 8
VectorLLM: Human-like extraction of structured building contours via multimodal LLMs
Zhang, T., Wei, S., Chen, S., Yu, W., Luo, M., & Ji, S. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.01.025 · Cited by 9
Sony, R., Farmanifard, P., Ross, A., & Jain, A. K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00388 · Cited by 6
DriveVA: Video Action Models are Zero-Shot Drivers
Liu, M., Zhang, D., Liu, J., Cui, J., Xie, H., Chen, G., Ye, H., Yang, M. Y., Nex, F., & Cheng, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37718-0_19 · Cited by 22
Self-citationStreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognition
Ding, X., Wu, H. W., Yang, Y., Jiang, S., Zhang, Q., Bai, D., Chen, Z., & Cao, T. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01249 · Cited by 6
Self-citationA universal foundation model for grounded biomedical image interpretation
Wu, L., Nie, Y., He, S., Zhuang, J., Luo, L., Li, T., Xie, Z., Chen, D., Zhao, Y., Mahboobani, N. R., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-73986-1 · Cited by 23
Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Better
Ge, M., Li, M., Tang, D., Li, P., Liu, K., Deng, S., Pu, S., Liu, L., Song, Y., & Zhang, T. (2024) · International Workshop on Multimodal and Responsible Affective Computing (MRAC) · doi:10.1145/3689092.3689415 · Cited by 9
Cross-scene visual context parsing with large vision-language model
Zhang, G., Kan, S., Shi, L., Xu, W., An, G., & Cen, Y. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111641 · Cited by 6
Luo, Z., Wu, H., Li, D., Ma, J., Kankanhalli, M., & Li, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00792 · Cited by 6
PhysVLM: Enabling Visual Language Models to Understand Robotic Physical Reachability
Zhou, W., Tao, M., Zhao, C., Guo, H., Dong, H., Tang, M., & Wang, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00651 · Cited by 13
Towards Understanding How Knowledge Evolves in Large Vision-Language Models
Wang, S., Zhang, Y., Zhu, Y. T., Li, J., Wang, Z., Liu, Y., & Ji, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02779 · Cited by 6
Metadata
- Authors
- Chen, Z., Wu, J., Wang, W., Su, W., Chen, G., Xing, S., Zhong, M., Zhang, Q., Zhu, X., Lu, L., Li, B., Luo, P., Lu, T., Qiao, Y., & Dai, J.
- Affiliations
- Nanjing University (CN)
- University of Hong Kong (HK)
- Chinese University of Hong Kong (HK)
- University of Science and Technology of China (CN)
- Tsinghua University (CN)
- Shanghai Artificial Intelligence Laboratory (CN)
- Sensetime (China) (CN)
- Nanjing University
- Tsinghua University
- Venue
- 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2024-06-16
- Pages
- 24185-24198
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4402713111
- Cited by
- 734
- References
- 145
- Citations by year
- 2026: 360 · 2025: 331 · 2024: 43
- FWCI
- 151.51
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62376134,62372223)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- vision-language foundation models, vision foundation models, LLM alignment, zero-shot image classification, image-text retrieval, visual perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
