Cited by 843Multimodal Machine Learning ApplicationsAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

The DOI matches its Crossref record; 138 of the 145 references it cites were found in a registry or an index.

Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks

Open access

Chen, Zhe, Wu, Jiannan, Wang, Wenhai, Su, Weijie, Chen, Guo, Xing, Sen, Zhong, Muyan, Zhang, Qinglong, Zhu, Xizhou, Lu, Lewei, Li, Bin, Luo, Ping, Lu, Tong, Qiao, Yu, Dai, Jifeng·2024·2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

DOI 10.1109/cvpr52733.2024.02283

Open this paper in CoChat — free account Open PDF

Abstract

The exponential growth of large language models (LLMs) has opened up numerous possibilities for multi-modal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal AGI, has not kept pace with LLMs. In this work, we design a large-scale vision-language foun-dation model (Intern VL), which scales up the vision foun-dation model to 6 billion parameters and progressively aligns it with the LLM, using web-scale image-text data from various sources. This model can be broadly applied to and achieve state-of-the-art performance on 32 generic visual-linguistic benchmarks including visual perception tasks such as image-level or pixel-level recognition, vision-language tasks such as zero-shot image/video classification, zero-shot image/video-text retrieval, and link with LLMs to create multi-modal dialogue systems. It has powerful visual capabilities and can be a good alternative to the ViT-22B. We hope that our research could contribute to the development of multi-modal large models.

Integrity signals

Registry

Crossref · 10.1109/cvpr52733.2024.02283

Cites

138 of 138 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465

Flagged first, then by citations

Show all 145 references

7 of the 145 references couldn’t be matched to a known paper.

Research works printed but not linked: 23

Achiam, 2023, Gpt-4 technical report, arXiv preprint
Bai, 2023, Qwen tech-nical report, arXiv preprint
Bai, 2023, Qwen-vl: A frontier large vision-language model with versatile abilities, arXiv preprint
Byeon, 2022, Coyo-700m: Image-text pair dataset
Carlsson, 2022, Cross-lingual and multilingual clip, LREC, 6848
Chen, 2023, Shikra: Unleashing multi-modal 11ms referential dialogue magic, arXiv preprint
Dosovitskiy, 2020, An image is worth 16×16 words: Transformers for image recognition at scale, ICLR
Goyal, 2017, Making the v in vq a matter: El-evating the role of image understanding in visual question answering, CVPR, 6904
2023, Introducing idefics: An open reproduction of state-of-the-art visual language model
Ilharco, 2021, Open-clip. Zenodo. Version 0.1
2023, Clip benchmark: Clip-like model evaluation
Li, 2023, Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models, 19730
Li, 2019, Coco-en for cross-lingual image tagging, captioning, and retrieval, TMM, 21, 2347
Liu, 2023, Aligning large multi-modal model with robust instruction tuning, arXiv preprint
Sawada, 2022, Construction and public release of language image pretraining models in japanese, MIRU
Oquab, 2023, Dinov2: Learning robust visual features with-out supervision, TMLR
Schuhmann, 2022, Laion coco:600m synthetic captions from laion2b-en
Sun, 2024, Generative pretraining in mul-timodality, ICLR
Sun, 2023, Moss: Training conversationallanguage models from synthetic data, arXiv preprint, 7
Taori, 2023, Alpaca: A strong, replicable instruction-following model, Stanford Center for Research on Foundation Models, 3, 7
Team, 2023, Internlm: A multilingual language model with progressively enhanced capabilities
Xie, 2022, Zero and r2d2: A large-scale chi-nese cross-modal benchmark and a vision-language frame-work, arXiv preprint
Zhu, 2023, Ghost in the minecraft: Generally capable agents for open-world enviroments via large language models with text-based knowledge and memory, arXiv preprint

Sorted by citations

Items 201–300 of 843

Scale Up Composed Image Retrieval Learning via Modification Text Generation
Zhou, Y., Wang, Y., Lin, H., Ma, C., Zhu, L., & Zheng, Z. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3599088 · Cited by 11
RAC3: Retrieval-Augmented Corner Case Comprehension for Autonomous Driving With Vision-Language Models
Wang, Y., Liu, Q., Fan, J., Hong, J., Chu, H., Tian, M., Gao, B., & Chen, H. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3673470 · Cited by 13
Extending Large Vision–Language Model for Diverse Interactive Tasks in Autonomous Driving
Zhao, Z., Fu, H., Liang, D., Zhou, X., Zhang, D., Xie, H., Wang, B., & Bai, X. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3719473 · Cited by 13
TroL: Traversal of Layers for Large Language and Vision Models
Lee, B., Chung, S., Kim, C. W., Park, B., & Ro, Y. M. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.633 · Cited by 18
AirSpatialBot: A Spatially Aware Aerial Agent for Fine-Grained Vehicle Attribute Recognition and Retrieval
Zhou, Y., Ding, R., Yang, X., Jiang, X., & Liu, X. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3570895 · Cited by 5
Cross-modal consistency types in multimodal social data
Vaiani, L., Cagliero, L., Garza, P., & Ravagli, J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113705 · Cited by 5
ModelGen: Automating Semiconductor Parameter Extraction with Large Language Model Agents
Wei, Y., Huang, L., Feng, Q., Chen, Z., Yan, J., Lin, T.-J., Huang, Z., Ren, K., Xing, W. W., & He, L. (2025) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3736165 · Cited by 8
Self-citation
Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning
Sun, H., Sun, Z., Peng, H., & Ye, H.-J. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.257 · Cited by 5
HiProbe-VAD: Video Anomaly Detection via Hidden States Probing in Tuning-Free Multimodal LLMs
Cai, Z., Li, F., Zheng, Z., & Qin, Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755575 · Cited by 9
MOERL: When Mixture-Of-Experts Meet Reinforcement Learning for Adverse Weather Image Restoration
Wang, T., Xia, P., Li, B., Jiang, P.-T., Kong, Z., Zhang, K., Lü, T., & Luo, W. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01269 · Cited by 5
Self-citation
A Survey on Fine-Grained Multimodal Large Language Models
Peng, Y., Wang, Z., Li, G., Zheng, X., Yin, S., & He, H. (2026) · Chinese Journal of Electronics · doi:10.23919/cje.2025.00.336 · Cited by 10
LLaVA-SpaceSGG: Visual Instruct Tuning for Open-Vocabulary Scene Graph Generation with Enhanced Spatial Relations
Xu, M., Wu, M., Zhao, Y., Li, J. C. L., & Ou, W. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00620 · Cited by 7
MatSwap: Light‐aware material transfers in images
Lopes, I., Deschaintre, V., Hold-Geoffroy, Y., & de Charette, R. (2025) · Computer Graphics Forum · doi:10.1111/cgf.70168 · Cited by 8
A Perspective on Quality Evaluation for AI-Generated Videos
Zhang, Z., Sun, W., & Zhai, G. (2025) · Sensors · doi:10.3390/s25154668 · Cited by 9
Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding
Wang, Z., Zhu, X., Yang, X., Luo, G., Li, H., Tian, C., Dou, W., Ge, J., Lu, L., Qiao, Y., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3593283 · Cited by 10
Self-citation
Detect Any Mirrors: Boosting Learning Reliability on Large-Scale Unlabeled Data with an Iterative Data Engine
Xing, Z., Liu, L., Yang, Y., Wang, H., Tian, Y., Chen, S., Li, W., Liu, G., & Zhu, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02372 · Cited by 5
EliGen: Entity-Level Controlled Image Generation with Regional Attention
Zhang, H., Duan, Z., Wang, X., Chen, Y., & Zhang, Y. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3771013 · Cited by 22
Da Yu: Toward ASV-Based Image Captioning for Waterway Surveillance and Scene Understanding
Guan, R., Ouyang, N., Xu, T. T., Liang, S., Dai, W., Sun, Y., Gao, S. S., Lai, S., Yao, S., Hu, X., et al. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3651269 · Cited by 5
Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control is Easier than You Think
Liang, C., Bai, S., Chai, W., Xie, W., Zhao, H., Vinci, L., Lin, J., & Chang, B. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00646 · Cited by 18
VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use
Zhang, Z., Rossi, R. A., Yu, T., Dernoncourt, F., Zhang, R., Gu, J., Kim, S., Chen, X., Wang, Z., & Lipka, N. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i43.40976 · Cited by 14
SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editing
Tu, R.-C., Sun, W., Jin, Z., Liao, J., Huang, J., & Tao, D. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3673949 · Cited by 14
Development of an Adaptive User Support System Based on Multimodal Large Language Models
Wang, W., Li, L., Wickramathilaka, S., Grundy, J., Khalajzadeh, H., Obie, H. O., & Madugalla, A. K. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00044 · Cited by 5
Self-citation
Scalable, Training-Free Visual Language Robotics: a modular multi-model framework for consumer-grade GPUs
Samson, M., Muraccioli, B., & Kanehiro, F. (2025) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii59315.2025.10870971 · Cited by 5
AgriBench: A Hierarchical Agriculture Benchmark for Multimodal Large Language Models
Zhou, Y., & Ryo, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91835-3_14 · Cited by 5
What drives attention sinks? A study of massive activations and rotational positional encoding in large vision–language models
Zhang, X., Zhu, Y., Gu, C., Cao, J., Cheng, H., & Wu, K. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104431 · Cited by 4
Multimodal Machine Translation for Low-Resource Indic Languages: A Chain-of-Thought Approach Using Large Language Models
Rajpoot, P. K., Bhat, N., & Shrivastava, A. (2024) · Conference on Machine Translation (WMT) · doi:10.18653/v1/2024.wmt-1.79 · Cited by 4
Large Vision-Language Model Security: A Survey
Wang, T., Fang, Z., Xue, H., Zhang, C., Jin, M., Xu, W., Shu, D., Yang, S. J., Wang, Z. G., & Liu, D. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-0151-6_1 · Cited by 4
Towards Interactive Deepfake Analysis
Qin, L., Jiang, N., Zhang, Y., Qiu, Y., Zeng, D., Hu, J., & Deng, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888337 · Cited by 5
GFIA: Generative Fault Image Analysis via vision–language model its application to train bogie transmission system
Zhang, C., Wang, Y., & You, X. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104482 · Cited by 4
WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts
Foroutan, N., Romanou, A., Ansaripour, M., Eisenschlos, J. M., Aberer, K., & Lebret, R. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1280 · Cited by 9
SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification
Wang, C., Shen, Y., Kuang, Z., Cohan, A., & Zhao, Y. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.420 · Cited by 4
Antidote: A Unified Framework for Mitigating LVLM Hallucinations in Counterfactual Presupposition and Object Perception
Wu, Y., Zhang, L., Yao, H., Du, J., Yan, K., Ding, S., Wu, Y., & Li, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01365 · Cited by 7
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Wang, W., Chen, Z., Liu, Y., Cao, Y., Wang, W., Zhu, X., Lu, L., Lü, T., Qiao, Y., & Dai, Y. (2025) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-031-94969-2_2 · Cited by 4
Self-citation
Fusionista2.0: Efficiency Retrieval System for Large-Scale Datasets
Le, H. M., Nguyen, D. T., Nguyen, P. B., Tran, G. B. L., Thien, P. T., Dinh, C., Nguyen, M., Nguyen, N. T., Nguyen, T. T. N., Ngo, H. G., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6963-2_17 · Cited by 4
ArtGS: 3D Gaussian Splatting for Interactive Visual-Physical Modeling and Manipulation of Articulated Objects
Yu, Q., Yuan, X., Jiang, Y., Chen, J., Zheng, D., Hao, C., You, Y., Chen, Y., Mu, Y., Liu, L., et al. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246522 · Cited by 4
DVGBench: Implicit-to-explicit visual grounding benchmark in UAV imagery with large vision–language models
Zhou, Y., Chen, J., Zhang, Z., Huang, P., Ding, R., Zou, Z., Gao, P., Wei, Y., Li, K., Yang, X., et al. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.01.005 · Cited by 9
MSSA: memory-driven and simplified scaled attention for enhanced image captioning
Hossain, M. A., Ye, Z., Hossen, M. B., Rahman, M. A., Islam, M. S., & Abdullah, M. I. (2026) · Scientific Reports · doi:10.1038/s41598-026-40164-8 · Cited by 4
Multimodal Adversarial Defense for Vision-Language Models by Leveraging One-To-Many Relationships
Waseda, F., Tejero-de-Pablos, A., & Echizen, I. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00673 · Cited by 4
LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
Wang, S., Liu, S., Kuang, Y., Wei, X., Liu, Y., Li, Z., Man, Y., Guo, C., Tao, A., Liu, G., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37718-0_20 · Cited by 35
Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
Jiang, C., Dong, W., Zhang, Z., Yu, F., Peng, W., Yuan, X., Bi, Y., Zhao, M., Zhou, Z., Si, C.-W., et al. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810615 · Cited by 4
SAT-Morph: Unsupervised Deformable Medical Image Registration Using Vision Foundation Models with Anatomically Aware Text Prompt
Xu, H., Xue, T., Liu, D., Zhang, F., Westin, C., Kikinis, R., O’Donnell, L. J., & Cai, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73471-7_8 · Cited by 4
Object-Aware Query Perturbation for Cross-Modal Image-Text Retrieval
Sogi, N., Shibata, T., & Terao, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72986-7_26 · Cited by 4
A Cognitive Evaluation Benchmark of Image Reasoning and Description for Large Vision-Language Models
Song, X., Wu, M., Zhu, K. Q., Zhang, C., & Chen, Y. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.324 · Cited by 8
OS-RRG: Observation State-Aware Radiology Report Generation With Balanced Diagnosis and Attention Intervention
Yang, H., Tang, H., Song, S., & Li, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3589103 · Cited by 4
Zoom-shot: Fast, efficient and unsupervised zero-shot knowledge transfer from CLIP to vision encoders
Shipard, J., Wiliem, A., Thanh, K. N., Xiang, W., & Fookes, C. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112323 · Cited by 6
Multi-aspect Knowledge Distillation with Large Language Model
Lee, T., Bang, J., Kwon, S., & Kim, T.-H. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00199 · Cited by 4
MedM-VL: What Makes a Good Medical LVLM?
Shi, Y., Yang, S., Zhu, X., Wang, H., Fu, X., Li, M., & Wu, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06004-4_29 · Cited by 5
Self-citation
Movie101v2: Improved Movie Narration Benchmark
Yue, Z., Yepeng, Z., Wang, Z., & Jin, Q. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.836 · Cited by 4
Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of ExplainabilityPreprint
Shu, D., Zhao, H., Hu, J., Liu, W., Lu, C. Y., & Du, M. (2025) · Qeios · doi:10.32388/ooam1q · Cited by 4
Unveiling the Lack of LVLM Robustness to Fundamental Visual Variations: Why and Path Forward
Fan, Z., Wang, Y., Polisetty, S., & Fung, Y. R. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1037 · Cited by 4
Empowering Robots with Multimodal Language Models for Task Planning with Interaction
Chung, T. L., Pang, J., & Cheng, J. S. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800613 · Cited by 3
Aligning Large Multimodal Model with Sequential Recommendation via Content-Behavior Guidance
Wu, Z., Wang, X. Y., Chang, H., Chen, H., Sun, L., & Zhu, W. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733273 · Cited by 3
Can Multimodal Foundation Models Understand Schematic Diagrams? An Empirical Study on Information-Seeking QA over Scientific Papers
Zhao, Y., Wang, C., Li, C., & Cohan, A. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.957 · Cited by 3
UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
Liu, X., Zhang, X., Zhang, Z., & Lu, Y. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.809 · Cited by 22
Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data?
Liu, C., Wan, Z., Wang, H., Chen, Y., Qaiser, T., Chen, J., Burlutskiy, N., Yousefi, F., & Arcucci, R. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.843 · Cited by 3
On the Suitability of Reinforcement Fine-Tuning to Visual Tasks
Chen, X., Li, W., Liu, C., Xie, C., Hu, X., Ma, C., Zhu, F., & Zhao, R. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00318 · Cited by 3
Multimodal mathematical reasoning embedded in aerial vehicle imagery: Benchmarking, analysis, and exploration
Zhou, Y., Feng, L., Lan, M., Yang, X., Li, Q., Ke, Y., Jiang, X., & Zhang, W. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.09.007 · Cited by 3
BMPCQA: Bioinspired Metaverse Point Cloud Quality Assessment Based on Large Multimodal Models
Duan, H., Fu, K., Wu, S., Li, Y., Zhang, Z., Hu, Q., Min, X., & Zhai, G. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202500504 · Cited by 3
VLN-ChEnv: Vision-language Navigation in Changeable Environments
Liu, S., Zhang, H., Qiao, Q., Wu, Q., & Wang, P. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755202 · Cited by 5
Leveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and Tracking
Pätzold, B., Nogga, J., & Behnke, S. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3606363 · Cited by 6
DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models
Zeng, L., Yao, J., Liao, B., Tao, H., Liu, W., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37369-4_18 · Cited by 15
Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision
He, Y., Huang, Y., Guo, C., Lü, L., Pei, B., Xu, J., Lu, T., & Sato, Y. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02608-y · Cited by 9
Self-citation
A systematic review of vision language models: Comprehensive analysis of architectures, applications, datasets and challenges towards robust multimodal intelligence
Rahman, A. (2026) · Array · doi:10.1016/j.array.2026.100739 · Cited by 10
LMOD \(\boldsymbol{+}\) : A Comprehensive Multimodal Dataset and Benchmark for Developing and Evaluating Multimodal Large Language Models in Ophthalmology
Qin, Z., Liu, Y., Yin, Y., Ding, J., Zhang, H., Li, A., Campbell, D., Wu, X., Zou, K., Keenan, T. D. L., et al. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3801746 · Cited by 4
Towards Scalable Web Accessibility Audit with MLLMs as Copilots
Gu, M., Wang, Z., Lai, S., Gao, Z., Zhou, S., & Bu, J. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i45.41193 · Cited by 4
Seeing the Threat: Vulnerabilities in Vision-Language Models to Adversarial Attack
Ren, J., Dras, M., & Naseem, U. (2026) · Human-Centric Intelligent Systems · doi:10.1007/s44230-026-00141-w · Cited by 6
Describe, Adapt and Combine: Empowering CLIP Encoders for Open-Set 3D Object Retrieval
Wang, Z., Zhou, Y., Liu, Z., Yu, R., Bai, S., Wang, Y., He, X., & Bai, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01954 · Cited by 3
ReCot: Reflective Self-Correction Training for Mitigating Confirmation Bias in Large Vision-Language Models
Qu, M., Hu, Y., Han, K., Wei, Y., & Zhao, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00855 · Cited by 3
METEOR: Multi-Encoder Collaborative Token Pruning for Efficient Vision Language Models
Liu, Y., Wang, Y., Shi, B., Zhang, X., Dai, W., Li, C., Xiong, H., & Tian, Q. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01996 · Cited by 3
CAAC: Confidence-Aware Attention Calibration to Reduce Hallucinations in Large Vision-Language Models
Fazli, M., Wei, B., Sari, A., & Zhu, Z. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00127 · Cited by 12
Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs
Xiao, X., Liu, C., Liao, C.-T., Zhang, Y., Lan, Q., Wei, Y., Zhao, L., Wang, J., Gu, J., Ye, M., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37232-1_16 · Cited by 3
GENIXER: Empowering Multimodal Large Language Model as a Powerful Data Generator
Zhao, H. H., Zhou, P., & Shou, M. Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73337-6_8 · Cited by 3
Automatic granary sweeping strategy using visual large language model
Zhang, B., Yan, J., Gao, Y., Yang, G., Zhang, K., & Li, J. (2025) · Journal of Stored Products Research · doi:10.1016/j.jspr.2025.102619 · Cited by 3
Piano Transcription by Hierarchical Language Modeling with Pretrained Roll-based Encoders
Li, D., Zang, Y., & Kong, Q. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890508 · Cited by 4
VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detection
Zhang, B., Qu, X., Li, G., Wan, J., & Wang, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888875 · Cited by 3
Efficient Transfer From Image-Based Large Multimodal Models to Video Tasks
Cao, S., Zhao, Z., Hao, S., Chai, W., Hwang, J., Wang, H., & Wang, G. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557692 · Cited by 3
Can Machines Understand Composition? Dataset and Benchmark for Photographic Image Composition Embedding and Understanding
Zhao, Z., Lu, P., Zhang, A., Li, P., Li, X., Liu, X., Hu, Y., Chen, S., Wang, L., & Guo, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01344 · Cited by 5
One framework to rule them all: Unifying multimodal tasks with LLM neural-tuning
Sun, H., Song, Y., Liu, J., Hu, J., Chen, Y.-W., & Lin, L. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112275 · Cited by 4
radio-llava: Advancing vision-language models for radio astronomical source analysis
Riggi, S., Cecconello, T., Pilzer, A., Palazzo, S., Gupta, N., Hopkins, A., Trigilio, C., & Umana, G. (2025) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2025.10082 · Cited by 14
Unlock the Power of Unlabeled Data in Language Driving Model
Wang, C., Yang, J., Hong, X., & Zhang, R. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127923 · Cited by 3
Toward Automation in Text-Based Video Retrieval with LLM Assistance
Quan, K.-A. C., Nguyen, Q. N., & Luu, D.-T. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00355 · Cited by 3
Sparkle: Mastering Basic Spatial Capabilities in Vision Language Models Elicits Generalization to Spatial Reasoning
Tang, Y., Qu, A., Wang, Z., Zhuang, D., Wu, Z., Ma, W., Wang, S., Zheng, Y., Zhao, Z., & Zhao, J. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.217 · Cited by 3
MMCircuitEval: A Comprehensive Multimodal Circuit-Focused Benchmark for Evaluating LLMs
Zhao, C., Shi, Z., Wen, X., Liu, C., Liu, Y., Zhou, Y., Zhao, Y., Feng, H., Zhu, Y., Wan, G.-W., et al. (2025) · doi:10.1109/iccad66269.2025.11240653 · Cited by 7
TinyRS-R1: Compact Vision Language Model for Remote Sensing
Köksal, A., & Alatan, A. A. (2025) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2025.3623244 · Cited by 3
HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets and CLIP Models
Wei, Z., Wang, G., Ma, X., Mei, K., Chen, H., Jin, Y., & Rao, F. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02084 · Cited by 3
Generalist YOLO: Towards Real-Time End-to-End Multi-Task Visual Language Models
Chang, H., Wang, C.-Y., Wang, R. R., Chou, G., & Liao, H.-Y. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00606 · Cited by 3
DiViCo: Disentangled Visual Token Compression for Efficient Large Vision-Language Model
Wang, X. Y., Pan, Z., Chen, H., & Zhu, W. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3567138 · Cited by 3
Aligning Vision Language Models with Contrastive Learning
Ak, K. E., Mohta, J., Dimitriadis, D., Manchanda, S., Xu, Y., & Shen, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91672-4_3 · Cited by 3
Industrial Large-Scale Diagnostic Model With Lightweight Customized Deployment for Distributed Multiple Non-IID Diagnostic Tasks
Jia, X., Qin, N., Huang, D., Du, J., & Wang, T. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3574226 · Cited by 3
Advancing Myopia To Holism: Fully Contrastive Language-Image Pre-training
Wang, H., Ju, C., Lin, W., Xiao, S., Chen, M., Huang, Y., Liu, C., Yao, M., Lan, J., Chen, Y., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02773 · Cited by 8
VisionArena: 230K Real World User-VLM Conversations with Preference Labels
Chou, C., Dunlap, L., Mashita, K., Mandal, K., Darrell, T., Stoica, I. G., Gonzalez, J. E., & Chiang, W.-L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00367 · Cited by 3
SilVar-Med: A Speech-Driven Visual Language Model for Explainable Abnormality Detection in Medical Imaging
Pham, T.-H., Bui, T.-D., Quang, M. L., Pham, T.-H., Ngo, C., & Hy, T. S. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00281 · Cited by 3
Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmark
Song, E., Chai, W., Xu, W., Xie, J., Liu, Y., & Wang, G. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00642 · Cited by 3
Task-Specific Dual-Model Framework for Comprehensive Traffic Safety Video Description and Analysis
Kyem, B. A., Owor, N. J., Danyo, A., Asamoah, J. K., Denteh, E., Muturi, T., Dontoh, A., Adu-Gyamfi, Y., & Aboah, A. (2025) · 2025 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw69036.2025.00562 · Cited by 8
Distinguishing Visually Similar Images: Triplet Contrastive Learning Framework for Image-text Retrieval
Ouyang, P., Chen, J., Ma, Q., Wang, Z., & Bai, C. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687694 · Cited by 2
Development of a Large-Scale Dataset of Chest Computed Tomography Reports in Japanese and a High-Performance Finding Classification Model: Dataset Development and Validation Study
Yamagishi, Y., Nakamura, Y., Kikuchi, T., Sonoda, Y., Hirakawa, H., Kano, S., Nakamura, S., Hanaoka, S., Yoshikawa, T., & Abe, O. (2025) · JMIR Medical Informatics · doi:10.2196/71137 · Cited by 4
Beyond the Brush: Fully-automated Crafting of Realistic Inpainted Images
Bertazzini, G., Albisani, C., Baracchi, D., Shullani, D., & Piva, A. (2024) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs61860.2024.10810722 · Cited by 2
Towards an Inclusive Mobile Web: A Dataset and Framework for Focusability in UI Accessibility
Gu, M., Pei, L., Zhou, S., Shen, M., Wu, Y., Gao, Z., Wang, Z., Shan, S., Jiang, W., Li, Y., et al. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714523 · Cited by 3
Vision-Language Multimodal Fusion in Dermatological Disease Classification
Quatra, M. L., Cilia, N. D., Conti, V., Sorce, S., Garraffa, G., & Salerno, V. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88217-3_15 · Cited by 2
CDAP-PFMs: A Cross-Domain Authentication Protocol for Edge Inference-Based PFMs
Meng, X., Xiao, Y., Liang, W., Xu, W., Xu, Z., Li, X., & Xiong, N. N. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3578252 · Cited by 2

Authors: Chen, Z., Wu, J., Wang, W., Su, W., Chen, G., Xing, S., Zhong, M., Zhang, Q., Zhu, X., Lu, L., Li, B., Luo, P., Lu, T., Qiao, Y., & Dai, J.
Affiliations: Nanjing University (CN)
University of Hong Kong (HK)
Chinese University of Hong Kong (HK)
University of Science and Technology of China (CN)
Tsinghua University (CN)
Shanghai Artificial Intelligence Laboratory (CN)
Sensetime (China) (CN)
Nanjing University
Tsinghua University
ORCID: Chen, Zhe
Wu, Jiannan
Wang, Wenhai
Chen, Guo
Zhang, Qinglong
Lu, Lewei
Li, Bin
Venue: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher: IEEE
Published: 2024-06-16
Pages: 24185-24198
ISSN: 1063-6919 (ISSN-L)
DOI: 10.1109/cvpr52733.2024.02283
OpenAlex: W4402713111
Cited by: 734
References: 145
Citations by year: 2026: 360 · 2025: 331 · 2024: 43
FWCI: 151.51
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: National Natural Science Foundation of China (62376134,62372223)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: vision-language foundation models, vision foundation models, LLM alignment, zero-shot image classification, image-text retrieval, visual perception

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks