What matters when building vision-language models?
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The growing interest in vision-language models (VLMs) has been driven by improvements in large language models and vision transformers. Despite the abundance of literature on this subject, we observe that critical decisions regarding the design of VLMs are often not justified. We argue that these unsupported decisions impede progress in the field by making it difficult to identify which choices improve model performance. To address this issue, we conduct extensive experiments around pre-trained models, architecture choice, data, and training methods. Our consolidation of findings includes the development of Idefics2, an efficient foundational VLM of 8 billion parameters. Idefics2 achieves state-of-the-art performance within its size category across various multimodal benchmarks, and is often on par with models four times its size. We release the model (base, instructed, and chat) along with the datasets created for its training.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 201–300 of 660
Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering
Si, C., Zhang, Y., Li, R., Yang, Z., Liu, R., & Yang, D. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.199 · Cited by 17
MIHBench: Benchmarking and Mitigating Multi-Image Hallucinations in Multimodal Large Language Models
Li, J., Wu, M., Jin, Z., Chen, H., Ji, J., Sun, X., Cao, L., & Ji, R. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754993 · Cited by 17
Seeing Culture: A Benchmark for Visual Reasoning and Grounding
Satar, B., Ma, Z., Irawan, P. A., Mulyawan, W. A., Jiang, J., Lim, E., & Ngo, C. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1131 · Cited by 17
True Multimodal In-Context Learning Needs Attention to the Visual Context
Chen, S., Liu, J., Han, Z. Y., Xia, Y., Cremers, D., Torr, P. H. S., Tresp, V., & Gu, J. (2025) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2507.15807 · Cited by 17
2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining
Zhang, W., Zhang, H., Li, X., Sun, J., Shen, Y., Lü, W., Zhao, D., Zhuang, Y., & Bing, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00442 · Cited by 17
Malla, H. J., Bazli, M., & Arashpour, M. (2025) · Waste Management · doi:10.1016/j.wasman.2025.114939 · Cited by 17
Learning to Steer: Input-dependent Steering for Multimodal LLMs
Parekh, J., Khayatan, P., Shukor, M., Dapogny, A., Newson, A., & Cord, M. (2025) · neural information processing systems · doi:10.52202/085713-5341 · Cited by 17
Self-citationRahimi, H., Bahaj, A., Abrini, M., Khoramshahi, M., Ghogho, M., & Chétouani, M. (2025) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3716553.3750767 · Cited by 17
Towards Understanding Visual Grounding in Visual Language ModelsPreprint
Πανταζόπουλος, Γ., & Bilici, E. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.10345 · Cited by 17
Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language ModelsPreprint
Liu, Z., Dou, G., Yuan, X., Zhang, C., Tan, Z., & Jiang, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.15910 · Cited by 17
ReasonVQA: A Multi-Hop Reasoning Benchmark with Structural Knowledge for Visual Question Answering
Tran, D. T., Tran, T.-K., Hauswirth, M., & Le-Phuoc, D. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01746 · Cited by 16
Vision Language Models for Spreadsheet Understanding: Challenges and Opportunities
Xia, S., Xiong, J., Dong, H., Zhao, J., Tian, Y., Zhou, M., He, Y., Han, S., & Zhang, D. (2024) · Workshop on Advances in Language and Vision Research (ALVR) · doi:10.18653/v1/2024.alvr-1.10 · Cited by 16
Jia, H., Jiang, C., Xu, H., Ye, W., Dong, M., Yan, M., Zhang, J., Huang, F., & Zhang, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00874 · Cited by 16
Zhao, Z., Lu, P., Zhang, A., Li, P., Li, X., Liu, X., Hu, Y., Chen, S., Wang, L., & Guo, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01344 · Cited by 16
ViLU: Learning Vision-Language Uncertainties for Failure Prediction
Lafon, M., Karmim, Y., Silva-Rodríguez, J., Couairon, P., Rambour, C., Fournier-S’niehotta, R., Ayed, I. B., Dolz, J., & Thome, N. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01654 · Cited by 17
ShortV: Efficient Multimodal Large Language Models by Freezing Visual Tokens in Ineffective Layers
Yuan, Q., Zhang, Q., Liu, Y., Chen, J., Lu, Y., Lin, H., Zheng, J. G., Han, X., & Sun, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00038 · Cited by 16
LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable EnvironmentsPreprint
Nayak, S., Orozco, A. M., Have, M. T., Thirumalai, V., Zhang, J., Chen, D., Kapoor, A., Robinson, E., Gopalakrishnan, K., Harrison, J., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.10031 · Cited by 16
Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied LearningPreprint
Li, Z., Yang, B., Miao, C., Zhu, K., Chen, H., Guan, Q., Wu, Z. Z., Zhan, W., Sun, Y., Huang, Z. Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.14183 · Cited by 16
CoGen: Learning from Feedback with Coupled Comprehension and Generation
Gul, M. O., & Artzi, Y. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.721 · Cited by 15
Xu, N., Wang, F., Zhang, S., Poon, H., & Chen, M. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.170 · Cited by 15
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review
Fu, P., Guan, T., Wang, Z., Guo, Z., Duan, C., Sun, H., Chen, B., Jiang, Q., Ma, J., Zhou, K., et al. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1023 · Cited by 15
PerLA: Perceptive 3D language assistant
Mei, G., Lin, W., Riz, L., Yujiao, W., Poiesi, F., & Wang, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01340 · Cited by 15
Wang, Z., Zhang, H., Fang, T., Tian, Y., Yang, Y., Ma, K., Pan, X., Song, Y., & Yu, D. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.513 · Cited by 15
On Large Multimodal Models as Open-World Image Classifiers
Conti, A., Mancini, M., Fini, E., Wang, Y., Rota, P., & Ricci, E. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01521 · Cited by 15
Generalizing Vision-Language Models to Novel Domains: A Comprehensive Survey
Li, X.-Y., Li, J.-J., Li, F.-L., Zhu, L., Yang, Y., & Shen, H.-T. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) · doi:10.1145/3816251 · Cited by 11
Vision-Language Models Align with Human Neural Representations in Concept Processing
Bavaresco, A., Kloots, M. D. H., Pezzelle, S., & Fernández, R. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-long.150 · Cited by 15
VAGUE: Visual Contexts Clarify Ambiguous Expressions
Nam, H., Ahn, J., Ka, K., Chung, J., & Yu, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00151 · Cited by 15
Locality Alignment Improves Vision-Language Models
Covert, I., Sun, T., Zou, J., & Hashimoto, T. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.11087 · Cited by 15
Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language ModelsPreprint
Maaz, M., Rasheed, H., Khan, F. S., & Khan, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.23478 · Cited by 15
On the Perception Bottleneck of VLMs for Chart UnderstandingPreprint
Liu, J., Zeng, W., Zhang, X., Wang, Y., Shan, Z., & He, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.18435 · Cited by 15
Huang, X., Wang, X., Zhang, H., Zhu, Y., Xi, J., An, J., Wang, H., Liang, H., & Pan, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i4.32396 · Cited by 14
Multimodal LLMs as Customized Reward Models for Text-to-Image Generation
Zhou, S., Zhang, R., Zhu, H., Kveton, B., Zhou, Y., Gu, J., Chen, J., & Chen, C. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01826 · Cited by 14
Surfer-H Meets Holo1: Cost-Efficient Web Agent Powered by Open WeightsPreprint
Andreux, M., Skuk, B. B., Benchekroun, H., Biré, E., Bonnet, A., Bordie, R., Bout, N., Brunel, M., Cedoz, P.-L., Chassang, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.02865 · Cited by 14
Self-citationMimicking or Reasoning: Rethinking Multi-Modal In-Context Learning in Vision-Language ModelsPreprint
Huang, C., Zhu, Y., Zhu, S., Xiao, J., Andrade, M., Chopra, S., & Kira, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.07936 · Cited by 14
Analyzing Finetuning Representation Shift for Multimodal LLMs SteeringPreprint
Khayatan, P., Shukor, M., Parekh, J., Dapogny, A., & Cord, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.03012 · Cited by 15
Self-citationIAA: Inner-Adaptor Architecture Empowers Frozen Large Language Model with Multimodal Capabilities
Wang, B., Xie, C., Leng, D., & Yin, Y. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i20.35400 · Cited by 13
World Knowledge-Enhanced Reasoning Using Instruction-Guided Interactor in Autonomous Driving
Zhai, M., Li, C., Guo, Z., Yang, N., Qin, X., Zhao, S., Han, J., Tao, J., Wu, Y., & Jia, Y. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i9.33067 · Cited by 13
Retrospective Learning from Interactions
Chen, Z., Gul, M. O., Chen, Y., Geng, G., Wu, A., & Artzi, Y. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1200 · Cited by 13
Choi, D., Lee, S., & Song, Y. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00459 · Cited by 13
SUA: Stealthy Multimodal Large Language Model Unlearning Attack
Zhang, X., Liu, H., Zhang, D. C., Tang, X., He, Q., Lee, D., & Wang, S. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.565 · Cited by 13
ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
Chen, L., Xu, Y., Ma, J., Liu, Y., Yang, D., Zhang, L., Yue, Z., Wang, W., & Jin, Q. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i24.39107 · Cited by 13
TG-LLaVA: Text Guided LLaVA via Learnable Latent Embeddings
Yan, D., Li, P., Li, Y., Chen, H., Chen, Q., Luo, W., Dong, W., Yan, Q., Zhang, H., & Shen, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i9.32982 · Cited by 13
CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts
Nikandrou, M., Πανταζόπουλος, Γ., Vitsakis, N., Konstas, I., & Suglia, A. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.402 · Cited by 14
LiveXiv -- A Multi-Modal Live Benchmark Based on Arxiv Papers Content
Shabtay, N., Polo, F. M., Doveh, S., Lin, W. M., Mirza, M. J., Choshen, L., Yurochkin, M., Sun, Y., Arbelle, A., Karlinsky, L., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.10783 · Cited by 13
LIME: Less Is More for MLLM EvaluationPreprint
Zhu, K., Zang, Q., Jia, S., Wu, S., Fang, F., Li, Y., Gavin, S., Zheng, T., Guo, J., Li, B., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.06851 · Cited by 13
TripletCLIP: Improving Compositional Reasoning of CLIP via Synthetic Vision-Language NegativesPreprint
Patel, M., Kusumba, A., Cheng, S., Kim, C., Gokhale, T., Baral, C., & Yang, Y. (2024) · arXiv (Cornell University) · doi:10.13016/m2ksck-meo0 · Cited by 13
Identifying and Mitigating Position Bias of Multi-image Vision-Language ModelsPreprint
Tian, X., Zou, S., Yang, Z., & Zhang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.13792 · Cited by 13
Visual Merit or Linguistic Crutch? A Close Look at DeepSeek-OCRPreprint
Liang, Y., Ying, R., Li, B., Li, H., Yan, K., Li, Q., Yang, M., Satoshi, O., Cui, Z., & Ni, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.03714 · Cited by 13
TopViewRS: Vision-Language Models as Top-View Spatial Reasoners
Li, C., Zhang, C., Zhou, H., Collier, N., Korhonen, A., & Vulić, I. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.106 · Cited by 12
ViPer: Visual Personalization of Generative Models via Individual Preference Learning
Salehi, S., Shafiei, M., Yeo, T., Bachmann, R., & Zamir, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72904-1_23 · Cited by 12
MMXU: A Multi-Modal and Multi-X-ray Understanding Dataset for Disease Progression
Mu, L., Huang, Z., Qin, S., Zhu, Y., Zhang, S., & Zhang, X. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.508 · Cited by 12
Wang, H., Guo, B., Zeng, Y., Chen, M., Ding, Y., Zhang, Y., Yao, L., & Yu, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3715098 · Cited by 12
KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension
Yang, J., Zeng, W., Jin, S., Xu, L., Liu, W., Qian, C., & Zhang, R. (2024) · neural information processing systems · doi:10.52202/079017-4467 · Cited by 12
SmolVLM: Redefining small and efficient multimodal models
Marafioti, A., Zohar, O., Farré, M., Noyan, M., Bakouch, E., Cuenca, P., Zakka, C., Allal, L. B., Lozhkov, A., Tazi, N., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.05299 · Cited by 11
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation
Nikandrou, M., Πανταζόπουλος, Γ., Konstas, I., & Suglia, A. (2024) · Workshop on Advances in Language and Vision Research (ALVR) · doi:10.18653/v1/2024.alvr-1.6 · Cited by 11
Chung, J., Lee, S., Kim, M.-S., Han, S., Yousefpour, A., Hessel, J., & Yu, Y. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.143 · Cited by 11
MiniCPM-V LLaMA Model for Image Recognition: A Case Study on Satellite Datasets
Kömürcü, K., & Petkevičius, L. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3547144 · Cited by 11
VADE: Visual Attention Guided Hallucination Detection and Elimination
Prabhakaran, V., Aggarwal, P., Verma, V. K., Swamy, G., & Saladi, A. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.773 · Cited by 11
Bavaresco, A., & Fernández, R. (2025) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2025.conll-1.10 · Cited by 11
VIEW2SPACE: Studying Multi-view Visual Reasoning from Sparse Observations
Ke, F., Cai, Z., Li, B., Chen, L., Lin, B., Wang, W., Haghighi, P. D., Haffari, G., & Rezatofighi, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37531-5_29 · Cited by 11
SmokeBench: Evaluating Multimodal Large Language Models for Wildfire Smoke Detection
Qi, T., Li, W., & Barnes, N. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00108 · Cited by 11
Yang, J., Xiong, T., Qian, S., Nahrstedt, K., & Wu, M. (2026) · doi:10.1109/cvprf71909.2026.00323 · Cited by 11
Comics Datasets Framework: Mix of Comics Datasets for Detection Benchmarking
Vivoli, E., Campaioli, I., Nardoni, M., Biondi, N., Bertini, M., & Karatzas, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70645-5_11 · Cited by 11
Garcia, F. J. C., Suglia, A., & Eshghi, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.643 · Cited by 11
Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model
Liu, H., You, Q., Han, X., Liu, Y., Huang, H., He, R., & Yang, H. (2024) · neural information processing systems · doi:10.52202/079017-0562 · Cited by 11
Zhao, T., Zhang, Q., Lee, K., Liu, P., Zhang, L., Fang, C., Liao, J., Jiang, K., Ma, Y., & Xu, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.04923 · Cited by 11
MIRAGE: Multimodal Identification and Recognition of Annotations in Indian General PrescriptionsPreprint
Mankash, T., Kota, V. K., De, A., Prakash, P., & Jadhav, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.09729 · Cited by 11
Ma, Y., Xu, G., Sun, X., Ji, J.-Y., Lou, J., Zhang, D., & Ji, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.20502 · Cited by 11
VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-MakingPreprint
Aissi, M.-S., Grislain, C., Chétouani, M., Sigaud, O., Soulier, L., & Thome, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.15108 · Cited by 11
Large Language Model-Brained GUI Agents: A Survey
Zhang, C., He, S., Qian, J., Li, B., Li, L., Qin, S., Kang, Y., Ma, M., Liu, G., Lin, Q., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.18279 · Cited by 10
CalibCLIP: Contextual Calibration of Dominant Semantics for Text-Driven Image Retrieval
Kang, B., Chen, B., Wang, J., Li, Y., Zhao, J., Wang, J., & Tian, Z. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755765 · Cited by 10
WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-Centric Image Editing
Zhang, H., Liu, J., Liu, Z., Niu, L., Meng, F., Wu, Z., & Jiang, Y.-G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37013-6_26 · Cited by 10
URaG: Unified Retrieval and Generation in Multimodal LLMs for Efficient Long Document Understanding
Shi, Y., Wang, J., Shan, Z., Peng, D., Lin, Z., & Jin, L. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i30.39729 · Cited by 10
Qolda: A Small Vision–Language Model for the Kazakh Language
Arystanbekov, B., Nurimanov, A., Maxutov, A., Albrekht, V., Kuzdeuov, A., & Varol, H. A. (2026) · IEEE Access · doi:10.1109/access.2026.3676919 · Cited by 10
Zeng, K., Zhong, G., Cheng, J., Yuan, J., & Li, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00221 · Cited by 10
LPOI: Listwise Preference Optimization for Vision Language Models
Zadeh, F. P., Oh, Y., & Kim, G. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1302 · Cited by 10
JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
Wang, Z., Liu, J., Tang, C.-W., Al-Omari, H., Sivakumar, A., Sun, R., Li, W., Atabuzzaman, M., Ayyubi, H., You, H., et al. (2024) · neural information processing systems · doi:10.52202/079017-2015 · Cited by 10
Abaskohi, A., Gella, S., Carenini, G., & Laradji, I. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.383 · Cited by 10
mOSCAR: A Large-scale Multilingual and Multimodal Document-level CorpusPreprint
Futeral, M., Zebaze, A. R., Suárez, P. O., Abadji, J., Lacroix, R., Schmid, C., Bawden, R., & Sagot, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.08707 · Cited by 10
Investigating the Scaling Effect of Instruction Templates for Training Multimodal Language ModelPreprint
Wang, S., Song, L., Zhang, J., Shimizu, R., Jin, J., Luo, A., Yuan, L., Yao, L., Chen, C., McAuley, J., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.08307 · Cited by 10
Wijaya, R., Nguyen, N.-B., & Cheung, N. M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.17417 · Cited by 10
Quantifying Web Agents - A Survey on Web Agent Performance and EfficiencyPreprint
Krupp, L., Geißler, D., Woźniak, P. W., Lukowicz, P., & Karolus, J. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/vhn2c_v2 · Cited by 10
AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language ModelPreprint
Jin, Z., Song, X., Wang, N., Liu, Y., Li, C., Li, X., Wang, R., Li, Z., Qi, Q., Cheng, L., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.11496 · Cited by 10
IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs
Faraz, A., Akash, Khan, S., Kolla, R., Patidar, A., Goswami, S., Ravi, A., Khatri, C., & Agarwal, S. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2511.04727 · Cited by 10
Haller, P., Barth, F., Golde, J., Rehm, G., & Akbik, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.24792 · Cited by 10
A Comparative Analysis of OCR Models on Diverse Datasets: Insights from Memes and Hiertext Dataset
Singh, I., Colom, M., & Bontcheva, K. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00148 · Cited by 9
NAVER LABS Europe Submission to the Instruction-following Track
Lee, B., Boito, M. Z., Besacier, L., & Calapodescu, I. (2025) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2025.iwslt-1.17 · Cited by 9
TokenCom: vision-language model for multimodal and multitask token communications
Jiang, F., Tu, S., Dong, L., Li, X., Wang, K., Cunhua, P., Han, Z., & Wang, J. (2026) · Science China Information Sciences · doi:10.1007/s11432-026-5166-3 · Cited by 9
L2V-CoT: Cross-Modal Transfer of Chain-of-Thought Reasoning via Latent Intervention
Zhan, Y., Tang, X., Wan, H., Li, J., Wen, J., & Sun, H. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i15.38228 · Cited by 11
LEGO Co-builder: Exploring Fine-Grained Vision-Language Modeling for Multimodal Assembly Assistants
Huang, H., Su, Y., Sun, X., Ahsan, M., Aliannejadi, M., Viola, I., Ren, Z., Yu, C., Lisowska, A., Belopolsky, A. V., et al. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831119 · Cited by 9
Kim, G., & Seo, M. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.944 · Cited by 9
Πανταζόπουλος, Γ., Nikandrou, M., Suglia, A., Lemon, O., & Eshghi, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.793 · Cited by 9
Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs
Zhang, K., Keda, T. A. O., Tang, J., & Wang, H. (2025) · neural information processing systems · doi:10.52202/085713-2220 · Cited by 9
Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding
Wang, S., Yang, S., Wang, L., Guo, Z., Cai, S., Huang, H. P., Wang, Y., Chen, J., & Jin, T. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.226 · Cited by 9
R^3-VQA: "Read the Room" by Video Social ReasoningPreprint
Niu, L., Li, J., Yu, X., Wang, S., Feng, R., Wu, B., Wei, P., Wang, Y., & Fan, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.04147 · Cited by 9
Towards LLM-Centric Multimodal Fusion: A Survey on Integration Strategies and TechniquesPreprint
An, J., Lee, J., Lee, J., & Son, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.04788 · Cited by 9
Empowering Multimodal LLMs with External Tools: A Comprehensive SurveyPreprint
An, W., Nie, J., Wu, Y., Tian, F., Lu, S., & Zheng, Q. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.10955 · Cited by 9
LocateAnything3D: Vision-Language 3D Detection with Chain-of-SightPreprint
Man, Y.-Z., Wang, S.-H., Zhang, G.-W., Bjorck, J., Li, Z.-Q., Gui, L., Fan, J., Kautz, J., Wang, Y.-X., & Yu, Z.-D. (2025) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.2511.20648 · Cited by 7
Tao, H., Liao, B., Chen, S., Yin, H., Zhang, Q., Liu, W., & Wang, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.08829 · Cited by 9
Metadata
- Authors
- Laurençon, H., Tronchon, L., Cord, M., & Sanh, V.
- ORCID
- Cord, Matthieu
- Venue
- Advances in Neural Information Processing Systems 37
- Published
- 2024
- Pages
- 87874-87907
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W4415796627
- Cited by
- 66
- References
- 0
- Citations by year
- 2026: 39 · 2025: 23 · 2024: 4
- FWCI
- 13.67
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- vision-language models, model design, multimodal representation learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.