Visual Instruction Tuning
The DOI matches its Crossref record.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [21]
In the citing paper
“This model extends the general-purpose LLaVA framework82 to the medical domain by adapting it for radiograph interpretation and multimodal instruction following.”
From MoMA: a mixture-of-multimodal-agents architecture for enhancing clinical prediction modelling (2025) · cites this paper as [82]
In the citing paper
“Using other VLMs to synthetically generate annotations is a popular approach [84, 119], but it is likely to perpetuate inaccuracies or biases that the model already has (see distribution shift [110]), rather than capturing important nuances.”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
In the citing paper
“VLM performance is heavily shaped by post-training activities, including fine-tuning on specific tasks (e.g., PixMoCap for captioning [35]) and diverse datasets [80], or training to provide answers in specific formats (e.g., instruction tuning [84]).”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
Citations
Cited by
Items 1,001–1,046 of 1,046
Enhancing Numerical Prediction of MLLMS With Soft Labeling
Wang, P., Cai, Z., Yang, H., Modolo, D., & Swaminathan, A. D. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00327 · Cited by 4
DOGR: Towards Versatile Visual Document Grounding and Referring
Zhou, Y., Chen, Y., Lin, H., Wu, Y., Yang, S., Qi, Z., Ma, C., & Zhu, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00343 · Cited by 28
ADIEE: Automatic Dataset Creation and Scorer for Instruction-Guided Image Editing Evaluation
Chen, X., Wei, Y., Zhou, L., & Kumar, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01705 · Cited by 7
Liu, H., Ruan, S., Huang, Y., Zhao, S., & Wei, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00976 · Cited by 16
Self-citationMETEOR: Multi-Encoder Collaborative Token Pruning for Efficient Vision Language Models
Liu, Y., Wang, Y., Shi, B., Zhang, X., Dai, W., Li, C., Xiong, H., & Tian, Q. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01996 · Cited by 10
Self-citationDiffTell: A High-Quality Dataset for Describing Image Manipulation Changes
Di, Z., Shi, J., Fan, Y., Tan, H., Black, A., Collomosse, J. P., & Liu, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02279 · Cited by 1
How Can Objects Help Video-Language Understanding?
Tang, Z., Wang, S., Cho, J., Yoo, J., & Sun, C. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02042 · Cited by 5
HumorDB: Can AI Understand Graphical Humor?
Jain, V. V., Kreiman, G., & Feitosa, F. D. S. A. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00064 · Cited by 11
ContextFace: Generating Facial Expressions from Emotional Contexts
Kim, M., Kim, M., & Baek, S. J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01059 · Cited by 6
MotionCtrl: A Real-Time Controllable Vision-Language-Motion Model
Cao, B., Zheng, S., Wang, Y., Xia, L., Wei, Q., Jin, Q., Liu, J., & Lu, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01139 · Cited by 7
LIRA: Reasoning Reconstruction via Multimodal Large Language Models
Zhou, Z., Wang, T., Ma, Y., Tan, X., & Jing, F. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00172 · Cited by 2
VFLowOpt: A Token Pruning Framework for LMMs with Visual Information Flow-Guided Optimization
Yang, S., Xu, R., Cui, C., Wang, T., Lin, D., & Pang, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02218 · Cited by 22
ConsNoTrainLoRA: Data-driven Weight Initialization of Low-Rank Adapters Using Constraints
Das, D., Park, H.-W., Hayat, M., Choi, S., Yun, S., & Porikli, F. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00054 · Cited by 9
RoboTron-Sim: Improving Real-World Driving via Simulated Hard-Case
Xiao, B., Feng, C., Huang, Z., Yan, F., Zhong, Y., & Ma, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02542 · Cited by 7
FAST-EQA: Efficient Embodied Question Answering with Global and Local Region Relevancy
Zhang, H., Savaliya, N., Siddiqui, F., & Sachdeva, E. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00167 · Cited by 11
MAFM 3 : Modular Adaptation of Foundation Models for Multi-Modal Medical AI
Qazi, M. A., Nwadike, M. S., Almakky, I., Yaqub, M. K., & Saeed, N. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00341 · Cited by 2
MarineEval: Assessing the Marine Intelligence of Vision-Language Models
Wong, Y. K., To, T.-A., Zhang, J., Zheng, Z., & Yeung, S.-K. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00148 · Cited by 5
Geo3DVQA: Evaluating Vision-Language Models for 3D Geospatial Reasoning from Aerial Imagery
Tsujimoto, M., Wang, J., Xuan, W., & Yokoya, N. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00485 · Cited by 4
ORCA: Object Recognition and Comprehension for Archiving Marine Species
Wong, Y. K., Liang, H., Ma, Z., Chen, Y. H., Zheng, Z., Gotama, R., Sebastian, P., Sparks, L., & Yeung, S.-K. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00161 · Cited by 1
UniVid: Unifying Vision Tasks with Pre-trained Video Generation Models
Chen, L., Gu, Y., & Mao, Q. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00653 · Cited by 7
Li, J., Liu, C., Bai, W., Liu, M., Arcucci, R., Bercea, C. I., & Schnabel, J. A. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00233 · Cited by 2
Multi-Grained Text-Guided Image Fusion for Multi-Exposure and Multi-Focus Scenarios
Tang, M., Nie, J., Yang, G., Cui, Z., & Li, J. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00740 · Cited by 1
Deshmukh, G., De, S., Sehgal, C., Gupta, J. S., & Mittal, S. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00208 · Cited by 5
Khan, M. A., & Siddique, M. N. (2025) · 2025 28th International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491458
Abdullah, S., Hossain, R., & Chowdhury, M. (2026) · Discover Applied Sciences · doi:10.1007/s42452-026-08793-w · Cited by 1
Li, S., Wang, F. H., Qin, S., Duan, R., Cheng, H., & Ye, L. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3796715 · Cited by 1
Xu, H., Jiang, H., Chen, X., Huang, X., Wang, Y., Chen, Y. Y., & Wang, L. (2026) · IEEE Systems Journal · doi:10.1109/jsyst.2026.3686806 · Cited by 1
Mixture-of-Experts Multi-View Large Vision-Language Models for Multimodal Fake News Detection
Liu, G., Sun, Y., Liu, Q., Zhang, X., Zhao, Z., Wu, J., Wu, S., & Wang, L. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3695787 · Cited by 1
Lv, Y., Xu, Y., Xu, G., & Ma, J. Y. (2026) · Genome biology · doi:10.1186/s13059-026-04109-8 · Cited by 2
Mohammed, S. R., Chegu, P. S., Shaik, A. A., Chiluveru, A., & Sunkara, K. (2026) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom70271.2026.11526319 · Cited by 1
Exploring Open-Weight Foundation Models: A Systematic Review from Transformers to Multimodal AI
Tayachi, C., Dridi, O., Barkaoui, M., & Fathallah, H. (2026) · IEEE Middle East and North Africa Communications Conference (MENACOMM) · doi:10.1109/menacomm69507.2026.11532795 · Cited by 1
Hao, X., Tang, Y., Zhang, L., Chen, L., Zhou, W., Han, J., Ding, W., & Zhang, X.-P. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3698366 · Cited by 3
Data-Driven Vision-Language Models for Remote Sensing: A survey
Zhou, Y., Zhao, S., Yang, X., Li, R., Zhang, T., Lan, M., Chen, C., Ma, L., He, H., & Li, K. (2026) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2026.3696441 · Cited by 3
IFCoT: Insights Fusion Chain of Thought for Multimodal Reasoning in LLMs
Liu, J., Du, J., Hu, T., Tong, L., Feng, Y., Zhou, J. T., Xu, M., & Liu, Z. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3702539 · Cited by 1
The Story of Your Life: Large Language Models and Personal Memory
Smart, P. R., Clowes, R. W., Krueger, J. W., & Boniface, M. (2026) · Review of Philosophy and Psychology · doi:10.1007/s13164-026-00831-1 · Cited by 2
Navigating maritime emergencies with large models: A lifecycle-oriented review
Xu, J., Yang, Q., Yang, Z., Gao, Y., Yang, K., & Jiang, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115411 · Cited by 2
ELVA: Exploring Ranking-Driven Universal Multimodal Retrieval
Liu, Y., Fu, P., Li, H., Qi, Y., Jiang, C., Fu, J., Liu, Z., Qin, B., Luo, Z., Luan, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37517-9_21 · Cited by 7
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M. C., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · arXiv · doi:10.48550/arxiv.2401.13649 · Cited by 1
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning
Han, X., Jian, Y., Hu, X., Liu, H., Wang, Y., Fan, Q., Ai, Y., Huang, H., He, R., Yang, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12568 · Cited by 1
Self-citationGTR: Guided Thought Reinforcement Prevents Thought Collapse in RL-Based VLM Agent Training
Wei, T., Yang, Y., Xing, J., Shi, Y., Lu, Z., & Ye, D. (2025) · 2025 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01752 · Cited by 1
Does Spatial Cognition Emerge in Frontier Models?
Ramakrishnan, S. K., Wijmans, E., Kraehenbuehl, P., & Koltun, V. (2024) · arXiv · doi:10.48550/arxiv.2410.06468 · Cited by 49
PRISM2: Unlocking Multi-Modal General Pathology AI with Clinical Dialogue
Vorontsov, E., Shaikovski, G., Casson, A., Viret, J., Zimmermann, E., Tenenholtz, N., Wang, Y. K., Bernhard, J. H., Godrich, R. A., Retamero, J. A., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.13063
Wen, S., Wang, Z., Zhang, X., Huang, L., & Wu, W. (2026) · arXiv · doi:10.48550/arxiv.2602.15329
A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents
Huang, W.-C., Zhang, W., Liang, Y., Bei, Y., Chen, Y., Feng, T., Pan, X., Tan, Z., Wang, Y., Wei, T., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.06052 · Cited by 70
Edge-Constrained Video Analytics: A Comprehensive Survey on Detection, Tracking, and Recognition
Toshpulatov, M. A., Lee, W., & Cho, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6614394
Enhancing Vision Foundation Models via Multimodal Continual Pre-Training
Chen, Y., Meng, L., Peng, W., Tao, J., Xu, C., Wu, Z., & Jiang, Y.-G. (2025) · arXiv · doi:10.48550/arxiv.2503.18931
Metadata
- Authors
- Liu, H., Li, C., Wu, Q., & Lee, Y. J.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 34892-34916
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133193597
- Cited by
- 2,428
- References
- 0
- Citations by year
- 2026: 1374 · 2025: 599 · 2024: 439 · 2023: 16
- FWCI
- 259.66
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- visual instruction tuning, vision-language models, instruction tuning, visual grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.