Visual Instruction Tuning
The DOI matches its Crossref record.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [21]
In the citing paper
“This model extends the general-purpose LLaVA framework82 to the medical domain by adapting it for radiograph interpretation and multimodal instruction following.”
From MoMA: a mixture-of-multimodal-agents architecture for enhancing clinical prediction modelling (2025) · cites this paper as [82]
In the citing paper
“Using other VLMs to synthetically generate annotations is a popular approach [84, 119], but it is likely to perpetuate inaccuracies or biases that the model already has (see distribution shift [110]), rather than capturing important nuances.”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
In the citing paper
“VLM performance is heavily shaped by post-training activities, including fine-tuning on specific tasks (e.g., PixMoCap for captioning [35]) and diverse datasets [80], or training to provide answers in specific formats (e.g., instruction tuning [84]).”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
Citations
Cited by
Items 101–200 of 1,046
Towards Learning a Generalist Model for Embodied Navigation
Zheng, D., Huang, S., Zhao, L., Zhong, Y., & Wang, L. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01293 · Cited by 68
Osprey: Pixel Understanding with Visual Instruction Tuning
Yuan, Y., Li, W., Liu, J., Tang, D., Luo, X., Qin, C., Zhang, L., & Zhu, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02664 · Cited by 65
Patro, B. N., & Agneeswaran, V. S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111279 · Cited by 103
Uni-MoE: Scaling Unified Multimodal LLMs With Mixture of Experts
Li, Y., Jiang, S., Hu, B., Wang, L., Zhong, W., Luo, W., Ma, L., & Zhang, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3532688 · Cited by 257
Enhancing Video-Language Representations With Structural Spatio-Temporal Alignment
Fei, H., Wu, S., Zhang, M., Zhang, M., Chua, T., & Yan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3393452 · Cited by 156
Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
Kuang, J., Shen, Y., Xie, J., Luo, H., Xu, Z., Li, R., Li, Y., Cheng, X., Lin, X., & Han, Y. (2025) · ACM Computing Surveys · doi:10.1145/3711680 · Cited by 177
ChatPose: Chatting about 3D Human Pose
Feng, Y., Jing, L., Dwivedi, S. K., Sun, Y. M., Patel, P., & Black, M. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00204 · Cited by 156
Open challenges and opportunities in federated foundation models towards biomedical healthcare
Li, X., Peng, L., Wang, Y., & Zhang, W. (2025) · BioData Mining · doi:10.1186/s13040-024-00414-9 · Cited by 106
Navgpt-2: Unleashing navigational reasoning capability for large vision-language models
Zhou, G., Hong, Y., Wang, Z., Wang, X. E., & Wu, Q. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72667-5_15 · Cited by 63
Self-citationExtracting Financial Data from Unstructured Sources: Leveraging Large Language Models
Li, H., Gao, H., Wu, C., & Vasarhelyi, M. A. (2024) · Journal of Information Systems · doi:10.2308/isys-2023-047 · Cited by 109
VLM-Social-Nav: Socially Aware Robot Navigation Through Scoring Using Vision-Language Models
Song, D., Liang, J., Payandeh, A., Raj, A. H., Xiao, X., & Manocha, D. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511409 · Cited by 165
Foundation models and intelligent decision-making: Progress, challenges, and perspectives
Huang, J., Xu, Y., Wang, Q., Wang, Q., Liang, X., Wang, F., Zhang, Z., Wei, W., Zhang, B., Huang, L., et al. (2025) · The Innovation · doi:10.1016/j.xinn.2025.100948 · Cited by 192
HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data
Yu, Q., Li, J., Wei, L., Pang, L., Ye, W., Qin, B., Tang, S., Tian, Q., & Zhuang, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01230 · Cited by 59
Harnessing the Power of MLLMs for Transferable Text-to-Image Person ReID
Tan, W., Ding, C., Jiang, J., Wang, F., Zhan, Y., & Tao, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01621 · Cited by 127
(2024) · doi:10.1109/cvprw63382.2024.00188 · Cited by 51
GREEN: Generative Radiology Report Evaluation and Error Notation
Ostmeier, S., Xu, J., Chen, Z., Varma, M., Blankemeier, L., Bluethgen, C., Md, A. E. M., Moseley, M., Langlotz, C., Chaudhari, A. S., et al. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.21 · Cited by 59
Prompting Large Language Models for Topic Modeling
Wang, H., Prakash, N., Hoang, N. K., Hee, M. S., Naseem, U., & Lee, R. K.-W. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386113 · Cited by 110
Clio: Real-Time Task-Driven Open-Set 3D Scene Graphs
Maggio, D., Chang, Y., Hughes, N., Trang, M., Griffith, D., Dougherty, C., Cristofalo, E., Schmid, L., & Carlone, L. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3451395 · Cited by 181
LLaFS: When Large Language Models Meet Few-Shot Segmentation
Zhu, L., Chen, T., Ji, D., Ye, J., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00296 · Cited by 115
Buess, L., Keicher, M., Navab, N., Maier, A., & Arasteh, S. T. (2025) · Biomedical Engineering Letters · doi:10.1007/s13534-025-00497-1 · Cited by 109
Seyfioğlu, M. S., Ikezogwo, W. O., Ghezloo, F., Krishna, R., & Shapiro, L. G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01252 · Cited by 176
Research status and application of artificial intelligence large models in the oil and gas industry
Liu, H., Ren, Y., Li, X., Deng, Y., Wang, Y., Cao, Q., Jinyang, D. U., Lin, Z., & Wang, W. (2024) · Petroleum Exploration and Development · doi:10.1016/s1876-3804(24)60524-0 · Cited by 75
Self-citationNew era towards autonomous additive manufacturing: a review of recent trends and future perspectives
Fan, H., Liu, C., Bian, S., Ma, C., Huang, J., Liu, X., Doyle, M., Lu, T., Chow, E., Chen, L., et al. (2025) · International Journal of Extreme Manufacturing · doi:10.1088/2631-7990/ada8e4 · Cited by 73
On Large Visual Language Models for Medical Imaging Analysis: An Empirical Study
Van, M.-H., Verma, P., & Wu, X. (2024) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase60773.2024.00029 · Cited by 101
Gao, F., Ge, X., Li, J., Fan, Y., Li, Y., & Zhao, R. (2024) · Sensors · doi:10.3390/s24165172 · Cited by 70
Foundation Models in Agriculture: A Comprehensive Review
Yin, S., Xi, Y., Zhang, X., Sun, C., & Mao, Q. (2025) · Agriculture · doi:10.3390/agriculture15080847 · Cited by 76
Vision Language Models are blind
Rahmanzadehgervi, P., Bolton, L., Taesiri, M. R., & Nguyen, A. T. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-981-96-0917-8_17 · Cited by 54
Urban attractiveness according to ChatGPT: Contrasting AI and human insights
Malekzadeh, M., Willberg, E. S., Torkko, J., & Toivonen, T. (2024) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2024.102243 · Cited by 80
Scene-Driven Multimodal Knowledge Graph Construction for Embodied AI
Song, Y., Sun, P., Liu, H., Li, Z., Song, W., Xiao, Y., & Zhou, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3399746 · Cited by 82
Self-citationAn Outlook into the Future of Egocentric Vision
Plizzari, C., Goletto, G., Furnari, A., Bansal, S., Ragusa, F., Farinella, G. M., Damen, D., & Tommasi, T. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02095-7 · Cited by 133
Zhang, Y., Pan, Y., Zhong, T., Dong, P., Xie, K., Liu, Y., Jiang, H., Wu, Z., Liu, Z., Zhao, W., et al. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100103 · Cited by 52
Chen, Z., Chen, H., Imani, M., Chen, R., & Imani, F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125769 · Cited by 69
How to Bridge the Gap Between Modalities: Survey on Multimodal Large Language Model
Song, S., Li, X., Li, S., Zhao, S., Yu, J., Ma, J., Mao, X., Zhang, W., & Wang, M. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3527978 · Cited by 145
LlaVA-CoT: Let Vision Language Models Reason Step-By-Step
Xu, G., Jin, P., Wu, Z., Li, H., Song, Y., Sun, L., & Yuan, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00202 · Cited by 660
EarthMarker: A Visual Prompting Multimodal Large Language Model for Remote Sensing
Zhang, W., Cai, M., Zhang, T., Zhuang, Y., Li, J., & Mao, X. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3523505 · Cited by 111
From screens to scenes: A survey of embodied AI in healthcare
Liu, Y., Cao, X., Chen, T., Jiang, Y., You, J., Wu, M., Wang, X., Feng, M., Jin, Y., & Chen, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103033 · Cited by 91
Zhang, Z., Yao, Y., Zhang, A., Tang, X., Ma, X., He, Z., Wang, Y., Gerstein, M., Wang, R., Liu, G., et al. (2025) · ACM Computing Surveys · doi:10.1145/3719341 · Cited by 51
VisEval: A Benchmark for Data Visualization in the Era of Large Language Models
Chen, N., Zhang, Y., Xu, J., Ren, K., & Yang, Y. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456320 · Cited by 154
On the Robustness of Large Multimodal Models Against Image Adversarial Attacks
Cui, X., Aparcedo, A., Jang, Y. K., & Lim, S.-N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02325 · Cited by 169
Tao, L., Zhang, H., Jing, H., Liu, Y., Yan, D., Wei, G., & Xue, X. (2025) · Remote Sensing · doi:10.3390/rs17010162 · Cited by 76
VisualWebArena: evaluating multimodal agents on realistic visual web tasks
Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.50 · Cited by 50
MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding
Cao, X., Zhou, T. H., Ma, Y., Ye, W., Cui, C., Tang, K., Cao, Z., Liang, K., Wang, Z., Rehg, J. M., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02061 · Cited by 123
RegionGPT: Towards Region Understanding Vision Language Model
Guo, Q., Mello, S. D., Yin, H., Byeon, W., Cheung, K. C., Yu, Y., Luo, P., & Liu, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01309 · Cited by 148
LLMs are Good Action Recognizers
Qu, H., Cai, Y., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01741 · Cited by 95
Wang, H., Li, C., & Li, Y. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3441638 · Cited by 57
Self-citationA survey on occupancy perception for autonomous driving: The information fusion perspective
Xu, H., Chen, J., Meng, S., Wang, Y., & Chau, L. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102671 · Cited by 97
VideoBooth: Diffusion-based Video Generation with Image Prompts
Jiang, Y., Wu, T., Yang, S., Si, C., Lin, D., Qiao, Y., Loy, C. C., & Liu, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00639 · Cited by 169
LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
Chen, G., Shen, L., Shao, R., Deng, X., & Nie, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02506 · Cited by 153
DiffEditor: Boosting Accuracy and Flexibility on Diffusion-Based Image Editing
Mou, C., Wang, X., Song, J., Shan, Y., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00811 · Cited by 117
Duan, H., Shao, S., Zhai, B., Shah, T., Han, J., & Ranjan, R. K. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02398-3 · Cited by 56
OpenVLA: An Open-Source Vision-Language-Action Model
Kim, M. J., Pertsch, K., Karamcheti, S., Xiao, T., Balakrishna, A., Nair, S., Rafailov, R., Foster, E., Lam, G., Sanketi, P., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.09246 · Cited by 62
Generative AI in the context of assistive technologies: Trends, limitations and future directions
Fu, B., Hadid, A., & Damer, N. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105347 · Cited by 66
Zambrano Chaves, J. M., Huang, S.-C., Xu, Y., Xu, H., Usuyama, N., Zhang, S., Wang, F., Xie, Y., Khademi, M., Yang, Z., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-58344-x · Cited by 45
Self-citationHolistic Autonomous Driving Understanding by Bird'View Injected Multi-Modal Large Models
Ding, X., Han, J., Xu, H., Liang, X., Zhang, W., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01297 · Cited by 164
An empirical study of LLaMA3 quantization: from LLMs to MLLMs
Huang, W., Zheng, X., Ma, X., Qin, H., Lv, C., Chen, H., Luo, J., Qi, X., Liu, X., & Magno, M. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00070-x · Cited by 173
MLVU: Benchmarking Multi-task Long Video Understanding
Zhou, J., Shu, Y., Zhao, B., Wu, B., Liang, Z., Xiao, S., Qin, M., Yang, X., Xiong, Y., Zhang, B., et al. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01278 · Cited by 44
Mini-InternVL: a flexible-transfer pocket multi-modal model with 5% parameters and 90% performance
Gao, Z., Chen, Z., Cui, E., Ren, Y., Wang, W., Zhu, J., Tian, H., Ye, S., He, J., Zhu, X., et al. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00067-6 · Cited by 159
Feng, H., Liu, Q., Liu, H., Tang, J., Zhou, W., Li, H., & Huang, C. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4250-y · Cited by 166
Self-citationEvaluating and Improving Compositional Text-to-Visual Generation
Li, B., Lin, Z., Pathak, D., Li, J., Fei, Y., Wu, K., Xia, X., Zhang, P., Neubig, G., & Ramanan, D. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00538 · Cited by 108
LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
Wang, J., & Ke, L. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00183 · Cited by 114
DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models
Xiong, L., Wang, H., Chen, X., Sheng, L., Xiong, Y., Liu, J., Xiao, Y., Chen, H., Han, Q., & Tang, Y. S. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2025.125495 · Cited by 61
MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning
Peng, L., Cai, S., Wu, Z., Shang, H., Zhu, X., & Li, X. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103225 · Cited by 44
An Image Grid Can Be Worth a Video: Zero-Shot Video Question Answering Using a VLM
Kim, W., Choi, C., Lee, W., & Rhee, W. (2024) · IEEE Access · doi:10.1109/access.2024.3517625 · Cited by 138
TokenPacker: Efficient Visual Projector for Multimodal LLM
Li, W., Yuan, Y., Liu, J., Tang, D., Wang, S., Qin, J., Zhu, J., & Zhang, L. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02491-7 · Cited by 248
Multimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 105
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
You, K., Zhang, H., Schoop, E., Weers, F., Swearngin, A., Nichols, J., Yang, Y., & Gan, Z. (2024) · arXiv · doi:10.48550/arxiv.2404.05719 · Cited by 40
Token-Mixer: Bind Image and Text in One Embedding Space for Medical Image Reporting
Yang, Y. Q., Yu, J., Fu, Z., Zhang, K., Yu, T., Wang, X., Jiang, H., Lv, J., Huang, Q., & Han, W. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3412402 · Cited by 60
Effectiveness assessment of recent large vision-language models
Jiang, Y., Yan, X., Ji, G.-P., Fu, K., Sun, M., Xiong, H., Fan, D.-P., & Khan, F. S. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00050-1 · Cited by 87
An Empirical Evaluation of the GPT-4 Multimodal Language Model on Visualization Literacy Tasks
Bendeck, A., & Stasko, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456155 · Cited by 93
GPT4Point: A Unified Framework for Point-Language Understanding and Generation
Qi, Z., Fang, Y., Sun, Z., Wu, X., Wu, T., Wang, J., Lin, D., & Zhao, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02495 · Cited by 132
MaViLa: Unlocking new potentials in smart manufacturing through vision language models
Fan, H., Liu, C., Janvisloo, N. E., Bian, S., Fuh, J. Y. H., Lu, W. F., & Li, B. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.02.017 · Cited by 52
Chen, Q. H., & Yin, X. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103478 · Cited by 53
TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document
Liu, Y., Yang, B., Liu, Q., Li, Z., Ma, Z., Zhang, S., & Bai, X. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3653415 · Cited by 272
Vision-Enabled Large Language and Deep Learning Models for Image-Based Emotion Recognition
Nadeem, M., Sohail, S. S., Javed, L., Anwer, F., Saudagar, A. K. J., & Muhammad, K. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10281-5 · Cited by 48
Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld
Yang, Y., Zhou, T., Li, K., Tao, D., Li, L., Shen, L., He, X., Jiang, J., & Shi, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02482 · Cited by 128
Li, F., Jiang, Q., Zhang, H., Ren, T., Liu, S., Zou, X., Xu, H., Li, H., Yang, J., Li, C., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01222 · Cited by 102
Self-citationResearch Progress on Data-Driven Industrial Fault Diagnosis Methods
Lei, L., Li, W., Zhang, S., Wu, C., & Yu, H. (2025) · Sensors · doi:10.3390/s25092952 · Cited by 64
LMEye: An Interactive Perception Network for Large Language Models
Li, Y., Hu, B., Chen, X., Ma, L., Xu, Y. D., & Zhang, M. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3428317 · Cited by 70
Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models
Hu, Y., Stretcu, O., Lu, C.-T., Viswanathan, K., Hata, K., Luo, E., Krishna, R., & Fuxman, A. D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00916 · Cited by 133
AffordanceLLM: Grounding Affordance from Vision Language Models
Qian, S., Chen, W., Bai, M., Zhou, X. H., Tu, Z., & Li, L. E. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00754 · Cited by 140
AIGC Image Quality Assessment via Image-Prompt Correspondence
Peng, F., Fu, H., Ming, A., Wang, C., Ma, H., He, S., Dou, Z., & Chen, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00644 · Cited by 73
OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving
Xing, S., Qian, C., Wang, Y., Hua, H., Tian, K., Zhou, Y., & Tu, Z. (2025) · 2025 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00113 · Cited by 37
Clinical insights: A comprehensive review of language models in medicine
Neveditsin, N., Lingras, P., & Mago, V. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000800 · Cited by 37
A survey of deep-learning-based radiology report generation using multimodal inputs
Wang, X., Figueredo, G. P., Li, R., Zhang, W. E., Chen, W., & Chen, X. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103627 · Cited by 82
Wickramasekara, A., Breitinger, F., & Scanlon, M. (2025) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2024.301859 · Cited by 88
EarthVQANet: Multi-task visual question answering for remote sensing image understanding
Wang, J., Ma, A., Chen, Z., Zheng, Z., Wan, Y., Zhang, L., & Zhong, Y. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.05.001 · Cited by 50
VIAssist: Adapting Multi-Modal Large Language Models for Users with Visual Impairments
Yang, B., He, L., Liu, K., & Yan, Z. (2024) · doi:10.1109/fmsys62467.2024.00010 · Cited by 72
OpenBias: Open-Set Bias Detection in Text-to-Image Generative Models
Moreno D’Incà, Peruzzo, E., Mancini, M., Xu, D., Goe, V., Xu, X., Wang, Z., Shi, H., & Sebe, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01162 · Cited by 122
Li, J., Li, J., Guo, Y., Yang, L., Chi, H., & Yang, L. (2025) · Drones · doi:10.3390/drones9040238 · Cited by 66
Embodied navigation with multi-modal information: A survey from tasks to methodology
Wu, Y., Zhang, P., Gu, M., Zheng, J., & Bai, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102532 · Cited by 34
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving
Fu, D., Lei, W., Wen, L., Cai, P., Mao, S., Dou, M., Shi, B., & Qiao, Y. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588848 · Cited by 72
FSVLM: A Vision-Language Model for Remote Sensing Farmland Segmentation
Wu, H., Du, Z., Zhong, D., Wang, Y., & Tao, C. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3532960 · Cited by 67
A comprehensive overview of Generative AI (GAI): Technologies, applications, and challenges
Zhang, Z., Zhang, J., Zhang, X., & Mai, W. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129645 · Cited by 60
Lin, H., Hong, D., Ge, S., Luo, C., Jiang, K., Jin, H., & Wen, C. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3547988 · Cited by 77
AgroGPT : Efficient Agricultural Vision-Language Model with Expert Tuning
Awais, M., Alharthi, A. H. S. A., Kumar, A., Cholakkal, H., & Anwer, R. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00555 · Cited by 92
Artificial general intelligence for radiation oncology
Liu, C., Liu, Z., Holmes, J., Zhang, L., Zhang, L., Ding, Y., Shu, P., Wu, Z., Dai, H., Li, Y., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100045 · Cited by 50
Interactive Planning Using Large Language Models for Partially Observable Robotic Tasks
Sun, L., Jha, D. K., Hori, C., Jain, S., Corcodel, R., Zhu, X., Tomizuka, M., & Romeres, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610981 · Cited by 77
Diff-Plugin: Revitalizing Details for Diffusion-Based Low-Level Tasks
Liu, Y., Ke, Z., Liu, F., Zhao, N., & Lau, R. W. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00402 · Cited by 79
EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
Xie, H., Peng, C.-J., Tseng, Y., Chen, H.-J., Hsu, C.-F., Shuai, H.-H., & Cheng, W.-H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02511 · Cited by 97
Yi, Z., Xiao, T., & Albert, M. V. (2025) · Information · doi:10.3390/info16020136 · Cited by 54
Metadata
- Authors
- Liu, H., Li, C., Wu, Q., & Lee, Y. J.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 34892-34916
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133193597
- Cited by
- 2,428
- References
- 0
- Citations by year
- 2026: 1374 · 2025: 599 · 2024: 439 · 2023: 16
- FWCI
- 259.66
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- visual instruction tuning, vision-language models, instruction tuning, visual grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.