Visual Instruction Tuning
The DOI matches its Crossref record.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [21]
In the citing paper
“This model extends the general-purpose LLaVA framework82 to the medical domain by adapting it for radiograph interpretation and multimodal instruction following.”
From MoMA: a mixture-of-multimodal-agents architecture for enhancing clinical prediction modelling (2025) · cites this paper as [82]
In the citing paper
“Using other VLMs to synthetically generate annotations is a popular approach [84, 119], but it is likely to perpetuate inaccuracies or biases that the model already has (see distribution shift [110]), rather than capturing important nuances.”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
In the citing paper
“VLM performance is heavily shaped by post-training activities, including fine-tuning on specific tasks (e.g., PixMoCap for captioning [35]) and diverse datasets [80], or training to provide answers in specific formats (e.g., instruction tuning [84]).”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
Citations
Cited by
Items 301–400 of 1,046
Improving Web Accessibility With an LLM-Based Tool: A Preliminary Evaluation for STEM Images
Pedemonte, G. M., Leotta, M., & Ribaudo, M. (2025) · IEEE Access · doi:10.1109/access.2025.3577519 · Cited by 23
Li, Z., Muhtar, D., Gu, F., He, Y., Zhang, X., Xiao, P., He, G., & Zhu, X. X. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.06.003 · Cited by 58
EmoVerse: Enhancing Multimodal Large Language Models for Affective Computing via Multitask Learning
Li, A., Xu, L., Ling, C., Zhang, J., & Wang, P. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130810 · Cited by 39
MtArtGPT: A Multi-Task Art Generation System With Pre-Trained Transformer
Jin, C., Zhu, R., Zhu, Z., Yang, L., Min, Y., & Luo, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3349567 · Cited by 23
Large Language and Vision Assistant in dermatology: a game changer or just hype?
Göktaş, P., Gülseren, D., & Tobin, A. (2024) · Clinical and Experimental Dermatology · doi:10.1093/ced/llae119 · Cited by 23
Homogeneous tokenizer matters: Homogeneous visual tokenizer for remote sensing image understanding
Shao, R., Zhang, Z., Tao, C., Zhang, Y., Peng, C., & Li, H. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.09.009 · Cited by 25
Describing Differences in Image Sets with Natural Language
Dunlap, L., Zhang, Y., Wang, X., Zhong, R., Darrell, T., Steinhardt, J., Gonzalez, J. E., & Yeung, S. Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02284 · Cited by 81
Kaul, P., Li, Z.-Z., Yang, H., Dukler, Y., Swaminathan, A., Taylor, C., & Soatto, S. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.02571 · Cited by 52
Popeye: A Unified Visual-Language Model for Multisource Ship Detection From Remote Sensing Imagery
Zhang, W., Cai, M., Zhang, T., Lei, G., Zhuang, Y., & Mao, X. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3488034 · Cited by 39
He, T. C., Chen, Y., Gao, X., Wang, L., Hu, T., & Cheng, H. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3491176 · Cited by 28
WavJourney: Compositional Audio Creation With Large Language Models
Liu, X., Zhu, Z., Liu, H., Yuan, Y., Huang, Q., Cui, M., Liang, J., Cao, Y. P., Kong, Q., Plumbley, M. D., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3574867 · Cited by 77
Self-citationTucano: Advancing neural text generation for Portuguese
Corrêa, N. K., Sen, A., Falk, S., & Fatimah, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101325 · Cited by 50
Retrieval-Augmented Few-Shot Medical Image Segmentation With Foundation Models
Zhao, L., Chen, X., Chen, E. Z., Liu, Y., Chen, T., & Sun, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3568479 · Cited by 19
Atakishiyev, S., Salameh, M., & Goebel, R. G. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588812 · Cited by 33
Koala: Key Frame-Conditioned Long Video-LLM
Tan, R., Sun, X., Hu, P., Wang, J.-H., Deilamsalehy, H., Plummer, B. A., Russell, B. C., & Saenko, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01289 · Cited by 84
ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Models
Qu, M., Chen, X., Liu, W., Li, A., & Zhao, Y. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00191 · Cited by 83
Vo, H. Q., Wong, K., Wong, K. K., Ezeana, C. F., Yu, X., Yang, W., Chang, J. C., Nguyen, H. V., & Wong, S. T. C. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3507638 · Cited by 27
Generative AI for Context-Aware 3D Object Creation Using Vision-Language Models in Augmented Reality
Behravan, M., Matković, K., & Gračanin, D. (2025) · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR) · doi:10.1109/aixvr63409.2025.00018 · Cited by 19
MLLM-Tool: A Multimodal Large Language Model for Tool Agent Learning
Wang, C., Luo, W., Dong, S., Xuan, X., Li, Z., Ma, L., & Gao, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00650 · Cited by 109
Quality Assessment for AI Generated Images With Instruction Tuning
Wang, J., Duan, H., Zhai, G., & Min, X. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651009 · Cited by 86
CoVR-2: Automatic Data Construction for Composed Video Retrieval
Ventura, L., Yang, A., Schmid, C., & Varol, G. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3463799 · Cited by 69
Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model
Pramanick, S., Han, G., Hou, R., Nag, S., Lim, S.-N., Ballas, N., Wang, Q., Chellappa, R., & Almahairi, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01335 · Cited by 64
Curriculum Point Prompting for Weakly-Supervised Referring Image Segmentation
Dai, Q., & Yang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01301 · Cited by 41
Accept the Modality Gap: An Exploration in the Hyperbolic Space
Ramasinghe, S., Shevchenko, V., Avraham, G., & Ajanthan, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02574 · Cited by 69
COCONut: Modernizing COCO Segmentation
Deng, X., Yu, Q., Wang, P., Shen, X., & Chen, L.-C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02065 · Cited by 49
RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model
Xu, J., Jin, S., Lei, Y., Zhang, Y., & Zhang, L. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801718 · Cited by 32
Yu, X., Elazab, A., Ge, R., Zhu, J., Zhang, L., Jia, G., Wu, Q., Wan, X., Li, L., & Wang, C. (2025) · Neural Networks · doi:10.1016/j.neunet.2024.107096 · Cited by 36
Self-citationPlanAgent: A Multimodal Large Language Agent for Closed-Loop Vehicle Motion Planning
Zheng, Y., Xing, Z., Zhang, Q., Jin, B., Li, P., Zheng, Y., Xia, Z., Chen, Y., & Zhao, D. (2026) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2026.3664120 · Cited by 78
MMSR: Symbolic regression is a multi-modal information fusion task
Li, Y., Liu, J., Wu, M., Yu, L., Li, W., Ning, X., Li, W., Hao, M., Deng, Y., & Wei, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102681 · Cited by 38
RescueADI: Adaptive Disaster Interpretation in Remote Sensing Images With Autonomous Agents
Liu, Z., Zhao, D., Yuan, B., & Jiang, Z. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3532594 · Cited by 42
Ortiz-Pérez, D., Benavent-Lledó, M., Rodriguez-Juan, J., García‐Rodríguez, J., & Tomás, D. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114264 · Cited by 29
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models
Li, Y., Liu, X., Wang, X., Lee, B., Wang, S., Rocha, A. D. R., & Lin, W. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3597211 · Cited by 93
Yang, M., Tao, Y., Cai, H., & Hu, B. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3397403 · Cited by 24
Empower Generalizability for Pansharpening Through Text-Modulated Diffusion Model
Xing, Y., Qu, L., Zhang, S., Feng, J., Zhang, X., & Zhang, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3434431 · Cited by 29
Time-, Memory- and Parameter-Efficient Visual Adaptation
Mercea, O.-B., Gritsenko, A. A., Schmid, C., & Arnab, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00529 · Cited by 42
Exploring the Transferability of Visual Prompting for Multimodal Large Language Models
Zhang, Y., Dong, Y., Zhang, S., Min, T., Su, H., & Zhu, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02508 · Cited by 17
Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
Wada, Y., Kaneda, K., Saito, D., & Sugiura, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01287 · Cited by 71
Beyond Text: Frozen Large Language Models in Visual Signal Comprehension
Zhu, L., Wei, F., & Lu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02554 · Cited by 45
ADAGENT: Anomaly Detection Agent With Multimodal Large Models in Adverse Environments
Zhang, M., Shen, Y., Yin, J., Lü, S., & Wang, X. (2024) · IEEE Access · doi:10.1109/access.2024.3480250 · Cited by 39
MiniMedGPT: Efficient Large Vision–Language Model for medical Visual Question Answering
Alsabbagh, A. R., Mansour, T., Al-Kharabsheh, M., Ebdah, A. S., Al-Emaryeen, R., Al-Nahhas, S., Mahafza, W. S., & Al-Kadi, O. S. (2025) · Pattern Recognition Letters · doi:10.1016/j.patrec.2025.01.001 · Cited by 19
Relax: Composable Abstractions for End-to-End Dynamic Machine Learning
Lai, R., Shao, J., Feng, S. M., Lyubomirsky, S., Hou, B., Lin, W., Ye, Z., Jin, H., Jin, Y., Liu, J., et al. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3676641.3716249 · Cited by 43
Konwer, A., Yang, Z., Bas, E., Xiao, C., Prasanna, P., Bhatia, P., & Kass-Hout, T. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01955 · Cited by 17
MAIRA-2: Grounded Radiology Report Generation
Bannur, S., Bouzid, K., Castro, D. C., Schwaighofer, A., Thieme, A., Bond-Taylor, S., Ilse, M., Pérez-García, F., Salvatelli, V., Sharma, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.04449 · Cited by 19
Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs
Lin, S., Chen, Y., Yang, S., Ding, X., Ge, Y., Chen, Y.-C., & Shan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01306 · Cited by 44
Li, B., Wei, Y. “., Fu, Y., Wang, Z., Li, Y., Zhang, J., Wang, R., & Zhang, T. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00073 · Cited by 48
DehazeMamba: large multi-modal model guided single image dehazing via mamba
Zhang, R., Yang, Z., & Pan, L. (2025) · Visual Intelligence · doi:10.1007/s44267-025-00083-0 · Cited by 21
Generative Region-Language Pretraining for Open-Ended Object Detection
Lin, C., Jiang, Y., Qu, L., Yuan, Z., & Cai, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01324 · Cited by 46
Multi-Modal Instruction Tuned LLMs with Fine-Grained Visual Perception
He, J., Wang, Y., Wang, L., Lu, H., He, J.-Y., Lan, J.-P., Luo, B., & Xie, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01326 · Cited by 62
GRAM: Global Reasoning for Multi-Page VQA
Blau, T., Fogel, S., Ronen, R., Golts, A., Tsiper, S., Avraham, E. B., Aberdam, A., Ganz, R., & Litman, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01477 · Cited by 48
Jiang, Y., Fan, L., Wang, H., Luo, Z., Zhang, W., Wang, J., Sun, X., Li, N., & Tian, J. (2024) · Nano Energy · doi:10.1016/j.nanoen.2024.110279 · Cited by 17
VideoQA in the Era of LLMs: An Empirical Study
Xiao, J., Huang, N., Qin, H., Li, D., Li, Y., Zhu, F., Tao, Z., Yu, J., Lin, L., Chua, T., et al. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02385-8 · Cited by 40
DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark
Li, H., Zhang, X., & Qu, H. (2025) · Remote Sensing · doi:10.3390/rs17040719 · Cited by 28
ViDDAR: Vision Language Model-Based Task-Detrimental Content Detection for Augmented Reality
Xiu, Y., Scargill, T., & Gorlatova, M. A. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549147 · Cited by 34
ReferSAM: Unleashing Segment Anything Model for Referring Image Segmentation
Liu, S.-A., Xie, H., Ge, J., & Zhang, Y. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3524543 · Cited by 19
MedFILIP: Medical Fine-Grained Language-Image Pre-Training
Liang, X., Li, X., Li, F., Jiang, J., Dong, Q., Wang, W., Wang, K., Dong, S., Luo, G., & Li, S. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3528196 · Cited by 31
Visual Instruction Tuning with Polite Flamingo
Chen, D., Liu, J., Dai, W., & Wang, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29727 · Cited by 59
Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning
Zhang, G., Zhang, Y., Zhang, K., & Volker Tresp, C. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00069 · Cited by 37
A Vision Check-up for Language Models
Sharma, P., Shaham, T. R., Baradad, M., Rodriíuez-Muñoz, A., Duggal, S., Isola, P., Torralba, A., & Fu, S. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01366 · Cited by 15
Visual Delta Generator with Large Multi-Modal Models for Semi-Supervised Composed Image Retrieval
Jang, Y. K., Kim, D., Meng, Z., Huynh, D., & Lim, S.-N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01590 · Cited by 33
ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object
Zhang, C., Pan, F., Kim, J., Kweon, I. S., & Mao, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02055 · Cited by 41
Physical Property Understanding from Language-Embedded Feature Fields
Zhai, A. J., Shen, Y., Chen, E. Y., Wang, G. X., Wang, X., Wang, S., Guan, K., & Wang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02673 · Cited by 60
ModaVerse: Efficiently Transforming Modalities with LLMs
Wang, X., Zhuang, B., & Wu, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02512 · Cited by 45
Self-citationCustomization Assistant for Text-to-image Generation
Zhou, Y., Zhang, R., Gu, J., & Sun, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00877 · Cited by 36
What If the TV was off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models
Zhang, L., Zhai, X., Zhao, Z., Zong, Y., Wen, X., & Zhao, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02064 · Cited by 45
Qiu, H., Wang, L., Zhao, T., Meng, F., Wu, Q., & Li, H. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3462100 · Cited by 19
Self-citationPhoto-Realistic Image Restoration in the Wild with Controlled Vision-Language Models
Luo, Z., Gustafsson, F., Zhao, Z., Sjölund, J., & Schön, T. B. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00658 · Cited by 38
When Large Vision-Language Models Meet Person Re-Identification
Wang, Q., Li, B., & Xue, X. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460593 · Cited by 29
PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image Understanding
Dai, D., Zhang, Y., Xu, L., Yang, Q., Shen, X., Xia, S., & Wang, G. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10821785 · Cited by 45
Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detection
Wang, H., He, Q., Peng, J., Yang, H., Chi, M., & Wang, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888334 · Cited by 26
Learning Electromagnetic Metamaterial Physics With ChatGPT
Lu, D., Deng, Y., Malof, J. M., & Padilla, W. J. (2025) · IEEE Access · doi:10.1109/access.2025.3552418 · Cited by 24
Reasoning-Driven Food Energy Estimation via Multimodal Large Language Models
Tanabe, H., & Yanai, . (2025) · Nutrients · doi:10.3390/nu17071128 · Cited by 23
Learning visual language models for video understanding
Yang, A. (2023) · theses.fr (ABES) · doi:10.70675/802872a7z8092z4556za1fdz2c7af45f0e72 · Cited by 26
From Detection to Application: Recent Advances in Understanding Scientific Tables and Figures
Huang, J., Chen, H., Yu, F., & Lu, W. P. (2024) · ACM Computing Surveys · doi:10.1145/3657285 · Cited by 20
GPT4Ego: Unleashing the Potential of Pre-Trained Models for Zero-Shot Egocentric Action Recognition
Dai, G., Shu, X., Wu, W., Yan, R., & Zhang, J. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521658 · Cited by 35
Guo, M., Wu, M., Shen, Y., Li, H., & Tao, C. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111672 · Cited by 25
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 22
AgroBench: Vision-Language Model Benchmark in Agriculture
Shinoda, R., Inoue, N., Kataoka, H., Onishi, M., & Ushiku, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00716 · Cited by 51
MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs
Daxberger, E., Wenzel, N., Griffiths, D., Gang, H., Lazarow, J., Kohavi, G., Kang, K., Eichner, M. L., Yang, Y., Dehghan, A., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00694 · Cited by 118
Zhai, Y., Chen, L., & Deng, M. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae188 · Cited by 15
A survey for table recognition based on deep learning
Yu, C., Li, W., Li, W., Zhu, Z., Liu, R., Hou, B., & Jiao, L. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128154 · Cited by 17
Distilling Vision-Language Models on Millions of Videos
Zhao, Y., Zhao, L., Zhou, X., Wu, J., Chu, C.-T., Miao, H., Schroff, F., Adam, H., Liu, T., Gong, B., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01245 · Cited by 38
UV-IDM: Identity-Conditioned Latent Diffusion Model for Face UV-Texture Generation
Li, H., Feng, Y., Xue, S., Liu, X., Zeng, B., Li, S., Liu, B., Liu, J., Han, S., & Zhang, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01007 · Cited by 26
GlitchBench: Can Large Multimodal Models Detect Video Game Glitches?
Taesiri, M. R., Feng, T., Bezemer, C., & Nguyen, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02118 · Cited by 38
Enhancing Visual Question Answering through Question-Driven Image Captions as Prompts
Özdemir, Ö., & Akagündüz, E. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00163 · Cited by 51
Beyond Human Vision: The Role of Large Vision Language Models in Microscope Image Analysis
Verma, P., Van, M.-H., & Wu, X. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825000 · Cited by 26
Hulk: A Universal Knowledge Translator for Human-Centric Tasks
Wang, Y., Wu, Y., He, W., Guo, X., Zhu, F., Bai, L., Zhao, R., Wu, J., He, T., Ouyang, W., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3552604 · Cited by 40
Tung, Y.-H., Yang, Z.-R., Shen, M.-W., Chang, C., Chen, C., & Ho, L.-C. (2025) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2025.105371 · Cited by 20
A decade of gender bias in machine translation
Savoldi, B., Bastings, J., Bentivogli, L., & Vanmassenhove, E. (2025) · Patterns · doi:10.1016/j.patter.2025.101257 · Cited by 43
Medical multimodal large language models: A systematic review
Hu, Y., Xu, C., Lin, B., Yang, W., & Tang, Y. Y. (2025) · Intelligent Oncology · doi:10.1016/j.intonc.2025.09.005 · Cited by 14
On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook
Bucur, A.-M., Moldovan, A.-C., Parvatikar, K., Zampieri, M., KhudaBukhsh, A. R., & Dinu, L. P. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3540507 · Cited by 27
Truong, T.-D., Nguyen, H.-Q., Nguyen, X.-B., Dowling, A. P. G., Li, X., & Luu, K. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02521-4 · Cited by 26
Progressive Frame-Proposal Mining for Weakly Supervised Video Object Detection
Han, M., Wang, Y., Li, M., Chang, X., Yang, Y., & Qiao, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3364536 · Cited by 16
Enhancing Few-Shot CLIP With Semantic-Aware Fine-Tuning
Zhu, Y. T., Chen, Y., Mao, X., Yan, X. J., Wang, Y., Wang, L., Wang, J., & Ji, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3443394 · Cited by 18
CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update
Gao, Z. F., Du, Y., Zhang, X., Ma, X., Han, W., Zhu, S. C., & Li, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01259 · Cited by 72
VIT-LENS: Towards Omni-modal Representations
Lei, W., Ge, Y., Yi, K., Zhang, J., Gao, D., Sun, D., Ge, Y., Shan, Y., & Shou, M. Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02516 · Cited by 49
ViTA: An Efficient Video-to-Text Algorithm using VLM for RAG-based Video Analysis System
Arefeen, M. A., Debnath, B. K., Uddin, M. Y. S., & Chakradhar, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00232 · Cited by 39
Application-Driven Exascale: The JUPITER Benchmark Suite
Herten, A., Achilles, S., Alvarez, D., Badwaik, J., Behle, E., Bode, M., Breuer, T., Caviedes‐Voullième, D., Cherti, M., Dabah, A., et al. (2024) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41406.2024.00038 · Cited by 39
VibroFM: Towards Micro Foundation Models for Robust Multimodal IoT Sensing
Kimura, T., Li, J., Wang, T., Chen, Y., Wang, R., Kara, D., Wigness, M., Bhattacharyya, J., Srivatsa, M., Liu, S., et al. (2024) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass62177.2024.00014 · Cited by 22
Language-Driven Visual Consensus for Zero-Shot Semantic Segmentation
Zhang, Z., Ke, W., Zhu, Y., Liang, X., Liu, J., Ye, Q., & Zhang, T. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3504816 · Cited by 19
ProCyon: A multimodal foundation model for protein phenotypesPreprint
Queen, O., Huang, Y., Calef, R., Giunchiglia, V., Chen, T., Dasoulas, G., Tai, L., Abbadessa, G., Howell, O. W., Li, M. M., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.10.627665 · Cited by 24
Metadata
- Authors
- Liu, H., Li, C., Wu, Q., & Lee, Y. J.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 34892-34916
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133193597
- Cited by
- 2,428
- References
- 0
- Citations by year
- 2026: 1374 · 2025: 599 · 2024: 439 · 2023: 16
- FWCI
- 259.66
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- visual instruction tuning, vision-language models, instruction tuning, visual grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.