Visual Instruction Tuning
The DOI matches its Crossref record.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [21]
In the citing paper
“This model extends the general-purpose LLaVA framework82 to the medical domain by adapting it for radiograph interpretation and multimodal instruction following.”
From MoMA: a mixture-of-multimodal-agents architecture for enhancing clinical prediction modelling (2025) · cites this paper as [82]
In the citing paper
“Using other VLMs to synthetically generate annotations is a popular approach [84, 119], but it is likely to perpetuate inaccuracies or biases that the model already has (see distribution shift [110]), rather than capturing important nuances.”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
In the citing paper
“VLM performance is heavily shaped by post-training activities, including fine-tuning on specific tasks (e.g., PixMoCap for captioning [35]) and diverse datasets [80], or training to provide answers in specific formats (e.g., instruction tuning [84]).”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [84]
Citations
Cited by
Items 501–600 of 1,046
Afzaal, U., Su, Z., Sajjad, U., Stack, T., Lü, H., Niu, S., Akbar, A., Gürcan, M. N., & Niazi, M. K. K. (2025) · Patterns · doi:10.1016/j.patter.2025.101284 · Cited by 15
Hu, R., Tu, Y., Wei, S., Lü, D., & Sang, J. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122361 · Cited by 14
Dar, S. S., Kaurav, B., Jain, A., Raghaw, C. S., Rehman, M. Z. U., & Kumar, N. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106480 · Cited by 15
Dong, Y., Meng, X., Yu, N., Li, Z., & Guo, S. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00119 · Cited by 70
IDEA: Image description enhanced CLIP-adapter for image classification
Ye, Z., Jiang, F., Wang, Q., Huang, K., & Huang, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112224 · Cited by 24
Multi-level Priors-Guided Diffusion-based Remote Sensing Image Super-Resolution
Lu, L., Huang, Z., Bao, Y., Wan, L., & Li, Z. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.07.020 · Cited by 12
Cui, C., Ma, Y., Park, S., Yang, Z., Zhou, Y., Liu, P., Lu, J., Peng, J., Zhang, J., Zhang, R., et al. (2026) · Proceedings of the IEEE · doi:10.1109/jproc.2026.3678829 · Cited by 49
VideoLLaMB: Long Streaming Video Understanding with Recurrent Memory Bridges
Wang, Y., Song, Y., Xie, C., Liu, Y., & Zheng, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02240 · Cited by 68
MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh
Fang, S., Shen, I., Wang, Y., Tsai, Y., Yang, Y., Zhou, S., Ding, W., Igarashi, T., & Yang, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01305 · Cited by 46
ManiCLIP: Multi-attribute Face Manipulation from Text
Wang, H., Lin, G., del Molino, A. G., Wang, A., Feng, J., & Shen, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02088-6 · Cited by 15
Defending Language Models Against Image-Based Prompt Attacks via User-Provided Specifications
Sharma, R. K., Gupta, V., & Grossman, D. (2024) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw63631.2024.00017 · Cited by 23
Transformer Module Networks for Systematic Generalization in Visual Question Answering
Yamada, M., D’Amario, V., Takemoto, K., Boix, X., & Sasaki, T. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3438887 · Cited by 13
Object-Centric Instruction Augmentation for Robotic Manipulation
Wen, J., Zhu, Y., Zhu, M., Li, J., Xu, Z., Che, Z., Shen, C., Peng, Y., Liu, D., Feng, F., et al. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10609992 · Cited by 26
Xu, J., Zhou, X., Shen, Y., Gu, X., Arnab, A., Sun, C., Wang, X., & Schmid, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01238 · Cited by 43
Singh, J., Zhang, J., Liu, Q., Smith, C., Lin, Z., & Zheng, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00621 · Cited by 21
Wang, C., Yang, J., Zhou, Y., & Yue, X. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121742 · Cited by 13
Bestow: Efficient and Streamable Speech Language Model with The Best of Two Worlds in GPT and T5
Chen, Z., Huang, H., Hrinchuk, O., Puvvada, K. C., Koluguri, N. R., Żelasko, P., Balam, J., & Ginsburg, B. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832146 · Cited by 38
Positive-Augmented Contrastive Learning for Vision-and-Language Evaluation and Training
Sarto, S., Moratelli, N., Cornia, M., Baraldi, L., & Cucchiara, R. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02535-y · Cited by 24
Lee, C., Lin, T., Pfister, H., & Zhu-Tian, C. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456332 · Cited by 7
An adaptive confidence-based data revision framework for Document-level Relation Extraction
Jiang, C., Liao, J., Zhao, X. H., Zeng, D., & Dai, J. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103909 · Cited by 8
Improving Multimodal Emotion Recognition by Leveraging Acoustic Adaptation and Visual Alignment
Zhao, Z., Chen, H., Li, X., Jiang, D., & Xie, L. (2024) · International Workshop on Multimodal and Responsible Affective Computing (MRAC) · doi:10.1145/3689092.3689407 · Cited by 12
Large multimodal model for open vocabulary semantic segmentation of remote sensing images
Liu, B., Chen, X., Yu, A., Feng, F., Yue, J., & Yu, X. (2024) · European Journal of Remote Sensing · doi:10.1080/22797254.2024.2447344 · Cited by 7
Enhancing knowledge distillation for semantic segmentation through text-assisted modular plugins
Wu, L., Zhang, S., Zhang, C., Zhao, Z., Liang, J., & Yang, W. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2024.111329 · Cited by 10
A Comparative Study of Vision Language Models for Italian Cultural Heritage
Vitaloni, C., Shullani, D., & Baracchi, D. (2025) · Heritage · doi:10.3390/heritage8030095 · Cited by 11
Diagram Formalization Enhanced Multi-Modal Geometry Problem Solver
Zhang, Z., Cheng, J.-K., Deng, J., Tian, L., Ma, J., Qin, Z., Zhang, X., Zhu, N., & Leng, T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889286 · Cited by 27
Exploring the Role of CLIP Global Visual Features in Multimodal Large Language Models
Bai, Z., & Bai, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889200 · Cited by 10
de Carvalho, G. P., Sawanobori, T., & Horii, T. (2025) · IEEE Access · doi:10.1109/access.2025.3552225 · Cited by 12
ReCA: Integrated Acceleration for Real-Time and Efficient Cooperative Embodied Autonomous Agents
Wan, Z., Du, Y., Ibrahim, M., Qian, J., Jabbour, J., Zhao, Y. K., Krishna, T., Raychowdhury, A., & Reddi, V. J. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3676641.3716016 · Cited by 33
Viveros-Muñoz, R., Carrasco-Sáez, J. L., Contreras-Saavedra, C., San-Martín-Quiroga, S., & Contreras-Saavedra, C. E. (2025) · Applied Sciences · doi:10.3390/app15073882 · Cited by 15
Kim, T.-W., Kim, B., & Choi, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i4.32455 · Cited by 22
A Comparative Analysis of OCR Models on Diverse Datasets: Insights from Memes and Hiertext Dataset
Singh, I., Colom, M., & Bontcheva, K. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00148 · Cited by 9
Hao, C., Wang, Z., Mao, X., He, S., Li, B., Liu, H., Peng, F., & Li, W. (2025) · Computers in Industry · doi:10.1016/j.compind.2025.104302 · Cited by 8
Self-citationFu, X., Yue, J., Faizan, M., Li, Z., Huo, Q., & Zhang, F. (2025) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2025.3561245 · Cited by 8
LLaFS++: Few-Shot Image Segmentation With Large Language Models
Zhu, L., Chen, T., Ji, D., Xu, P., Ye, J., & Liu, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3573609 · Cited by 16
PathVLM-Eval: Evaluation of open vision language models in histopathology
Gilal, N. U., Zegour, R., Al-Thelaya, K., Özer, E., Agus, M., Schneider, J., & Boughorbel, S. (2025) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2025.100455 · Cited by 7
Distributed VLMs: Efficient Vision-Language Processing through Cloud-Edge Collaboration
Li, Y., Gumaste, D., Türkcan, M. K., Ghaderi, J., Zussman, G., & Kostić, Z. (2025) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops65533.2025.00078 · Cited by 14
Optical image processing and applications empowered by vision-language models
Xiao, J., Sun, Z., An, H., Zhao, H., Qiu, M., & Li, X. (2025) · iOptics · doi:10.1016/j.iopt.2025.100003 · Cited by 10
A survey of backdoor attacks and defences: From deep neural networks to large language models
Jin, L., Jiang, W., Wen, X., Lin, M.-Y., Zhan, J., Zhou, X.-Z., Habtie, M. A., & Werghi, N. (2025) · Journal of Electronic Science and Technology · doi:10.1016/j.jnlest.2025.100326 · Cited by 13
Enhancing vision-language models through pre-training-free knowledge fusion with TransferCVLM
Choi, D., Kim, J.-J., & Lee, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113986 · Cited by 8
A careful examination of large behavior models for multitask dexterous manipulation
Barreiros, J. A. L., Beaulieu, A., Bhat, A. D., Cory, R., Cousineau, E. A., Dai, H., Fang, C.-H., Hashimoto, K., Irshad, M. Z., Itkina, M., et al. (2026) · Science Robotics · doi:10.1126/scirobotics.aea6201 · Cited by 180
Minerva: Evaluating Complex Video Reasoning
Nagrani, A., Menon, S., İşcen, A., Buch, S., Mehran, R., Jha, N., Hauth, A., Zhu, Y., Vondrick, C., Сиротенко, М., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02222 · Cited by 52
Prediction of actions and places by the time series recognition from images with Multimodal LLM
Ogawa, T., Yoshioka, K., Fukuda, K., & Morita, T. (2024) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc59802.2024.00053 · Cited by 7
Dasgupta, D., Mondal, A., & Chakrabarti, P. P. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00748 · Cited by 12
Solanki, J., & Senapati, B. (2024) · IEEE International Conference and Expo on Real Time Communications at IIT (RTC) · doi:10.1109/rtc62204.2024.10739086 · Cited by 9
Das, D., Talon, D., Mancini, M., Wang, Y., & Ricci, E. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00550 · Cited by 12
VLMine: Long-Tail Data Mining with Vision Language Models
Ye, M., Meyer, G. P., Zhang, Z., Park, D., Mustikovela, S. K., Chai, Y., & Wolff, E. M. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00120 · Cited by 9
Alignment and Generation Adapter for Efficient Video-text Understanding
Fang, H., Yang, Z., Wei, Y., Zang, X., Ban, C., Feng, Z., He, Z., Li, Y., & Sun, H. S. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00296 · Cited by 15
Lim, Q. Z., Lee, C. P., Lim, K. M., & Samingan, A. K. (2024) · IEEE Access · doi:10.1109/access.2024.3403101 · Cited by 17
Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-Modal Language Models
Zhao, S., Li, Z., Lu, Y., Yuille, A., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01267 · Cited by 20
An Empirical Study on the Power Consumption of LLMs with Different GPU Platforms
Chen, Z., Lin, W., Xie, X., Hu, Y., Li, C., Tong, Q., Wu, Y., & Li, S. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825662 · Cited by 7
Self-citationLMM-driven Semantic Image-Text Coding for Ultra Low-bitrate Learned Image Compression
Murai, S., Sun, H., & Katto, J. (2024) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip63160.2024.10849863 · Cited by 6
Sun, Y., Pendyala, V., Lian, R., Xin, H., Patel, P., Bucy, E. P., & Shah, D. V. (2025) · Visual Communication Quarterly · doi:10.1080/15551393.2025.2455495 · Cited by 8
MiniCPM-V LLaMA Model for Image Recognition: A Case Study on Satellite Datasets
Kömürcü, K., & Petkevičius, L. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3547144 · Cited by 11
Liu, Z., Liu, J., Ling, X., Huang, Q., & Wang, J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113274 · Cited by 12
Optimizing Vision-Language Model for Road Crossing Intention Estimation
Uziel, R., & Bialer, O. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00173 · Cited by 8
CATALOG: A Camera Trap Language-Guided Contrastive Learning Model
Santamaria, J. D., Isaza, C., & Giraldo, J. H. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00124 · Cited by 16
Cross-scene visual context parsing with large vision-language model
Zhang, G., Kan, S., Shi, L., Xu, W., An, G., & Cen, Y. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111641 · Cited by 9
Cross-attention fusion of graph and MLLM for social relation recognition
Tang, W., Qing, L., Wang, P., Li, L., & Peng, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103259 · Cited by 8
Sarcasm-GPT: advancing sarcasm detection with large language models
Li, Q., Li, Z., Liu, W., He, X., & Pan, Y. (2025) · The Computer Journal · doi:10.1093/comjnl/bxaf055 · Cited by 13
Infrared and visible image fusion driven by multimodal large language models
Wang, K., Hu, D., Cheng, Y., Che, Y., Li, Y., Jiang, Z., Chen, F., & Li, W. (2025) · Frontiers in Physics · doi:10.3389/fphy.2025.1599937 · Cited by 7
Visual hallucination detection in large vision-language models via evidential conflict
Huang, T., Liu, Z., Wang, R., Zhang, Y., & Jing, L. (2025) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2025.109507 · Cited by 18
Enhancing the Robustness of Vision-Language Foundation Models by Alignment Perturbation
Zhang, C., Wang, S., Li, X., Zhu, Y. T., Qi, H., & Huang, Q. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3586430 · Cited by 9
Language-Driven Motion Prior Knowledge Learning for Moving Infrared Small Target Detection
Chen, S., Ji, L., Peng, S., Zhu, S., Ye, M., & Sang, Y. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3596902 · Cited by 7
A Simple yet Effective Layout Token in Large Language Models for Document Understanding
Zhu, Z., Luo, C., Shao, Z., Gao, F., Xing, H., Zheng, Q., & Zhang, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01349 · Cited by 20
Intelligent analysis of chest X-ray based on multi-modal instruction tuning
Yao, J., Wang, J., Xiao, Z., Hao, X., & Jiang, X. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100172 · Cited by 7
Learning motion blur robust vision transformers for real-time UAV tracking
Wu, Y., Wang, X., Zeng, D., Ye, H., Xie, X., Zhao, Q., & Li, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129445 · Cited by 21
Dhinagar, N. J., Thomopoulos, S. I., & Thompson, P. M. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11251809 · Cited by 14
Multimodal Referring Segmentation: A Survey
Ding, H., Tang, S., He, S., Liu, C., Wu, Z., & Jiang, Y. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02943-8 · Cited by 37
MG-LLaVA: Toward Multi-Granularity Visual Instruction Tuning
Zhao, X., Li, X., Duan, H., Huang, H., Li, Y., Chen, K., & Yang, H. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3643469 · Cited by 33
VideoExpert: Augmented LLM for Temporal-Sensitive Video Understanding
Zhao, H., Ji, G.-P., Yan, R., Xiong, H., & Li, Z. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3653742 · Cited by 28
Park, S., Cui, C., Ma, Y., Moradipari, A., Gupta, R., Han, K., & Wang, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00756 · Cited by 50
Fu, Y., Wang, R., Ren, B., Sun, G., Gong, B., Fu, Y., Paudel, D. P., Huang, X. S., & Gool, L. V. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00616 · Cited by 49
GaSLight: Gaussian Splats for Spatially-Varying Lighting in HDR
Bolduc, C., Hold-Geoffroy, Y., & Lalonde, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02704 · Cited by 6
Ghosh, A., Zheng, S., Tamburo, R., Vuong, K., Alvarez-Padilla, J., Zhu, H., Cardei, M., Dunn, N., Mertz, C., & Narasimhan, S. G. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00579 · Cited by 42
OmniVTLA: Vision-Tactile-Language-Action Models With Semantic-Aligned Tactile Sensing
Cheng, Z., Zhang, Y., Tang, A., Wang, K., Zhang, W., Li, H., Zhang, H., & Song, L. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3710060 · Cited by 91
Trusted LLM Inference on the Edge with Smart Contracts
Karanjai, R., & Shi, W. L. (2024) · IEEE International Conference on Blockchain and Cryptocurrency (ICBC) · doi:10.1109/icbc59979.2024.10634448 · Cited by 12
Autonomous materials research and design: Characterization
Kaufmann, K., & Vecchio, K. S. (2024) · Current Opinion in Solid State and Materials Science · doi:10.1016/j.cossms.2024.101192 · Cited by 9
Common Canvas: Open Diffusion Models Trained on Creative-Commons Images
Gokaslan, A., Cooper, A. F., Collins, J., Seguin, L., Jacobson, A., Patel, M., Frankle, J., Stephenson, C., & Kuleshov, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00788 · Cited by 27
VideoCon: Robust Video-Language Alignment via Contrast Captions
Bansal, H., Bitton, Y., Szpektor, I., Chang, K.-W., & Grover, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01321 · Cited by 45
Towards Better Vision-Inspired Vision-Language Models
Cao, Y.-H., Ji, K., Huang, Z., Zheng, C., Liu, J., Wang, J., Chen, J., & Yang, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01285 · Cited by 38
What does CLIP know about peeling a banana?
Cuttano, C., Rosi, G., Trivigno, G., & Averta, G. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00229 · Cited by 15
Task Navigator: Decomposing Complex Tasks for Multimodal Large Language Models
Ma, F., Zhou, Y., Zhang, Y., Wu, S., Zhang, Z., He, Z., Rao, F., & Sun, X. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00230 · Cited by 18
Evolved Hierarchical Masking for Self-Supervised Learning
Feng, Z., & Zhang, S. S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3490776 · Cited by 18
MMInstruct: a high-quality multi-modal instruction tuning dataset with extensive diversity
Liu, Y., Cao, Y. Q., Gao, Z., Wang, W., Chen, Z., Wang, W., Tian, H., Lu, L., Zhu, X., Lu, T., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4187-3 · Cited by 59
Wang, Z. Y., Jiang, X., Gao, C., Dong, F., Dai, W., Wang, B., Yan, B., Chen, Q., Huang, W., Zhang, T., et al. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822152 · Cited by 10
Luo, X., Qin, M., Gao, Z., Yan, H., & Yang, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126563 · Cited by 9
Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks
Hossain, M. Z., & Imteaj, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825099 · Cited by 30
LoCo: Low-Bit Communication Adaptor for Large-Scale Model Training
Xie, X., Lin, Z., Toh, K.-C., & Zhou, P. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3544764 · Cited by 19
Detours for Navigating Instructional Videos
Ashutosh, K., Xue, Z., Nagarajan, T., & Grauman, K. L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01779 · Cited by 17
SigPhi-Med: A lightweight vision-language assistant for biomedicine
Zhou, F., Liu, X., Zeng, Q., Li, Z., & Xiao, H. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104849 · Cited by 10
Mai, G. (2024) · Wiley eBooks · doi:10.1002/9781118786352.wbieg2206 · Cited by 6
UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Images
Qu, Y., Shen, X., Wu, Y., Backes, M., Zannettou, S., & Zhang, Y. (2025) · Proceedings of the 2025 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3719027.3765088 · Cited by 6
UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation
Wu, L., Nie, Y., He, S., Zhuang, J., Luo, L., Li, T., Xie, Z., Chen, D., Zhao, Y., Mahboobani, N., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.21336 · Cited by 6
Let storytelling tell vivid stories: A multi-modal-agent-based unified storytelling framework
Zhang, R., Tang, J., Zang, C., Pei, M., Liang, W., Zhao, Z., & Zhao, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2024.129316 · Cited by 15
Parameter-Efficient Adaptation of Large Vision—Language Models for Video Memorability Prediction
Martín-Fernández, I., Esteban-Romero, S., Fernández-Martínez, F., & Gil-Martín, M. (2025) · Sensors · doi:10.3390/s25061661 · Cited by 10
Verhelst, E., Janssens, R., & Belpaeme, T. (2025) · Studies in computational intelligence · doi:10.1007/978-3-031-82915-4_2 · Cited by 8
Cross-Lingual Adaptation for Vision-Language Model via Multimodal Semantic Distillation
Weng, Y., He, W., Dong, J., Chaomurilige, C., Liu, X., & Liu, Z. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557678 · Cited by 15
Videogamebunny: Towards Vision Assistants for Video Games
Taesiri, M. R., & Bezemer, C. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00144 · Cited by 19
Xu, M., Wu, M., Zhao, Y., Li, J. C. L., & Ou, W. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00620 · Cited by 22
Fanelli, N., Vessio, G., & Castellano, G. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00592 · Cited by 7
Metadata
- Authors
- Liu, H., Li, C., Wu, Q., & Lee, Y. J.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 34892-34916
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133193597
- Cited by
- 2,428
- References
- 0
- Citations by year
- 2026: 1374 · 2025: 599 · 2024: 439 · 2023: 16
- FWCI
- 259.66
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- visual instruction tuning, vision-language models, instruction tuning, visual grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.