The DOI matches its DataCite record; 154 of the 194 references it cites were found in a registry or an index.
Hallucination of Multimodal Large Language Models: A Survey
Open accessAbstract
This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and remarkable abilities in multimodal tasks. Despite these promising developments, MLLMs often generate outputs that are inconsistent with the visual content, a challenge known as hallucination, which poses substantial obstacles to their practical deployment and raises concerns regarding their reliability in real-world applications. This problem has attracted increasing attention, prompting efforts to detect and mitigate such inaccuracies. We review recent advances in identifying, evaluating, and mitigating these hallucinations, offering a detailed overview of the underlying causes, evaluation benchmarks, metrics, and strategies developed to address this issue. Additionally, we analyze the current challenges and limitations, formulating open questions that delineate potential pathways for future research. By drawing the granular classification and landscapes of hallucination causes, evaluation benchmarks, and mitigation methods, this survey aims to deepen the understanding of hallucinations in MLLMs and inspire further advancements in the field. Through our thorough and in-depth review, we contribute to the ongoing dialogue on enhancing the robustness and reliability of MLLMs, providing valuable insights and resources for researchers and practitioners alike. Resources are available at: https://github.com/showlab/Awesome-MLLM-Hallucination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent investigations have increasingly drawn attention to the phenomenon of 'hallucinated references,' wherein LLMs such as ChatGPT generate citations that appear syntactically correct and contextually appropriate, yet do not correspond to any real or retrievable publication.”
From Fabricated or accurate? Ethical concerns and citation hallucination in aI-generated scientific writing on musculoskeletal topics (2025) · cites this paper as [10]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 4×
“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”
InfluentialLoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453 · cited 2×
“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953 · cited 1×
“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”
Self-citationProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 1×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
(2019) · AI & Quantum Computing for Finance & Insurance · doi:10.1142/9789811203909_0022 · Cited by 9,775 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436 · cited 1×
“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 1×
“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107 · cited 1×
“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · cited 1×
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 1×
“Existing methods for hallucination mitigation are primarily based on empirical observations of specific patterns, such as skipping the ‘\n’ token and penalizing over-trust tokens.”
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Fast R-CNNPreprint
Girshick, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 2,781 · cited 1×
“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604 · cited 3×
“Prominent examples include GPT-3 [8], PaLM [18], LLaMA [99], and GPT-4 The characteristics and behaviors of LLMs are intricately linked to their training processes.”
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · cited 1×
“Prominent examples include GPT-3 [8], PaLM [18], LLaMA [99], and GPT-4 The characteristics and behaviors of LLMs are intricately linked to their training processes.”
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1×
“The hallucinatory examples are generated using leading MLLMs and image generation models, such as LLaVA [75], MiniGPT-4 [138], DALL-E2 [89], and DALL-E3 [6].”
Large language models are zero-shot reasoners
Kojima, T., Gu, S. (., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1613 · Cited by 2,013 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
Jia, C., Yang, Y., Xia, Y., Chen, Y.-T., Parekh, Z., Pham, H., Le, Q. V., Sung, Y., Li, Z., & Duerig, T. (2021) · arXiv · doi:10.48550/arxiv.2102.05918 · Cited by 1,977 · cited 1×
“Among them, vision+LLM is particularly prominent, owing to the extensive research on vision-language models (VLMs) [51, 88, 116] prior to LLMs.”
Semantic Understanding of Scenes Through the ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1140-0 · Cited by 1,831
Self-citationGQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering
Hudson, D. A., & Manning, C. D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00686 · Cited by 1,797 · cited 2×
“Currently, image-text pair datasets [92] and visual QA [48, 80] data are used for training MLLMs.”
Improved Baselines with Visual Instruction Tuning
Liu, H., Li, C., Li, Y., & Lee, Y. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02484 · Cited by 1,748 · cited 4×
“5 [74] adds human annotated QA data into instruction following and shows improved results, revealing the effect of noisy data.”
InfluentialRANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434 · cited 1×
“RLHF typically employs a preference model [7], trained to predict preference rankings based on prompts and human-labeled responses.”
CoCa: Contrastive Captioners are Image-Text Foundation ModelsPreprint
Yu, J., Wang, Z., Vasudevan, V., Yeung, L., Seyedhosseini, M., & Wu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.01917 · Cited by 1,413 · cited 1×
“Among them, vision+LLM is particularly prominent, owing to the extensive research on vision-language models (VLMs) [51, 88, 116] prior to LLMs.”
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction TuningPreprint
Dai, W., Li, J., Li, D., Tiong, A. M. H., Zhao, J., Wang, W., Li, B., Fung, P., & Hoi, S. C. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.06500 · Cited by 1,372 · cited 5×
“Learnable query-based methods, exemplified by Q-Former [66], as used in MiniGPT-4 [138] and Instruct-BLIP [22], utilize a set of learnable query tokens to capture visual signals via cross-attention.”
InfluentialmPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityPreprint
Ye, Q.-H., Xu, H., Xu, G., Ye, J., Yan, M., Zhou, Y., Wang, J., Hu, A., Shi, P.-C., Shi, Y., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2304.14178 · Cited by 1,318 · cited 2×
“MLLMs [22, 75, 111, 138] typically refers to a series of models that enable LLMs to perceive and comprehend data from various modalities.”
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
Wang, P., Bai, S., Tan, S., Wang, S., Fan, Z., Bai, J., Chen, K., Liu, X., Wang, J., Ge, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12191 · Cited by 1,302
Self-citationInstruction Tuning for Large Language Models: A Survey
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., Li, J., Hu, R., Zhang, T., Wang, G., et al. (2025) · ACM Computing Surveys · doi:10.1145/3777411 · Cited by 1,271 · cited 1×
“To address this disparity, the concept of Supervised Fine-Tuning (SFT) [125] has been introduced.”
Shikra: Unleashing Multimodal LLM's Referential Dialogue MagicPreprint
Chen, K., Zhang, Z., Zeng, W., Zhang, R., Zhu, F., & Zhao, R. (2023) · arXiv.org · doi:10.48550/arxiv.2306.15195 · Cited by 1,091 · cited 1×
“Projection layer-based methods, as widely applied in LLaVA [75], Shikra [12], etc., involve training a linear projection layer or a Multi-Layer Perceptron (MLP) module to transform extracted visual features.”
Self-citationGLM: General Language Model Pretraining with Autoregressive Blank Infilling
Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., & Tang, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.26 · Cited by 1,068
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058 · cited 1×
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
Chen, X.-K., Wu, Z.-Y., Liu, X.-C., Pan, Z.-Z., Liu, W., Xie, Z.-D., Yu, X.-K., & Ruan, C. (2025) · arXiv.org · doi:10.48550/arxiv.2501.17811 · Cited by 942 · cited 1×
“This integration of human feedback into the training loop has demonstrated effectiveness in enhancing the alignment of LLMs.”
When and why vision-language models behave like bags-of-words, and what to do about it?Preprint
Yuksekgonul, M., Bianchi, F., Kalluri, P., Jurafsky, D., & Zou, J. Y. (2022) · International Conference on Learning Representations · doi:10.48550/arxiv.2210.01936 · Cited by 808 · cited 1×
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
Contrastive Decoding: Open-ended Text Generation as OptimizationPreprint
Li, X. L., Holtzman, A., Fried, D., Liang, P., Eisner, J., Hashimoto, T. B., Zettlemoyer, L., & Lewis, M. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2210.15097 · Cited by 806 · cited 1×
“The lack of standardized benchmarks and evaluation metrics poses significant challenges in assessing the degree of hallucination in MLLMs.”
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
Wu, Z.-Y., Chen, X.-K., Pan, Z.-Z., Liu, X.-C., Liu, W., Dai, D.-M., Gao, H.-Z., Ma, Y.-Y., Wu, C., Wang, B.-L., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2412.10302 · Cited by 735
Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Chen, Z., Wu, J., Wang, W., Su, W., Chen, G., Xing, S., Zhong, M., Zhang, Q., Zhu, X., Lu, L., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02283 · Cited by 734 · cited 2×
“Unlearning refers to a technique designed to induce a model to ’forget’ specific behaviors or data, primarily through the application of gradient ascent methods [9].”
Objects365: A Large-Scale, High-Quality Dataset for Object Detection
Shao, S., Li, Z., Zhang, T., Peng, C., Yu, G., Zhang, X., Li, J., & Sun, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00852 · Cited by 673
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelPreprint
Gao, P., Han, J., Zhang, R., Lin, Z., Geng, S., Zhou, A., Zhang, W., Lu, P., He, C., Yue, X., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.15010 · Cited by 656
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 1×
“Unlearning refers to a technique designed to induce a model to ’forget’ specific behaviors or data, primarily through the application of gradient ascent methods [9].”
Otter: A Multi-Modal Model With In-Context Instruction Tuning
Li, B., Zhang, Y., Chen, L., Wang, J., Pu, F., Cahyono, J. A., Yang, J., Li, C., & Liu, Z. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3571946 · Cited by 571
Learning to summarize from human feedback
Stiennon, N., Ouyang, L., Wu, J., Ziegler, D. M., Lowe, R., Voss, C., Radford, A., Amodei, D., & Christiano, P. (2020) · arXiv · doi:10.48550/arxiv.2009.01325 · Cited by 550 · cited 1×
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Agrawal, A., Summers-Stay, D., Batra, D., & Parikh, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1116-0 · Cited by 487
MMBench: Is Your Multi-modal Model an All-around Player?
Liu, Y., Duan, H., Zhang, Y., Li, B., Zhang, S., Zhao, W., Yuan, Y., Wang, J., He, C., Liu, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.06281 · Cited by 487
Aligning Large Multimodal Models with Factually Augmented RLHFPreprint
Sun, Z., Shen, S., Cao, S., Liu, H., Li, C., Shen, Y., Gan, C., Gui, L.-Y., Wang, Y.-X., Yang, Y., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.14525 · Cited by 477 · cited 5×
“Insufficient data could potentially lead to problematic cross-modal alignment, resulting in hallucinations [96, 103].”
InfluentialTransfusion: Predict the Next Token and Diffuse Images with One Multi-Modal ModelPreprint
Zhou, C., Yu, L., Babu, A., Tirumala, K., Yasunaga, M., Shamis, L., Kahn, J., Ma, X., Zettlemoyer, L., & Levy, O. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.11039 · Cited by 467 · cited 1×
“This integration of human feedback into the training loop has demonstrated effectiveness in enhancing the alignment of LLMs.”
Reasoning with Language Model Prompting: A SurveyPreprint
Qiao, S.-F., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S.-M., Tan, C.-Q., Huang, F., & Chen, H.-J. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.09597 · Cited by 456 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
mPLUG-OwI2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration
Ye, Q., Xu, H., Ye, J., Yan, M., Hu, A., Liu, H., Qian, Q., Zhang, J., & Huang, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01239 · Cited by 431
Object Hallucination in Image Captioning
Rohrbach, A., Hendricks, L. A., Burns, K., Darrell, T., & Saenko, K. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1437 · Cited by 420 · cited 8×
“CHAIR [90] .”
InfluentialBenchmarking Large Language Models for News Summarization
Zhang, T., Ladhak, F., Durmus, E., Liang, P., McKeown, K., & Hashimoto, T. B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00632 · Cited by 415 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
GPT4RoI: Instruction Tuning Large Language Model on Region-of-InterestPreprint
Zhang, S., Sun, P., Chen, S., Xiao, M., Shao, W., Zhang, W., Liu, Y., Chen, K., & Luo, P. (2023) · ECCV Workshops · doi:10.48550/arxiv.2307.03601 · Cited by 390 · cited 1×
“This property results in incomplete cross-modal alignment and deprives the model of grounding ability [62, 126].”
PandaGPT: One Model To Instruction-Follow Them AllPreprint
Su, Y., Lan, T., Li, H., Xu, J., Wang, Y., & Cai, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.16355 · Cited by 379
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
Huang, Y., Bai, Y., Zhu, Z., Zhang, J., Zhang, J., Su, T., Liu, J., Lv, C., Zhang, Y., Lei, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.08322 · Cited by 373 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Multimodal Large Language Models: A Survey
Wu, J., Gan, W., Chen, Z., Wan, S., & Yu, P. S. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386743 · Cited by 369
AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination EvaluationPreprint
Wang, J., Wang, Y., Xu, G., Zhang, J., Gu, Y., Jia, H., Wang, J., Xu, H., Yan, M., Zhang, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.07397 · Cited by 362 · cited 4×
“Empirically, object hallucination can be categorized into three types: object category , object attribute , and object relation .”
InfluentialAnalyzing and Mitigating Object Hallucination in Large Vision-Language ModelsPreprint
Zhou, Y., Cui, C., Yoon, J., Zhang, L., Deng, Z., Finn, C., Bansal, M., & Yao, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.00754 · Cited by 308 · cited 7×
“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”
InfluentialMeasuring Massive Multitask Language Understanding
Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., & Steinhardt, J. (2020) · arXiv · doi:10.48550/arxiv.2009.03300 · Cited by 291 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
OCR-VQA: Visual Question Answering by Reading Text in Images
Mishra, A., Shekhar, S., Singh, A. K., & Chakraborty, A. (2019) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2019.00156 · Cited by 281 · cited 2×
“Currently, image-text pair datasets [92] and visual QA [48, 80] data are used for training MLLMs.”
Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding
Wang, X., Pan, J., Ding, L., & Biemann, C. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2403.18715 · Cited by 279 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
LIMA: Less Is More for Alignment
Zhou, C., Liu, P., Xu, P., Iyer, S., Sun, J., Mao, Y., Ma, X., Efrat, A., Yu, P., Yu, L., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2400 · Cited by 275 · cited 1×
“Pre-training serves as a fundamental phase in the learning process of LLMs [134].”
Lin, Z., Liu, C., Zhang, R., Gao, P., Qiu, L., Han, X., Qiu, H., Lin, C., Shao, W., Chen, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.07575 · Cited by 275
Huang, Q., Dong, X., Zhang, P., Wang, B., He, C., Wang, J., Lin, D., Zhang, W., & Yu, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01274 · Cited by 270 · cited 4×
“Among the various methods, Reinforcement Learning from Human Feedback”
InfluentialAn Analysis of Visual Question Answering Algorithms
Kafle, K., & Kanan, C. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.217 · Cited by 268
Yu, T., Yao, Y., Zhang, H., He, T., Han, Y., Cui, G., Hu, J., Liu, Z., Zheng, H.-T., & Sun, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01310 · Cited by 267 · cited 2×
“Similarly, RLHF-V [119] also employs the RLHF paradigm to enhance the pre-trained MLLM. Specifically, this work emphasizes two improvements: 1) at the data level, it proposes to collect human feedback in the form of fine-grained segment-level corrections, providing a clear, dense, and fine-grained…”
Self-citationBeyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
Zhao, Z.-Y., Wang, B., Ouyang, L.-K., Dong, X.-W., Wang, J., & He, C.-H. (2023) · arXiv.org · doi:10.48550/arxiv.2311.16839 · Cited by 263 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
Liu, S., Zheng, K.-C., & Chen, W. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2407.21771 · Cited by 247 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions
Hu, W., Xu, Y., Li, Y., Li, W., Chen, Z., & Tu, Z. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2308.09936 · Cited by 233
Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Leng, S., Zhang, H., Chen, G., Li, X., Lu, S., Miao, C., & Bing, L. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01316 · Cited by 199 · cited 2×
“When trained with such detailed data, in an attempt to fit the detail level and length distribution of ground truth captions, the model may risk expressing details that it cannot discern from the image, and therefore exhibit hallucinations.”
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
Bai, J., Bai, S., Yang, S., Wang, S., Tan, S., Wang, P., Lin, J., Zhou, C., & Zhou, J. (2023) · arXiv · doi:10.48550/arxiv.2308.12966 · Cited by 193 · cited 2×
“Qwen-VL [2] has shown the effectiveness of gradually enlarging image resolution from 224 × 224 to 448 × 448.”
Self-citationEyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
Tong, S., Liu, Z., Zhai, Y., Ma, Y., LeCun, Y., & Xie, S. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00914 · Cited by 189
ImageBind-LLM: Multi-modality Instruction TuningPreprint
Han, J., Zhang, R., Shao, W., Gao, P., Xu, P., Xiao, H., Zhang, K., Liu, C., Wen, S., Guo, Z., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.03905 · Cited by 189
Aligning Modalities in Vision Large Language Models via Preference Fine-tuningPreprint
Zhou, Y., Cui, C., Rafailov, R., Finn, C., & Yao, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.11411 · Cited by 186 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Evaluation and Analysis of Hallucination in Large Vision-Language ModelsPreprint
Wang, J., Zhou, Y., Xu, G., Shi, P., Zhao, C., Xu, H., Ye, Q., Yan, M., Zhang, J., Zhu, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.15126 · Cited by 186 · cited 3×
“During generation, as the sequence length grows, the self-attention will focus more on the previously generated text tokens, i.e., the attention on the visual content is diluted [45, 102–104].”
Peng, B., Li, C., He, P., Galley, M., & Gao, J. (2023) · arXiv · doi:10.48550/arxiv.2304.03277 · Cited by 183
(2023) · doi:10.48550/arxiv.2310.14566 · Cited by 166 · cited 1×
“…the CHAIR [90] metric in generative tasks and F1 in discriminative tasks to form the AMBER Score as follows: RAH-Bench [16] Relation-Associated Hallucination Benchmark (RAH-Bench) can be regarded as an upgraded version of POPE, containing 3,000 yes-or-no questions with their corresponding images.”
Penedo, G., Malartic, Q., Hesslow, D., Cojocaru, R., Cappelli, A., Alobeidli, H., Pannier, B., Almazrouei, E., & Launay, J. (2023) · arXiv · doi:10.48550/arxiv.2306.01116 · Cited by 164 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
Bai, Z.-C., He, T., Mei, H.-Y., Wang, P., Gao, Z., Chen, J., Liu, L., Zhang, Z., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2409.19603 · Cited by 158 · cited 1×
“InsufficientData e.g. AMBER[103],LLaVA-RLHF[96] DataQuality NoisyData e.g. HalluciDoctor[117],LLaVA-1.”
Self-citationMitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
Liu, F., Lin, K., Li, L., Wang, J., Yacoob, Y., & Wang, L. (2023) · arXiv · doi:10.48550/arxiv.2306.14565 · Cited by 149 · cited 4×
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
InfluentialHALC: Object Hallucination Reduction via Adaptive Focal-Contrast DecodingPreprint
Chen, Z., Zhao, Z., Luo, H., Yao, H., Li, B., & Zhou, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.00425 · Cited by 133 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Multi-Modal Hallucination Control by Visual Information Grounding
Favero, A., Zancato, L., Trager, M., Choudhary, S., Perera, P., Achille, A., Swaminathan, A. D., & Soatto, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01356 · Cited by 132 · cited 4×
“Among the various methods, Reinforcement Learning from Human Feedback”
InfluentialHolistic Analysis of Hallucination in GPT-4V(ision): Bias and Interference ChallengesPreprint
Cui, C., Zhou, Y., Yang, X., Wu, S., Zhang, L., Zou, J., & Yao, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.03287 · Cited by 129 · cited 1×
“Bingo [21] Bingo (Bias and Interference Challenges in Visual Language Models) is a benchmark specifically designed for assessing and analyzing the limitations of current popular MLLMs, such as GPT-4V [83].”
Silkie: Preference Distillation for Large Visual Language ModelsPreprint
Li, L., Xie, Z., Li, M., Chen, S., Wang, P., Chen, L., Yang, Y., Wang, B., & Kong, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.10665 · Cited by 125 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Self-citationMMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
Zhao, H., Cai, Z., Si, S., Ma, X., An, K., Chen, L., Liu, Z., Wang, S., Han, W., & Chang, B. (2023) · arXiv · doi:10.48550/arxiv.2309.07915 · Cited by 120
Transfer Visual Prompt Generator across LLMs
Zhang, A., Fei, H., Yao, Y., Ji, W., Li, L., Liu, Z.-Y., & Chua, T.-S. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.01278 · Cited by 120
MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
Wang, C.-X., Chen, X., Zhang, N.-Y., Tian, B., Xu, H., Deng, S.-M., & Chen, H.-J. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.11779 · Cited by 118 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
@ CREPE: Can Vision-Language Foundation Models Reason Compositionally?
Ma, Z., Hong, J., Gul, M. O., Gandhi, M., Gao, I., & Krishna, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01050 · Cited by 111 · cited 1×
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
VIGC: Visual Instruction Generation and Correction
Wang, B., Wu, F., Han, X., Peng, J., Zhong, H.-P., Zhang, P., Dong, X.-W., Li, W.-J., Li, W., Wang, J., et al. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2308.12714 · Cited by 108 · cited 1×
“During generation, as the sequence length grows, the self-attention will focus more on the previously generated text tokens, i.e., the attention on the visual content is diluted [45, 102–104].”
Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedback
Xiao, W., Huang, Z., Gan, L., He, W., Li, H., Yu, Z., Jiang, H., Wu, F., & Zhu, L. (2024) · arXiv.org · doi:10.48550/arxiv.2404.14233 · Cited by 105 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?Preprint
Zeng, Y., Zhang, H.-B., Zheng, J.-N., Xia, J.-N., Wei, G.-Q., Wei, Y., Zhang, Y.-C., Kong, T., & Song, R.-H. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2307.02469 · Cited by 97
IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decoding
Zhu, L., Ji, D., Chen, T., Xu, P., Ye, J., & Liu, J. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00150 · Cited by 96 · cited 1×
“Following the same idea of contrastive decoding, IBD [139] proposes an image-biased decoding strategy.”
Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key
Yang, Z.-H., Luo, X., Han, D.-Q., Xu, Y.-J., & Li, D.-S. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00992 · Cited by 93 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Wang, L., He, J., Li, S.-S., Liu, N., & Lim, E.-P. (2023) · Conference on Multimedia Modeling · doi:10.48550/arxiv.2312.01701 · Cited by 91 · cited 4×
“Interestingly, when organizing the data, a set of edited images is intentionally added.”
InfluentialXie, Y., Li, G., Xu, X., & Kan, M.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.findings-emnlp.775 · Cited by 89 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Mitigating Object Hallucination via Concentric Causal Attention
Xing, Y., Li, Y.-H., Laptev, I., & Lu, S.-J. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2410.15926 · Cited by 82 · cited 1×
“The reliance of MLLMs on large volumes of data presents significant challenges in terms of data quality, diversity, and bias.”
An, W., Tian, F., Leng, S., Nie, J., Lin, H., Wang, Q., Chen, P., Zhang, X., & Lu, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02784 · Cited by 77 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Li, Z.-W., Shi, H.-Z., Gao, Y.-H., Liu, D., Wang, Z.-T., Chen, Y.-X., Liu, T., Zhao, L., Wang, H., & Metaxas, D. N. (2025) · International Conference on Machine Learning · doi:10.48550/arxiv.2502.03628 · Cited by 77 · cited 1×
“In this section, we delve into the challenges and future directions of this pivotal domain.”
Show, Recall, and Tell: Image Captioning with Recall Mechanism
Wang, L., Bai, Z., Zhang, Y., & Lu, H. (2020) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2001.05876 · Cited by 74 · cited 2×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationMultiModal-GPT: a vision and language model for dialogue with humans
Gong, T., Lyu, C., Zhang, S., Wang, Y., Zheng, M., Zhao, Q., Liu, K., Zhang, W., Luo, P., & Chen, K. (2023) · arXiv · doi:10.48550/arxiv.2305.04790 · Cited by 70
Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded GuidancePreprint
Zhao, L., Deng, Y., Zhang, W., & Gu, Q. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.08680 · Cited by 69 · cited 1×
“MARINE [131] proposes a training-free approach.”
Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative InstructionsPreprint
Li, J., Pan, K., Ge, Z., Gao, M., Ji, W., Zhang, W., Chua, T., Tang, S., Zhang, H., & Zhuang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.04152 · Cited by 68
DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucination
Gong, X., Ming, T., Wang, X.-P., & Wei, Z.-H. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2410.04514 · Cited by 68 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
CIEM: Contrastive Instruction Evaluation Method for Better Instruction TuningPreprint
Hu, H., Zhang, J., Zhao, M., & Sun, Z. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.02301 · Cited by 62 · cited 1×
“CIEM [42] CIEM is a benchmark to evaluate hallucination of MLLMs. Unlike previous works utilize human annotated objects, CIEM is generated using an automatic pipeline.”
CLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMs
Ouali, Y., Bulat, A., Martínez, B., & Tzimiropoulos, G. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2408.10433 · Cited by 61 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Chen, B., Lyu, X., Gao, L.-L., Song, J.-K., & Shen, H. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.15356 · Cited by 61 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data
Yu, Q., Li, J., Wei, L., Pang, L., Ye, W., Qin, B., Tang, S., Tian, Q., & Zhuang, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01230 · Cited by 59 · cited 6×
“For mitigating hallucination, recent works make attempts on data, including introducing negative data [73], introducing counterfactual data [117], and reducing noise and errors in existing dataset [105, 120].”
InfluentialSeeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMsPreprint
Zhang, X., Quan, Y., Gu, C., Shen, C., Yuan, X., Yan, S., Cheng, H., Wu, K., & Ye, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.09968 · Cited by 59 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Mitigating Hallucination in Visual Language Models with Visual SupervisionPreprint
Chen, Z., Zhu, Y., Zhan, Y., Li, Z., Zhao, C., Wang, J., & Tang, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.16479 · Cited by 59
CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models
Kim, J., Kim, H., Kim, Y., & Yong, M.-R. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2406.01920 · Cited by 56 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
VCoder: Versatile Vision Encoders for Multimodal Large Language Models
Jain, J., Yang, J., & Shi, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02644 · Cited by 53
Interpreting and Editing Vision-Language Representations to Mitigate HallucinationsPreprint
Jiang, N., Kachinthaya, A., Petryk, S., & Gandelsman, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.02762 · Cited by 52 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Mitigating Object Hallucination in MLLMs via Data-augmented Phrase-level AlignmentPreprint
Sarkar, P., Ebrahimi, S., Etemad, A., Beirami, A., Arık, S. Ö., & Pfister, T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.18654 · Cited by 51 · cited 1×
“In this section, we delve into the challenges and future directions of this pivotal domain.”
Zhong, W., Feng, X.-C., Zhao, L., Li, Q.-M., Huang, L., Gu, Y., Ma, W.-T., Xu, Y., & Qin, B. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2407.00569 · Cited by 50 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward ModelingPreprint
Yan, S.-M., Bai, M., Chen, W., Zhou, X., Huang, Q.-X., & Li, E.-R. L. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2402.06118 · Cited by 45 · cited 1×
“Another similar work, ViGoR [110], also designs a fine-grained reward model to update pre-trained MLLMs, aiming to improve visual grounding and reduce hallucination.”
LLaVA-OneVision: Easy Visual Task Transfer
Li, B., Zhang, Y., Guo, D., Zhang, R., Li, F., Zhang, H., Zhang, K., Zhang, P., Li, Y., Liu, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.03326 · Cited by 44
Language Modeling Is Compression
Delétang, G., Ruoss, A., Duquenne, P.-A., Catt, E., Genewein, T., Mattern, C., Grau-Moya, J., Wenliang, L. K., Aitchison, M., Orseau, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.10668 · Cited by 39 · cited 1×
“Neural networks, especially large language models, possess an intrinsic tendency to memorize training data, as noted in [23].”
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence
He, J.-H., Zhu, K., Guo, H.-Y., Fang, J.-F., Hua, Z.-L., Jia, Y.-H., Tang, M., Chua, T.-S., & Wang, J.-Q. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2412.13949 · Cited by 38 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning
Wu, S.-Q., Fei, H., Pan, L., Wang, W., Yan, S.-C., & Chua, T.-S. (2024) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2412.11124 · Cited by 35 · cited 1×
“We envision this survey empowering researchers and practitioners to dedicate efforts to advancing research and developing robust solutions in this vital area of study.”
Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual HallucinationPreprint
Zheng, H., Xu, T., Sun, H., Pu, S., Chen, R., & Sun, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.12591 · Cited by 34 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Reformulating Vision-Language Foundation Models and Datasets Towards Universal Multimodal Assistants
Yu, T., Hu, J., Yao, Y., Zhang, H.-Y., Zhao, Y., Wang, C., Wang, S., Pan, Y., Xue, J., Li, D., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2310.00653 · Cited by 33
FGAIF: Aligning Large Vision-Language Models with Fine-grained AI FeedbackPreprint
Jing, L., & Du, X. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.05046 · Cited by 32 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMsPreprint
Yan, A., Yang, Z.-Y., Wu, J.-D., Zhu, W., Yang, J., Li, L., Lin, K., Wang, J., McAuley, J. J., Gao, J.-F., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2404.16375 · Cited by 32 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Qu, X.-Y., Sun, J., Wei, W., Liu, D.-Z., Dong, J.-F., & Cheng, Y. (2024) · International Conference on Computational Linguistics · doi:10.48550/arxiv.2408.17150 · Cited by 30 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
LOVA3: Learning to Visual Question Answering, Asking and Assessment
Zhao, H. H., Zhou, P., Gao, D.-F., Bai, Z.-C., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.14974 · Cited by 30 · cited 1×
“InsufficientData e.g. AMBER[103],LLaVA-RLHF[96] DataQuality NoisyData e.g. HalluciDoctor[117],LLaVA-1.”
Self-citationDoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29 · cited 1×
“The lack of standardized benchmarks and evaluation metrics poses significant challenges in assessing the degree of hallucination in MLLMs.”
PerturboLLaVA: Reducing Multimodal Hallucinations with Perturbative Visual TrainingPreprint
Chen, C., Liu, M., Jing, C., Zhou, Y., Rao, F., Chen, H., Zhang, B., & Shen, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.06486 · Cited by 29 · cited 2×
“For mitigating hallucination, recent works make attempts on data, including introducing negative data [73], introducing counterfactual data [117], and reducing noise and errors in existing dataset [105, 120].”
Fu, Y.-H., Xie, R.-B., Sun, X.-W., Kang, Z.-H., & Li, X.-R. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2411.10436 · Cited by 29 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Zhang, C., Wan, Z., Kan, Z., Ma, M. Q., Stepputtis, S., Ramanan, D., Salakhutdinov, R. R., Morency, L., Sycara, K. P., & Xie, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.06130 · Cited by 28 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Cross-Modal Attention Calibration for LVLM Hallucination MitigationPreprint
Li, J., Zhang, J., Jie, Z., Ma, L., & Li, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.01926 · Cited by 28 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation
Ge, Y., Zeng, X., Huffman, J. S., Lin, T., Liu, M.-Y., & Cui, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01331 · Cited by 27 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding
Min, K., Kim, M., Lee, K.-I., Lee, D., & Jung, K. (2024) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2410.13321 · Cited by 27 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Chu, Z., Chen, J., Chen, Q., Yu, W., He, T., Wang, H., Peng, W., Liu, M., Qin, B., & Liu, T. (2023) · arXiv · doi:10.48550/arxiv.2309.15402 · Cited by 25 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Self-citationXing, S., Zhao, F., Wu, Z., An, T., Chen, W., Li, C., Zhang, J., & Dai, X.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2402.09801 · Cited by 23 · cited 2×
“To the best of our knowledge, EFUF [109] is the first and only work that applies the unlearning framework to the task of hallucination mitigation, opening up a new path for future research.”
The Instinctive Bias: Spurious Images lead to Hallucination in MLLMsPreprint
Han, T., Lian, Q., Pan, R., Pi, R.-J., Zhang, J., Diao, S., Lin, Y., & Zhang, T. (2024) · arXiv.org · doi:10.48550/arxiv.2402.03757 · Cited by 22 · cited 1×
“This effort further completes the definition of hallucination types.”
Enhancing Multimodal Large Language Models with Vision Detection Models: An Empirical Study
Jiao, Q.-R., Chen, D.-Y., Huang, Y., Li, Y.-L., & Shen, Y. (2024) · arXiv.org · doi:10.48550/arxiv.2401.17981 · Cited by 21 · cited 1×
“Another work [54] ensembles additional object detection and optical-character recognition into the MLLM architecture.”
RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in LVLMs
Woo, S., Jang, J., Kim, D., Choi, Y., & Kim, C. (2024) · arXiv.org · doi:10.48550/arxiv.2405.17821 · Cited by 21 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Octopus: Alleviating Hallucination via Dynamic Contrastive Decoding
Suo, W., Zhang, L., Sun, M., Wu, L. Y., Wang, P., & Zhang, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02783 · Cited by 20 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Self-citationInterpreting and Mitigating Hallucination in MLLMs through Multi-agent DebatePreprint
Lin, Z., Niu, Z.-X., Wang, Z., & Xu, Y. (2024) · arXiv.org · doi:10.48550/arxiv.2407.20505 · Cited by 19 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Alleviating Hallucination in Large Vision-Language Models with Active Retrieval Augmentation
Qu, X., Chen, Q., Wei, W., Sun, J., Liu, D., & Dong, J. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3742434 · Cited by 18 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Wang, J., Gao, Y., & Sang, J. (2024) · arXiv.org · doi:10.48550/arxiv.2411.15839 · Cited by 18 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Unsupervised Open-Vocabulary Object Localization in Videos
Fan, K., Bai, Z.-C., Xiao, T., Zietlow, D., Horn, M., Zhao, Z., Simon-Gabriel, C.-J., Shou, M., Locatello, F., Schiele, B., et al. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01264 · Cited by 16 · cited 1×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationChe, L.-W., Liu, T., Jia, J.-H., Qin, W., Tang, R.-X., & Pavlovic, V. (2025) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51701.2025.02009 · Cited by 15 · cited 1×
“The issue of ’losing attention’ would also lead to the model’s output response being irrelevant to the visual content.”
Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs
Zhang, K., Tao, K.-D., Tang, J.-S., & Wang, H. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2501.19164 · Cited by 14 · cited 1×
“It’s only when the dreams enter deemed factually incorrect territory that we label them as ’hallucinations’.”
Yuan, F., Qin, C., Xu, X.-G., & Li, P.-J. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2409.20429 · Cited by 13 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
EAGLE: Enhanced Visual Grounding Minimizes Hallucinations in Instructional Multimodal ModelsPreprint
Villa, A., Alcázar, J. L., Alfarra, M., Araujo, V., Soto, Á., & Ghanem, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.02699 · Cited by 13
Chen, B., Lyu, X., Gao, L., Song, J., & Shen, H. T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08216 · Cited by 11 · cited 1×
“The issue of ’losing attention’ would also lead to the model’s output response being irrelevant to the visual content.”
LM-Switch: Lightweight Language Model Conditioning in Word Embedding Space
Han, C., Xu, J., Li, M.-L., Fung, Y. R., Sun, C., Jiang, N.-J., Abdelzaher, T. F., & Ji, H. (2023) · arXiv.org · doi:10.48550/arxiv.2305.12798 · Cited by 10 · cited 1×
“The detailed implementation is inspired by LM-switch [33], which involves adding a control parameter 𝜖 serving as a "switching value".”
Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection
Yang, L., Zheng, Z., Chen, B., Zhao, Z., Lin, C., & Shen, C. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01364 · Cited by 9 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Zhuang, X.-W., Zhu, Z.-H., Xie, Y., Liang, L., & Zou, Y. (2025) · arXiv.org · doi:10.48550/arxiv.2501.06553 · Cited by 9 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Bridging Information Asymmetry in Text-video Retrieval: A Data-centric ApproachPreprint
Bai, Z., Xiao, T., He, T., Wang, P., Zhang, Z., Brox, T., & Shou, M. Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.07249 · Cited by 8 · cited 1×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationFilterRAG: Zero-Shot Informed Retrieval-Augmented Generation to Mitigate Hallucinations in VQAPreprint
Sarwar, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.18536 · Cited by 8 · cited 1×
“Among the various methods, Reinforcement Learning from Human Feedback”
InfMLLM: A Unified Framework for Visual-Language TasksPreprint
Zhou, Q., Wang, Z., Chu, W., Xu, Y., Li, H., & Qi, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.06791 · Cited by 6
Behind the Magic, MERLIM: Multi-Modal Evaluation Benchmark for Large Image-Language Models
Villa, A., Alcázar, J. L., Soto, Á., & Ghanem, B. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00054 · Cited by 5 · cited 1×
“MERLIM [100] MERLIM ( M ulti-modal E valuation benchma R k for L arge I mage-language M odels) is a test-bed aimed at empirically evaluating MLLMs on core computer vision tasks, including object recognition, instance counting, and identifying object-to-object relationships.”
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective
Yue, Z., Zhang, L., & Jin, Q. (2024) · Volume 1 · doi:10.18653/v1/2024.acl-long.633 · Cited by 5 · cited 7×
“However, another work [120] hypothesizes that the text descriptions in the instruction tuning data contain too much details, exceeding the perception limit of MLLMs.”
InfluentialKnowledge Unlearning for Mitigating Privacy Risks in Language Models
Jang, J., Yoon, D., Yang, S., Cha, S., Lee, M., Logeswaran, L., & Seo, M. (2022) · arXiv · doi:10.48550/arxiv.2210.01504 · Cited by 4 · cited 1×
“Recently, unlearning for LLMs has been receiving increasing attention [50], effectively eliminating privacy vulnerabilities in LLMs.”
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Fu, C., Chen, P., Shen, Y., Qin, Y., Zhang, M., Lin, X., Yang, J., Zheng, X., Li, K., Sun, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.13394
Cited by
Sorted by citations
Show-o: One Single Transformer to Unify Multimodal Understanding and GenerationPreprint
Xie, J., Mao, W., Bai, Z., Zhang, D. J., Wang, W., Lin, K. Q., Gu, Y., Chen, Z., Yang, Z., & Shou, M. Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.12528 · Cited by 641
“2.1 M ULTIMODAL U NDERSTANDING Significant advancements in large language models (LLMs) (Touvron et al., 2023; Brown et al., 2020; Chowdhery et al., 2023) have inspired the development of multimodal large language models (MLLMs) (Li et al., 2024; Yin et al., 2023; Bai et al., 2024).”
BackgroundMethodInfluentialSelf-citationFoundation Models Defining a New Era in Vision: A Survey and Outlook
Awais, M., Naseer, M., Khan, S., Anwer, R. M., Cholakkal, H., Shah, M., Yang, M.-H., & Khan, F. S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3506283 · Cited by 304
“Curious readers may refer to [191] for a more comprehensive treatment of the subject.”
MMaDA: Multimodal Large Diffusion Language ModelsPreprint
Yang, L., Tian, Y., Li, B., Zhang, X., Shen, K., Tong, Y., & Wang, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.15809 · Cited by 244
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
Bai, Z.-C., He, T., Mei, H.-Y., Wang, P., Gao, Z., Chen, J., Liu, L., Zhang, Z., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2409.19603 · Cited by 158
“The remarkable advancements of large language models (LLMs) motivate the research community to extend the foundational capabilities of LLMs to the visual domain, leading to multimodal large language models (MLLMs) [67, 4].”
BackgroundSelf-citationLi, Z., Wu, X., Du, H., Liu, F., Nghiem, H. T., & Shi, G. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00147 · Cited by 91
“The alignment issue in multi-modal models arises from contextual deviation between modalities, leading to hallucinations [209].”
Metadata
- Authors
- Bai, Z., Wang, P., Xiao, T., He, T., Han, Z., Zhang, Z., & Shou, M. Z.
- ORCID
- Han, Zongbo
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2404.18930
- OpenAlex
- W6922346929
- Cited by
- 38
- References
- 194
- Citations by year
- 2026: 4 · 2025: 28 · 2024: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Research Foundation
- National Research Foundation Singapore
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Hallucinations in medical conditions
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- hallucinations, multimodal large language models, hallucination mitigation, hallucination detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
