Hallucination of Multimodal Large Language Models: A Survey
Open accessAbstract
This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and remarkable abilities in multimodal tasks. Despite these promising developments, MLLMs often generate outputs that are inconsistent with the visual content, a challenge known as hallucination, which poses substantial obstacles to their practical deployment and raises concerns regarding their reliability in real-world applications. This problem has attracted increasing attention, prompting efforts to detect and mitigate such inaccuracies. We review recent advances in identifying, evaluating, and mitigating these hallucinations, offering a detailed overview of the underlying causes, evaluation benchmarks, metrics, and strategies developed to address this issue. Additionally, we analyze the current challenges and limitations, formulating open questions that delineate potential pathways for future research. By drawing the granular classification and landscapes of hallucination causes, evaluation benchmarks, and mitigation methods, this survey aims to deepen the understanding of hallucinations in MLLMs and inspire further advancements in the field. Through our thorough and in-depth review, we contribute to the ongoing dialogue on enhancing the robustness and reliability of MLLMs, providing valuable insights and resources for researchers and practitioners alike. Resources are available at: https://github.com/showlab/Awesome-MLLM-Hallucination.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
LLMs such as ChatGPT generate citations that appear syntactically correct and contextually appropriate, yet do not correspond to any real or retrievable publication.
“Recent investigations have increasingly drawn attention to the phenomenon of 'hallucinated references,' wherein LLMs such as ChatGPT generate citations that appear syntactically correct and contextually appropriate, yet do not correspond to any real or retrievable publication.”
From Fabricated or accurate? Ethical concerns and citation hallucination in aI-generated scientific writing on musculoskeletal topics (2025) · cites this paper as [10]
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1× · see citing works
“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”
Fast R-CNNPreprint
Girshick, R. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 29,416 · cited 1× · see citing works
“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 4× · see citing works
“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”
InfluentialKirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953 · cited 1× · see citing works
“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”
Self-citationProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 1× · see citing works
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
(2019) · AI & Quantum Computing for Finance & Insurance · doi:10.1142/9789811203909_0022 · Cited by 9,775 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436 · cited 1× · see citing works
“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 1× · see citing works
“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107 · cited 1× · see citing works
“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction TuningPreprint
Dai, W., Li, J., Li, D., Tiong, A., Zhao, J.-Q., Wang, W., Li, B. A., Fung, P., & Hoi, S. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.06500 · Cited by 4,191 · cited 5× · see citing works
“Learnable query-based methods, exemplified by Q-Former [66], as used in MiniGPT-4 [138] and Instruct-BLIP [22], utilize a set of learnable query tokens to capture visual signals via cross-attention.”
InfluentialGQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering
Hudson, D. A., & Manning, C. D. (2019) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2019.00686 · Cited by 3,703 · cited 2× · see citing works
“Currently, image-text pair datasets [92] and visual QA [48, 80] data are used for training MLLMs.”
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · cited 1× · see citing works
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 1× · see citing works
“Existing methods for hallucination mitigation are primarily based on empirical observations of specific patterns, such as skipping the ‘\n’ token and penalizing over-trust tokens.”
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · cited 1× · see citing works
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604 · cited 3× · see citing works
“Prominent examples include GPT-3 [8], PaLM [18], LLaMA [99], and GPT-4 The characteristics and behaviors of LLMs are intricately linked to their training processes.”
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · cited 1× · see citing works
“Prominent examples include GPT-3 [8], PaLM [18], LLaMA [99], and GPT-4 The characteristics and behaviors of LLMs are intricately linked to their training processes.”
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579 · see citing works
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 2,523 · cited 2× · see citing works
“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1× · see citing works
“The hallucinatory examples are generated using leading MLLMs and image generation models, such as LLaVA [75], MiniGPT-4 [138], DALL-E2 [89], and DALL-E3 [6].”
Large language models are zero-shot reasoners
Kojima, T., Gu, S. (., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1613 · Cited by 2,013 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
Jia, C., Yang, Y., Xia, Y., Chen, Y.-T., Parekh, Z., Pham, H., Le, Q. V., Sung, Y., Li, Z., & Duerig, T. (2021) · arXiv · doi:10.48550/arxiv.2102.05918 · Cited by 1,977 · cited 1× · see citing works
“Among them, vision+LLM is particularly prominent, owing to the extensive research on vision-language models (VLMs) [51, 88, 116] prior to LLMs.”
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Fu, C., Chen, P., Shen, Y.-H., Qin, Y.-L., Zhang, M.-D., Lin, X., Yang, J., Zheng, X.-W., Li, K., Sun, X., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2306.13394 · Cited by 1,917
CoCa: Contrastive Captioners are Image-Text Foundation ModelsPreprint
Yu, J.-H., Wang, Z., Vasudevan, V., Yeung, L., Seyedhosseini, M., & Wu, Y.-H. (2022) · Trans. Mach. Learn. Res. · doi:10.48550/arxiv.2205.01917 · Cited by 1,899 · cited 1× · see citing works
“Among them, vision+LLM is particularly prominent, owing to the extensive research on vision-language models (VLMs) [51, 88, 116] prior to LLMs.”
Semantic Understanding of Scenes Through the ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1140-0 · Cited by 1,831 · see citing works
Self-citationImproved Baselines with Visual Instruction Tuning
Liu, H., Li, C., Li, Y., & Lee, Y. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02484 · Cited by 1,748 · cited 4× · see citing works
“5 [74] adds human annotated QA data into instruction following and shows improved results, revealing the effect of noisy data.”
InfluentialRANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434 · cited 1× · see citing works
“RLHF typically employs a preference model [7], trained to predict preference rankings based on prompts and human-labeled responses.”
mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityPreprint
Ye, Q.-H., Xu, H., Xu, G., Ye, J., Yan, M., Zhou, Y., Wang, J., Hu, A., Shi, P.-C., Shi, Y., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2304.14178 · Cited by 1,318 · cited 2× · see citing works
“MLLMs [22, 75, 111, 138] typically refers to a series of models that enable LLMs to perceive and comprehend data from various modalities.”
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
Wang, P., Bai, S., Tan, S., Wang, S., Fan, Z., Bai, J., Chen, K., Liu, X., Wang, J., Ge, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12191 · Cited by 1,302 · see citing works
Self-citationShikra: Unleashing Multimodal LLM's Referential Dialogue MagicPreprint
Chen, K., Zhang, Z., Zeng, W., Zhang, R., Zhu, F., & Zhao, R. (2023) · arXiv.org · doi:10.48550/arxiv.2306.15195 · Cited by 1,091 · cited 1× · see citing works
“Projection layer-based methods, as widely applied in LLaVA [75], Shikra [12], etc., involve training a linear projection layer or a Multi-Layer Perceptron (MLP) module to transform extracted visual features.”
Self-citationDeep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058 · cited 1× · see citing works
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
GLM: General Language Model Pretraining with Autoregressive Blank Infilling
Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., & Tang, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.26 · Cited by 1,028 · see citing works
Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
Chen, X.-K., Wu, Z.-Y., Liu, X.-C., Pan, Z.-Z., Liu, W., Xie, Z.-D., Yu, X.-K., & Ruan, C. (2025) · arXiv.org · doi:10.48550/arxiv.2501.17811 · Cited by 942 · cited 1×
“This integration of human feedback into the training loop has demonstrated effectiveness in enhancing the alignment of LLMs.”
Aligning Large Multimodal Models with Factually Augmented RLHFPreprint
Sun, Z., Shen, S., Cao, S.-C., Liu, H., Li, C., Shen, Y., Gan, C., Gui, L., Wang, Y.-X., Yang, Y., et al. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2309.14525 · Cited by 914 · cited 5× · see citing works
“Insufficient data could potentially lead to problematic cross-modal alignment, resulting in hallucinations [96, 103].”
InfluentialContrastive Decoding: Open-ended Text Generation as OptimizationPreprint
Li, X. L., Holtzman, A., Fried, D., Liang, P., Eisner, J., Hashimoto, T. B., Zettlemoyer, L., & Lewis, M. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2210.15097 · Cited by 805 · cited 1× · see citing works
“The lack of standardized benchmarks and evaluation metrics poses significant challenges in assessing the degree of hallucination in MLLMs.”
When and why vision-language models behave like bags-of-words, and what to do about it?
Yuksekgonul, M., Bianchi, F., Kalluri, P., Jurafsky, D., & Zou, J. Y. (2022) · International Conference on Learning Representations · doi:10.48550/arxiv.2210.01936 · Cited by 805 · cited 1×
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelPreprint
Gao, P., Han, J., Zhang, R., Lin, Z.-Y., Geng, S., Zhou, A., Zhang, W., Lu, P., He, C.-H., Yue, X., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2304.15010 · Cited by 777 · see citing works
mPLUG-OwI2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration
Ye, Q.-H., Xu, H., Ye, J., Yan, M.-S., Hu, A., Liu, H.-W., Qian, Q., Zhang, J., Huang, F., & Zhou, J.-R. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.01239 · Cited by 763 · see citing works
OCR-VQA: Visual Question Answering by Reading Text in Images
Mishra, A., Shekhar, S., Singh, A., & Chakraborty, A. (2019) · IEEE International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2019.00156 · Cited by 746 · cited 2× · see citing works
“Currently, image-text pair datasets [92] and visual QA [48, 80] data are used for training MLLMs.”
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
Wu, Z.-Y., Chen, X.-K., Pan, Z.-Z., Liu, X.-C., Liu, W., Dai, D.-M., Gao, H.-Z., Ma, Y.-Y., Wu, C., Wang, B.-L., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2412.10302 · Cited by 735
Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Chen, Z., Wu, J., Wang, W., Su, W., Chen, G., Xing, S., Zhong, M., Zhang, Q., Zhu, X., Lu, L., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02283 · Cited by 734 · cited 2× · see citing works
“Unlearning refers to a technique designed to induce a model to ’forget’ specific behaviors or data, primarily through the application of gradient ascent methods [9].”
Objects365: A Large-Scale, High-Quality Dataset for Object Detection
Shao, S., Li, Z., Zhang, T., Peng, C., Yu, G., Zhang, X., Li, J., & Sun, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00852 · Cited by 673 · see citing works
Instruction Tuning for Large Language Models: A Survey
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., Li, J., Hu, R., Zhang, T., Wang, G., et al. (2025) · ACM Computing Surveys · doi:10.1145/3777411 · Cited by 640 · cited 1× · see citing works
“To address this disparity, the concept of Supervised Fine-Tuning (SFT) [125] has been introduced.”
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 1× · see citing works
“Unlearning refers to a technique designed to induce a model to ’forget’ specific behaviors or data, primarily through the application of gradient ascent methods [9].”
Learning to summarize from human feedback
Stiennon, N., Ouyang, L., Wu, J., Ziegler, D. M., Lowe, R., Voss, C., Radford, A., Amodei, D., & Christiano, P. (2020) · arXiv · doi:10.48550/arxiv.2009.01325 · Cited by 550 · cited 1× · see citing works
“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Zhou, C., Yu, L., Babu, A., Tirumala, K., Yasunaga, M., Shamis, L., Kahn, J., Ma, X., Zettlemoyer, L. S., & Levy, O. (2024) · arXiv.org · doi:10.48550/arxiv.2408.11039 · Cited by 538 · cited 1×
“This integration of human feedback into the training loop has demonstrated effectiveness in enhancing the alignment of LLMs.”
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Agrawal, A., Summers-Stay, D., Batra, D., & Parikh, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1116-0 · Cited by 487 · see citing works
MMBench: Is Your Multi-modal Model an All-around Player?
Liu, Y., Duan, H., Zhang, Y., Li, B., Zhang, S., Zhao, W., Yuan, Y., Wang, J., He, C., Liu, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.06281 · Cited by 487 · see citing works
PandaGPT: One Model To Instruction-Follow Them AllPreprint
Su, Y., Lan, T., Li, H., Xu, J., Wang, Y., & Cai, D. (2023) · Tsinghua Interdisciplinary Workshop on Logic, Language and Meaning · doi:10.48550/arxiv.2305.16355 · Cited by 474 · see citing works
Reasoning with Language Model Prompting: A SurveyPreprint
Qiao, S.-F., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S.-M., Tan, C.-Q., Huang, F., & Chen, H.-J. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.09597 · Cited by 456 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Object Hallucination in Image Captioning
Rohrbach, A., Hendricks, L. A., Burns, K., Darrell, T., & Saenko, K. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1437 · Cited by 420 · cited 8× · see citing works
“CHAIR [90] .”
InfluentialBenchmarking Large Language Models for News Summarization
Zhang, T., Ladhak, F., Durmus, E., Liang, P., McKeown, K., & Hashimoto, T. B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00632 · Cited by 415 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Analyzing and Mitigating Object Hallucination in Large Vision-Language ModelsPreprint
Zhou, Y.-Y., Cui, C.-H., Yoon, J., Zhang, L.-J., Deng, Z., Finn, C., Bansal, M., & Yao, H. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.00754 · Cited by 399 · cited 7× · see citing works
“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”
InfluentialGPT4RoI: Instruction Tuning Large Language Model on Region-of-InterestPreprint
Zhang, S., Sun, P., Chen, S., Xiao, M., Shao, W., Zhang, W., Liu, Y., Chen, K., & Luo, P. (2023) · ECCV Workshops · doi:10.48550/arxiv.2307.03601 · Cited by 390 · cited 1× · see citing works
“This property results in incomplete cross-modal alignment and deprives the model of grounding ability [62, 126].”
An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination EvaluationPreprint
Wang, J.-Y., Wang, Y.-H., Xu, G., Zhang, J., Gu, Y., Jia, H.-T., Xu, H., Yan, M., Zhang, J., & Sang, J.-T. (2023) · arXiv.org · doi:10.48550/arxiv.2311.07397 · Cited by 356 · cited 4× · see citing works
“Empirically, object hallucination can be categorized into three types: object category , object attribute , and object relation .”
InfluentialLin, Z.-Y., Liu, C., Zhang, R., Gao, P., Qiu, L.-T., Xiao, H., Qiu, H., Lin, C., Shao, W., Chen, K.-Q., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2311.07575 · Cited by 316 · see citing works
Multimodal Large Language Models: A Survey
Wu, J., Gan, W., Chen, Z., Wan, S., & Yu, P. S. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386743 · Cited by 309 · see citing works
Multi-Modal Hallucination Control by Visual Information Grounding
Favero, A., Zancato, L., Trager, M., Choudhary, S., Perera, P., Achille, A., Swaminathan, A., & Soatto, S. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.01356 · Cited by 299 · cited 4× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
InfluentialMeasuring Massive Multitask Language Understanding
Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., & Steinhardt, J. (2020) · arXiv · doi:10.48550/arxiv.2009.03300 · Cited by 291 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding
Wang, X., Pan, J., Ding, L., & Biemann, C. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2403.18715 · Cited by 279 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
LIMA: Less Is More for Alignment
Zhou, C., Liu, P., Xu, P., Iyer, S., Sun, J., Mao, Y., Ma, X., Efrat, A., Yu, P., Yu, L., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2400 · Cited by 275 · cited 1× · see citing works
“Pre-training serves as a fundamental phase in the learning process of LLMs [134].”
An Analysis of Visual Question Answering Algorithms
Kafle, K., & Kanan, C. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.217 · Cited by 272 · see citing works
Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
Zhao, Z.-Y., Wang, B., Ouyang, L.-K., Dong, X.-W., Wang, J., & He, C.-H. (2023) · arXiv.org · doi:10.48550/arxiv.2311.16839 · Cited by 263 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Otter: A Multi-Modal Model With In-Context Instruction Tuning
Li, B., Zhang, Y., Chen, L., Wang, J., Pu, F., Cahyono, J. A., Yang, J., Li, C., & Liu, Z. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3571946 · Cited by 253 · see citing works
Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
Liu, S., Zheng, K.-C., & Chen, W. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2407.21771 · Cited by 247 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Aligning Modalities in Vision Large Language Models via Preference Fine-tuningPreprint
Zhou, Y.-Y., Cui, C.-H., Rafailov, R., Finn, C., & Yao, H. (2024) · arXiv.org · doi:10.48550/arxiv.2402.11411 · Cited by 235 · cited 1× · see citing works
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions
Hu, W., Xu, Y., Li, Y., Li, W., Chen, Z., & Tu, Z. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2308.09936 · Cited by 233
HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding
Chen, Z., Chen, Z., Zhao, Z., Luo, H., Yao, H.-X., Li, B., & Zhou, J.-W. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2403.00425 · Cited by 226 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Leng, S., Zhang, H., Chen, G., Li, X., Lu, S., Miao, C., & Bing, L. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01316 · Cited by 199 · cited 2× · see citing works
“When trained with such detailed data, in an attempt to fit the detail level and length distribution of ground truth captions, the model may risk expressing details that it cannot discern from the image, and therefore exhibit hallucinations.”
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
Bai, J., Bai, S., Yang, S., Wang, S., Tan, S., Wang, P., Lin, J., Zhou, C., & Zhou, J. (2023) · arXiv · doi:10.48550/arxiv.2308.12966 · Cited by 193 · cited 2× · see citing works
“Qwen-VL [2] has shown the effectiveness of gradually enlarging image resolution from 224 × 224 to 448 × 448.”
Self-citationEyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
Tong, S., Liu, Z., Zhai, Y., Ma, Y., LeCun, Y., & Xie, S. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00914 · Cited by 189 · see citing works
ImageBind-LLM: Multi-modality Instruction Tuning
Han, J., Zhang, R., Shao, W., Gao, P., Xu, P., Xiao, H., Zhang, K., Liu, C., Wen, S., Guo, Z.-Y., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2309.03905 · Cited by 187
Peng, B., Li, C., He, P., Galley, M., & Gao, J. (2023) · arXiv · doi:10.48550/arxiv.2304.03277 · Cited by 183 · see citing works
Huang, Q., Dong, X., Zhang, P., Wang, B., He, C., Wang, J., Lin, D., Zhang, W., & Yu, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01274 · Cited by 171 · cited 4× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Influential(2023) · doi:10.48550/arxiv.2310.14566 · Cited by 166 · cited 1× · see citing works
“…the CHAIR [90] metric in generative tasks and F1 in discriminative tasks to form the AMBER Score as follows: RAH-Bench [16] Relation-Associated Hallucination Benchmark (RAH-Bench) can be regarded as an upgraded version of POPE, containing 3,000 yes-or-no questions with their corresponding images.”
Penedo, G., Malartic, Q., Hesslow, D., Cojocaru, R., Cappelli, A., Alobeidli, H., Pannier, B., Almazrouei, E., & Launay, J. (2023) · arXiv · doi:10.48550/arxiv.2306.01116 · Cited by 164 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
Bai, Z.-C., He, T., Mei, H.-Y., Wang, P., Gao, Z., Chen, J., Liu, L., Zhang, Z., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2409.19603 · Cited by 158 · cited 1×
“InsufficientData e.g. AMBER[103],LLaVA-RLHF[96] DataQuality NoisyData e.g. HalluciDoctor[117],LLaVA-1.”
Self-citationYu, T., Yao, Y., Zhang, H., He, T., Han, Y., Cui, G., Hu, J., Liu, Z., Zheng, H.-T., & Sun, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01310 · Cited by 156 · cited 2× · see citing works
“Similarly, RLHF-V [119] also employs the RLHF paradigm to enhance the pre-trained MLLM. Specifically, this work emphasizes two improvements: 1) at the data level, it proposes to collect human feedback in the form of fine-grained segment-level corrections, providing a clear, dense, and fine-grained…”
Self-citationMitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
Liu, F., Lin, K., Li, L., Wang, J., Yacoob, Y., & Wang, L. (2023) · arXiv · doi:10.48550/arxiv.2306.14565 · Cited by 149 · cited 4× · see citing works
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
InfluentialHolistic Analysis of Hallucination in GPT-4V(ision): Bias and Interference ChallengesPreprint
Cui, C.-H., Zhou, Y.-Y., Yang, X.-Y., Wu, S., Zhang, L.-J., Zou, J., & Yao, H. (2023) · arXiv.org · doi:10.48550/arxiv.2311.03287 · Cited by 145 · cited 1× · see citing works
“Bingo [21] Bingo (Bias and Interference Challenges in Visual Language Models) is a benchmark specifically designed for assessing and analyzing the limitations of current popular MLLMs, such as GPT-4V [83].”
Silkie: Preference Distillation for Large Visual Language ModelsPreprint
Li, L., Xie, Z.-H., Li, M., Chen, S.-N., Wang, P., Chen, L., Yang, Y.-Z., Wang, B.-Y., & Kong, L.-P. (2023) · arXiv.org · doi:10.48550/arxiv.2312.10665 · Cited by 139 · cited 1× · see citing works
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Self-citationInterpreting and Editing Vision-Language Representations to Mitigate Hallucinations
Jiang, N., Kachinthaya, A., Petryk, S., & Gandelsman, Y. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.02762 · Cited by 129 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Transfer Visual Prompt Generator across LLMs
Zhang, A., Fei, H., Yao, Y., Ji, W., Li, L., Liu, Z.-Y., & Chua, T.-S. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.01278 · Cited by 120
MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
Wang, C.-X., Chen, X., Zhang, N.-Y., Tian, B., Xu, H., Deng, S.-M., & Chen, H.-J. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.11779 · Cited by 118 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Evaluation and Analysis of Hallucination in Large Vision-Language ModelsPreprint
Wang, J., Zhou, Y., Xu, G., Shi, P.-C., Zhao, C., Xu, H., Ye, Q.-H., Yan, M.-S., Zhang, J., Zhu, J.-H., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2308.15126 · Cited by 118 · cited 3× · see citing works
“During generation, as the sequence length grows, the self-attention will focus more on the previously generated text tokens, i.e., the attention on the visual content is diluted [45, 102–104].”
VIGC: Visual Instruction Generation and Correction
Wang, B., Wu, F., Han, X., Peng, J., Zhong, H.-P., Zhang, P., Dong, X.-W., Li, W.-J., Li, W., Wang, J., et al. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2308.12714 · Cited by 108 · cited 1×
“During generation, as the sequence length grows, the self-attention will focus more on the previously generated text tokens, i.e., the attention on the visual content is diluted [45, 102–104].”
Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedback
Xiao, W., Huang, Z., Gan, L., He, W., Li, H., Yu, Z., Jiang, H., Wu, F., & Zhu, L. (2024) · arXiv.org · doi:10.48550/arxiv.2404.14233 · Cited by 105 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions
Li, J.-C., Pan, K.-H., Ge, Z., Gao, M.-H., Ji, W., Zhang, W.-Q., Chua, T.-S., Tang, S.-L., Zhang, H., & Zhuang, Y. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2308.04152 · Cited by 105
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?Preprint
Zeng, Y., Zhang, H.-B., Zheng, J.-N., Xia, J.-N., Wei, G.-Q., Wei, Y., Zhang, Y.-C., Kong, T., & Song, R.-H. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2307.02469 · Cited by 97 · see citing works
CIEM: Contrastive Instruction Evaluation Method for Better Instruction Tuning
Hu, H., Zhang, J.-Y., Zhao, M.-Y., & Sun, Z.-B. (2023) · arXiv.org · doi:10.48550/arxiv.2309.02301 · Cited by 94 · cited 1×
“CIEM [42] CIEM is a benchmark to evaluate hallucination of MLLMs. Unlike previous works utilize human annotated objects, CIEM is generated using an automatic pipeline.”
Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key
Yang, Z.-H., Luo, X., Han, D.-Q., Xu, Y.-J., & Li, D.-S. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00992 · Cited by 93 · cited 1× · see citing works
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Wang, L., He, J., Li, S.-S., Liu, N., & Lim, E.-P. (2023) · Conference on Multimedia Modeling · doi:10.48550/arxiv.2312.01701 · Cited by 91 · cited 4×
“Interestingly, when organizing the data, a set of edited images is intentionally added.”
Influential@ CREPE: Can Vision-Language Foundation Models Reason Compositionally?
Ma, Z., Hong, J., Gul, M. O., Gandhi, M., Gao, I., & Krishna, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01050 · Cited by 90 · cited 1× · see citing works
“The definition of hallucination types aligns well with the domain of compositional generalization [79, 121] of VLMs, which investigates visio-linguistic generalization and reasoning abilities.”
Xie, Y., Li, G., Xu, X., & Kan, M.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.findings-emnlp.775 · Cited by 89 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Mitigating Object Hallucination via Concentric Causal Attention
Xing, Y., Li, Y.-H., Laptev, I., & Lu, S.-J. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2410.15926 · Cited by 82 · cited 1×
“The reliance of MLLMs on large volumes of data presents significant challenges in terms of data quality, diversity, and bias.”
Li, Z.-W., Shi, H.-Z., Gao, Y.-H., Liu, D., Wang, Z.-T., Chen, Y.-X., Liu, T., Zhao, L., Wang, H., & Metaxas, D. N. (2025) · International Conference on Machine Learning · doi:10.48550/arxiv.2502.03628 · Cited by 77 · cited 1×
“In this section, we delve into the challenges and future directions of this pivotal domain.”
Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMs
Zhang, X., Quan, Y.-H., Gu, C.-C., Shen, C., Yuan, X., Yan, S., Cheng, H., Wu, K., & Ye, J.-P. (2024) · arXiv.org · doi:10.48550/arxiv.2411.09968 · Cited by 75 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Show, Recall, and Tell: Image Captioning with Recall Mechanism
Wang, L., Bai, Z., Zhang, Y., & Lu, H. (2020) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2001.05876 · Cited by 74 · cited 2×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationMultiModal-GPT: a vision and language model for dialogue with humans
Gong, T., Lyu, C., Zhang, S., Wang, Y., Zheng, M., Zhao, Q., Liu, K., Zhang, W., Luo, P., & Chen, K. (2023) · arXiv · doi:10.48550/arxiv.2305.04790 · Cited by 70 · see citing works
DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucination
Gong, X., Ming, T., Wang, X.-P., & Wei, Z.-H. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2410.04514 · Cited by 68 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Mitigating Hallucination in Visual Language Models with Visual SupervisionPreprint
Chen, Z., Zhu, Y., Zhan, Y.-F., Li, Z.-W., Zhao, C., Wang, J.-Q., & Tang, M. (2023) · arXiv.org · doi:10.48550/arxiv.2311.16479 · Cited by 67 · see citing works
CLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMs
Ouali, Y., Bulat, A., Martínez, B., & Tzimiropoulos, G. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2408.10433 · Cited by 61 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Chen, B., Lyu, X., Gao, L.-L., Song, J.-K., & Shen, H. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.15356 · Cited by 61 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data
Yu, Q., Li, J., Wei, L., Pang, L., Ye, W., Qin, B., Tang, S., Tian, Q., & Zhuang, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01230 · Cited by 59 · cited 6× · see citing works
“For mitigating hallucination, recent works make attempts on data, including introducing negative data [73], introducing counterfactual data [117], and reducing noise and errors in existing dataset [105, 120].”
InfluentialCODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models
Kim, J., Kim, H., Kim, Y., & Yong, M.-R. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2406.01920 · Cited by 56 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Zhang, C., Wan, Z., Kan, Z.-H., Ma, M. Q., Stepputtis, S., Ramanan, D., Salakhutdinov, R., Morency, L., Sycara, K. P., & Xie, Y.-Q. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2502.06130 · Cited by 54 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
PerturboLLaVA: Reducing Multimodal Hallucinations with Perturbative Visual TrainingPreprint
Chen, C., Liu, M.-Y., Jing, C.-C., Zhou, Y., Rao, F.-Y., Chen, H., Zhang, B., & Shen, C.-H. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2503.06486 · Cited by 53 · cited 2× · see citing works
“For mitigating hallucination, recent works make attempts on data, including introducing negative data [73], introducing counterfactual data [117], and reducing noise and errors in existing dataset [105, 120].”
Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation
Ge, Y.-H., Zeng, X.-H., Huffman, J., Lin, T.-Y., Liu, M.-Y., & Cui, Y. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.01331 · Cited by 52 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Mitigating Object Hallucination in Large Vision-Language Models via Classifier-Free GuidancePreprint
Zhao, L.-X., Deng, Y., Zhang, W.-T., & Gu, Q.-Q. (2024) · arXiv.org · doi:10.48550/arxiv.2402.08680 · Cited by 51 · cited 1× · see citing works
“MARINE [131] proposes a training-free approach.”
Zhong, W., Feng, X.-C., Zhao, L., Li, Q.-M., Huang, L., Gu, Y., Ma, W.-T., Xu, Y., & Qin, B. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2407.00569 · Cited by 49 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward ModelingPreprint
Yan, S.-M., Bai, M., Chen, W., Zhou, X., Huang, Q.-X., & Li, E.-R. L. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2402.06118 · Cited by 45 · cited 1× · see citing works
“Another similar work, ViGoR [110], also designs a fine-grained reward model to update pre-trained MLLMs, aiming to improve visual grounding and reduce hallucination.”
LLaVA-OneVision: Easy Visual Task Transfer
Li, B., Zhang, Y., Guo, D., Zhang, R., Li, F., Zhang, H., Zhang, K., Zhang, P., Li, Y., Liu, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.03326 · Cited by 44 · see citing works
Mitigating Object Hallucination in MLLMs via Data-augmented Phrase-level Alignment
Sarkar, P., Ebrahimi, S., Etemad, A., Beirami, A., Arik, S. Ö., & Pfister, T. (2024) · doi:10.48550/arxiv.2405.18654 · Cited by 44 · cited 1×
“In this section, we delve into the challenges and future directions of this pivotal domain.”
FGAIF: Aligning Large Vision-Language Models with Fine-grained AI Feedback
Jing, L., & Du, X. (2024) · Trans. Mach. Learn. Res. · doi:10.48550/arxiv.2404.05046 · Cited by 41 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Language Modeling Is Compression
Delétang, G., Ruoss, A., Duquenne, P.-A., Catt, E., Genewein, T., Mattern, C., Grau-Moya, J., Wenliang, L. K., Aitchison, M., Orseau, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.10668 · Cited by 39 · cited 1× · see citing works
“Neural networks, especially large language models, possess an intrinsic tendency to memorize training data, as noted in [23].”
IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decoding
Zhu, L., Ji, D., Chen, T., Xu, P., Ye, J., & Liu, J. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00150 · Cited by 39 · cited 1× · see citing works
“Following the same idea of contrastive decoding, IBD [139] proposes an image-biased decoding strategy.”
Octopus: Alleviating Hallucination via Dynamic Contrastive Decoding
Suo, W., Zhang, L., Sun, M., Wu, L., Wang, P., & Zhang, Y.-N. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.02783 · Cited by 39 · cited 1× · see citing works
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Self-citationThinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual HallucinationPreprint
Zheng, H., Xu, T., Sun, H., Pu, S., Chen, R., & Sun, L. (2024) · arXiv.org · doi:10.48550/arxiv.2411.12591 · Cited by 39 · cited 1× · see citing works
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence
He, J.-H., Zhu, K., Guo, H.-Y., Fang, J.-F., Hua, Z.-L., Jia, Y.-H., Tang, M., Chua, T.-S., & Wang, J.-Q. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2412.13949 · Cited by 38 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
VCoder: Versatile Vision Encoders for Multimodal Large Language Models
Jain, J., Yang, J., & Shi, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02644 · Cited by 35 · see citing works
Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning
Wu, S.-Q., Fei, H., Pan, L., Wang, W., Yan, S.-C., & Chua, T.-S. (2024) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2412.11124 · Cited by 35 · cited 1×
“We envision this survey empowering researchers and practitioners to dedicate efforts to advancing research and developing robust solutions in this vital area of study.”
An, W., Tian, F., Leng, S., Nie, J., Lin, H., Wang, Q., Chen, P., Zhang, X., & Lu, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02784 · Cited by 34 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Reformulating Vision-Language Foundation Models and Datasets Towards Universal Multimodal Assistants
Yu, T., Hu, J., Yao, Y., Zhang, H.-Y., Zhao, Y., Wang, C., Wang, S., Pan, Y., Xue, J., Li, D., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2310.00653 · Cited by 33
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMsPreprint
Yan, A., Yang, Z.-Y., Wu, J.-D., Zhu, W., Yang, J., Li, L., Lin, K., Wang, J., McAuley, J. J., Gao, J.-F., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2404.16375 · Cited by 32 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Qu, X.-Y., Sun, J., Wei, W., Liu, D.-Z., Dong, J.-F., & Cheng, Y. (2024) · International Conference on Computational Linguistics · doi:10.48550/arxiv.2408.17150 · Cited by 30 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
LOVA3: Learning to Visual Question Answering, Asking and Assessment
Zhao, H. H., Zhou, P., Gao, D.-F., Bai, Z.-C., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.14974 · Cited by 30 · cited 1×
“InsufficientData e.g. AMBER[103],LLaVA-RLHF[96] DataQuality NoisyData e.g. HalluciDoctor[117],LLaVA-1.”
Self-citationDoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29 · cited 1× · see citing works
“The lack of standardized benchmarks and evaluation metrics poses significant challenges in assessing the degree of hallucination in MLLMs.”
Fu, Y.-H., Xie, R.-B., Sun, X.-W., Kang, Z.-H., & Li, X.-R. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2411.10436 · Cited by 29 · cited 1×
“This includes eliminating biases, promoting diversity and inclusivity, and mitigating other potential issues that may induce hallucinations.”
Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding
Min, K., Kim, M., Lee, K.-I., Lee, D., & Jung, K. (2024) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2410.13321 · Cited by 27 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Chu, Z., Chen, J., Chen, Q., Yu, W., He, T., Wang, H., Peng, W., Liu, M., Qin, B., & Liu, T. (2023) · arXiv · doi:10.48550/arxiv.2309.15402 · Cited by 25 · cited 1× · see citing works
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
Self-citationXing, S., Zhao, F., Wu, Z., An, T., Chen, W., Li, C., Zhang, J., & Dai, X.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2402.09801 · Cited by 23 · cited 2×
“To the best of our knowledge, EFUF [109] is the first and only work that applies the unlearning framework to the task of hallucination mitigation, opening up a new path for future research.”
Cross-Modal Attention Calibration for LVLM Hallucination Mitigation
Li, J.-M., Zhang, J.-C., Jie, Z.-Q., Ma, L., Li, M., Luo, X.-N., & Li, G.-B. (2025) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.2501.01926 · Cited by 22 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
The Instinctive Bias: Spurious Images lead to Hallucination in MLLMsPreprint
Han, T., Lian, Q., Pan, R., Pi, R.-J., Zhang, J., Diao, S., Lin, Y., & Zhang, T. (2024) · arXiv.org · doi:10.48550/arxiv.2402.03757 · Cited by 22 · cited 1× · see citing works
“This effort further completes the definition of hallucination types.”
Enhancing Multimodal Large Language Models with Vision Detection Models: An Empirical Study
Jiao, Q.-R., Chen, D.-Y., Huang, Y., Li, Y.-L., & Shen, Y. (2024) · arXiv.org · doi:10.48550/arxiv.2401.17981 · Cited by 21 · cited 1×
“Another work [54] ensembles additional object detection and optical-character recognition into the MLLM architecture.”
RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in LVLMs
Woo, S., Jang, J., Kim, D., Choi, Y., & Kim, C. (2024) · arXiv.org · doi:10.48550/arxiv.2405.17821 · Cited by 21 · cited 2×
“Among the various methods, Reinforcement Learning from Human Feedback”
Interpreting and Mitigating Hallucination in MLLMs through Multi-agent DebatePreprint
Lin, Z., Niu, Z.-X., Wang, Z., & Xu, Y. (2024) · arXiv.org · doi:10.48550/arxiv.2407.20505 · Cited by 19 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Alleviating Hallucination in Large Vision-Language Models with Active Retrieval Augmentation
Qu, X., Chen, Q., Wei, W., Sun, J., Liu, D., & Dong, J. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3742434 · Cited by 18 · cited 2× · see citing works
“Among the various methods, Reinforcement Learning from Human Feedback”
Wang, J., Gao, Y., & Sang, J. (2024) · arXiv.org · doi:10.48550/arxiv.2411.15839 · Cited by 18 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Unsupervised Open-Vocabulary Object Localization in Videos
Fan, K., Bai, Z.-C., Xiao, T., Zietlow, D., Horn, M., Zhao, Z., Simon-Gabriel, C.-J., Shou, M., Locatello, F., Schiele, B., et al. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01264 · Cited by 16 · cited 1× · see citing works
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationChe, L.-W., Liu, T., Jia, J.-H., Qin, W., Tang, R.-X., & Pavlovic, V. (2025) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51701.2025.02009 · Cited by 15 · cited 1×
“The issue of ’losing attention’ would also lead to the model’s output response being irrelevant to the visual content.”
Chen, B., Lyu, X., Gao, L.-L., Song, J.-K., & Shen, H. (2025) · arXiv.org · doi:10.48550/arxiv.2503.08216 · Cited by 14 · cited 1×
“The issue of ’losing attention’ would also lead to the model’s output response being irrelevant to the visual content.”
Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs
Zhang, K., Tao, K.-D., Tang, J.-S., & Wang, H. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2501.19164 · Cited by 14 · cited 1×
“It’s only when the dreams enter deemed factually incorrect territory that we label them as ’hallucinations’.”
Yuan, F., Qin, C., Xu, X.-G., & Li, P.-J. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2409.20429 · Cited by 13 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
Bridging Information Asymmetry in Text-video Retrieval: A Data-centric Approach
Bai, Z.-C., Xiao, T., He, T., Wang, P., Zhang, Z., Brox, T., & Shou, M. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2408.07249 · Cited by 12 · cited 1×
“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”
Self-citationFilterRAG: Zero-Shot Informed Retrieval-Augmented Generation to Mitigate Hallucinations in VQA
Sarwar, S. M. (2025) · arXiv.org · doi:10.48550/arxiv.2502.18536 · Cited by 10 · cited 1×
“Among the various methods, Reinforcement Learning from Human Feedback”
LM-Switch: Lightweight Language Model Conditioning in Word Embedding Space
Han, C., Xu, J., Li, M.-L., Fung, Y. R., Sun, C., Jiang, N.-J., Abdelzaher, T. F., & Ji, H. (2023) · arXiv.org · doi:10.48550/arxiv.2305.12798 · Cited by 10 · cited 1×
“The detailed implementation is inspired by LM-switch [33], which involves adding a control parameter 𝜖 serving as a "switching value".”
Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection
Yang, L., Zheng, Z., Chen, B., Zhao, Z., Lin, C., & Shen, C. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01364 · Cited by 9 · cited 1× · see citing works
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
EAGLE: Enhanced Visual Grounding Minimizes Hallucinations in Instructional Multimodal Models
Villa, A., Alc'azar, J. L., Alfarra, M., Araujo, V., Soto, Á., & Ghanem, B. (2025) · arXiv.org · doi:10.48550/arxiv.2501.02699 · Cited by 9
Zhuang, X.-W., Zhu, Z.-H., Xie, Y., Liang, L., & Zou, Y. (2025) · arXiv.org · doi:10.48550/arxiv.2501.06553 · Cited by 9 · cited 1×
“Otherwise, research on methods to mitigate hallucinations may be built on an incorrect foundation.”
InfMLLM: A Unified Framework for Visual-Language TasksPreprint
Zhou, Q., Wang, Z., Chu, W., Xu, Y., Li, H., & Qi, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.06791 · Cited by 6 · see citing works
Behind the Magic, MERLIM: Multi-Modal Evaluation Benchmark for Large Image-Language Models
Villa, A., Alcázar, J. L., Soto, Á., & Ghanem, B. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00054 · Cited by 5 · cited 1× · see citing works
“MERLIM [100] MERLIM ( M ulti-modal E valuation benchma R k for L arge I mage-language M odels) is a test-bed aimed at empirically evaluating MLLMs on core computer vision tasks, including object recognition, instance counting, and identifying object-to-object relationships.”
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective
Yue, Z., Zhang, L., & Jin, Q. (2024) · Volume 1 · doi:10.18653/v1/2024.acl-long.633 · Cited by 5 · cited 7×
“However, another work [120] hypothesizes that the text descriptions in the instruction tuning data contain too much details, exceeding the perception limit of MLLMs.”
InfluentialKnowledge Unlearning for Mitigating Privacy Risks in Language Models
Jang, J., Yoon, D., Yang, S., Cha, S., Lee, M., Logeswaran, L., & Seo, M. (2022) · arXiv · doi:10.48550/arxiv.2210.01504 · Cited by 4 · cited 1× · see citing works
“Recently, unlearning for LLMs has been receiving increasing attention [50], effectively eliminating privacy vulnerabilities in LLMs.”
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
Huang, Y., Bai, Y., Zhu, Z., Zhang, J., Zhang, J., Su, T., Liu, J., Lv, C., Zhang, Y., Lei, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.08322 · cited 1×
“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”
MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
Zhao, H., Cai, Z., Si, S., Ma, X., An, K., Chen, L., Liu, Z., Wang, S., Han, W., & Chang, B. (2023) · arXiv · doi:10.48550/arxiv.2309.07915
Flagged first, then by citations
40 of the 194 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Show-o: One Single Transformer to Unify Multimodal Understanding and GenerationPreprint
Xie, J., Mao, W.-J., Bai, Z.-C., Zhang, D. J., Wang, W., Lin, K. Q., Gu, Y.-C., Chen, Z., Yang, Z.-H., & Shou, M. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2408.12528 · Cited by 832 · see citing works
“2.1 M ULTIMODAL U NDERSTANDING Significant advancements in large language models (LLMs) (Touvron et al., 2023; Brown et al., 2020; Chowdhery et al., 2023) have inspired the development of multimodal large language models (MLLMs) (Li et al., 2024; Yin et al., 2023; Bai et al., 2024).”
BackgroundMethodInfluentialSelf-citationFoundation Models Defining a New Era in Vision: A Survey and Outlook
Awais, M., Naseer, M., Khan, S., Anwer, R. M., Cholakkal, H., Shah, M., Yang, M.-H., & Khan, F. S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3506283 · Cited by 304 · see citing works
“Curious readers may refer to [191] for a more comprehensive treatment of the subject.”
MMaDA: Multimodal Large Diffusion Language Models
Yang, L., Tian, Y., Li, B.-W., Zhang, X.-C., Shen, K., Tong, Y.-H., & Wang, M.-D. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2505.15809 · Cited by 272
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
Bai, Z.-C., He, T., Mei, H.-Y., Wang, P., Gao, Z., Chen, J., Liu, L., Zhang, Z., & Shou, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2409.19603 · Cited by 158
“The remarkable advancements of large language models (LLMs) motivate the research community to extend the foundational capabilities of LLMs to the visual domain, leading to multimodal large language models (MLLMs) [67, 4].”
BackgroundSelf-citationLi, Z., Wu, X., Du, H., Liu, F., Nghiem, H. T., & Shi, G. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00147 · Cited by 72 · see citing works
“The alignment issue in multi-modal models arises from contextual deviation between modalities, leading to hallucinations [209].”
RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
Yu, T., Zhang, H.-Y., Li, Q.-M., Xu, Q.-X., Yao, Y., Chen, D., Lu, X., Cui, G., Dang, Y., He, T., et al. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.01861 · Cited by 121
“Halluci-nation reduction has received great attention as one of the most prominent misalignment problems [4, 27, 46, 71].”
Self-citationA Survey on the Memory Mechanism of Large Language Model-based Agents
Zhang, Z., Dai, Q., Bo, X., Ma, C., Li, R., Chen, X., Zhu, J., Dong, Z., & Wen, J.-R. (2025) · ACM Transactions on Information Systems · doi:10.1145/3748302 · Cited by 118 · see citing works
Self-citationMLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
Wang, C.-X., Chen, X., Zhang, N.-Y., Tian, B., Xu, H., Deng, S.-M., & Chen, H.-J. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.11779 · Cited by 118
“…of hallucination, which typically results in the model generating statements about non-existent images while neglecting to mention certain visible objects, effectively causing it to fool itself (Bai et al., 2024; Liu et al., 2024a; Li et al., 2023b; Liu et al., 2023a; Rawte et al., 2023).”
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey
Lin, Q.-K., Zhu, Y.-F., Mei, X., Huang, L., Ma, J.-Y., He, K., Peng, Z., Cambria, E., & Feng, M.-L. (2024) · Information Fusion · doi:10.48550/arxiv.2408.12880 · Cited by 101
“As for the hallucination of MLLMs, it can be mitigated using technologies similar to the general domain, from data, model, training, and inference perspectives [202].”
SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models
Zhang, Y.-T., Chen, L.-Y., Zheng, G.-D., Gao, Y., Zheng, R., Fu, J.-L., Yin, Z.-F., Jin, S.-J., Qiao, Y., Huang, X.-J., et al. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.01850 · Cited by 99
“This success extends to VLMs, where RLHF has been used to address hallucination issues [5, 39, 48, 61].”
Explainable and Interpretable Multimodal Large Language Models: A Comprehensive SurveyPreprint
Dang, Y., Huang, K., Huo, J., Yan, Y., Huang, S.-R., Liu, D.-R., Gao, M., Zhang, J., Qian, C., Wang, K., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2412.02104 · Cited by 94 · see citing works
“To address this challenge, a detailed survey [191] invsigated hallucination in MLLMs, reviewing its root causes, current evaluation benchmarks, and available mitigation strategies.”
Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key
Yang, Z.-H., Luo, X., Han, D.-Q., Xu, Y.-J., & Li, D.-S. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00992 · Cited by 93 · see citing works
“LVLMs has garnered significant attention as a major mis-alignment issue [12, 14, 55].”
Xie, Y., Li, G., Xu, X., & Kan, M.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.findings-emnlp.775 · Cited by 89
“However, these methods often require increased inference time, obstructing their generalizability and scalability across diverse data domains and sizes (Bai et al., 2024).”
BackgroundZou, X., Wang, Y., Yan, Y., Lyu, Y., Zheng, K.-N., Huang, S.-R., Chen, J.-K., Jiang, P.-J., Liu, J., Tang, C., et al. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2410.03577 · Cited by 89
“CD-based approaches (Chuang et al., 2023; Chen et al., 2024b; Neo & Chen, 2024), represented by ICD (Wang et al., 2024) and VCD (Leng et al., 2024), adjust the decoding distribution to mitigate hallucinations in MLLM, but this does not consistently improve performance as it introduces potential noise into the CD. Comp…”
InfluentialVL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation
Zhang, R.-Y., Zhang, H., & Zheng, Z. (2024) · arXiv.org · doi:10.48550/arxiv.2411.11919 · Cited by 87
“Research in this field can be divided into two main trajectories [2, 25, 32].”
What’s in the Imageƒ A Deep-Dive into the Vision of Vision Language Models
Kaduri, O., Bagon, S., & Dekel, T. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.01356 · Cited by 86
“For VLMs, recent works examine where visual information is stored [4], analyze hallucinations [3], and study spatial localization via logit lens [21, 33].”
Li, Y.-N., Li, Y.-H., Wang, X., Jiang, Y., Zhang, Z., Zheng, X., Wang, H., Zheng, H.-T., Xie, P.-J., Yu, P. S., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2411.02937 · Cited by 82
“Many prior works explore mitigating this hallucination issue (Liu et al. 2024c; Bai et al. 2024) by introducing additional knowledge-enhancing data or tasks into the different training stages of MLLMs, including pre-training (Zhai et al. 2023), instruction fine-tuning (Chai et al. 2024b; Jain,…”
Self-citationLi, Z.-W., Shi, H.-Z., Gao, Y.-H., Liu, D., Wang, Z.-T., Chen, Y.-X., Liu, T., Zhao, L., Wang, H., & Metaxas, D. N. (2025) · International Conference on Machine Learning · doi:10.48550/arxiv.2502.03628 · Cited by 77
“Hallucination Mitigation in LVLMs. Hallucination – the generation of content that is irrelevant, factually incorrect, or inconsistent with visual inputs (Bai et al., 2024) – represents a fundamental challenge in LVLM development.”
MIRAGE: The Illusion of Visual Understanding
Asadi, M., O'Sullivan, J., Cao, F., Nedaee, T., Rajabalifardi, K., Li, F.-F., Adeli, E., & Ashley, E. A. (2026) · arXiv.org · doi:10.48550/arxiv.2603.21687 · Cited by 74
“17,20,21,32 A response generated by a model in mirage-mode can be correct in every sense, accompanied by a meticulous reasoning trace, and completely coherent.”
Visual Prompting in Multimodal Large Language Models: A SurveyPreprint
Wu, J.-D., Zhang, Z.-H., Xia, Y., Li, X.-T., Xia, Z., Chang, A., Yu, T., Kim, S., Rossi, R. A., Zhang, R., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2409.15310 · Cited by 74 · see citing works
“…(Lin et al., 2024a; Wu et al., 2024d), conventional prompting methods fall short of providing accurate visual grounding and referring to detailed visual information, which can cause visual hallucinations (Bai et al., 2024; Huang et al., 2024b) and language bias (Wu et al., 2024b; Qu et al., 2024).”
BackgroundSelf-citationDetecting and Evaluating Medical Hallucinations in Large Vision Language ModelsPreprint
Chen, J., Yang, D.-K., Wu, T., Jiang, Y., Hou, X., Li, M.-C., Wang, S.-L., Xiao, D., Li, K., & Zhang, L.-H. (2024) · arXiv.org · doi:10.48550/arxiv.2406.10185 · Cited by 73 · see citing works
“Although LVLMs have shown significant capabilities on a range of multimodal tasks, they still suffer from inevitable performance bottlenecks due to hallucinatory interference [2, 8].”
Lu, J., Pang, Z.-L., Xiao, M., Zhu, Y., Xia, R., & Zhang, J.-J. (2024) · arXiv.org · doi:10.48550/arxiv.2407.06089 · Cited by 72 · see citing works
“Factuality hallucination emphasizes the discrepancy between generated content and verifiable real-world facts (Bai et al., 2024).”
BackgroundScaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generation
Yang, Y., Patel, A., Deitke, M., Gupta, T., Weihs, L., Head, A., Yatskar, M., Callison-Burch, C., Krishna, R., Kembhavi, A., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2502.14846 · Cited by 69
“As a result, without high-quality image-text data, models may overly rely on language priors, leading to hallucinations in their responses (Bai et al., 2024).”
Savage, C., Kanhere, A. U., Parekh, V. S., Langlotz, C. P., Joshi, A., Huang, H., & Doo, F. X. (2025) · Radiology · doi:10.1148/radiol.241073 · Cited by 57 · see citing works
“However, this enhanced multimodal capability of foundation models introduces additional problem points, including unique non-language hallucinations, which will require further research for safe clinical deployment (2,80,93).”
CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models
Kim, J., Kim, H., Kim, Y., & Yong, M.-R. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2406.01920 · Cited by 56
“We refer to readers for more comprehensive survey papers [43, 3] addressing hallucination in LMMs.”
BackgroundZhang, C., Wan, Z., Kan, Z.-H., Ma, M. Q., Stepputtis, S., Ramanan, D., Salakhutdinov, R., Morency, L., Sycara, K. P., & Xie, Y.-Q. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2502.06130 · Cited by 54
“…mitigating undesired hallucinations by contrasting token predictions derived from original visual input with bias-inducing counterparts, such as no/distorted visual input (Favero et al., 2024; Leng et al., 2024), disturbed instructions (Wang et al., 2024), or premature layers (Chuang et al., 2024).”
InfluentialReasoning about Uncertainty: Do Reasoning Models Know When They Don't Know?
Mei, Z.-T., Zhang, C., Yin, T., Lidard, J., Shorinwa, O., & Majumdar, A. (2025) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2506.18183 · Cited by 51
“Despite their remarkable capabilities, SOTA reasoning language models often generate confident but factually-incorrect responses to questions, known as hallucinations [5, 31], similar to their non-reasoning counterparts.”
Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey
Miyai, A., Yang, J., Zhang, J., Ming, Y., Lin, Y., Yu, Q., Irie, G., Joty, S. R., Li, Y., Li, H., et al. (2024) · Trans. Mach. Learn. Res. · doi:10.48550/arxiv.2407.21794 · Cited by 51
“Among the various hallucination issues [32], the challenge of identifying out-of-place questions is crucial for deploying LVLMs in safety-critical applications.”
Deep learning for the harmonization of structural MRI scans: a survey
Abbasi, S., Lan, H.-Y., Choupan, J., Sheikh-Bahaei, N., Pandey, G., & Varghese, B. A. (2024) · BioMedical Engineering OnLine · doi:10.1186/s12938-024-01280-6 · Cited by 49 · see citing works
“The causes of hallucinations in GANs are multifaceted [77].”
BackgroundX2-DFD: A framework for eXplainable and eXtendable Deepfake DetectionPreprint
Chen, Y.-Z., Yan, Z., Cheng, G.-L., Zhao, K.-R., Lyu, S., & Wu, B. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2410.06126 · Cited by 48 · see citing works
“Due to MLLMs’ well-documented tendency to hallucinate, especially under uncertain conditions [4], it is crucial to ensure that the models relies on their “familiar” forgery cues with strong discrimination for detection .”
Song, M.-J., Sim, S. H., Bhardwaj, R., Chieu, H. L., Majumder, N., & Poria, S. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2409.11242 · Cited by 48
“For instance, Bai et al. (2024) examines hallucinations due to incorrect access to parametric knowledge.”
BackgroundSecuring Large Language Models: Addressing Bias, Misinformation, and Prompt Attacks
Peng, B., Chen, H., Chen, K., Li, M., Feng, P., Bi, Z., Liu, J., Song, X., Niu, Q., Bao, R., et al. (2026) · Eureka · doi:10.63336/eureka.46 · Cited by 29 · see citing works
“Mitigation strategies include improving data quality, enhancing vision models, refining decoding processes, etc. [49].”
Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
Yan, Y., Wang, S., Huo, J., Ye, J.-H., Chu, Z.-D., Hu, X.-M., Yu, P. S., Gomes, C. P., Selman, B., & Wen, Q.-S. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2502.02871 · Cited by 47
“Additionally, by integrating causal reasoning into MLLMs, the models can better explain the relationships between variables, such as causes and effects, rather than simply identifying correlations (Xiong et al., 2024b; Jin et al., 2024b).”
Core Knowledge Deficits in Multi-Modal Language Models
Li, Y.-J., Gao, Q.-Y., Zhao, T., Wang, B.-Y., Sun, H.-R., Lyu, H., Hawkins, R. D., Vasconcelos, N., Golan, T., Luo, D., et al. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2410.10855 · Cited by 47
“To explore whether core knowledge exists and how it is represented, structured, and used in MLLMs, we draw inspiration from developmental cognitive science and introduce the CoreCognition dataset, the first large-scale benchmark tailored for the assessment of core knowledge.”
MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation
Wu, W., Liu, M.-Y., Zhu, Z.-Y., Xia, X., Feng, H., Wang, W., Lin, K. Q., Shen, C.-H., & Shou, M. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.02699 · Cited by 46
Self-citationA Survey of Multimodal Hallucination Evaluation and Detection
Chen, Z., Min, Y., Zhang, J., Yan, B., Wang, J., Wang, X., & Shan, S. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02756-9 · Cited by 11 · see citing works
“…some benchmarks integrate both discriminative and generative tasks to analyze the inconsistencies in hallucination behavior across different evaluation tasks (Wang et al., 2023; Jiang et al., 2024), which has not been sufficiently addressed in previous surveys (Lan et al., 2024; Bai et al., 2024).”
InfluentialVideoQA in the Era of LLMs: An Empirical Study
Xiao, J., Huang, N., Qin, H., Li, D., Li, Y., Zhu, F., Tao, Z., Yu, J., Lin, L., Chua, T., et al. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02385-8 · Cited by 17 · see citing works
“Also, there is a surge of works (Bai et al., 2024) studying the hallucination problem of multimodal LLMs in visual description.”
VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations on Synthetic Video Understanding
Li, Z.-X., Wu, X.-Y., Shi, G.-Y., Qin, Y., Du, H.-Y., Liu, F., Zhou, T.-Y., Manocha, D., & Boyd-Graber, J. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2505.01481 · Cited by 39
“However, they remain prone to hallucinations and shallow visual reasoning [1–3].”
Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual HallucinationPreprint
Zheng, H., Xu, T., Sun, H., Pu, S., Chen, R., & Sun, L. (2024) · arXiv.org · doi:10.48550/arxiv.2411.12591 · Cited by 39 · see citing works
“Hallucination remains a significant challenge in MLLMs, where models generate information that is factually incorrect or irrelevant to the given inputs [3].”
EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuning
Xing, B.-H., Yu, Z.-T., Liu, X., Yuan, K.-S., Ye, Q.-L., Xie, W.-C., Yue, H.-J., Yang, J.-Y., & Kälviäinen, H. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-026-02918-9 · Cited by 39
“In addition, based on current research (Bai et al., 2024), Rein-forcement Learning from Human Feedback (RLHF) not only enhances the model’s ability to follow prompts but also helps LLMs reduce hallucinations.”
Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs
Ghosh, S., Evuru, C. K. R., Kumar, S., Tyagi, U., Nieto, O., Jin, Z., & Manocha, D. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2405.15683 · Cited by 39
“Bai et al. (2024) highlight the growing importance of mitigating hallucinations in LVLMs, particularly in tasks involving complex interactions between visual and textual data.”
Chen, J.-Z., Zhang, T.-S., Huang, S.-Y., Niu, Y., Zhang, L.-F., Wen, L.-J., & Hu, X. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00398 · Cited by 37
“Many efforts have been made to understand the causes of hallucination [1, 16, 30, 39, 50, 50, 53, 62, 64, 70, 71, 75, 92, 99].”
Unveiling the Ignorance of MLLMs: Seeing Clearly, Answering Incorrectly
Liu, Y., Liang, Z.-Y., Wang, Y., Wu, X., Tang, F., He, M., Li, J., Liu, Z., Yang, H., Lim, S.-N., et al. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00849 · Cited by 37
“The assessment of MLLMs [34] is mainly divided into two main categories: general capability [47, 70] and hallucination benchmarks [8].”
Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling
Wu, T.-H., Lee, H., Ge, J.-X., Gonzalez, J., Darrell, T., & Chan, D. M. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2504.13169 · Cited by 36
“While discriminative tasks, binary (Yes/No) questions targeting object, attributes, and spatial understanding, are also common, backtracking provides limited benefit in such settings, which have been noted to offer less diagnostic insight into VLM hallucinations [7, 39].”
A Survey on Multimodal Benchmarks: In the Era of Large AI ModelsPreprint
Li, L., Chen, G., Shi, H., Xiao, J., & Chen, L. (2024) · arXiv.org · doi:10.48550/arxiv.2409.18142 · Cited by 35 · see citing works
“The term “hallucination” typically refers to situations where the generated responses contain information that is not present in the visual content [232]–[235].”
BackgroundRecognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models
Li, L., Zhou, Y., Liang, Y., Tsung, F., & Wei, J.-H. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2506.14674 · Cited by 34
“Thus, these models often suffer from hallucination [64, 65, 66], especially in visual tasks where they produce seemingly plausible but incorrect outputs.”
Learning to Summarize from LLM-generated Feedback
Song, H., Yun, T., Lee, Y.-H., Oh, J., Lee, G., Cai, J. (., & Su, H. (2024) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2410.13116 · Cited by 34
“These meth-ods have demonstrated effectiveness in aligning LLMs with human preferences, particularly in mitigating hallucination, harmful outputs, and biased contents (Tonmoy et al., 2024; Bai et al., 2024; Al-lam, 2024; Li et al., 2024).”
Foundation Models and Biometrics: A Survey and Outlook
Shahreza, H. O., & Marcel, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3602233 · Cited by 17 · see citing works
“3) Hallucination in Linguistic-Based Models: Linguistic-based FMs can hallucinate by generating outputs that appear realistic but are not correct [343], [344].”
CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving
Arai, H., Miwa, K., Sasaki, K., Watanabe, K., Yamaguchi, Y., Aoki, S., & Yamamoto, I. (2025) · 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv61041.2025.00195 · Cited by 33 · see citing works
“VLMs is their tendency to generate hallucinations, producing captions that do not accurately reflect the visual content, particularly in tasks like visual question answering and image captioning [2,33].”
Mitigating Object Hallucinations via Sentence-Level Early Intervention
Peng, S., Yang, S., Jiang, L., & Tian, Z.-T. (2025) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51701.2025.00067 · Cited by 32 · see citing works
“Object Hallucination (OH) in Multimodal Large Language Models (MLLMs) is characterized by the generation of text that is semantically coherent yet inconsistent with the visual content of the provided image [4, 52].”
Atwany, H., Waheed, A., Singh, R., Choudhury, M., & Raj, B. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2502.12414 · Cited by 31
“…investigated hal-lucination in text generated by large language models (LLMs), identifying it as a prevalent phenomenon (Huang et al., 2025; Bai et al., 2024; Yao et al., 2023; Jiang et al., 2024; Maynez et al., 2020; Parikh et al., 2020; Ji et al., 2023; Mittal et al., 2024; Filippova,…”
Beyond Logit Lens: Contextual Embeddings for Robust Hallucination Detection & Grounding in VLMs
Phukan, A., Divyansh, Morj, H. K., Vaishnavi, Saxena, A., & Goswami, K. (2024) · arXiv.org · doi:10.48550/arxiv.2411.19187 · Cited by 31
“While our work significantly advances the state-of-the-art in training-free hallucination detection and grounding in LMMs, it has some limitations that provide exciting avenues for future research.”
InfluentialModality-Fair Preference Optimization for Trustworthy MLLM Alignment
Jiang, S., Zhang, Y., Chen, R.-Z., Hu, T.-X., Jin, Y.-Y., He, Q.-L., Feng, Y., Wu, J., & Liu, Z.-Z. (2024) · International Joint Conference on Artificial Intelligence · doi:10.48550/arxiv.2410.15334 · Cited by 31
“To address this issue, recent work has applied preference optimization to improve the alignment of modalities in MLLM [ Rafailov et al. , 2024; Naveed et al. , 2023 ] .”
A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future
Sun, S.-L., An, W., Tian, F., Nan, F., Liu, Q., Liu, J., Shah, N., & Chen, P. (2024) · arXiv.org · doi:10.48550/arxiv.2412.14056 · Cited by 30
“A. Eliminating the MLLMs hallucination with MXAI Current methods for mitigating hallucinations mainly involve recognizing patterns and penalizing overconfident to-kens using counterfactual samples [295], [296], [298], [331].”
From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalities
Jiang, S., Liang, J.-F., Wang, J.-Y., Dong, X., Chang, H., Yu, W., Du, J., Liu, M., & Qin, B. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2025.findings-acl.453 · Cited by 30
Multimodal Large Language Models for Medicine: A Comprehensive SurveyPreprint
Ye, J.-R., & Tang, H. (2025) · arXiv.org · doi:10.48550/arxiv.2504.21051 · Cited by 29 · see citing works
“Based on experience, hallucinations caused by misidentification can be categorized into three types: type, property, and relationship [176].”
Can VLMs Actually See and Read? A Survey on Modality Collapse in Vision-Language Models
Sim, M. Y., Zhang, W. E., Dai, X., & Fang, B. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2025.findings-acl.1256 · Cited by 29
“…conducted to review VLMs (Du et al., 2022; Long et al., 2022), multimodal models 1 (Uppal et al., 2022; Xu et al., 2023; Liang et al., 2024), large multi-modal models (Yin et al., 2024; Caffagni et al., 2024; Wu et al., 2023) and hallucination issue in large multimodal models (Bai et al., 2024).”
From Superficial Outputs to Superficial Learning: Risks of Large Language Models in EducationPreprint
Delikoura, I., Fung, Y. R., & Hui, P. (2025) · arXiv.org · doi:10.48550/arxiv.2509.21972 · Cited by 28 · see citing works
“Intrinsic hallucinations stem from limitations in the model’s internal knowledge or representation [77], while extrinsic hallucinations arise from misinterpretations of external prompts or multi-modal inputs [11].”
RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought
Lu, Y., Cao, J., Wu, Y.-L., Li, B.-Z., Tang, L., Ji, Y.-G., Wu, C., Wu, J., & Zhu, W.-B. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2506.04277 · Cited by 28
“These cues help MLLMs focus on key image regions without altering model parameters, mitigating issues like visual hallucination (Bai et al., 2024) and language bias (Qu et al., 2024).”
Yu, Q., Xiao, Z., Li, B., Wang, Z., Chen, C., & Zhang, W. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730288 · Cited by 17 · see citing works
“Despite their advanced image comprehension capabilities, MLLMs frequently exhibit hallucinations when converting visual inputs into textual outputs [2], which raises a natural question: Why not present the images directly instead of describing their content?”
Yan, Y., Xu, G., Zou, X., Liu, S.-L., Kwok, J. T., & Hu, X.-M. (2025) · arXiv.org · doi:10.48550/arxiv.2509.23883 · Cited by 27
“…et al., 2022; Jang et al., 2025), urban sensing (Zou et al., 2025; Yan et al., 2024c; Yan & Lee, 2024; Hou et al., 2025b), multimodal reasoning (Wang et al., 2024; Yan et al., 2025a; 2024a; Su et al., 2025b; Yan et al., 2024b), multimodal retrieval (Lin et al., 2024; Lu & Tang, 2025; Kagaya et…”
CoRe-MMRAG: Cross-Source Knowledge Reconciliation for Multimodal RAG
Tian, Y., Liu, F., Zhang, J.-Y., Victoria, W., Hu, Y.-P., & Nie, L.-Q. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2506.02544 · Cited by 27
“How-* ever, these models inherently suffer from hallu-cination (Bai et al., 2024) and knowledge limitations (Caffagni et al., 2024), as their parametric knowledge is frozen after pretraining and cannot dynamically adapt to external information.”
He, Z.-T., Polisetty, S., Fan, Z.-Y., Huang, Y.-C., Wu, S.-J., & Fung, Y. R. M. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2505.23224 · Cited by 27
A Survey on the Honesty of Large Language Models
Li, S., Yang, C., Wu, T., Shi, C., Zhang, Y.-J., Zhu, X., Cheng, Z., Cai, D., Yu, M., Liu, L.-M., et al. (2024) · Trans. Mach. Learn. Res. · doi:10.48550/arxiv.2409.18786 · Cited by 27
“Additionally, these models often struggle to accurately convey in-context knowledge, such as relevant articles or figures (Liu et al., 2024d; Shi et al., 2024; Bai et al., 2024; Zhang et al., 2024d).”
Sahu, P., Sikka, K., & Divakaran, A. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2407.02352 · Cited by 27
“We defined these predicates by using a taxonomy of question-types from prior works on VQA (Antol et al., 2015) and multimodal hallucinations (Bai et al., 2024).”
MethodGao, H., Qu, J., Tang, J.-Y., Bi, B.-L., Liu, Y., Chen, H.-Y., Liang, L., Su, L., & Huang, Q. (2025) · Transactions of the Association for Computational Linguistics · doi:10.48550/arxiv.2503.19622 · Cited by 26
“For VLM, hallucination refers to the phenomenon that the generated text responses are inconsistent with the corresponding visual content [2].”
Jung, M., Lee, S., Kim, E., & Yoon, S. (2025) · International Conference on Machine Learning · doi:10.48550/arxiv.2502.01419 · Cited by 26
“5 (Liu et al., 2024a), LLaVA-Next (Liu et al., 2024b), and Qwen2-VL (Wang et al., 2024), each with 7B parameters.”
InfluentialChen, Z.-J., Hu, W.-B., He, G., Deng, Z.-J., Zhang, Z., & Hong, R. (2024) · International Conference on Computational Linguistics · doi:10.48550/arxiv.2412.14660 · Cited by 26
“However, like LLMs, MLLMs also suffer from issues such as hallucinations and unreliability (Bai et al., 2024).”
Self-citationPark, W., Kim, W., Kim, J., & Do, J. (2025) · International Conference on Machine Learning · doi:10.48550/arxiv.2506.08391 · Cited by 25
“…at two scales, S ECOND accumulates object-relevant patches through patch selection strategy. nation—a phenomenon where models generate plausible yet inaccurate responses that are not grounded in the visual content—remains a persistent and critical challenge (Bai et al., 2024; Leng et al., 2024).”
VidHal: Benchmarking Temporal Hallucinations in Vision LLMs
Choong, W. Y., Guo, Y., & Kankanhalli, M. (2024) · arXiv.org · doi:10.48550/arxiv.2411.16771 · Cited by 25
“A common demonstration is that the generated responses contain information which is inconsistent with the visual content [1, 36, 55, 63].”
Chen, F., Li, Y., Chen, Y.-L., Bian, Z.-X., Duo, L., Zhou, Q., & Zhang, L. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70075 · Cited by 24 · see citing works
“…between visual and textual data is particularly problematic in medical AI systems that rely on both modalities for decision-making, as the model might prioritize one source of information over the other or attempt to reconcile contradictory inputs in ways that don’t reflect clinical reality [9].”
MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMsPreprint
Chen, H., Peng, J., Min, D., Sun, C., Chen, K., Yan, Y., Yang, X., & Cheng, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.14159 · Cited by 11 · see citing works
“On the one hand, prior works examine hallucination issues, which evaluates the discrepancy between generated responses and the visual content (Bai et al., 2024; Wang et al., 2023; Jiang et al., 2024).”
When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
Luo, R. M., Xue, Z., Dimakis, A., & Grauman, K. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2510.06077 · Cited by 23
Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios
Dang, Y., Gao, M., Yan, Y., Zou, X., Gu, Y., Li, J.-G., Wang, J.-Y., Jiang, P.-J., Liu, A., Liu, J., et al. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2411.02708 · Cited by 23
“Such knowledge is comparatively more susceptible to being misled, consistent with current findings in hallucination research (Bai et al., 2024).”
BackgroundRadFlag: A Black-Box Hallucination Detection Method for Medical Vision Language Models
Zhang, S., Sambara, S., Banerjee, O., Acosta, J. N., Fahrner, L. J., & Rajpurkar, P. (2024) · ML4H@NeurIPS · doi:10.48550/arxiv.2411.00299 · Cited by 23
“To the best of our knowledge, only one study has applied uncertainty modeling to remove hallucinations in radiology report generation by using Monte Carlo dropout to estimate uncertainty at both the image and text levels, integrating these estimates into a novel loss function (Wang et al., 2024).”
Qin, Z., Chen, D., Zhang, W., Yao, L., Huang, Y., Ding, B., Li, Y., & Deng, S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3576835 · Cited by 8 · see citing works
“Similar to LLMs, MLLMs also suffer from hallucination issues [141], and these hallucinations can additionally occur in other modalities [267].”
BackgroundReasonMap: Towards Fine-Grained Visual Reasoning from Transit Maps
Feng, S.-C., Wang, S., Ouyang, S.-Y., Kong, L.-D., Song, Z.-K., Zhu, J., Wang, H., & Wang, X.-C. (2025) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.2505.18675 · Cited by 22
“Answers that do not comply with the specified format or cannot be parsed due to model hallucination [4] are marked as wrong answer.”
Ho, H. P., Ramesh, V., Zaloudek, I., Rikhtehgar, D. J., & Wang, S.-H. (2025) · International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712145 · Cited by 22 · see citing works
“Studies identify two main forms of hallucination [1]: (1) omitting objects present in the visual input and (2) fabricating details that are not there.”
From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities
Zhang, W.-P., Xie, Z.-L., Feng, Y., Li, Y., Xing, X.-R., Zheng, S.-P., & Lu, Z.-Q. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.02155 · Cited by 22
“However, these models often face challenges in modality alignment, leading to issues such as hallucination in MLLMs (Bai et al., 2024).”
V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
Luo, Y., Zhao, X.-L., Lin, B., Zhu, L.-T., Tang, L., Liu, Y., Chen, Y.-C., Qian, S.-J., Wang, X., & You, Y. (2025) · arXiv.org · doi:10.48550/arxiv.2511.16668 · Cited by 21
“This phenomenon has been documented in recent evaluations of video language models [5, 20] and corroborated by multimodal hallucination surveys highlighting their vulnerability to dense or abstract visual patterns [1].”
Wang, Y.-N., Zhang, M., Sun, J.-J., Wang, C., Yang, M., Xue, H., Tao, J.-L., Duan, R.-J., & Liu, J.-X. (2025) · USENIX Security Symposium · doi:10.48550/arxiv.2501.15269 · Cited by 21
“To address the unintended effects of unfaithful MLLMs, the causes of hallucinations have been explored [4].”
FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Models
Heiman, A., Zhang, X.-M., Chen, E., Kim, S. E., & Rajpurkar, P. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.02867 · Cited by 21 · see citing works
“This issue has increased focus on fact-checking and mitigating hallucinations across multiple modalities [1, 11, 23].”
Biswas, A., & Talukdar, W. (2024) · arXiv.org · doi:10.48550/arxiv.2406.10295 · Cited by 21
ChatGPT is incredible (at being average)
Rudko, I., & Bonab, A. B. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09845-2 · Cited by 26 · see citing works
“Many believe that the tendency of models to hallucinate is a substantial hurdle when it comes to ensuring their reliability in real-life applications (Bai et al., 2024; Chen et al., 2023; Jiang et al., 2024a, b; Liu et al., 2024a, b; Tonmoy et al., 2024; Wang et al., 2023).”
V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
Luo, X.-W., Yang, F.-Z., Ding, F., Gao, X.-B., Xing, S., Zhou, Y., Tu, Z.-Z., & Liu, C. (2025) · arXiv.org · doi:10.48550/arxiv.2506.02580 · Cited by 20
“This reasoning-aware design improves both transparency and utility [4, 26, 31].”
Ye, Z.-K., Li, Q.-M., Feng, X.-C., Qin, L.-B., Huang, Y.-C., Li, B.-H., Jiang, K., Xiang, Y., Zhang, Z.-R., Lu, Y.-F., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2506.11073 · Cited by 20
“However, LVLMs still suffer from serious object hallucination, i.e. , generating responses that are inconsistent with the visual input (S. et al., 2023; Z. et al., 2024; Huang Figure 1: A comparison of attention weights map be-tween Chinese and English query.”
Self-citationMatters: Training-free Fine-grained Image Caption Enhancement via Local Perception
Peng, R.-T., He, H., Wei, Y.-K., Wen, Y.-D., & Hu, D. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.00375 · Cited by 20
“However, challenges such as hallucinations [8] and lack of fine-grained detail [33] persist.”
What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations
Liu, D., Whitehouse, C., Yu, X., Mahon, L., Saxena, R., Zhao, Z., Qiu, Y., Lapata, M., & Demberg, V. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2502.08279 · Cited by 20
“…performance in scientific contexts, particularly when processing technical terminology and scientific visual elements like figures and tables (Li et al., 2024c; Lu et al., 2024; Yue et al., 2024; Hu et al., 2024a; Bai et al., 2024; Liang et al., 2024; Patil et al., 2024; Huang et al., 2024).”
Unified Generative and Discriminative Training for Multi-modal Large Language Models
Chow, W., Li, J.-C., Yu, Q.-F., Pan, K.-H., Fei, H., Ge, Z., Yang, S., Tang, S.-L., Zhang, H.-W., & Sun, Q. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2411.00304 · Cited by 20
“However, challenges such as hallucinations and weak image object discrimination abilities [7, 89] persist.”
BackgroundA multimodal large language model for materials science
Tang, Y., Xu, W., Cao, J., Ma, J., Gao, W., Farrell, S., Erichson, N. B., Mahoney, M. W., Nonaka, A., & Yao, Z. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01214-y · Cited by 42 · see citing works
Chen, T.-Y., Zhang, Y., Zhang, Z., Yu, P.-Y., Wang, S., Wang, Z.-D., Lin, K., Wang, X., Yang, Z.-Y., Li, L., et al. (2025) · doi:10.48550/arxiv.2509.13399 · Cited by 19
“First, for instruction-following evaluation, they are notoriously poor at spatial reasoning Zhang et al. (2025b); Chen et al. (2024); Chang et al. (2025) and are prone to object hallucinations in existence, category, attributes, and relations Bai et al. (2024).”
Self-citationKhanal, B., Pokhrel, S., Bhandari, S., Rana, R., Shrestha, N., Gurung, R., Linte, C. A., Watson, A., Shrestha, Y., & Bhattarai, B. (2025) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.48550/arxiv.2505.07001 · Cited by 19
“Hallucination, in this context, refers to instances where the model produces information that appears plausible but is factually incorrect or fabricated [3,12].”
Yu, H.-Q., & McQuade, F. (2025) · arXiv.org · doi:10.48550/arxiv.2503.13514 · Cited by 19
“For example, in image captioning and visual question answering, hallucinations can lead to misinterpretation or incorrect descriptions of objects or scenes, posing significant concerns regarding the practical deployment of such models [18].”
Interpreting and Mitigating Hallucination in MLLMs through Multi-agent DebatePreprint
Lin, Z., Niu, Z.-X., Wang, Z., & Xu, Y. (2024) · arXiv.org · doi:10.48550/arxiv.2407.20505 · Cited by 19 · see citing works
“Hallucination in LLMs typically manifests as a discrepancy between generated content and actual facts, known as factual hallucination [1].”
BackgroundCertainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness
Chandu, K. R., Li, L.-J., Awadalla, A., Lu, X., Park, J. S., Hessel, J., Wang, L.-J., & Choi, Y. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2407.01942 · Cited by 19
“Most standard multimodal benchmarks focus on clear, definitive answers or partial hallucinations [68, 69] for discriminative [64, 70, 71] or generative tasks [30, 67].”
BackgroundMLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval
Cai, W.-T., Huang, J.-B., Gong, S., Jin, H., & Liu, Y. (2024) · Pattern Recognition · doi:10.48550/arxiv.2406.17880 · Cited by 19
“…Text Paragraph Construction module and also demonstrated the robustness of our design across different MLLMs in Table 5, designing a more intuitive standard to measure and improve the quality of MLLMs (such as regarding hallucination [4]) is a worthwhile direction to be explored in the future.”
Continual Learning for Generative AI: From LLMs to MLLMs and Beyond
Guo, H.-Y., Zeng, F.-H., Zhu, F., Wang, J., Wang, X.-K., Zhou, J., Zhao, H.-B., Liu, W.-Z., Ma, S.-J., Wang, D.-H., et al. (2025) · doi:10.48550/arxiv.2506.13045 · Cited by 18
“To achieve this, it is essential to refine the generative reasoning process alongside the underlying factual knowledge representation, thereby mitigating hallucinations [10, 91] and semantic inconsistencies [247].”
Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimization
Liu, W., Song, X., Li, J., Wei, Y.-W., Zheng, N., Yin, J.-H., & Nie, L.-Q. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2506.11712 · Cited by 18
“Despite their impressive performance, MLLMs often suffer from hallucination problems [6, 7], generating outputs inconsistent with the given image input or not relevant to the input textual prompt [8].”
Domain knowledge-driven image captioning for bridge damage description generation
Chai, C., Gao, Y., Xiong, G., Liu, J., & Li, H. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106116 · Cited by 17 · see citing works
“It is primarily associated with deviations between model-generated textual descriptions and actual visual feature regions of an image, making the output potentially misleading [20-21].”
Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative AnalysisPreprint
Mala, C., Gezici, G., & Giannotti, F. (2025) · arXiv.org · doi:10.48550/arxiv.2504.05324 · Cited by 18 · see citing works
- Authors
- Bai, Z., Wang, P., Xiao, T., He, T., Han, Z., Zhang, Z., & Shou, M. Z.
- ORCID
- Han, Zongbo
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2404.18930
- OpenAlex
- W6922346929
- Cited by
- 38
- References
- 194
- Citations by year
- 2026: 4 · 2025: 28 · 2024: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Research Foundation
- National Research Foundation Singapore
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Hallucinations in medical conditions
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- hallucinations, multimodal large language models, hallucination mitigation, hallucination detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
