Hallucination of Multimodal Large Language Models: A Survey

“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”

“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”

“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”

“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”

“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”

“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”

“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”

“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”

“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”

“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”

“1), i.e., the generated text describes entities not present in the input image or misses relevant entities altogether, generating content not grounded in the visual input [19, 8].”

“…process and susceptibility to generating hallucinations, describing cases when the model produces responses that are not supported by any information given in the input, but instead are drawn from the language priors within the LLM Li et al. (2023b); Liu et al. (2024); Bai et al. (2024).”

“These findings indicate that different visual encoders excel in various aspects, and using multiple encoders together could be a promising approach for developing VLMs, as explored in Tong et al. (2024); Lin et al. (2023); Gao et al. (2024).”

“This issue, whether caused by the way models are optimized or by unintended hallucinations [4, 2], leads to a fundamental challenge: reasoning inconsistency.”

“However, during the integration of text and vision modalities, a new type of hallucination issue has emerged, where the model generates object information that does not exist in the images or creates inaccurate spatial representations [1, 3, 6, 7, 17].”

“Hallucination in multimodal large models has been widely studied in object-centric settings, typically involving errors in object existence, attributes, or relations [7].”

“AI-generated codes, themes, and summaries inherit both the documented biases of large multimodal models [78] and their propensity to hal-lucinate [41,80].”

“#13 Upon viewing the image, “ [role] ” is more inclined to feel “ [emotion1] ” compared to “ [emotion2] ”. suffer from hallucinations [52], trustworthiness issues [53], and incomplete affective perception.”

“…× × × × × × ✓ ✓ ✓ × × × × 3 Huang and Chang [18] ✓ ✓ ✓ × × × ✓ ✓ ✓ × × × × 6 Andriopoulos and Pouwelse [19] ✓ × × × × × ✓ × ✓ ✓ × × × 4 Bai et al. [20] ✓ ✓ ✓ × × × ✓ ✓ ✓ × × × × 6 Lavrinovics et al. [21] × × × × × × ✓ × ✓ × × × × 2 Tonmoy et al. [22] × × × × × × ✓ ✓ ✓ ✓ ✓ ✓ × 6 Agrawal et al.…”

“Despite these advances, LVLMs remain prone to hallucinations [3, 21, 24, 51], producing outputs that are linguistically plausible yet ungrounded in the visual input.”

“Mitigating Generalized Hallucination in MLLMs. Extensive research has investigated the origins of hallucinations in MLLMs [76, 84, 4].”

“Building on this foundation, MLLM UE further needs to consider uncertainty sources that are specific to multimodal settings, such as visual perception ambiguity, and cross-modal alignment failures [37], [38].”

“Each sub-process of MLLM inference contributes its own form of uncertainty (Bai et al., 2024).”

“Recent work has shown that VLMs can produce fluent answers that are weakly grounded in the supplied image, exposing a gap between answer plausibility and visual evidence use Li et al. (2023); Bai et al. (2024).”

“These methods and models include GPT-4V (Achiam et al., 2023), RLAIF-V (Yu et al., 2024c), CCA-LLaVA (Xing et al., 2024), mDPO (Wang et al., 2024), RLHF-V (Yu et al., 2024b), HSA-DPO (Xiao et al., 2024), AMP-MEG (Zhang et al., 2024), HALVA (Sarkar et al., 2025), and OPA-DPO (Yang et al., 2025).”

“Despite strong task performance, they remain prone to visual hallucination , producing text that is inconsistent with the image, which has motivated a growing line of analysis and mitigation [20, 21].”

“However, hallucination remains a persistent challenge for MLLMs, which can substantially impair their reliability across a variety of vision–language tasks (Bai et al., 2024).”

“Hallucination in VLMs refers to the generation of fluent but visually unsupported content, including nonexistent objects, incorrect attributes, or fabricated relations (Liu et al. [2024a], Bai et al. [2025]).”

“Research indicates that VLMs frequently suffer from hallucinations [ 14], producing content that is neither required nor relevant to the input.”

“Object hallucination—false positives (describing non-existent objects) or false negatives (omitting present ones)—is the most studied and practically significant form [3, 11].”

“Beyond the intrinsic hallucination tendencies of autoregressive LLMs, the encoder– adaptor–LLM joint-training paradigm introduces additional risks (Bai et al., 2024b; Zhou et al., 2024; Xie et al., 2026).”

“From this perspective, we propose a set of encoder-side metrics (defined in Section 3.2) to diagnose how different training paradigms shape the encoder–LLM interface.”

“Prior studies have explored hallucination reduction [7, 8] and prompt design [9], but they do not examine how different quantization levels and quantization types affect LLM performance in qualitative analysis.”

“However, they still suffer from object hallucination, where generated captions mention non-existent objects [1, 20].”

“To address this, strategies include fine-tuning with high-quality data, robust evaluation frameworks, and integrating explainability mechanisms to ensure accuracy and patient safety 37,38 .”

“LLMs are prone to hallucination and overconfident narrative [69–71].”

“However, a critical challenge is hallucination, generating content ungrounded in the visual input, such as describing absent objects or misinter-preting scenes [2, 19, 24].”

“Building on insights from prior studies [9, 38, 60], which indicate that MLLMs often hallucinate elements that frequently co-occur with ground-truth data, we construct hard negatives by leveraging co-occurrence matrices derived from datasets commonly used to train MLLMs, such as Visual Genome, VQA,…”

“…the other hand, Multimodal Large Language Models (MLLMs) offer high-level natural language reasoning and can articulate plausible emotional narratives, but often struggle to ground their judgments in fine-grained, verifiable acoustic evidence (Tang et al., 2024; Bai et al., 2025; Hu et al., 2024).”

“Hallucination manifests as generated responses that contain information inconsistent with the actual visual content, typically arising from modal misalignment, imbalanced training data, or over-reliance on prior linguistic knowledge (Bansal et al., 2024; Bai et al., 2024).”

“Recently, Vision Language Models (VLMs) (Team et al., 2025; Wang et al., 2025c; Bai et al., 2025a) have demonstrated impressive capabilities across a wide range of complex tasks, including image captioning, visual question answering, and multimodal reasoning.”

“In such cases, the model generates text that is inconsistent with the visual evidence, for example by confidently describing ob-† Corresponding author. jects that are not present in the image [14, 19, 26, 30].”

“Existing approaches can be broadly grouped into two paradigms: external verification-based meth-ods and uncertainty-driven methods [6], [10].”

“This leads to well-documented issues such as visual hallucination, shallow cross-modal alignment, and limited abstraction abilities when reasoning about fine-grained or implicit visual content[26, 27, 28].”

“However, LMMs suffer from the issue of hallucination, and will occasionally produce outputs visually inconsistent with the input image [2].”

“Despite their prowess, VLMs remain plagued by object hallucinations (OH): the fabrication of objects, attributes, or spatial relations absent from the input image, often stemming from linguistic priors or distributional biases in training data [3, 15, 16, 29, 41].”

“Hallucinations in VLMs can be addressed at three stages: data, model, and inference (Bai et al., 2025; Huang et al., 2025; Zhang et al., 2025).”

“Zhang et al. [18] discussed how vision-language RAG pipelines try to anchor generated text to visual evidence, but multimodal alignment is challenging when the knowledge base is not covered for dynamic, real-time queries.”

“Thus, hallucinations [14], [6] are a prominent issue across all modalities, arising from limitations in training data, architectural design, and a lack of context and understanding of the robots’ working environment.”

“…vision research, object hallucinations are systematically categorized into three subtypes: Category Hallucination, Attribute Hallucination, and Relation Hallucination, corresponding to errors at the levels of object recognition, attribute judgment, and relation understanding, respectively [16].”

“However, constrained by the timeliness and knowledge breadth of pre-training data, these models often exhibit hallucination issues in real-world knowledge based VQA tasks [Bai et al. , 2024].”

“Research on this topic typically points to two main sources of failure: one relates to the language decoder, which can hallucinate details not present in the image [4], while the other focuses on the visual encoder, which may provide ambiguous visual information.”

“Concurrently, mitigating phenomena like hallucinations in MLLMs is a significant area of research, with comprehensive overviews identifying key challenges and future directions for addressing these issues in the pursuit of robust multimodal Artificial General Intelligence [29].”

“When ω is too small ( e.g. , 1e − 4 ), the induced distributional shift is limited, resulting in marginal improvement over the baseline.”

“CHAIR calculates the proportion of words generated in captions that are actually in the image according to the ground truth annotations and object segmentations [29].”

“In recent years, LVLMs [7, 12, 22, 25, 29, 42, 47, 57] have revolutionized multimodal understanding [3, 4, 20, 30] by integrating powerful visual encoders [34, 46, 52] with Large Language Models (LLMs) [2, 10, 39, 40].”

“However, recent studies[4], [5] reveal that even state-of-the-art LVLMs still suffer from serious hallucination issues, where generated content fails to align with visual input, limiting their reliability in real-world scenarios.”

“Additionally, traditional prompting methods in language models often lack precise visual grounding for specialized inputs like spectrograms, which can lead to issues such as visual misinterpretations [17].”

“It may also suffer from hallucinations, in which the generated output is inconsistent with the provided input [57].”

“Examples of images with these causes of low model competency are shown in column 1 of Figures 2–7 for the lunar dataset and in Figures 8–13 for the speed dataset in Appendix A.”

“…misinterpret objects that do not exist in the image and/or are unable to identify the complete set of objects present in the image (illustrated in Figure 1 where one can see that the models are not able to recognize the person behind, and is incorrectly hallucinating the presence of a dog) [3, 13].”

“Rates of AI hallucinations are dif fi cult to estimate due to the heterogeneity of prompt queries and LLMs, and some accounts suggest the concern may be overstated (e.g., Bai et al., 2024).”

“…are very specific, retrieving a context-aware information from the super-sized, pre-trained model (treating as a Blackbox, without knowing the knowledge content inside and data sources) are most likely to provide wrong responses (which in industry’s term called Hallucination [13, 44]).”

“Still, if utilized, students must be cautious and critically evaluate the content generated by AI which often suffers from inaccuracy and even hallucination (Ji et al, 2023).”

“However, MLLMs still encounter significant challenges such as multi-modal hallucination [26], [27], [28], where generated text diverges from the provided multi-modal information.”

“Hallucination in multimodal and vision-language models has been studied as a mismatch between generated content and visual evidence [15], [16].”

“Despite the advancements, these models frequently suffer from hallucination (Huang et al., 2023; Bai et al., 2024), under-mining the faithfulness of their outputs (Zhu et al., 2024).”

“Furthermore, data hallucination and domain shift present inherent risks for data augmentation [42].”

“Although these failures have different causes, current models tend to answer by default, producing fluent but ungrounded responses, a common form of hallucination [3, 22, 34].”

“This question sits at the intersection of rapid progress in VLMs [Radford et al., 2021, Alayrac et al., 2022, Liu et al., 2023, OpenAI, 2023] and growing evidence that multimodal systems can hallucinate or over-trust misleading inputs [Li et al., 2023, Bai et al., 2024].”

“Among the many factors contributing to hallucinations (Bai et al., 2024; Huang et al., 2025), a critical factor lies in reinforcement learning with verifiable rewards (RLVR), a widely adopted post-training paradigm that typically assesses only the final output holistically.”

“Foundation models may hallucinate objects, semantic regions, or navigable connections [46], [47], making direct use of their predictions as action commands unreliable in partially observed environments.”

“These improvements show that ResOT improves object existence judgments across the three LVLMs. Results on CHAIR.”

“However, their reliable deployment in real-world applications requires solving the severe problem of hallucination [5, 17], where MLLMs confidently generate factually incorrect but grammatically plausible content.”

“VT-Attack (Wang et al., 2024), VEAttack (Mei et al., 2026b), and PA-Attack (Mei et al., 2026a) degrade performance with budgets as small as ϵ = 2 / 255 , and VEV-UAP (Kim et al., 2024) disrupts the model across many images with a single universal perturbation.”

“Despite these advances, they frequently generate content that is unsupported by the available visual evidence, a failure commonly referred to as hallucination Liu et al. (2024a); Bai et al. (2024); Lan et al. (2024); Rani et al. (2024); Li et al. (2023).”

“Multimodal large language models (MLLMs) have greatly advanced vision– language understanding and multi-step reasoning (Yin et al., 2024; Wu et al., 2024; Li et al., 2024b).”

“They hallucinate details inconsistent with an image, and recent work shows that benchmark quality substantially affects measured hallucination behavior [15, 16].”

“Despite these advances, recent studies show that MLLMs may generate fluent but visually inconsistent outputs, including object, attribute, relation and semantic hallucinations [5, 6, 25–28].”

“These effects may consequently increase the risk of semantically inconsistent or hallucinatory generation [12], [13].”

“Such issues can arise in the representation of the number of objects, visual attributes such as colors and materials, or spatial attributes such as object positions and relationships [27].”

“Hallucination studies often capture the failure symptom, while uncertainty-aware methods ask whether the system can detect the weak support before committing to an answer [32, 33, 36].”

“These issues are especially important because foundation models can generalize across tasks but also amplify reliability and governance risks [6, 5, 34].”

“This hypothesis has motivated contrastive decoding (VCD; Leng et al., 2024), instruction-based correction (ICD; Wang et al., 2024), and preference optimization (Zhao et al., 2023)—all targeting the same causal pathway: suppress the language prior, reduce hallucination.”

“Early fusion prepends projected visual tokens to the LLM input, as in LLaVA (Liu et al., 2023) and Qwen-VL2 (Wang et al., 2024).”

“Broader surveys on hal-lucination in multimodal large language models [3] further characterize hallucination along perceptual, factual, and reasoning axes, motivating the multi-granular approach central to CMVKG-Guard.”

“Moreover, due to limited geometric reasoning capabilities [10], [11], VLMs exhibit low accuracy in interpreting information such as knob orientations and scale positions.”

“However, their application to high-stakes engineering analysis is often hindered by reliability issues, such as object hallu-cination and high sensitivity to input formatting [25], [26].”

“Chief among them are visual hallucinations —the tendency of MLLMs to generate content not grounded in the visual input [2]—and spatial reasoning deficits , where models struggle to accurately interpret geometric, projective, and topological relationships between objects.”

“However, due to the static nature of pre-trained knowledge and limited domain-specific coverage, LLMs are prone to hallucination, generating misinformation by fabricating facts or citing non-existent sources [1, 12, 18].”

“A further concern is hallucination: the language model can emit plausible but wrong text alongside the segmentation token, yielding an inaccurate mask or one that references an absent object [109,110].”

“…domain, a different line of work has targeted hallucinations, the tendency of VLMs to generate plausible-sounding but factually unsupported statements [16, 27], proposing benchmarks for its detection in medical VLMs [5, 14, 37], often alongside broader trustworthiness dimensions such as fairness,…”