Hallucination of Multimodal Large Language Models: A Survey

“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”

“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”

“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”

“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”

“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”

“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”

“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”

“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”

“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”

“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”

“However, addressing hallucination [6] remains the most crucial aspect for LLM-based approaches.”

“Hallucination detection For sentences classified as parametric knowledge, we further assess whether they are factually accurate or hallucinated as LLMs are known to hallucinate (Huang et al., 2023; Xu et al., 2024b; Bai et al., 2024).”

“Contact: zifuw@cs.cmu.edu . of LVLMs in real-world applications where precise visual interpretation is essential [2, 3, 24].”

“However,LLMs’responses,whileoftenappearing fluentandplausible,maycontainmisinformationstemmingfrom hallucinations,outdatedinformation,andpromptinjectionattacks [4,40,105].”

“To combat the hallucination issues in LVMs, it is essential to develop comprehensive and accurate evaluation protocols.”

“Metrics Following prior work [3, 13, 33, 44, 47], we evaluate hallucinations on POPE dataset (using the test subset of our partition) using standard classification metrics: Accuracy , defined as the proportion of samples in which the model gives the correct answer regarding the presence or absence…”

“Recent analysis [3, 21, 62] indicates that this architectural design makes models prone to visual hallucinations, generating descriptions even when relevant visual information is absent.”

“As illustrated in Figure 2(b), these studies make fine-grained editing or annotations to the hallucinations (Huang et al., 2024; Bai et al., 2024) present in the text output of the language model, thereby obtaining factual training data ( i.e. , high-preference data) with consistent linguistic…”

“LLM-based methods, like CoML4VIS (Chen et al., 2024), leverage chain-of-thought prompting to generate visualizations (Comanici et al., 2025), but often ingest raw data directly, risking token limit violations, hallucinations, and failures on multi-source data (Bai et al., 2024; Chen et al., 2024).”

“While the flexibility and quality of these models is appealing, they may still hallucinate or give incorrect answers (Rawte et al., 2023; Bai et al., 2024).”

“Hallucination [1] affects the trustworthiness and reliability of LVLM for broad application.”

“Building on this foundation, subsequent research [36, 23, 1] has extended hallucination studies to the visual domain, examining whether visual-language models (VLMs) exhibit similar problems.”

“Prior analyses document weak visual grounding [11, 45], hallucinations [2, 9], and brittle use of chain-of-thought [33, 44], suggesting that benchmark accuracy can mask deeper vulnerabilities.”

“Detecting such hallucinations is thus essential for safe and reliable deployment of LVLMs, and has become an increasingly active area of research [14].”

“Hallucination in LVLMs occurs when generated outputs do not accurately reflect visual inputs, posing challenges to their reliability (Guan et al., 2024; Liu et al., 2024b; Bai et al., 2025).”

“To tackle this issue, previous studies propose various methods [3, 27], which can be broadly categorized into training-time and inference-time methods.”

“Hallucinations have been extensively studied in large language models (LLMs) [21, 48, 54] and large vision-language models (LVLMs) [4, 17, 27], but remain relatively underexplored in image-focused diffusion models.”

“This perspective stems from a crucial observation that while hallucinations arise from biased parametric knowledge, they manifest specifically during the processing of real-world visual inputs (Gunjal et al., 2024; Bai et al., 2024).”

“Previous research has examined the internal information distribution within these models (Basu et al., 2024), highlighted the limitations arising from pre-trained vision encoders (Tong et al., 2024), and investigated the issue of hallucinations in VLMs (Bai et al., 2024; Jiang et al., 2025).”

“Instruction followability is crucial across several key areas in AI, including reasoning (Yu et al., 2024), explainable AI (Arrieta et al., 2019), mitigating hallucinations (Bai et al., 2024), and AI alignment (Ji et al., 2023).”

“A prime example is the phenomenon of “confabulations” (or “hallucintations”) in large language models—responses that lack factual support, potentially leading to substantial harm if trusted (Bai et al., 2024; Weidinger et al., 2021).”

“The problem of hallucinations in LLMs has gathered significant attention [1, 13, 15, 39, 58].”

“There are various design choices of MLLM (McK-inzie et al., 2024; Tong et al., 2024; Wu et al., 2025; Liu et al., 2025a) in vision encoders, feature alignment adapters, and datasets.”

“Despite advancements of LVLMs, similar to LLMs (Huang et al., 2023a; Ji et al., 2023), they also suffer from hallucination (Dai et al., 2023b), a phenomenon that LVLMs occasionally generate outputs that appear reasonable but are inconsistent with the actual visual content (Bai et al., 2024).”

“Basu et al. (2024) apply causal intervention methods to understand the information storage and transfer in MLLMs. Tong et al. (2024) study the shortcomings of the visual encoder CLIP.”

“Despite their advanced image comprehension capabilities, MLLMs frequently exhibit hallucinations when converting visual inputs into textual outputs [2], which raises a natural question: Why not present the images directly instead of describing their content?”

“As a result, a bad action at test time can still be paired with a success-biased future [13, 14].”

“Even with perfect outcome narrations to choose from, VLMs are often overconfident evaluators [3, 18] which can undermine the quality of the policy steering.”

“Previous studies in the bimodal (text-image) setting have shown that the significantly stronger capability of text encoders compared to visual encoders results in dominant textual priors [4, 27].”

“…the distinctions that current models fail to capture—such as whether a tool is present, how many objects are in view, or the direction an object is facing—are trivial for humans, suggesting a fundamental mismatch between MLLM representations and the demands of fine-grained reasoning [4, 15].”

“Hallucinations in LLMs refer to instances where the generated responses, while grammatically correct, fluent, and plausible, deviate from the input or contradict factual information [21], [22].”

“On the model side, a series of Multimodal Large Language Models (MLLMs) (Wu et al., 2023a; Bai et al., 2024), such as BLIP-2 (Li et al., 2023a), LLaVA (Liu et al., 2023), have been built based on LLMs, demonstrating remarkable performance on vision-language tasks (Wang et al., 2020; Bai et al.,…”

“Despite their outstanding performance, LVLMs are significantly plagued by the issue of hallucination, i.e., generating content that appears plausible but contradicts the visual input [1]–[3].”

“∗ Corresponding authors. hallucinations [2, 10], which hinder their practical application in real-world medical scenarios.”

“In comparison to LLMs, research [40], [41] on hallucinations in LMMs has primarily focused on the inconsistencies between the generated text responses and the provided visual content, i.e., cross-modal inconsistencies.”

“However, studies such as [7], [8] have highlighted the significant challenge of hallucination in even the most advanced LVLMs, which substantially restricts their potential for practical applications.”

“Recent studies have demonstrated MLLMs’ vulnerability to various adversarial attacks that can trigger hallucinations (Bai et al., 2024), enable jailbreaking (Jin et al., 2024), and induce model misuse (Niu et al., 2024), making their security critical for real-world applications (Liu et al., 2025;…”

“Despite the advancements, the issue of “hallu-cination”, where the generated responses are not grounded in the input visual contexts, greatly impedes the reliability and practical deployment of LVLMs (Liu et al., 2024a; Bai et al., 2024).”

“Such data are counterfactual and can help in model debiasing [64], thus mitigating hal-lucination caused by LLMs’ parametric knowledge [5].”

“Furthermore, weak vision models have been linked to hallucinations in MLLMs, as highlighted by [Bai et al. , 2024].”

“Despite their success, a persistent challenge in LVLMs is the phenomenon of hallucination (Bai et al., 2024), where the model generates text that is factually inconsistent with the visual input.”

“Hallucination errors are most commonly associated with Natural Language Generation (NLG) and Large Language Models (LLMs), where they involve generating false or fabricated content Huang et al. (2025); Bai et al. (2024).”

“Finally, the released MCoT dataset provides a practical benchmark for diverse vision tasks, including hallucination evaluation and mitigation (Bai et al., 2025), enabling systematic comparison of hallucination-reduction strategies and advancing reliable MLLM reasoning.”

“To address this question, a growing line of work has explored post-training alignment techniques, such as supervised fine-tuning and reinforcement learning with human feedback (Bai et al., 2024; Sun et al., 2024; Tonmoy et al., 2024).”

“While the topic continues to be widely researched [2, 3, 4], existing research on large language model (LLM) hallucinations has mostly focused on object hallucinations, particularly in text [5], leaving some emerging questions understudied.”

“This raises concerns about VLMs’ reliability and applicability, indicating the need for mitigating such hallucinations [5].”

“Recently, new approaches have been proposed to address hallucination from data, model, training, and inference [131].”

“Extensive literature has explored inequities in LLM s and VLM s [15, 52].”

“Object Hallucination (OH) refers to the phenomenon where LVLMs generate text that, while semantically coherent, inaccurately represents the actual objects in the accompanying image [4, 20, 23, 26, 28].”

“Perceptual misinterpretations propagate downstream, leading to faulty reasoning and frequent hallucinations, although the final answer may occasionally still be correct [13–15].”

“LMMs also suffer from hallucinations, misinterpret intent (Bai et al., 2024; Liu et al., 2024a), and lack up-to-date knowledge.”

“While MLLMs’ hallucination and miscalibration problems are well known (Chen et al., 2025; Rohrbach et al., 2018; Bai et al., 2024), task instance-specific uncertainty quantification for MLLMs remains relatively underdeveloped.”

“Recently, numerous approaches have been proposed to mitigate multimodal hallucinations (Liu et al., 2024b; Bai et al., 2024), addressing this issue across three key stages: training, inference, and post-processing.”

“5-VL-72B (Bai et al., 2025a), prompted with zero-shot Chain-of-Thought (CoT); (2) Agent-based systems , including MDAgents (Kim et al., 2024), ReCon-cile (Chen et al., 2024), ColaCare (Wang et al., 2025b), and MedAgents (Tang et al., 2024).”

“They can also sometimes fail to follow instructions accurately [27, 5, 51, 49].”

“…patch-level alignment abilities, while our P Patch Aligned significantly enhances these two aspects. this training paradigm, recent works [12, 13, 14, 15, 16] reveal that these MLLMs still struggle with region-specific understanding and tend to hallucinate with irrelevant or incorrect information.”

“LLM hallucination is a broader well-known concern in the literature [8, 20, 32].”

“However, due to the generative nature of LLMs, current MLLMs often exhibit hal-lucinations—outputs that do not align with user intentions [1, 42].”

“Despite the remarkable advancements, MLLMs often experience severe hallucination problems (Yin et al., 2023; Leng et al., 2023; Huang et al., 2023; Zhu et al., 2024; Yue et al., 2024; Bai et al., 2024) by generating textual responses that are not aligned with the corresponding image contents.”

“With the progress of research on LVLMs, the problem of hallucination has gradually been exposed (Bai et al., 2024), and it has attracted more and more attention.”

“For instance, in one case, a horse’s color is incorrectly identified as black when it is actually white or light gray.”

“More recent hallucination survey compilation can be found in [Liu et al., 2024a; Bai et al., 2024b].”

“…typically refers to “object hallucination,” where the models generate plausible outputs containing objects that are either absent from or mismatched with the images [15, 19, 24, 38, 50], and is commonly categorized into three types: category, attribute and relation hallucinations [3, 49].”

“However, their tendency to produce hallucinations [9, 10, 11, 32], i.e. , generating responses that not factually grounded in the given image, undermines their reliability and practicality in real-world applications.”

“Different studies have explored the roots of hallucination [4, 26], showing that it arises not only from the generative tendencies of LLMs but also from weak vision grounding, modality misalignment, biased training data, and context-blind decoding strategies.”

“Hallucination in Vision–Language Models (VLMs) has been widely surveyed [12, 13], with several approaches proposed to mitigate its effects [14, 15, 16].”

“Recent research [2] identifies the root of hallucinations in noisy or corrupted training samples, eventually exacerbated by the addition of synthetic training data, as well as an imbalance in the frequency of certain entities appearing more often than others during optimization.”

“…in variational autoencoders (VAEs), posterior collapse can broadly account for hallucination in current multimodal models—many of which share structural traits such as encoder-decoder architecture, information capacity discrepancy between modalities, and powerful autoregressive decoders [24, 29].”

“Despite their impressive achievements, MLLMs are prone to severe hallucination issues [53, 69, 7, 67], where the model fails to correctly interpret input data and generates inaccurate or entirely fabricated responses.”

“As for multimodal LLMs, model output is sometimes inconsistent with corresponding visual input, which will present significant hurdles to practical implementation and raises concerns about reliability [25].”

“In Figure 9, the results reveal that Chain-of-Description enables MLLMs to capture richer and more detailed visual information across all six dimensions, whereas captions generated by the base LLaVA-Qwen2-7B-UHD often include inaccuracies, e.g., hallucinations [91].”

“…significant progress in image comprehension and depth reasoning (OpenAI, 2025; Zheng et al., 2025; Shen et al., 2025), existing MLLMs persistently suffer from multimodal hal-lucination (Bai et al., 2025), posing a critical gap for stable industrial deployment and everyday use (Magesh et al., 2024).”

“Recent work on multimodal safety has primarily focused on improving refusal policies [8, 9] or detecting harmful instructions [10, 11].”

“One major issue caused by this bias is hallucination [8, 9], where the model generates content that does not exist in the image.”

“Previous reviews have categorized multimodal model hallucinations into three types: object category, object attribute, and object relation [1] , with our work primarily focusing on the latter two categories.”

“However, despite their impressive versatility, LVLMs are confronted with a critical limitation known as “hallucination” (Zhou et al., 2023; Bai et al., 2024; Rawte et al., 2023; Huang et al., 2023), a phenomenon in which models generate text that appears semantically coherent, but contains content…”

“We adopt Qwen2-VL-7B [Wang et al., 2024] as the base model and use the LLaMA Factory [Zheng et al., 2024] platform to carry out the overall training process.”

“Despite these efforts, modern LVLMs struggle with real-world challenges due to their notorious hallucinations [2, 22] jeopardizing downstream reliability and safety.”

“However, their tendency to produce hallucinations [9, 10, 11, 32], i.e. , generating responses that not factually grounded in the given image, undermines their reliability and practicality in real-world applications.”

“To enhance efficiency in multi-camera traffic video analysis, merging overlapping information with unique details from each camera only once can significantly reduce the video-to-text conversion process.”

“However, recent studies [25], [31], [32], [33] reveal that most existing MLLMs tend to struggle in interpreting inter-object relations, as illustrated in Fig.”

“LVLMs are prone to hallucination issues as their output descriptions are often inconsistent with the input images and text instructions [16, 6, 5].”

“Additionally, these linguistic complexities also increase the likelihood of hallucination, where the model generates plausible but factually incorrect or irrelevant responses [10].”

“However, they still suffer from object hallucination [4, 22, 27], i.e., generating objects that are not present in the image, undermining their reliability and practical use.”

“Tong et al. [2024] show that state-of-the-art VLMs frequently fail on visual questions that humans answer trivially.”

“Despite achieving impressive performance across various multi-modal tasks, existing MLLMs are prone to hallucinations [15], where the model generates text that is factually inconsistent with the provided visual content, as shown in Figure 1(a).”

“They also risk hallucinations [3, 14, 29], such as prematurely stopping before enumerating all target objects or entering endless generation loops in dense-object scenes [50].”

“Object hallucination can be further categorized into three types: object category, object attribute (color, shape, or counting), and object relation (human-object interactions or relative positions) [4, 31].”

“This issue is exacerbated by the factual unreliability of underlying large language models (LLMs) (Huang et al., 2025; Zhu et al., 2024b; Pal et al., 2023), highlighting the urgent need for effective mitigation strategies (Kim et al., 2025; Bai et al., 2025).”

“…the quality of intermediate steps is critical, as the inherent randomness of diffusion models (Zhang et al., 2023a) and the hallucination phenomenon of large language models (LLMs) (Zhang et al., 2025b; Bai et al., 2024) inevitably introduce low-quality elements that can degrade the final result.”