Hallucination of Multimodal Large Language Models: A Survey

“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”

“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”

“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”

“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”

“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”

“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”

“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”

“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”

“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”

“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”

“Despite the rapid advancements in alignment research [103, 104] Extract semantic representations { e ki } for all samples X k ∈ D ( t ) using f i ( · ) .”

“It is important to acknowledge that large language models can sometimes experience hallucinations [31], and multimodal large language models are no exception [1].”

“LMM Hallucination Detection [7, 33] aims for detecting either context-misfollowing [32] or factual mistakes [3] in generated multimodal reponses.”

“Despite these achievements, MLLMs still suffer from hallucination, where models generate content inconsistent with visual inputs, such as describing nonexistent objects, incorrect attributes, or implausible relationships [3, 35].”

“Accurate attribution in chart-related tasks is crucial for ensuring that multimodal large language models (MLLMs) generate reliable and trustworthy outputs (Bai et al., 2024).”

“Despite these advancements, modern LVLMs continue to face significant security and robustness challenges, notably object hallucination [10].”

“Despite these striking capabilities, recent work on probing the workings of MLLMs have begun to uncover significant limitations in how current MLLMs integrate visual information [3, 12, 20].”

“These focus on the consistency of the model’s descriptions with the object categories, color and shape attributes, and positional relationships depicted in the images [4].”

“Visual information might be ignored in favor of textual priors, or conversely, textual instructions might be overwhelmed by visual content associations [64], [65].”

“Hallucinations in foundation models is a well-documented phenomenon [36].”

“As a result, it will cause the hallucination problem (Bai et al., 2024; Rawte et al., 2024; Wu et al., 2024a,d) due to the strong language prior inherent in the back-bone LLMs.”

“High-resolution input images inherently provide enriched detail and intricate object relationships, which are essential for mitigating hallucination issues [7, 37, 103] and enhancing fine-grained perception tasks [33,34].”

“However, MLLMs are known to suffer from hallucinations[4, 15, 21, 35], which means the models generate responses that do not align with the corresponding visual content.”

“Presently, all LVLMs experience visual hallucination issues [24], [25], often producing answers inconsistent with image content.”

“However, these models are prone to object hallucination—the generation of text describing non-existent objects or attributes not grounded in the visual input [1, 16].”

“Similarly, it suffers from several critical issues inherent to current MLLMs, such as hallucinations [2, 5, 17], where they may perceive objects or phenomena that are not actually present in the image, leading to inaccurate scores.”

“For instance, these models are prone to generating hallucinated content [4, 30, 56, 59] or providing responses that do not fully meet user expectations.”

“…factual halluci-nations—outputs that appear plausible but are fac-tually incorrect (Favero et al., 2024; Rawte et al., 2025; Sahoo et al., 2024; Bai et al., 2024), struggling with outdated knowledge for time-sensitive question answering (Siyue et al., 2024; Wu et al., 2024; Uddin et al.,…”

“This taxonomy is adapted from prior work on LLM reliability and hallucination research [16,54].”

“This limitation may be attributed to inherent hallucinations in its knowledge base and insufficient visual reasoning capabilities [7, 36, 37].”

“Despite this progress, they remain vulnerable to object hallucination (Li et al., 2023c; Bai et al., 2024; Rohrbach et al., 2018): the model produces fluent, plausible content that is simply not supported by the image.”

“However, VLM judges suffer from well-documented limitations: hallucinations are pervasive across large vision-language models [26, 3, 19], with studies showing that even GPT-4V fails on basic visual patterns [34] and that statistical biases and language priors cause systematic object hallucinations…”

“Embodied agents frequently produce textually plausible responses that are inconsistent with the observed 3D scene, such as affirming the presence of nonexistent objects or misidentifying those that are present [3, 17, 18, 37].”

“In the context of natural images, we focus on hallucination [5, 37], the generation of answers unsup-ported by the image, and define “negative queries” as those asking about non-existent image content.”

“Nevertheless, their broader practical deployment remains hindered by the issue of hal-lucination , [5, 16, 25] which is prevalent even in the most advanced LVLMs.”

“However, challenges such as hallucinations (Bai et al., 2024), trustworthiness issues (Liu et al., 2024b), and inherent limitations in emotional perception can lead to inaccuracies in the extracted emotions.”

“Mitigating Hallucinations in MLLMs. Efforts to mitigate hallucinations in MLLM can be categorized into two main directions: training-related and inference-related work (Bai et al., 2025a).”

“In vision-language models, hallucinations [Bai et al. , 2024] refer to scenes where the generated output does not align with the input image.”

“Despite recent advancements in simpler tasks such as captioning and basic visual question answering (VQA), MLLMs continue to struggle with complex tasks, including hallucination [16], model interpretability [17], [18], reasoning [19], and knowledge-intensive VQA [8].”

“This means that a model may “understand” a concept but fail to provide a “correct” response (Bai et al., 2024).”

“The RED text shows the deviation from the ground-truth answer of the question—“There are 3 bird-like creatures in the image.” and inference-related methods [12].”

“To mitigate hallucination errors, domain-specific fine -tuning like Gemini-Pro-Vision 1.5 [33]and Llava [34] reduces hallucination errors, improving zero-shot accuracy on the SHRP2 NDS dataset [35].”

“Despite their versatility, a critical limitation persists: MLLMs may generate outputs that contradict obvious factual evidence or misrepresent visual inputs, known as the hallucination problem [9, 10, 11, 12].”

“As a result, it will cause the hallucination problem (Bai et al., 2024; Rawte et al., 2024; Wu et al., 2024a,d) due to the strong language prior inherent in the back-bone LLMs.”

“Evidence–Hypothesis Consistency Checking Although the Hierarchical Perceptual Solver generates an initial verdict y t with a confidence score s t , this preliminary result may still contain conflicts or hallucinations [4,65].”

“Multimodal Large Language Models (MLLMs) often produce hallucinations, which means generating descriptions or answers that are not grounded in the input image [2,14].”

“Current mitigation strategies generally fall into training-time alignment (Bai et al., 2025; Liu et al., 2024a) or inference-time intervention (Leng et al., 2024b; An et al., 2025; Li et al., 2025; Fazli et al., 2025).”

“If more than three captions are provided, captions [4] onwards are refined views with higher quality.”

“Visual Design Automation Recent advances in multimodal foundation models [3, 4, 16, 28] have driven significant progress in automating various visual design tasks.”

“…assessments, they fall short in several ways: they are poor at spatial reasoning [6, 7, 9, 35, 61], prone to hallu-cinating objects and attributes [2], insensitive to subtle pixel-level changes [47] (e.g., fine structures or small attribute shifts), and miscalibrated for artifacts and aesthetics…”

“These benchmarks are central for multimodal grounding, but most are single-scene evaluations and hence do not test hallucinations under a temporally evolving latent state [1].”

“This phenomenon can be regarded as a hallucination (Chu et al., 2024; Bai et al., 2024) of the video generation model, or as evidence of the lack of underlying physical knowledge (Lin et al., 2025; Bansal et al., 2024).”

“Prior work has largely examined visual hallucinations (e.g., recognizing objects or actions not actually present) [3, 4], but audio hallucinations, where sound descriptions conflict with the actual audio and instead follow visual cues, remain underex-plored, particularly in first-person…”

“MLLMs are prone to generating content inconsistent with visual evidence [2,14,20,27,57,60].”

“Compounding this, traditional RL strategies often relegate visual input to a static backdrop, neglecting the dynamic degradation of visual anchoring during generation [59].”

“For Qwen2VL series, we show performance on different generations ”-2VL” and ”-2.5VL” in Fig.”

“This phenomenon exposes a critical insight that severely limits VLM deployment in high-stakes domains Ji et al. (2023); Li & Wang (2026); Bai et al. (2024); Li et al. (2024); Wang et al. (2025b): hallucinations are rarely monolithic errors that can be diagnosed by a single metric like “accuracy” or…”

“…remarkable capabilities across diverse tasks [54], yet their tendency to generate factually incorrect content—commonly referred to as hallucinations—poses critical challenges for deployment in high-stakes domains such as healthcare, legal reasoning, and financial analysis [8, 27, 34, 35, 37].”

“Hallucination definitions in the Large Vision-Language Model (LVLM) : Hallucination in LVLM denotes a disagreement between factual content of images and corresponding generated textual content, akin to the solely textual hallucination encountered in large language models [73, 74].”

“Models describe objects or facts that are not in the image [7], [8], [9].”

“However, despite their impressive reasoning ability, medical MLLMs remain susceptible to hallucinations , i.e. , responses that contradict the visual facts grounded in the image [5, 27].”

“The reasons for the occurrence of hallucination phenomenon [9], [10] can be categorized into three aspects.”

“For all methods, we select the top-scoring video and evaluate against human annotations. supporting our design choice of factual correction with text-based verification, consistent with recent findings that text-based measures are more reliable than direct VQA [3, 7].”

“Their reliance on global visual understanding can lead to errors in fine-grained text recognition and spatial disambiguation [5].”

“The issues of hallucinations (Bai et al., 2024; Rohrbach et al., 2018; Li et al., 2023b) often cause MLLMs to output content that is inconsistent with visual input, severely undermining their reliability.”

“Since users often select multiple phrases for single class, the encoded vectors are averaged to initialize the continuous text vector representation, thereby capturing the comprehensive semantic attributes of the target class.”

“However, alongside these rapid advancements, a concerning issue has emerged: these models tend to generate hallucinations (Li et al., 2023b; Liu et al., 2024; Zhou et al., 2023), content that appears plausible but is factually incorrect or unfaithful to the input (Bai et al., 2024).”

“This “specious” behavior – whether an inevitable artifact of the model’s optimization process or an unintended hal-lucination (Banerjee et al., 2024; Bai et al., 2024) – poses a significant challenge, often outpacing the ability of human judgment to accurately assess the fidelity and truthfulness…”

“Despite these remarkable achievements, the generative nature of LLM simultaneously raises the challenge of hallucination (Huang et al., 2023b; Bai et al., 2024).”

“First, LLMs and VLMs continue to hallucinate [6, 16], mis-follow instructions [24, 27], and struggle with long or multimodal contexts [7, 40], making it difficult to recognize nuanced deception.”

“Existing models frequently generate conclusions that either conflict with the visual evidence or contradict their own reasoning chains [3].”

“Yet they still hallucinate, i.e., produce answers inconsistent with the visual content (Li et al., 2023; Tong et al., 2024; Wu & Xie, 2024; Bai et al., 2024; Chen et al., 2026).”

“These include severe hallucinations, such as confidently describing non-existent objects [6, 7], and vulnerability to visual jailbreak attacks that bypass safety alignment [8, 9].”

“…hallucinations manifest as a multifaceted divergence from visual reality, where models may confidently assert the presence of non-existent objects, mischaracterize attributes such as size or color, or even fabricate complex spatial and semantic relationships that lack any pixel-level basis 4 .”

“Second, the long-tail problem caused by frequently occurring objects [7–9].”

“These issues remain a well-known obstacle to deploying LVLMs in tasks that demand precise visual perception [6, 28, 49, 74, 79, 98].”

“3) Multimodal hallucination further compounds these difficulties Bai et al. (2024); Sung-Bin et al. (2024); Xing et al. (2026a).”

“While treating the CAPTCHA image as a single UI element might suggest a misinterpretation of its attributes (PH.3), viewing it as a raw image reverts the scenario to a classical VLM object detection failure [66].”

“Visual hallucination in MLLMs primarily manifests as cross-modal inconsistency between generated textual outputs and visual inputs [7, 11, 18, 34, 42, 48].”

“LVLM hallucinations arise from multiple factors [2, 19, 22, 30, 39, 46].”

“Despite these advances, MLLMs still struggle with insufficient visual perception capabilities [11, 45], often resulting in incorrect answers or hallucinated explanations [5, 15, 22, 42].”

“Further, we evaluate various MLLMs on MM-DeceptionBench and find that while human evaluation remains prohibitively expensive at scale, existing MLLM-as-a-judge (Zheng et al., 2023; Gu et al., 2024) exhibit critical limitations (Section 5.2).”

“This imbalance between linguistic reasoning and perceptual understanding has been repeatedly observed across recent evaluations, which report limited grounding fidelity and reduced robustness on fine-grained or localized visual reasoning benchmarks [4, 35, 61].”

“Large vision-language models (LVLMs) (Bai et al., 2025; Zhang et al., 2023), which extend LLMs with visual inputs, also exhibit hallucinations—typically manifesting as mismatches between gen-2 erated text and visual content.”

“While plausible in terms of linguistic structure, concerns about hallucinations amplify their development alongside factually flawed issues and encourage anthropomorphism (Bai et al., 2024).”

“…(2025a); Yang et al. (2025), contrastive decoding Wu et al. (2025c); Zhang et al. (2025), and intermediate-layer modification Jiang et al. (2024; 2025); Wang et al. (2024), relation hallucination, which accounts for nearly 40% of all hallucinations Zheng et al. (2024), remains a salient challenge.”

“Our method, called multimodal reward-guided decoding (MRGD), employs two reward functions, one tailored for hallucination reduction [3] and one tailored for improving object recall.”

“Comprehensive surveys have addressed hallucination within AGI, particularly in nascent multimodal settings, offering overviews of current efforts and identifying promising avenues for future research to mitigate such issues in advanced AI systems [30].”

“A recent survey [2] categories the hallucinations in VLMs, in particular, object-related hallucinations into the following groups: 1) category , where the VLM identifies incorrect or non-existing objects in the image; 2) attribute , where wrong descriptions such as color and shape for the given…”

“LVLMs relying solely on textual inputs exhibited two key limitations: visual hallucinations [6,23] and language-driven biases [47,64].”

“Despite these capabilities, VLMs remain prone to hallucination , producing confidently stated but incorrect content [3, 14, 30].”

“Hallucinations are categorized into two types: factual hallucinations, where the generated content contradicts real-world facts, and faith-fulness hallucinations, where the content deviates from the input or lacks internal consistency [51].”

“General domain MLLMs may produce incorrect responses or complete hallucinations, which are not allowed to appear in medical domain [7].”

“However, LVLMs continue to struggle with persistent hallucination issues [10, 11], often exhibiting incorrect references to visual content [12, 13, 11].”

“We collect a large amount of open-source data, spanning datasets that focus on a specific task and data collections for prior open-source works (Laurenc¸on et al., 2024; Lu et al., 2024b; Tong et al., 2024; Li et al., 2024b).”