Hallucination of Multimodal Large Language Models: A Survey

“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”

“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”

“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”

“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”

“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”

“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”

“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”

“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”

“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”

“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”

“2.1 M ULTIMODAL U NDERSTANDING Significant advancements in large language models (LLMs) (Touvron et al., 2023; Brown et al., 2020; Chowdhery et al., 2023) have inspired the development of multimodal large language models (MLLMs) (Li et al., 2024; Yin et al., 2023; Bai et al., 2024).”

“Curious readers may refer to [191] for a more comprehensive treatment of the subject.”

“The remarkable advancements of large language models (LLMs) motivate the research community to extend the foundational capabilities of LLMs to the visual domain, leading to multimodal large language models (MLLMs) [67, 4].”

“The alignment issue in multi-modal models arises from contextual deviation between modalities, leading to hallucinations [209].”

“Halluci-nation reduction has received great attention as one of the most prominent misalignment problems [4, 27, 46, 71].”

“…of hallucination, which typically results in the model generating statements about non-existent images while neglecting to mention certain visible objects, effectively causing it to fool itself (Bai et al., 2024; Liu et al., 2024a; Li et al., 2023b; Liu et al., 2023a; Rawte et al., 2023).”

“As for the hallucination of MLLMs, it can be mitigated using technologies similar to the general domain, from data, model, training, and inference perspectives [202].”

“This success extends to VLMs, where RLHF has been used to address hallucination issues [5, 39, 48, 61].”

“To address this challenge, a detailed survey [191] invsigated hallucination in MLLMs, reviewing its root causes, current evaluation benchmarks, and available mitigation strategies.”

“LVLMs has garnered significant attention as a major mis-alignment issue [12, 14, 55].”

“However, these methods often require increased inference time, obstructing their generalizability and scalability across diverse data domains and sizes (Bai et al., 2024).”

“CD-based approaches (Chuang et al., 2023; Chen et al., 2024b; Neo & Chen, 2024), represented by ICD (Wang et al., 2024) and VCD (Leng et al., 2024), adjust the decoding distribution to mitigate hallucinations in MLLM, but this does not consistently improve performance as it introduces potential noise into the CD. Comp…”

“Research in this field can be divided into two main trajectories [2, 25, 32].”

“For VLMs, recent works examine where visual information is stored [4], analyze hallucinations [3], and study spatial localization via logit lens [21, 33].”

“Many prior works explore mitigating this hallucination issue (Liu et al. 2024c; Bai et al. 2024) by introducing additional knowledge-enhancing data or tasks into the different training stages of MLLMs, including pre-training (Zhai et al. 2023), instruction fine-tuning (Chai et al. 2024b; Jain,…”

“Hallucination Mitigation in LVLMs. Hallucination – the generation of content that is irrelevant, factually incorrect, or inconsistent with visual inputs (Bai et al., 2024) – represents a fundamental challenge in LVLM development.”

“17,20,21,32 A response generated by a model in mirage-mode can be correct in every sense, accompanied by a meticulous reasoning trace, and completely coherent.”

“…(Lin et al., 2024a; Wu et al., 2024d), conventional prompting methods fall short of providing accurate visual grounding and referring to detailed visual information, which can cause visual hallucinations (Bai et al., 2024; Huang et al., 2024b) and language bias (Wu et al., 2024b; Qu et al., 2024).”

“Although LVLMs have shown significant capabilities on a range of multimodal tasks, they still suffer from inevitable performance bottlenecks due to hallucinatory interference [2, 8].”

“Factuality hallucination emphasizes the discrepancy between generated content and verifiable real-world facts (Bai et al., 2024).”

“As a result, without high-quality image-text data, models may overly rely on language priors, leading to hallucinations in their responses (Bai et al., 2024).”

“However, this enhanced multimodal capability of foundation models introduces additional problem points, including unique non-language hallucinations, which will require further research for safe clinical deployment (2,80,93).”

“We refer to readers for more comprehensive survey papers [43, 3] addressing hallucination in LMMs.”

“…mitigating undesired hallucinations by contrasting token predictions derived from original visual input with bias-inducing counterparts, such as no/distorted visual input (Favero et al., 2024; Leng et al., 2024), disturbed instructions (Wang et al., 2024), or premature layers (Chuang et al., 2024).”

“Despite their remarkable capabilities, SOTA reasoning language models often generate confident but factually-incorrect responses to questions, known as hallucinations [5, 31], similar to their non-reasoning counterparts.”

“Among the various hallucination issues [32], the challenge of identifying out-of-place questions is crucial for deploying LVLMs in safety-critical applications.”

“The causes of hallucinations in GANs are multifaceted [77].”

“Due to MLLMs’ well-documented tendency to hallucinate, especially under uncertain conditions [4], it is crucial to ensure that the models relies on their “familiar” forgery cues with strong discrimination for detection .”

“For instance, Bai et al. (2024) examines hallucinations due to incorrect access to parametric knowledge.”

“Mitigation strategies include improving data quality, enhancing vision models, refining decoding processes, etc. [49].”

“Additionally, by integrating causal reasoning into MLLMs, the models can better explain the relationships between variables, such as causes and effects, rather than simply identifying correlations (Xiong et al., 2024b; Jin et al., 2024b).”

“To explore whether core knowledge exists and how it is represented, structured, and used in MLLMs, we draw inspiration from developmental cognitive science and introduce the CoreCognition dataset, the first large-scale benchmark tailored for the assessment of core knowledge.”

“…some benchmarks integrate both discriminative and generative tasks to analyze the inconsistencies in hallucination behavior across different evaluation tasks (Wang et al., 2023; Jiang et al., 2024), which has not been sufficiently addressed in previous surveys (Lan et al., 2024; Bai et al., 2024).”

“Also, there is a surge of works (Bai et al., 2024) studying the hallucination problem of multimodal LLMs in visual description.”

“However, they remain prone to hallucinations and shallow visual reasoning [1–3].”

“Hallucination remains a significant challenge in MLLMs, where models generate information that is factually incorrect or irrelevant to the given inputs [3].”

“In addition, based on current research (Bai et al., 2024), Rein-forcement Learning from Human Feedback (RLHF) not only enhances the model’s ability to follow prompts but also helps LLMs reduce hallucinations.”

“Bai et al. (2024) highlight the growing importance of mitigating hallucinations in LVLMs, particularly in tasks involving complex interactions between visual and textual data.”

“Many efforts have been made to understand the causes of hallucination [1, 16, 30, 39, 50, 50, 53, 62, 64, 70, 71, 75, 92, 99].”

“The assessment of MLLMs [34] is mainly divided into two main categories: general capability [47, 70] and hallucination benchmarks [8].”

“While discriminative tasks, binary (Yes/No) questions targeting object, attributes, and spatial understanding, are also common, backtracking provides limited benefit in such settings, which have been noted to offer less diagnostic insight into VLM hallucinations [7, 39].”

“The term “hallucination” typically refers to situations where the generated responses contain information that is not present in the visual content [232]–[235].”

“Thus, these models often suffer from hallucination [64, 65, 66], especially in visual tasks where they produce seemingly plausible but incorrect outputs.”

“These meth-ods have demonstrated effectiveness in aligning LLMs with human preferences, particularly in mitigating hallucination, harmful outputs, and biased contents (Tonmoy et al., 2024; Bai et al., 2024; Al-lam, 2024; Li et al., 2024).”

“3) Hallucination in Linguistic-Based Models: Linguistic-based FMs can hallucinate by generating outputs that appear realistic but are not correct [343], [344].”

“VLMs is their tendency to generate hallucinations, producing captions that do not accurately reflect the visual content, particularly in tasks like visual question answering and image captioning [2,33].”

“Object Hallucination (OH) in Multimodal Large Language Models (MLLMs) is characterized by the generation of text that is semantically coherent yet inconsistent with the visual content of the provided image [4, 52].”

“…investigated hal-lucination in text generated by large language models (LLMs), identifying it as a prevalent phenomenon (Huang et al., 2025; Bai et al., 2024; Yao et al., 2023; Jiang et al., 2024; Maynez et al., 2020; Parikh et al., 2020; Ji et al., 2023; Mittal et al., 2024; Filippova,…”

“While our work significantly advances the state-of-the-art in training-free hallucination detection and grounding in LMMs, it has some limitations that provide exciting avenues for future research.”

“To address this issue, recent work has applied preference optimization to improve the alignment of modalities in MLLM [ Rafailov et al. , 2024; Naveed et al. , 2023 ] .”

“A. Eliminating the MLLMs hallucination with MXAI Current methods for mitigating hallucinations mainly involve recognizing patterns and penalizing overconfident to-kens using counterfactual samples [295], [296], [298], [331].”

“Based on experience, hallucinations caused by misidentification can be categorized into three types: type, property, and relationship [176].”

“…conducted to review VLMs (Du et al., 2022; Long et al., 2022), multimodal models 1 (Uppal et al., 2022; Xu et al., 2023; Liang et al., 2024), large multi-modal models (Yin et al., 2024; Caffagni et al., 2024; Wu et al., 2023) and hallucination issue in large multimodal models (Bai et al., 2024).”

“Intrinsic hallucinations stem from limitations in the model’s internal knowledge or representation [77], while extrinsic hallucinations arise from misinterpretations of external prompts or multi-modal inputs [11].”

“These cues help MLLMs focus on key image regions without altering model parameters, mitigating issues like visual hallucination (Bai et al., 2024) and language bias (Qu et al., 2024).”

“Despite their advanced image comprehension capabilities, MLLMs frequently exhibit hallucinations when converting visual inputs into textual outputs [2], which raises a natural question: Why not present the images directly instead of describing their content?”

“…et al., 2022; Jang et al., 2025), urban sensing (Zou et al., 2025; Yan et al., 2024c; Yan & Lee, 2024; Hou et al., 2025b), multimodal reasoning (Wang et al., 2024; Yan et al., 2025a; 2024a; Su et al., 2025b; Yan et al., 2024b), multimodal retrieval (Lin et al., 2024; Lu & Tang, 2025; Kagaya et…”

“How-* ever, these models inherently suffer from hallu-cination (Bai et al., 2024) and knowledge limitations (Caffagni et al., 2024), as their parametric knowledge is frozen after pretraining and cannot dynamically adapt to external information.”

“Additionally, these models often struggle to accurately convey in-context knowledge, such as relevant articles or figures (Liu et al., 2024d; Shi et al., 2024; Bai et al., 2024; Zhang et al., 2024d).”

“We defined these predicates by using a taxonomy of question-types from prior works on VQA (Antol et al., 2015) and multimodal hallucinations (Bai et al., 2024).”

“For VLM, hallucination refers to the phenomenon that the generated text responses are inconsistent with the corresponding visual content [2].”

“5 (Liu et al., 2024a), LLaVA-Next (Liu et al., 2024b), and Qwen2-VL (Wang et al., 2024), each with 7B parameters.”

“However, like LLMs, MLLMs also suffer from issues such as hallucinations and unreliability (Bai et al., 2024).”

“…at two scales, S ECOND accumulates object-relevant patches through patch selection strategy. nation—a phenomenon where models generate plausible yet inaccurate responses that are not grounded in the visual content—remains a persistent and critical challenge (Bai et al., 2024; Leng et al., 2024).”

“A common demonstration is that the generated responses contain information which is inconsistent with the visual content [1, 36, 55, 63].”

“…between visual and textual data is particularly problematic in medical AI systems that rely on both modalities for decision-making, as the model might prioritize one source of information over the other or attempt to reconcile contradictory inputs in ways that don’t reflect clinical reality [9].”

“On the one hand, prior works examine hallucination issues, which evaluates the discrepancy between generated responses and the visual content (Bai et al., 2024; Wang et al., 2023; Jiang et al., 2024).”

“Such knowledge is comparatively more susceptible to being misled, consistent with current findings in hallucination research (Bai et al., 2024).”

“To the best of our knowledge, only one study has applied uncertainty modeling to remove hallucinations in radiology report generation by using Monte Carlo dropout to estimate uncertainty at both the image and text levels, integrating these estimates into a novel loss function (Wang et al., 2024).”

“Similar to LLMs, MLLMs also suffer from hallucination issues [141], and these hallucinations can additionally occur in other modalities [267].”

“Answers that do not comply with the specified format or cannot be parsed due to model hallucination [4] are marked as wrong answer.”

“Studies identify two main forms of hallucination [1]: (1) omitting objects present in the visual input and (2) fabricating details that are not there.”

“However, these models often face challenges in modality alignment, leading to issues such as hallucination in MLLMs (Bai et al., 2024).”

“This phenomenon has been documented in recent evaluations of video language models [5, 20] and corroborated by multimodal hallucination surveys highlighting their vulnerability to dense or abstract visual patterns [1].”

“To address the unintended effects of unfaithful MLLMs, the causes of hallucinations have been explored [4].”

“This issue has increased focus on fact-checking and mitigating hallucinations across multiple modalities [1, 11, 23].”

“Many believe that the tendency of models to hallucinate is a substantial hurdle when it comes to ensuring their reliability in real-life applications (Bai et al., 2024; Chen et al., 2023; Jiang et al., 2024a, b; Liu et al., 2024a, b; Tonmoy et al., 2024; Wang et al., 2023).”

“This reasoning-aware design improves both transparency and utility [4, 26, 31].”

“However, LVLMs still suffer from serious object hallucination, i.e. , generating responses that are inconsistent with the visual input (S. et al., 2023; Z. et al., 2024; Huang Figure 1: A comparison of attention weights map be-tween Chinese and English query.”

“However, challenges such as hallucinations [8] and lack of fine-grained detail [33] persist.”

“…performance in scientific contexts, particularly when processing technical terminology and scientific visual elements like figures and tables (Li et al., 2024c; Lu et al., 2024; Yue et al., 2024; Hu et al., 2024a; Bai et al., 2024; Liang et al., 2024; Patil et al., 2024; Huang et al., 2024).”

“However, challenges such as hallucinations and weak image object discrimination abilities [7, 89] persist.”

“First, for instruction-following evaluation, they are notoriously poor at spatial reasoning Zhang et al. (2025b); Chen et al. (2024); Chang et al. (2025) and are prone to object hallucinations in existence, category, attributes, and relations Bai et al. (2024).”

“Hallucination, in this context, refers to instances where the model produces information that appears plausible but is factually incorrect or fabricated [3,12].”

“For example, in image captioning and visual question answering, hallucinations can lead to misinterpretation or incorrect descriptions of objects or scenes, posing significant concerns regarding the practical deployment of such models [18].”

“Hallucination in LLMs typically manifests as a discrepancy between generated content and actual facts, known as factual hallucination [1].”

“Most standard multimodal benchmarks focus on clear, definitive answers or partial hallucinations [68, 69] for discriminative [64, 70, 71] or generative tasks [30, 67].”

“…Text Paragraph Construction module and also demonstrated the robustness of our design across different MLLMs in Table 5, designing a more intuitive standard to measure and improve the quality of MLLMs (such as regarding hallucination [4]) is a worthwhile direction to be explored in the future.”

“To achieve this, it is essential to refine the generative reasoning process alongside the underlying factual knowledge representation, thereby mitigating hallucinations [10, 91] and semantic inconsistencies [247].”

“Despite their impressive performance, MLLMs often suffer from hallucination problems [6, 7], generating outputs inconsistent with the given image input or not relevant to the input textual prompt [8].”

“It is primarily associated with deviations between model-generated textual descriptions and actual visual feature regions of an image, making the output potentially misleading [20-21].”