Hallucination of Multimodal Large Language Models: A Survey

“In the realm of computer vision, object recognition is the core task, including sub-tasks such as object classification [60], detection [27], and segmentation [37], etc. Similarly, studies on hallucination in MLLMs primarily focus on object hallucination.”

“It first verifies that CLIPScore [88] can effectively distinguish between hallucinated and non-hallucinated sentences through a series of studies across different models and datasets.”

“During this stage, there are various options for training, such as fine-tuning LLM parameters in full [75], or using techniques like LoRA [41] to tune specific LLM parameters.”

“With these additional annotations, it further supervises MLLMs with mask prediction loss using a state-of-the-art expert vision model, SAM [57], guiding MLLMs to focus on highly-related image content.”

“To better align with human preferences, RLHF optimizes the LLM to generate outputs that maximize rewards provided by the trained preference model, often utilizing reinforcement learning algorithms like Proximal Policy Optimization (PPO) [93].”

“Recently, the emergence of large language models (LLMs) [29, 81, 85, 99, 132] has dominated a wide range of tasks in natural language processing (NLP), achieving unprecedented progress in language understanding [39, 47], generation [128, 140] and reasoning [20, 58, 87, 107, 115].”

“Specifically, inspired by denoising autoencoders [101], which are designed to reconstruct clean data from corrupted input, LURE [137] employs a hallucination revisor that aims to transform potentially hallucinatory descriptions into accurate ones.”

“However, CLIP has been shown to lose some visual details compared to pure vision models like DINO ViT [10].”

“During the instruction tuning stage, both machine-generated datasets [75] and human-annotated QA datasets [48, 59, 80] are utilized to enhance the model’s ability to comprehend and follow multimodal instructions.”

“(RLHF) [19, 84, 94] emerges as a notable approach for achieving alignment through reinforcement learning.”

“Nevertheless, they remain highly prone to hallucination in strabismus diagnosis, often producing conclusions that are inconsistent with visual evidence or misaligned with accepted clinical criteria [20], [21].”

“Unlike Visual Question Answering, where hallucination often refers to entities not present in the image or video [5], weakly-scripted social scenarios require evaluating subtler failures: interpretations that are poorly grounded in observable cues or that map those cues implausibly onto social…”

“Extending robustness to MLLMs is harder because attacks can target model behavior beyond label changes, including visual hallucinations [4, 24], factual inconsistencies [59], reasoning failures [60], and violations of alignment and safety constraints.”

“Recent deep generative learning models [9] may implicitly extract task constraint information; however, more direct incorporation of this information into the LfD process can reduce computational loads, increase the explainability of the results and avoid hallucinations [10].”

“MLLMs face challenges in accurately identifying the coordinates and positions of visual elements in images, where they are prone to hallucinations [9], [20].”

“[14].”

“Although these methods show strong adaptability and zero-shot *Corresponding author. generalization, they still suffer from semantic hallucination and insufficient visual grounding [12], [20], [21] .”

“Mitigating hallucinations has long been a major challenge in the development of LVLMs [5, 10, 15, 29, 34, 46, 52].”

“In image-to-text tasks, hallucinations might manifest either incorrect identification of disease symptoms or stress levels [9]; in text-to-image generation [10], they may produce anatomically or phenologically implausible plant structures [11].”

“Bai et al. [13] present a broader view on the phenomena of hallucination by providing a comprehensive overview of the hallucinations in multimodal large language models.”

“To further enhance the generalization and reliability of CCHD, we will explore: (i) combining multiple pivot languages and non-MT para-phrasers with adaptive selection; and (ii) extending evaluation to hallucinations produced by multimodal LLMs [20].”

“However, subsequent analyses [9, 22, 26, 28, 54] indicate that performance on such benchmarks can be confounded by linguistic priors limiting their ability to faithfully assess visual understanding.”

“I J C A However, these models frequently suffer from hallucinations [Rawte et al. , 2023; Bai et al. , 2024; Liu et al. , 2024], generating content that is inconsistent with or absent from the visual input, such as fabricating non-existent objects, misinterpreting spatial relationships, or…”

“LLMs, with their powerful contextual reasoning and decision-making abilities, offer a promising alternative to traditional, training-heavy approaches [29], [30].”

“2) De-Biased Motion Prototype Learning: It is well-known that MLLMs are susceptible to hallucination effects, yielding uncertain reasoning outcomes [51].”

“Due to a lack of internalized domain knowledge, these models[3, 5, 16] may generate seemingly plausible but factually incorrect explanations, known as hallucinations.”

“Hallucination in LVLMs denotes factually inconsistent or fabricated content [2].”

“Bai et al [12] also proposed an adversarial framework extract system prompts from commercial LLMs such as Claude, GPT-4, Bing, and ChatGPT, but this relies adversarial queries and multiple outputs, without addressing rewrite recovery or hybrid pipelines.”

“These constraints have been associated with modal decoupling [3]: phenomena where the generated response fails to align with the visual content.”

“1) Existing synthesized chart datasets often lack sufficient diversity and complexity (Wang et al., 2024).”

“Recent robustness benchmarks[2, 10, 38, 40] quantitatively validated that leading MLLMs experience precipitous performance degradation under extreme brightness conditions.”

“Furthermore, generative AI systems like ChatGPT carry the risk of hallucination problems, where they output incorrect information[1].”

“Hallucination in language models originated in unimodal LLMs, where it describes generated content that deviates from factual knowledge or user instructions(Huang et al., 2025; Yang et al., 2025; Bai et al., 2024).”

“Furthermore, the current systems are seldom able to learn about previous hallucinations so as to avoid future occurrences, and hence make the same mistakes each time some writing occurs [6].”

“Автори [9] підкреслили вразли-вість мультимодальних систем до явища «галюцина-цій».”

“Despite the impressive results, VLMs still face significant challenges in effectively aligning vision and language [59, 8, 37].”

“They offer broad semantic coverage, yet they often fail in the same way: premature commitment to a dominant, prior-driven interpretation, with complementary cues left unused (Bai et al., 2024; Leng et al., 2024; Lei et al., 2024).”

“In image captioning, special attention is paid to object hallu-cination, which is classified into three types: category hallucination, attribute hallucination, and relationship hallucination [25].”

“Despite these advancements, however, a critical limitation persists: current MLLMs exhibit a severe deficiency in fine-grained spatial understanding [1, 5].”

“Despite these advances, recent research increasingly highlight the limitations of MLLMs in reliability, factuality, explainability, and logical reasoning [5,14,25,34,54,65,74].”

“Finally, even flagship LLMs are prone to producing credible but semantically misleading hallucinations Bai et al. (2024).”

“Vision-language models are rapidly moving from lab systems to deployed assistants that interpret images and support real decisions, including in settings where errors can cause harm (Hurst et al., 2024; Bai et al., 2024; Helff et al., 2024; Zhou et al., 2024b; Huang et al., 2024; Li et al., 2025c).”

“Despite their sophisticated ability to process cross-modal input, MLLMs remain dependent on parametric knowledge, creating a knowledge-cutoff bottleneck and hallucination problems due to MLLMs prioritizing their internal knowledge over actual evidence [3, 4, 29, 56].”

“…zoryana@lute.lviv.ua) R. Zatserkovna is with the Lviv Polytechnic National University, 12 Stepan Bandera Str., 79013 Lviv, Ukraine (e-mail: rokso-liana.s.zatserkovna@lpnu.ua) but factually incorrect descriptions of objects, attributes, or relationships that do not exist in the source image [2].”

“However, to mitigate the risk of MLLM hallucinations [8], a method for measuring label quality is necessary.”

“Besides, Bai et al. [12] have proved that the use of multimodal large language models in segmentation can be through the improved contextual understanding, while the implementation of pure transformer approaches in the medical image analysis area like SwinUnet [13] has been evidenced.”

“However, how to keep long-chain multimodal reasoning grounded in task-critical visual evidence remains underexplored.”

“Recent studies highlight multimodal hallucination as a growing problem, particularly when overlapping cues between modalities obscure factual errors [9, 10].”

“Bai et al. [14] examine hallucinations in multimodal LLMs, noting that although they inject spurious content, they also generate high creative novelty beneficial in application areas such as design thinking and art.”

“Our systematic analysis reveals four common categories of erroneous QA pairs, which we refer to as follows: • (E1) Incorrectly Visually Grounded (19/100): questions or answers that exhibit mismatches between textual claims and the visual evidence [4], e.g., misreading chart values (Fig.”

“However, a core challenge for these models is Object Hallucination (OH)[3], where the model outputs objects that are not present in the image, or incorrectly describes object attributes and relationships.”

“Existing research primarily attributes these failures to cross-modal misalignment , typically investigating scenarios where textual prompts conflict with visual content [4, 9].”

“Object hallucinations occur when models incorrectly classify an object’s category, attributes, or its relationship with other objects and are usually studied in image captioning and VQA tasks [4], [5].”

“Generated captions from MLLMs are inherently susceptible to visual inaccuracies, including category and attribute hal-lucination [26, 27].”

“In spite of such an advancement, the MLLMs are burdened with severe issues such as hallucination, complexity of computation, and the issues of cross-modal alignment which greatly limits their practical application [4].”

“Due to the imbalance in model capacity and data scale between modalities during pretraining, VLMs often exhibit a bias toward language priors, which can lead to hallucinations—fluent yet visually inconsistent or factually incorrect outputs (Bai et al., 2024; Huang et al., 2024; Leng et al., 2024).”

“In large language models (LLMs) and vision– language models (VLMs), hallucination has been extensively studied because it undermines trust, factuality, and reliability, leading to a rich body of surveys and evaluation methods [8, 1, 3, 13, 14, 5, 11, 2, 9].”

“It becomes a critical concern in modern machine learning with the widespread deployment of large-scale generative models across language, vision, and multimodal domains [Ji et al., 2023, Liu et al., 2024, Bai et al., 2024, Kalai et al., 2025].”

“…BLIP [13]) with Large Language Models (LLMs), allowing them to generate semantically rich descriptions and multi-step inferences across modalities [4] However, despite their advancements, LVLMs often hallucinate non-existent visual content due to intrinsic model errors or succumb to external…”

“…LVLM systems, key metrics include: • CHAIR (Caption Hallucination Assessment with Image Relevance), which quantifies hallucination in generated reports using instance-level (CHAIR I ) (Eq.1) and sentence-level (CHAIR S ) (Eq.2) analysis by comparing outputs with ground-truth annotations [41], [42].”

“Comparative studies are the most traditional way to measure the effectiveness of RAG; they compare models with RAG to models without RAG based on a variety of metrics [8].”

“Instead, it often arises from the model’s misinter-pret or neglect crucial information from different modalities(Huang et al. 2024; Bai et al. 2024).”

“To address this, strategies include fine-tuning with high-quality data, robust evaluation frameworks, and integrating explainability mechanisms to ensure accuracy and patient safety [42, 43].”

“…of MLLMs is significantly constrained by the persistent challenge of hallucination, a phenomenon wherein models generate assertions about non-existent visual content while omitting critical descriptions of actually present objects, thereby propagating self-deceptive outputs [8, 9, 10, 11, 12].”

“Despite these advancements, effective MLLM deployment remains hindered by critical reliability issues, particularly inconsistencies with clinical reality [11], [12].”

“Moreover, because the LLM lacks direct visual grounding, ambiguities in the prompt or mistaken labels can lead to “halluci-nated” details or incomplete scene descriptions [4].”

“However, MLLMs are known to generate incorrect or inconsistent descriptions [2], such as misassigning body part movements or fabricating transitions that do not exist in the input images.”

“Hallucinations as a research topic have recently received attention in NLP, with Large Language Models (LLMs) producing unfaithful and inaccurate outputs, despite their sheer size in terms of trainable parameters and training data volume [29, 55, 44, 2].”

“D ESPITE advancements in Large Vision-Language Models (LVLMs) [1], multimodal hallucination [2] continues to be a persistent challenge.”

“…has precipitated a critical research challenge: the Tonmo et al. [4] Rawte et al. [12] Zhang et al. [13] Huang et al. [14] Bai et al. [15] Jiang et al. [16] Rawte et al. [17] Mathematical Formalization emergence of hallucinatory phenomena that exhibit escalating prevalence across…”