PreprintCited by 0Adversarial Robustness in Machine LearningMisinformation and Its ImpactsTopic Modeling

MIRAGE: Defending Long-Form RAG Against Misinformation Pollution

Open access
Eletter, Saadeldine, Zeng, Ruihong, Wang, Yuxia, Panov, Maxim, Rubashevskii, Aleksandr, Nakov, Preslav·2026·arXiv

Abstract

Retrieval-Augmented Generation (RAG) improves factuality by grounding LLMs in external evidence, but real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabrications. We introduce MIRAGE, a training-free, model-agnostic defense for long-form RAG. MIRAGE builds an NLI-based cross-document claim graph and applies a Defended-Claims Gate to either condition generation on a consistent, multi-source supported subset or to block retrieval and answer parametrically. We also release a minimal-edit pollution protocol spanning four perturbation families (Unambiguous, Conflicting, Misleading, Fabricated) to construct matched clean, mixed, and fully polluted evaluation regimes. Across four long-form QA benchmarks and multiple commercial and open-weight LLMs, pollution severely degrades vanilla RAG, while MIRAGE consistently restores factuality under mixed and fully polluted evidence and outperforms prior robust-RAG methods. Our implementation and datasets are available at https://github.com/SaadElDine/MIRAGE.

AI snapshot

Written from the paper’s full text.

TL;DR

MIRAGE is a training-free, model-agnostic defense for long-form RAG that builds an NLI-based cross-document claim graph and uses a Defended-Claims Gate to either generate from a consistent, multi-source supported subset of claims or block retrieval and answer parametrically. Across four long-form QA benchmarks and five LLMs, it restores factuality under mixed and fully polluted retrieval and outperforms prior robust-RAG methods.

Key findings

  • Retrieval pollution severely degrades vanilla RAG: averaged across four datasets and five backbones, GPT-4o-mini drops from 53.88% under mixed pollution and 39.87% under full pollution, versus 85.32% clean RAG and 75.88% No-RAG; MIRAGE reaches 83.43% under mixed and 78.00% under full pollution.
  • MIRAGE improves over strong robust-RAG baselines under pollution: on LongFact with GPT-4o-mini under full pollution, MIRAGE scores 88.93% versus 74.87% for the strongest baseline; with Qwen3-8B, 85.11% versus 66.41%.
  • The gate passes 87.2% of clean queries on average, drops to 48.6% under mixed retrieval, and blocks nearly all fully polluted queries (0% pass).
  • Ablations show each component contributes: removing counter-evidence probing drops average F1 from 83.43 to 71.04 under mixed pollution and from 78.00 to 74.05 under full pollution; removing all trust criteria drops to 69.61 and 47.65, respectively.

Methods

  • Design: MIRAGE wraps a standard retrieve-then-generate pipeline. It extracts sentence-level claims from top-k passages, builds a directed weighted graph using cross-source NLI support/contradiction edges plus counter-evidence probing, prunes to a consistent defended set, and gates retrieval based on contradiction ratio and source diversity. If the gate passes, generation is conditioned on verified claims; otherwise retrieval is blocked and the LLM answers parametrically.
  • Data and sample: evaluated on four long-form QA benchmarks—LongFact, FAVA, AlpacaFact, and Biography—with GPT-4o-mini, GPT-5-mini, LLaMA-3.1-8B, Mistral-7B-Instruct-v0.2, and Qwen3-8B. Retrieval uses top-k=20 passages from a cached dataset-specific evidence pool; pollution is generated by GPT-4o-mini via a minimal-edit protocol with four families (Unambiguous, Conflicting, Misleading, Fabricated) and three regimes (Clean, Mixed 50% polluted, Fully Polluted 100%).
  • Analysis: factuality is measured with VeriScore F1@k (median over prompts); NLI uses DeBERTa-large-MNLI. Gate thresholds are selected offline on held-out 20% splits without invoking the generator. The paper also reports ablations, retrieval-depth sensitivity, NLI-label validation, VeriScore-label validation, and runtime/cost diagnostics.

Limitations

  • Stated: MIRAGE inherits the coverage and diversity of retrieved evidence; low recall or limited source diversity can produce sparse graphs and more conservative blocking, yielding safer but less informative answers.
  • Stated: NLI-based consistency and lexical-overlap filtering are efficient approximations and can miss paraphrastic or omission-based misinformation; coordinated misinformation repeated across sources may appear trustworthy; the training-free modular design may limit adaptation to some domains or languages; and MIRAGE adds local NLI computation for graph construction and counter-evidence checks.
  • Evident from the text: evaluation relies on synthetic minimal-edit pollution generated by GPT-4o-mini and on VeriScore/NLI proxies, with domain trust assigned by heuristic URL/TLD rules; the benchmarks are prompt-only with cached web evidence rather than naturally occurring polluted retrieval.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2607.05069

Cites

0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

10 of 23 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Long-form question answering relies heavily on retrieval-augmented generation to generate comprehensive and factual responses.

    “Long-form Question Answering relies heavily on Retrieval-Augmented Generation (RAG) to generate comprehensive and factual responses (Wei et al., 2024;Chen et al., 2025).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Wei et al., 2024 source

      The LongFact description (section label ✘; page unavailable) says its questions require long-form responses containing multiple detailed factoids. Related work (section 7; page unavailable) mentions evaluating responses from a RAG system, but the paper does not say that long-form question answering relies heavily on RAG to produce comprehensive, factual answers. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites Chen et al., 2025

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    Real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabrications.

    “real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabrications.”
    • Also stated in: § 1 Introduction · plain
      “In practice, knowledge bases and web indices are noisy environments, containing not just irrelevant documents, but polluted evidence, which are plausible sounding texts that contain subtle fabrications, entity swaps, or incorrect temporal attributions (Pan et al., 2023;Zeng et al., 2025).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Pan et al., 2023 source

      Section 4.4 reports that fabricated, semantically relevant passages were likely to be retrieved in the paper’s misinformation-pollution experiments. But Section 6 describes the research as primarily simulation-based and forecasts a real-world threat; it does not establish that real-world retrieval is often polluted or specifically document misleading framings. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • cites Zeng et al., 2025

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    Current LLMs exhibit a sycophancy bias towards retrieved context, often propagating errors into the final answer with high confidence.

    “Current LLMs exhibit a “sycophancy” bias towards retrieved context, often propagating these errors into the final answer with high confidence (Perez et al., 2023).”
    • Also stated in: § Robustness Against Noisy, Conflicting, and Misleading Evidence. · plain
      “Recent work shows LLMs can over-trust retrieved context (“sycophancy”), propagating plausible misinformation (Zeng et al., 2025).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Perez et al., 2023 source

      Section 4.2 (p. 7) finds that larger models tend to repeat a user's stated views, supporting the claim that they can be sycophantic. The paper tests agreement with users, not deference to retrieved context; the cited passages do not establish that models propagate errors from retrieved material into final answers with high confidence. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • cites Zeng et al., 2025

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisenone given

    All four long-form benchmarks used (LongFact, FAVA, AlpacaFact, Biography) are prompt-only, i.e., questions without an accompanying gold evidence set.

    “All four benchmarks are prompt-only (questions without an accompanying gold evidence set).”
    Quote in the paperSubstantial claim3 of 3 sources checked
    • cites Wei et al., 2024 source

      Section 2 describes LongFact as a set of question prompts, supporting that part of the claim. The paper does not establish that FAVA or AlpacaFact are prompt-only; its Related work section instead says biography prompts are evaluated against each person's Wikipedia article, so it does not support the claim for all four benchmarks. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites Mishra et al., 2024 source

      The Source prompts section (page unavailable) describes four sources of queries for FAVABENCH, not the four named benchmarks. Searches for LongFact, AlpacaFact, and gold evidence sets found no passage establishing that all four benchmarks are prompt-only. The paper’s discussion of retrieved evidence for FAVA does not settle whether those benchmarks provide gold evidence. (LLM, conf=0.72)

      Experimental — accuracy not yet measured
    • cites Dubois et al., 2023 source

      Sections 4.4 and 5 describe AlpacaFarm’s evaluation instructions and benchmark its reference methods, but do not characterize LongFact, FAVA, AlpacaFact, or Biography. Searches for those benchmark names, “prompt-only,” and “gold evidence set” found no passage establishing whether the four benchmarks include gold evidence. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Findingown data

    Under mixed and especially full pollution, vanilla RAG degrades sharply and often falls below No-RAG.

    “Under mixed and especially full pollution, vanilla RAG degrades sharply and often falls below No-RAG”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 43
  • May combine two claims. 60
  • The quote only partly states this claim. 3
  • Classified as probably not a substantial claim.

    Study design and conductcitation

    The authors evaluate factuality with VeriScore F1@k (median over prompts), which decomposes each generated answer into claims and uses a verifier to label each claim as supported, unsupported, or insufficient given evidence snippets.

    “We evaluate factuality with VeriScore (Song et al., 2024) F1@k (median over prompts), which decomposes each generated answer into claims and uses a verifier to label each claim as supported, unsupported, or insufficient given evidence snippets (Wei et al., 2024); see Appendix E.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Song et al., 2024 source

      Sections 2.2–2.4 describe extracting claims, checking them against retrieved evidence, and calculating F1@K. But §2.4 defines VeriScore as the average F1@K across prompt responses; the median sets K from the number of extracted claims, not the score over prompts. Section 2.3 says the final verifier combines contradicted and inconclusive cases into one unsupported category, rather than using the three labels stated in the claim. Page numbers were not available in our copy. (LLM, conf=0.91)

      Experimental — accuracy not yet measured
    • cites Wei et al., 2024 source

      The SAFE section describes breaking responses into individual facts and using search results to judge whether each is supported. But its labels are supported, not supported, and irrelevant—not supported, unsupported, and insufficient. The paper’s benchmarking table also says its metrics are averaged over prompts, not reported as a median. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Prior active and self-reflective RAG methods largely assume a reasonably trustworthy corpus and mainly filter irrelevant context, leaving them vulnerable to semantically relevant but incorrect passages.

    “However, these approaches largely assume a reasonably trustworthy corpus and mainly filter irrelevant context, leaving them vulnerable to semantically relevant but incorrect passages (i.e., polluted evidence).”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites Jiang et al., 2023b source

      Sections 3.2.2 and 6.2 describe improving retrieval relevance and avoiding unnecessary retrieval noise, which supports the claim's relevance-focused characterization of FLARE. But the paper does not say that active or self-reflective RAG methods generally assume a trustworthy corpus, mainly filter irrelevant passages, or are vulnerable to semantically relevant but incorrect evidence. The cited passages have no page numbers in our copy. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites Asai et al., 2024

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Su et al., 2024

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    Compared with prior robust-RAG methods that require multiple generation calls or iterative retrieval, MIRAGE keeps generation to a single LLM call per query and shifts robustness computation to bounded local NLI verification.

    “Compared with prior robust-RAG methods that require multiple generation calls or iterative retrieval (Wang et al., 2025a;Jiang et al., 2023b;Su et al., 2024), MIRAGE keeps generation to a single LLM call per query and shifts robustness computation to bounded local NLI verification.”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites Wang et al., 2025a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Jiang et al., 2023b source
    • cites Su et al., 2024

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Simple concatenation schemes partially mitigate the worst failures by allowing the verifier to choose between multiple answers, but they still trail MIRAGE by a wide margin on both datasets.

    “Simple concatenation schemes partially mitigate the worst failures by allowing the verifier to choose between multiple answers, but they still trail MIRAGE by a wide margin on both datasets.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    MIRAGE generation requires only one LLM call per query, but introduces additional local NLI computation for graph construction and counter-evidence checks.

    “Finally, while generation still requires only one LLM call per query, MIRAGE introduces additional local NLI computation for graph construction and counter-evidence checks; Appendix G reports the resulting overhead.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Across all datasets, MIRAGE ranks first for both backbones and both regimes.

    “Across all datasets, MIRAGE ranks first for both backbones and both regimes”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Under full pollution, MIRAGE detects unreliable retrieval and falls back to parametric generation, avoiding harmful context.

    “Under full pollution, MIRAGE detects unreliable retrieval and falls back to parametric generation, avoiding harmful context.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In practice, the gate passes most clean queries, degrades under mixed retrieval, and blocks nearly all fully polluted queries.

    “In practice, the gate satisfies basic sanity checks: it passes most clean queries, degrades under mixed retrieval, and blocks nearly all fully polluted queries, see Table 3.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Under MixP, gains are large across backbones (e.g., GPT-4o-mini improves from 53.88% to 83.43% on average; for LLaMA-3.1-8B, it improves from 41.71% to 71.91%).

    “Under MixP, gains are large across backbones (e.g., GPT-4o-mini improves from 53.88% to 83.43% on average; for LLaMA-3.1-8B, it improves from 41.71% to 71.91%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Polluted claims induce dense contradictions, while clean evidence forms multi-source support clusters, and MIRAGE uses these patterns to detect unreliable retrieval.

    “Polluted claims induce dense contradictions, while clean evidence forms multi-source support clusters.MIRAGE uses these patterns to detect unreliable retrieval.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    In the illustrative mixed-retrieval example, MIRAGE keeps the top N = 3 claims, yielding the defended set S* = {C1, C2, C3}.

    “Let MIRAGE keep the top N =3 claims, yielding the defended set S ⋆ = {C1, C2, C3}.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In the illustrative mixed-retrieval example, the claim extractor produces one atomic claim per passage.
  • May combine two claims.

    Findingown data

    Under FullP, vanilla RAG collapses (e.g., GPT-4o-mini: 39.87% vs. No-RAG 75.88%), while MIRAGE substantially recovers performance (GPT-4o-mini reaches 78.00% on average; LLaMA-3.1-8B reaches 70.34%).

    “Under FullP, vanilla RAG collapses (e.g., GPT-4o-mini: 39.87% vs. No-RAG 75.88%), while MIRAGE substantially recovers performance (GPT-4o-mini reaches 78.00% on average; LLaMA-3.1-8Breaches 70.34%).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    In the illustrative mixed-retrieval example, under the global gate configuration (r max = 0.98 and d min = 2), all active gate conditions are satisfied and the gate passes, conditioning the generator only on S*.

    “Under the global gate configuration used in our experiments (r max = 0.98 and d min = 2), all active gate conditions are satisfied: 0.0 ≤ 0.98 and 3 ≥ 2. The gate therefore passes and the generator is conditioned only on S ⋆ .”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In the illustrative mixed-retrieval example, the claim extractor produces one atomic claim per passage.
  • The quote only partly states this claim.

    Findingown data

    MIRAGE restores factuality toward clean-RAG levels under mixed and full pollution.

    “whereas MIRAGE restores factuality toward clean-RAG levels”
    • Also stated in: § 7 Conclusion and Future Work · plain
      “MIRAGE restores factuality under mixed and fully polluted evidence”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    Within the illustrative defended set S*, overlap-based pairing produces one support edge between C1 and C2 and no contradictions, so contradiction_ratio = 0.0.

    “Within S ⋆ , the overlap-based pairing produces one edge between C 1 and C 2 (support), and no contradictions: edges = 1, support_edges = 1, and contradiction_edges = 0. Thus, contradiction_ratio = 0/1 = 0.0.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In the illustrative mixed-retrieval example, the claim extractor produces one atomic claim per passage.
  • May combine two claims.

    Findingnone given

    The claim-support graph baseline improves naive concatenation but underperforms MIRAGE.

    “This improves naive concatenation but underperforms MIRAGE”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The gate passes 87.2% of clean queries on average, drops to 48.6% under mixed retrieval, and blocks nearly all fully polluted queries (0% pass).

    “Table 3 shows that the gate passes 87.2% of clean queries on average, drops to 48.6% under mixed retrieval, and blocks nearly all fully polluted queries (0% pass).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Lexical filtering reduces the average number of pairs sent to NLI from 971.22 to 38.28 in MixP and from 1214.76 to 31.15 in FullP, avoiding 96.1% and 97.4% of pairwise NLI calls, respectively.

    “As shown in Table 18, lexical filtering reduces the average number of pairs sent to NLI from 971.22 to 38.28 in MixP and from 1214.76 to 31.15 in FullP, avoiding 96.1% and 97.4% of pairwise NLI calls, respectively.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    MIRAGE reduces the number of NLI pairs by 96.1% under mixed pollution and 97.4% under full pollution.

    “MixP | 120 | 971.22 | 38.28 932.93 | 96.1%”
    • Also stated in: § K.1 Unambiguous (Single-Fact Edits) · plain
      “FullP | 120 1214.76 | 31.15 1183.61 | 97.4%”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The optimal value of k depends mildly on the corruption level, with larger k benefiting heavily polluted settings.

    “The optimal value depends mildly on the corruption level, with larger k benefiting heavily polluted settings.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The claim-support graph baseline is the strongest answer-level baseline in several settings, but still trails MIRAGE; on FAVA with GPT-4o-mini it achieves 68.24% versus 82.54% for MIRAGE, and on LongFact 74.66% versus 88.93%.

    “The claim-support graph baseline is the strongest answer-level baseline in several settings, but still trails MIRAGE; for example, on FAVA with GPT-4o-mini it achieves 68.24% versus 82.54% for MI-RAGE, and on LongFact 74.66% versus 88.93%.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    In the illustrative mixed-retrieval example, the claims span three distinct domains, so source_diversity = 3.

    “Since the claims span three distinct domains, source_diversity = 3.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In the illustrative mixed-retrieval example, the claim extractor produces one atomic claim per passage.
  • May combine two claims.

    Findingown data

    On LongFact, MIRAGE improves over the strongest baseline for GPT-4o-mini (88.93% vs. 74.87%) and for Qwen3-8B (85.11% vs. 66.41%).

    “on Long-Fact, MIRAGE improves over the strongest baseline for GPT-4o-mini (88.93% vs. 74.87%)and for Qwen3-8B (85.11% vs. 66.41%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Because polluted claims receive no cross-source support and come from low-trust domains, they rank below the coherent clean cluster and are pruned away.

    “Because polluted claims receive no cross-source support (and come from low-trust domains), they rank below the coherent clean cluster and are pruned away.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Using log(1+n(c)) gives a large gain for the first independent supporter and diminishing returns for additional supporters.

    “We use log(1+n(c)) so that the first independent supporter yields a large gain (from 0 to log 2 ≈ 0.69) while additional supporters have diminishing returns.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Lexical filtering can miss paraphrastic agreement or contradiction, especially under omission, framing, or heavy rewording rather than shared entities, dates, or numbers.

    “Lexical filtering can miss paraphrastic agreement or contradiction, especially under omission, framing, or heavy rewording rather than shared entities, dates, or numbers.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    MIRAGE blocks unreliable evidence and falls back to parametric answering.

    “while MIRAGE blocks unreliable evidence and falls back to parametric answering”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    In MIRAGE, domain trust is strictly secondary: it can break ties among otherwise similar claims, but it is never sufficient on its own and cannot override multi-source agreement.

    “In MIRAGE, domain trust is strictly secondary: it can break ties among otherwise similar claims, but it is never sufficient on its own and cannot override multi-source agreement.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    In polluted RAG, a retriever returns a mix of clean and polluted passages, and even a single high-scoring polluted document can steer the LLM toward a confident but incorrect answer.

    “A retriever returns a mix of clean and polluted passages.Even a single highscoring polluted document can steer the LLM toward a confident but incorrect answer.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The authors enforce strict edit constraints, including high token overlap and neutral tone, to ensure realistic rather than overtly adversarial pollution.

    “We enforce strict edit constraints, including high token overlap and neutral tone, to ensure realistic rather than overtly adversarial pollution.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    MIRAGE inherits the coverage and diversity of retrieved evidence: low recall or limited source diversity can produce sparse graphs and more conservative blocking, yielding safer but less informative answers.

    “MIRAGE inherits the coverage and diversity of retrieved evidence: low recall or limited source diversity can produce sparse graphs and more conservative blocking, yielding safer but less informative answers.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. The quote only partly states this claim.

    Study design and conductcitation

    The authors instantiate four corruption families under minimal-edit constraints: Unambiguous, Conflicting, Misleading, and Fabricated.

    “Inspired by prior evidence taxonomies for misleading/conflicting retrieval (e.g., (Zeng et al., 2025)), we instantiate four corruption families under minimal-edit constraints:”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Zeng et al., 2025

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Robust RAG should verify retrieved evidence before generation, rather than treating topical relevance as sufficient evidence quality.

    “More broadly, the findings suggest that robust RAG should verify retrieved evidence before generation, rather than treating topical relevance as sufficient evidence quality.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    The authors manually verify 150 VeriScore-labeled claims with retrieved evidence; two annotators achieve 87.33% agreement.

    “We manually verify 150 VeriScore-labeled claims with retrieved evidence; two annotators achieve 87.33% agreement.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    The choice of α=0.5, β=0.3 encodes a priority ordering: cross-source agreement dominates, domain quality provides a modest prior, and retrieval rank only breaks ties.

    “This choice encodes a simple priority ordering that we keep consistent throughout: (i) cross-source agreement should dominate, (ii) domain quality should provide a modest prior, and (iii) retrieval rank should only break ties.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The domain-trust weights in Table 10 are valid proxies for source reliability.
  • May combine two claims.

    Study design and conductnone given

    MIRAGE employs lightweight sentence segmentation and does not use an LLM for claim decomposition in any main experiment.

    “MIRAGE employs lightweight sentence segmentation and does not use an LLM for claim decomposition in any main experiment, ensuring that the method remains training-free, reproducible, and low-overhead.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Counter-evidence edges penalize claims that appear plausible in the original retrieval set but are contradicted by targeted counter-evidence, complementing cross-source support and contradiction edges in the main claim graph.

    “These edges penalize claims that appear plausible in the original retrieval set but are contradicted by targeted counter-evidence, complementing the cross-source support and contradiction edges in the main claim graph.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    MIRAGE is plugged on top of an embedding-based retriever without modifying the retrieval model.

    “In all experiments we plug MIRAGE on top of an embedding-based retriever and do not modify the retrieval model; see Appendix D for details.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    MIRAGE restores factuality by filtering contradiction-heavy evidence and falling back to parametric answering when needed.

    “by filtering contradiction-heavy evidence and falling back to parametric answering when needed.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    These gains primarily reflect avoiding harmful retrieval rather than exploiting polluted evidence.

    “These gains primarily reflect avoiding harmful retrieval rather than exploiting polluted evidence.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The pollution type and rationale are never shown to MIRAGE; they are used only for auditing and reporting.

    “The rationale and type are never shown to MIRAGE; they are used only for auditing and reporting.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The retrieval pollution protocol produces matched clean, mixed, and polluted evidence sets for each benchmark.

    “This protocol produces matched clean, mixed, and polluted evidence sets for each benchmark.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    A strict verifier prompt is used that decides only from shown snippets, requires high-trust evidence for SUPPORTED, and treats microperturbations as UNSUPPORTED.

    “We use a strict verifier prompt that (i) decides only from the shown snippets, (ii) requires high-trust evidence to mark a claim as SUPPORTED, and (iii) treats microperturbations (dates, numbers, entities, directions, and temporal scopes) as UNSUPPORTED.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The domain trust mapping is query-independent and used only as a lightweight source prior.

    “This mapping is query-independent and used only as a lightweight source prior.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    MIRAGE improves resilience to polluted retrieval while keeping API-side cost close to a standard single-call RAG pipeline.

    “Together with the robustness results in Table 2, this shows that MIRAGE improves resilience to polluted retrieval while keeping API-side cost close to a standard single-call RAG pipeline.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Thresholds are determined once offline from graph statistics on the combined held-out 20% splits of all datasets, without invoking the generator; these splits are excluded from downstream evaluation to avoid data leakage, and the resulting single global configuration is used across all datasets and models.

    “Thresholds are determined once offline from graph statistics on the combined held-out 20% splits of all datasets, without invoking the generator; these splits are excluded from downstream evaluation to avoid data leakage, and the resulting single global configuration is used across all datasets and models.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Core gate criteria configuration is selected offline via grid search on cached retrieval and NLI outputs without invoking the generator.

    “Core gate criteria configuration is selected offline via grid search on cached retrieval and NLI outputs without invoking the generator.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    MIRAGE operates without access to ground-truth passage labels; its decisions are based solely on the retrieved text and the structural properties of the defended-claims graph.

    “MIRAGE operates without access to ground-truth passage labels; its decisions are based solely on the retrieved text and the structural properties of the defended-claims graph.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Under FullP, improvements mainly come from blocking polluted context, while under MixP, MIRAGE also benefits from retained clean, mutually supported claims.

    “Under FullP, improvements mainly come from blocking polluted context, while under MixP, MIRAGE also benefits from retained clean, mutually supported claims.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    The coefficients (α, β) in equation (3) are fixed across all experiments (α = 0.5 and β = 0.3) and not tuned per dataset.

    “The coefficients (α, β) in equation ( 3) are not tuned per dataset and are fixed across all experiments (α = 0.5 and β = 0.3).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The domain-trust weights in Table 10 are valid proxies for source reliability.
  • May combine two claims.

    Study design and conductnone given

    The No-RAG baseline is a parametric-only generation baseline without retrieved evidence, while MIRAGE's BLOCKED path uses a stronger no-evidence fallback prompt that explicitly asks the model to be uncertain, avoid speculation, and state what would be needed for verification.

    “The No-RAG baseline is a parametric-only generation baseline without retrieved evidence, while MIRAGE's BLOCKED path uses a stronger noevidence fallback prompt that explicitly asks the model to be uncertain, avoid speculation, and state what would be needed for verification.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    The design of presenting only defended claims through a structured verified-claims prompt turns retrieval into an evidence-only input, constraining the model to generate answers grounded in verified claims and reducing hallucination.

    “This design turns retrieval into an evidence-only input, constraining the model to generate answers grounded in verified claims and reducing hallucination.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    MIRAGE is intentionally training-free and modular, improving robustness, interpretability, and auditability across settings, though this may limit adaptation to some domains or languages.

    “MIRAGE is intentionally training-free and modular, improving robustness, interpretability, and auditability across settings, though this may limit adaptation to some domains or languages.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Study design and conductnone given

    All MIRAGE gate criteria and claim-scoring weights are fixed globally across datasets and LLM backbones.

    “All values are fixed globally across datasets and LLM backbones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    MIRAGE's domain-level features complement content-based consistency signals.

    “Similarly, our domain-level features complement content-based consistency signals.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    To systematically stress-test long-form RAG under misinformation, the authors introduce minimally edited corrupted variants of retrieved passages, yielding three controlled retrieval regimes per query (CLEAN, MIXED, POLLUTED) while keeping the evidence size fixed and preserving topical relevance.

    “To systematically stress-test long-form RAG under misinformation, we introduce minimally edited corrupted variants of retrieved passages, yielding three controlled retrieval regimes per query: CLEAN, MIXED, and POLLUTED, while keeping the evidence size fixed and preserving topical relevance.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Retrieval pollution (on-topic misinformation) is a significant problem for long-form RAG.
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    For each question, the authors start from cached clean retrieval passages and use GPT-4o-mini to generate corrupted variants that remain fluent and on-topic while introducing at least one verifiable factual error.

    “For each question q, we start from cached clean retrieval passages D CLEAN (q) = {p 1 , . . ., p k } and use GPT-4o-mini to generate corrupted variants pi that remain fluent and on-topic while introducing at least one verifiable factual error.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data

    MIRAGE retains up to N = 120 candidate claims, yielding 120 2 = 7140 possible pairs, but performs at most P max = 400 sampled pairwise NLI checks per query.

    “Although MIRAGE retains up to N = 120 candidate claims (yielding 120 2 = 7140 possible pairs), it performs at most P max = 400 sampled pairwise NLI checks per query.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    MIRAGE uses NLI-based consistency and lexical-overlap filtering as efficient, interpretable approximations for scalable cross-claim verification, though these can miss paraphrastic or omission-based misinformation.

    “It uses NLI-based consistency and lexical-overlap filtering as efficient, interpretable approximations for scalable cross-claim verification, though these can miss paraphrastic or omission-based misinformation.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: NLI-based consistency and lexical-overlap filtering are sufficient for scalable cross-claim verification.
  • May combine two claims.

    Study design and conductreasoning

    All NLI verification uses a local model and therefore contributes wall-clock compute but not LLM API cost.

    “All NLI verification uses a local model and therefore contributes wall-clock compute but not LLM API cost.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    MIRAGE surpasses No-RAG through trust-aware gating and fallback no-evidence generation.

    “through trust-aware gating and fallback no-evidence generation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Scaling the domain prior by 0.5 ensures that moving from lowest to highest trust changes s(c) by at most 0.35, which is smaller than the gain from one additional independent supporter (log 2 ≈ 0.69), preventing priors from overpowering consensus.

    “We scale the domain prior by 0.5 so that moving from the lowest-to highest-trust sources (0.20 → 0.90) changes s(c) by at most 0.35, which is still smaller than the gain from one additional independent supporter (log 2 ≈ 0.69), preventing priors from overpowering consensus.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The domain-trust weights in Table 10 are valid proxies for source reliability.
  • May combine two claims.

    Study design and conductnone given

    MIRAGE applies a Defended-Claims Gate to either condition generation on a consistent, multi-source supported subset or to block retrieval and answer parametrically.

    “applies a Defended-Claims Gate to either condition generation on a consistent, multi-source supported subset or to block retrieval and answer parametrically.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Domain trust being secondary prevents high-reputation but polluted passages from dominating the graph, while still allowing source quality to stabilize scoring.

    “This prevents high-reputation but polluted passages from dominating the graph, while still allowing source quality to stabilize scoring.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    In regimes where MIRAGE blocks retrieval, differences from No-RAG should not be interpreted as evidence-use gains; they reflect removal of polluted context exposure plus the effect of the safer fallback instruction template.

    “Therefore, in regimes where MIRAGE blocks retrieval, differences from No-RAG should not be interpreted as evidence-use gains.They reflect removal of polluted context exposure plus the effect of the safer fallback instruction template.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    To enable controlled and reproducible retrieval/pollution evaluation, the authors construct a dataset-specific cached clean evidence pool from web search and derive Clean/Mixed/Fully-Polluted retrieval regimes from that fixed pool.

    “To enable controlled and reproducible retrieval/pollution evaluation, we construct a dataset-specific cached clean evidence pool from web search and derive Clean/Mixed/Fully-Polluted retrieval regimes from that fixed pool.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    In the illustrative mixed-retrieval example, MIRAGE does not observe the pollution labels.

    “For exposition only, we annotate which retrieved passages are polluted; MIRAGE does not observe these labels.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductnone given

    MIRAGE is a training-free, model-agnostic defense for long-form RAG.

    “We introduce MI-RAGE, a training-free, model-agnostic defense for long-form RAG.”
    • Also stated in: § 1 Introduction · plain
      “We introduce MIRAGE, a training-free and model-agnostic defense for long-form RAG that constructs cross-document NLI-based claim graphs to identify, prune, and gate misinformation-polluted evidence before generation (see Section 3).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Retrieval uses cached/local evidence, and the reported monetary cost reflects only LiteLLM-recorded gpt-4o-mini generation cost.

    “Retrieval uses cached/local evidence, and the reported monetary cost reflects only LiteLLMrecorded gpt-4o-mini generation cost.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The token-overlap filter is used only for efficient candidate generation before NLI adjudication.

    “The token-overlap filter in equation ( 1) is used only for efficient candidate generation before NLI adjudication.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    MIRAGE remains training-free, reproducible, and low-overhead.

    “MIRAGE employs lightweight sentence segmentation and does not use an LLM for claim decomposition in any main experiment, ensuring that the method remains training-free, reproducible, and low-overhead.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Retrieved passages and similarity scores are cached per (dataset, model) run for reproducibility and to seed the pollution protocol.

    “Retrieved passages and similarity scores are cached per (dataset, model) run for reproducibility and to seed the pollution protocol.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    MIRAGE issues counter-evidence probes for up to M = 8 claims with at most k ctr = 3 passages each, yielding a bounded local verification budget of roughly 400 + 8 × 3 = 424 NLI checks per query.

    “MIRAGE also issues counter-evidence probes for up to M = 8 claims with at most k ctr = 3 passages each, yielding a bounded local verification budget of roughly 400 + 8 × 3 = 424 NLI checks per query.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    All retrieval regimes (Clean/Mixed/Fully Polluted) are derived from the same cached candidate pool.

    “All retrieval regimes (Clean/Mixed/Fully Polluted) are derived from the same cached candidate pool.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The retrieved evidence pool is representative of the web evidence that RAG systems encounter.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Query-independent authority signals such as TrustRank-style propagation are auxiliary features rather than primary evidence in web-ranking practice.

    “This follows web-ranking practice, where queryindependent authority signals such as TrustRankstyle propagation (Soricut and Echihabi, 2010) are auxiliary features rather than primary evidence.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Soricut and Echihabi, 2010

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Coordinated misinformation repeated across sources may appear trustworthy to MIRAGE.

    “Coordinated misinformation repeated across sources may also appear trustworthy.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    MIRAGE avoids conditioning on polluted retrieval, whereas vanilla RAG remains exposed to it.

    “The substantive comparison is that MIRAGE avoids conditioning on polluted retrieval, whereas vanilla RAG remains exposed to it.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The added counter-evidence query terms are generic and dataset-independent, intended to surface refutations, corrections, or disagreement-oriented evidence without using ground-truth labels.

    “The added terms are generic and dataset-independent: they are intended to surface refutations, corrections, or disagreementoriented evidence without using any ground-truth labels.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Unless otherwise stated, all experiments use a single fixed global configuration for both the core gate criteria and computational settings.

    “Unless otherwise stated, all experiments use a single fixed global configuration for both the core gate criteria (Table 8) and computational settings (Table 9).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Retrieval is made deterministic and efficient by pre-constructing and caching per-question retrievers.

    “To make retrieval deterministic and efficient, we pre-construct and cache per-question retrievers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductnone given

    MIRAGE makes a single LLM generation call per query: either verified-claims generation when the gate passes, or parametric no-retrieval generation when the gate blocks.

    “MIRAGE makes a single LLM generation call per query: either verified-claims generation when the gate passes, or parametric no-retrieval generation when the gate blocks.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The pollution protocol enforces topic preservation, minimal editing, non-absurd plausibility, and anti-shortcut rules to avoid trivial artifacts.

    “To avoid trivial artifacts, we enforce: (1) topic preservation (the rewrite remains about the same entities and subject as the question/passage), (2) minimal editing (preserve 50-80% of tokens and cap token-change at ≤ 0.75), (3) non-absurd plausibility (neutral encyclopedic tone; no satire), and (4) anti-shortcut rules (reject vague comparatives and meta-commentary; no citations/URLs).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The pollution protocol's constraints (topic preservation, minimal editing, non-absurd plausibility, anti-shortcut rules) ensure that polluted passages are realistic and non-trivial.
  • May combine two claims.

    Interpretationnone given

    MIRAGE operates on the underlying retrieval graph and can block RAG entirely, falling back to safer parametric generation.

    “whereas MIRAGE operates on the underlying retrieval graph and can block RAG entirely, falling back to safer parametric generation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The manual check complements the NLI-label audit: the NLI audit validates the claim-graph edges used by MIRAGE, while the VeriScore audit validates the factuality labels used to evaluate generated answers.

    “This check complements the NLI-label audit above: while the NLI audit validates the claimgraph edges used by MIRAGE, the VeriScore audit validates the factuality labels used to evaluate generated answers.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Polluted passages are generated using an approximately uniform mix over the four corruption families to reduce confounding from any single corruption style.

    “To reduce confounding from any single corruption style, we generate polluted passages using an approximately uniform mix over the four families.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The four corruption families (Conflicting, Misleading, Fabricated, Unambiguous) cover the space of misinformation that long-form RAG must defend against.
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The paper releases a minimal-edit pollution protocol spanning four perturbation families (Unambiguous, Conflicting, Misleading, Fabricated) to construct matched clean, mixed, and fully polluted evaluation regimes.

    “We also release a minimal-edit pollution protocol spanning four perturbation families (Unambiguous, Conflicting, Misleading, Fabricated) to construct matched clean, mixed, and fully polluted evaluation regimes.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The token-overlap filter works well in practice because supporting evidence typically preserves key lexical anchors.

    “This containment-style overlap works well in practice because supporting evidence typically preserves key lexical anchors (e.g., named entities and dates).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The claim-support graph baseline lacks an explicit defense mechanism and cannot stop generation when retrieval is broadly polluted but internally consistent.

    “Second, it lacks an explicit defense mechanism and cannot stop generation when retrieval is broadly polluted but internally consistent.”
    Quote in the paperSubstantial claim
88 of 88
  • The paper relies on this without support.

    Correct claims are often repetitive and consistent across diverse sources, whereas statements containing misinformation are contradictory to each other.

    “Our core insight is that correct claims are often repetitive and consistent across diverse sources, whereas statements containing misinformation are contradictory to each other.”
    “truthful evidence tends to be corroborated across sources, whereas polluted evidence induces structural inconsistency.”
  • The paper relies on this without support.

    Exact optimization of the defended-set objective F(S) is NP-hard.

    “Exact optimization is NP-hard, so we use a greedy hill-climbing procedure that iteratively removes claims whose exclusion improves F (S).”
  • The paper relies on this without support.

    Retrieval pollution (on-topic misinformation) is a significant problem for long-form RAG.

    “To defend against retrieval pollution (on-topic misinformation), we introduce MIRAGE, a trainingfree, model-agnostic defense for long-form RAG.”
  • The paper relies on this without support.

    The domain-trust weights in Table 10 are valid proxies for source reliability.

    “We then assign a domain-trust weight by applying the rules in Table 10 via substring or TLD matching.”
    “Domain type (rule) Trust Reference / encyclopedia (wikipedia, wiki) 0.90 Official / academic (.gov, .edu)0.80 Major news keywords (nytimes, reuters) 0.70 Non-profit / org TLD (.org) 0.65 Commercial TLD (.com) 0.50 Unknown / no domain found (unknown) 0.40 Forum / discussion keyword (forum) 0.20”
  • The paper relies on this without support.

    The pollution protocol's constraints (topic preservation, minimal editing, non-absurd plausibility, anti-shortcut rules) ensure that polluted passages are realistic and non-trivial.

    “To avoid trivial artifacts, we enforce: (1) topic preservation (the rewrite remains about the same entities and subject as the question/passage), (2) minimal editing (preserve 50-80% of tokens and cap token-change at ≤ 0.75), (3) non-absurd plausibility (neutral encyclopedic tone; no satire), and (4) anti-shortcut rules (reject vague comparatives and meta-commentary; no citations/URLs).”
  • The paper relies on this without support.

    The four corruption families (Conflicting, Misleading, Fabricated, Unambiguous) cover the space of misinformation that long-form RAG must defend against.

    “To reduce confounding from any single corruption style, we generate polluted passages using an approximately uniform mix over the four families.”
  • The paper relies on this without support.

    NLI-based consistency and lexical-overlap filtering are sufficient for scalable cross-claim verification.

    “It uses NLI-based consistency and lexical-overlap filtering as efficient, interpretable approximations for scalable cross-claim verification, though these can miss paraphrastic or omission-based misinformation.”
  • The paper relies on this without support.

    The retrieved evidence pool is representative of the web evidence that RAG systems encounter.

    “All benchmarks we use are prompt-only; therefore, we construct a dataset-specific candidate corpus by collecting a clean evidence pool from the web.”
  • The authors state this as an assumption.

    In the illustrative mixed-retrieval example, the claim extractor produces one atomic claim per passage.

    “Assume the claim extractor produces one atomic claim per passage (C i from P i )”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Mistral-7B FAVA polluted-RAG score differs between tables

    Minor

    Table 12 reports 27.64 for Mistral-7B on FAVA under polluted RAG, while Table 14 reports 47.64 for the same dataset, model, and condition. The two values also imply substantially different pollution-related drops.

  • Qwen3-8B AlpacaFact clean-RAG score differs between tables

    Minor

    Table 12 gives 70.08 for Qwen3-8B clean RAG on AlpacaFact, whereas Table 14 gives 60.79 for the same result.

  • Qwen3-8B Biography clean-RAG score differs between tables

    Minor

    Table 12 gives 70.82 for Qwen3-8B clean RAG on Biography, but Table 14 gives 62.18 for that same result.

3 of 3

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 16

  1. Mingda Chen, Yang Li, Karthik Padthe, Rulin Shao, Alicia Yi Sun, Luke Zettlemoyer, Gargi Ghosh, and Wen-tau Yih. 2025. Improving factuality with ex- plicit working memory. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL '25, pages 11199-11213, Vienna, Austria. Association for Com- putational Linguistics. · DOI
  2. Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2021. DeBERTa: Decoding-enhanced BERT with disentangled attention. In Proceedings of the International Conference on Learning Represen- tations, ICLR '21.
  3. Zhengbao Jiang, Frank F. Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023b. Active retrieval augmented generation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Lan- guage Processing, EMNLP '23, pages 7969-7992, Singapore. Association for Computational Linguis- tics. · DOI · Paper page
  4. Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Koh, Mohit Iyyer, Luke Zettle- moyer, and Hannaneh Hajishirzi. 2023. FActScore: Fine-grained atomic evaluation of factual precision in long form text generation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Lan- guage Processing, EMNLP '23, pages 12076-12100, Singapore. Association for Computational Linguis- tics. · DOI · Paper page
  5. Yikang Pan, Liangming Pan, Wenhu Chen, Preslav Nakov, Min-Yen Kan, and William Wang. 2023. On the risk of misinformation pollution with large language models. In Findings of the Associa- tion for Computational Linguistics: EMNLP 2023, EMNLP '23, pages 1389-1403, Singapore. Associa- tion for Computational Linguistics. · DOI · Paper page
  6. Ethan Perez, Sam Ringer, Kamile Lukosiute, Karina Nguyen, Edwin Chen, Scott Heiner, Craig Pettit, Catherine Olsson, Sandipan Kundu, Saurav Kada- vath, Andy Jones, Anna Chen, Ben Mann, Brian Israel, Bryan Seethor, Cameron McKinnon, Christo- pher Olah, Da Yan, Daniela Amodei, and 44 others. 2023. Discovering language model behaviors with model-written evaluations. In Findings of the Asso- ciation for Computational Linguistics: ACL 2023, ACL '23, pages 13387-13434, Toronto, Canada. As- sociation for Computational Linguistics. · DOI · Paper page
  7. Rishanth Rajendhran, Amir Zadeh, Matthew Sarte, Chuan Li, and Mohit Iyyer. 2025. VeriFastScore: Speeding up long-form factuality evaluation. In Find- ings of the Association for Computational Linguis- tics: EMNLP 2025, EMNLP '25, pages 9234-9259, Suzhou, China. Association for Computational Lin- guistics. · DOI
  8. Yixiao Song, Yekyung Kim, and Mohit Iyyer. 2024. VeriScore: Evaluating the factuality of verifiable claims in long-form text generation. In Findings of the Association for Computational Linguistics: EMNLP 2024, EMNLP '24, pages 9447-9474, Mi- ami, Florida, USA. Association for Computational Linguistics. · DOI · Paper page
  9. Radu Soricut and Abdessamad Echihabi. 2010. TrustRank: Inducing trust in automatic translations via ranking. In Proceedings of the 48th Annual Meet- ing of the Association for Computational Linguistics, ACL '10, pages 612-621, Uppsala, Sweden. Associ- ation for Computational Linguistics.
  10. Weihang Su, Yichen Tang, Qingyao Ai, Zhijing Wu, and Yiqun Liu. 2024. DRAGIN: Dynamic retrieval augmented generation based on the real-time informa- tion needs of large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL '24, pages 12991-13013, Bangkok, Thailand. Association for Computational Linguistics. · DOI · Paper page
  11. Yingjia Wan, Haochen Tan, Xiao Zhu, Xinyu Zhou, Zhi- wei Li, Qingsong Lv, Changxuan Sun, Jiaqi Zeng, Yi Xu, Jianqiao Lu, Yinhong Liu, and Zhijiang Guo. 2025. FaStFact: Faster, stronger long-form factuality evaluations in LLMs. In Findings of the Associa- tion for Computational Linguistics: EMNLP 2025, EMNLP '25, pages 23814-23854, Suzhou, China. Association for Computational Linguistics. · DOI
  12. Fei Wang, Xingchen Wan, Ruoxi Sun, Jiefeng Chen, and Sercan O. Arik. 2025a. ASTUTE RAG: Overcom- ing imperfect retrieval augmentation and knowledge conflicts for large language models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL '25, pages 30553-30571, Vienna, Austria. As- sociation for Computational Linguistics. · DOI
  13. Han Wang, Archiki Prasad, Elias Stengel-Eskin, and Mohit Bansal. 2025b. Retrieval-augmented genera- tion with conflicting evidence. In Proceedings of the Conference on Language Modeling, COLM '25.
  14. Zhepei Wei, Wei-Lin Chen, and Yu Meng. 2025. In- structRAG: Instructing retrieval-augmented genera- tion via self-synthesized rationales. In Proceedings of the International Conference on Learning Repre- sentations, ICLR '25.
  15. Chong Xiang, Tong Wu, Zexuan Zhong, David Wagner, Danqi Chen, and Prateek Mittal. 2024. Certifiably ro- bust RAG against retrieval corruption. In ICML 2024 Workshop on Next Generation of AI Safety, ICML Workshop '24.
  16. Zhenrui Yue, Huimin Zeng, Yimeng Lu, Lanyu Shang, Yang Zhang, and Dong Wang. 2024. Evidence-driven retrieval augmented response generation for online misinformation. In Proceedings of the 2024 Con- ference of the North American Chapter of the As- sociation for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), NAACL '24, pages 5628-5643, Mexico City, Mex- ico. Association for Computational Linguistics. · DOI

Authors
Eletter, S., Zeng, R., Wang, Y., Panov, M., Rubashevskii, A., & Nakov, P.
Affiliations
  • Mohamed bin Zayed University of Artificial Intelligence (AE)
  • Sofia University "St. Kliment Ohridski" (BG)
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7167628479
Cited by
0
References
0
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
retrieval-augmented generation, factuality, training-free defense, natural language inference, long-form question answering, large language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review