Cited by 22Information Retrieval and Search BehaviorTopic ModelingExplainable Artificial Intelligence (XAI)

Correctness is not Faithfulness in Retrieval Augmented Generation Attributions

Wallat, Jonas, Heuss, Maria, Rijke, Maarten de, Anand, Avishek·2025·Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR)

Abstract

Large language models (LLMs) have transformed information retrieval through chat interfaces, but their hallucination tendencies pose significant risks. While Retrieval Augmented Generation (RAG) with citations has emerged as a solution by allowing users to verify responses through source attribution, current evaluation approaches focus primarily on citation correctness - whether cited documents support the corresponding statements. This is insufficient and we introduce citation faithfulness - whether the model's reliance on cited documents is genuine rather than post-rationalized to fit pre-existing knowledge. Our contributions are threefold: (i) we introduce coherent notions of attribution and introduce the concept of citation faithfulness; (ii) we propose desiderata for citations beyond correctness and accuracy needed for trustworthy systems; and (iii) we emphasize evaluating citation faithfulness by studying post-rationalization. Through experimentation, we reveal prevalent post-rationalization issues, finding that up to 57% of citations lack faithfulness. This undermines reliable attribution and may result in misplaced trust, highlighting a critical gap in current LLM-based IR systems. We demonstrate why both citation correctness and faithfulness must be considered when deploying LLMs in IR applications, contributing to a broader discussion of building more reliable and transparent information access systems.

Integrity signals

Registry

Crossref · 10.1145/3731120.3744592

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Source attribution is implicit and not causally grounded in the model's reasoning process.

    “Source attribution is implicit and not causally grounded in the model's reasoning process.”
  • When inputs from multiple sources are combined within a shared context window, the model cannot reliably determine the origin of the content.

    “V-M2: Source Attribution Failure in Multi-Source Contexts. When inputs from multiple sources are combined within a shared context window, the model cannot reliably determine the origin of the content (Wallat et al., 2025).”
  • Citation support does not establish causal reliance on evidence.

    “Related work already identifies a divergence between answer quality and citation grounding under compression (Li et al., 2026a), while citation support does not establish causal reliance on evidence (Wallat et al., 2025).”

    From The Attribution-Compression Frontier in Retrieval-Augmented Generation (2026) · cites this paper as Wallat et al., 2025

  • Wallat et al. (2025) distinguish citation correctness from causal faithfulness and investigate post-rationalization.

    “Wallat et al. (2025) distinguish citation correctness from causal faithfulness and investigate post-rationalization.”

    From The Attribution-Compression Frontier in Retrieval-Augmented Generation (2026) · cites this paper as Wallat et al., 2025

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Wallat, J., Heuss, M., Rijke, M. D., & Anand, A.
Affiliations
  • L3S Research Center (DE)
  • University of Amsterdam (NL)
  • Delft University of Technology (NL)
Venue
Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR)
Publisher
ACM
Published
2025-07-18
Pages
22-32
OpenAlex
W4412673546
Cited by
21
References
47
Citations by year
2026: 20 · 2025: 1
FWCI
25.20
Type
conference paper
Language
en
Open access
closed
Locations
ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) (publishedVersion)
Funders
  • German Research Foundation (DFG) (AN 996/1-1)
  • European Union's Horizon Europe (101070212)
  • Lower Saxony Ministry of Science and Culture (MWK) (HybrInt)
  • Dutch Research Council (024.004.022,NWA.1389.20.\-183,KICH3.LTP.20.006)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
retrieval-augmented generation, source attribution, hallucinations, large language models, information retrieval, evaluation metrics, trustworthy systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review