CoChat
Sign Up
PreprintCited by 1Topic ModelingAdversarial Robustness in Machine LearningNatural Language Processing Techniques

FACTUM: Mechanistic Detection of Citation Hallucination in Long-Form RAG

Open access
Dassen, Maxime, Kotula, Rebecca, Murray, Kenton, Yates, Andrew, Lawrie, Dawn, Kayi, Efsun, Mayfield, James, Duh, Kevin·2026·arXiv
DOI 10.48550/arxiv.2601.05866arXiv 2601.05866
Open this paper in CoChat — free account

Abstract

Retrieval-Augmented Generation (RAG) models are critically undermined by citation hallucinations, a deceptive failure where a model cites a source that fails to support its claim. While existing work attributes hallucination to a simple over-reliance on parametric knowledge, we reframe this failure as an evolving, scale-dependent coordination failure between the Attention (reading) and Feed-Forward Network (recalling) pathways. We introduce FACTUM (Framework for Attesting Citation Trustworthiness via Underlying Mechanisms), a framework of four mechanistic scores: Contextual Alignment (CAS), Attention Sink Usage (BAS), Parametric Force (PFS), and Pathway Alignment (PAS). Our analysis reveals that correct citations are consistently marked by higher parametric force (PFS) and greater use of the attention sink (BAS) for information synthesis. Crucially, we find that "one-size-fits-all" theories are insufficient as the signature of correctness evolves with scale: while the 3B model relies on high pathway alignment (PAS), our best-performing 8B detector identifies a shift toward a specialized strategy where pathways provide distinct, orthogonal information. By capturing this complex interplay, FACTUM outperforms state-of-the-art baselines by up to 37.5% in AUC. Our results demonstrate that high parametric force is constructive when successfully coordinated with the Attention pathway, paving the way for more nuanced and reliable RAG systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2601.05866

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Real citations deployed to support claims the cited references do not actually make are more prevalent and harder to detect than hallucinated titles.

    “The more prevalent and harder-to-detect variant-real citations deployed to support claims the cited references do not actually make [35], [36], [37], [38]-remains an open challenge for which reliable detection methods remain under active development.”

    From LLM hallucinations in the wild: Large-scale evidence from non-existent citations (2026) · cites this paper as [35]

    The Introduction (pp. 1–2) describes a real retrieved source being cited for a claim it does not support, and treats detecting such misattribution as a challenge. It does not establish that this variant is more prevalent or harder to detect than hallucinated titles. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

  • Reliable detection methods for misrepresenting citations remain under active development.

    “remains an open challenge for which reliable detection methods remain under active development.”

    From LLM hallucinations in the wild: Large-scale evidence from non-existent citations (2026) · cites this paper as [35]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 44

  1. [1]1. Agrawal, A., Suzgun, M., Mackey, L., Kalai, A.: Do language models know when they're hallucinating references? In: Graham, Y., Purver, M. (eds.) Findings of the Association for Computational Linguistics: EACL 2024. pp. 912928. Association for Computational Linguistics, St. Julian's, Malta (Mar 2024), https://aclanthology.org/2024.findings-eacl.62/
  2. [2]2. Ayala, O., Bechard, P.: Reducing hallucination in structured outputs via retrievalaugmented generation. In: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track). p. 228-238. Association for Computational Linguistics (2024). https://doi.org/10.18653/v1/2024.naacl-industry.19, http://dx.doi.org/10.18653/v1/2024.naacl-industry.19 · DOI · Paper page
  3. [3]3. Barbero, F., Álvaro Arroyo, Gu, X., Perivolaropoulos, C., Bronstein, M., Veličković, P., Pascanu, R.: Why do LLMs attend to the first token? (2025), https://arxiv. org/abs/2504.02732
  4. [5]5. Belrose, N., Furman, Z., Smith, L., Halawi, D., Ostrovsky, I., McKinney, L., Biderman, S., Steinhardt, J.: Eliciting latent predictions from transformers with the tuned lens (2023), https://arxiv.org/abs/2303.08112 · arXiv
  5. [6]6. Dai, D., Dong, L., Hao, Y., Sui, Z., Chang, B., Wei, F.: Knowledge neurons in pretrained transformers. In: Muresan, S., Nakov, P., Villavicencio, A. (eds.) Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 8493-8502. Association for Computational Linguistics, Dublin, Ireland (May 2022). https://doi.org/10.18653/v1/2022.acl-long.581, https://aclanthology.org/2022.acl-long.581/ · DOI · Paper page
  6. [8]8. van Dort, I., Maria, H.: How do llms cite? a mechanistic interpretation of attribution in rag. In: ECIR 2026: 48th European Conference on Information Retrieval (April 2026)
  7. [10]10. Es, S., James, J., Espinosa Anke, L., Schockaert, S.: RAGAs: Automated evaluation of retrieval augmented generation. In: Aletras, N., De Clercq, O. (eds.) Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. pp. 150-158. Association for Computational Linguistics, St. Julians, Malta (Mar 2024). https://doi.org/10.18653/v1/2024.eacl-demo.16, https://aclanthology. org/2024.eacl-demo.16/ · DOI · Paper page
  8. [11]11. Galán-Sales, F.J., Reina-Jiménez, P., Carranza-García, M., Luna-Romera, J.M.: An approach to enhance time series forecasting by fast fourier transform. In: International Conference on Soft Computing Models in Industrial and Environmental Applications. pp. 259-268. Springer (2023)
  9. [12]12. Geva, M., Schuster, R., Berant, J., Levy, O.: Transformer feed-forward layers are key-value memories. In: Moens, M.F., Huang, X., Specia, L., Yih, S.W.t. (eds.) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. pp. 5484-5495. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic (Nov 2021). https://doi.org/10.18653/v1/2021.emnlp-main.446, https://aclanthology.org/ 2021.emnlp-main.446/ · DOI · Paper page
  10. [14]14. Huang, P., Liu, Z., Yan, Y., Zhao, H., Yi, X., Chen, H., Liu, Z., Sun, M., Xiao, T., Yu, G., Xiong, C.: Parammute: Suppressing knowledge-critical FFNs for faithful retrieval-augmented generation (2025), https://arxiv.org/abs/2502.15543 · arXiv
  11. [15]15. Huang, Y., Zhang, J., Wang, Z., Bie, B., Hu, X., R., Y., Fung, He, X.: Reppl: Recalibrating perplexity by uncertainty in semantic propagation and language generation for explainable qa hallucination detection (2025), https://arxiv.org/abs/2505. 15386
  12. [16]16. Hussain, M.S., Zaki, M.J., Subramanian, D.: The information pathways hypothesis: Transformers are dynamic self-ensembles. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. p. 810-821. KDD '23, Association for Computing Machinery, New York, NY, USA (2023). https://doi.org/10.1145/3580305.3599520, https://doi.org/ 10.1145/3580305.3599520 · DOI
  13. [17]17. Ji, Z., Chen, D., Ishii, E., Cahyawijaya, S., Bang, Y., Wilie, B., Fung, P.: LLM internal states reveal hallucination risk faced with a query. In: Belinkov, Y., Kim, N., Jumelet, J., Mohebbi, H., Mueller, A., Chen, H. (eds.) Proceedings of the 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP. pp. 88-104. Association for Computational Linguistics, Miami, Florida, US (Nov 2024). https://doi.org/10.18653/v1/2024.blackboxnlp-1.6, https://aclanthology.org/2024.blackboxnlp-1.6/ · DOI
  14. [18]18. Kadavath, S., Conerly, T., Askell, A., Henighan, T., Drain, D., Perez, E., Schiefer, N., Hatfield-Dodds, Z., DasSarma, N., Tran-Johnson, E., Johnston, S., Showk, S.E., Jones, A., Elhage, N., Hume, T., Chen, A., Bai, Y., Bowman, S., Fort, S., Ganguli, D., Hernandez, D., Jacobson, J., Kernion, J., Kravec, S., Lovitt, L., Ndousse, K., Olsson, C., Ringer, S., Amodei, D., Brown, T., Clark, J., Joseph, N., Mann, B., McCandlish, S., Olah, C., Kaplan, J.: Language models (mostly) know what they know. CoRR abs/2207.05221 (2022), https://doi.org/10.48550/arXiv.2207. 05221 · DOI
  15. [19]19. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., Liu, T.Y.: Lightgbm: A highly efficient gradient boosting decision tree. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems. vol. 30. Curran Associates, Inc. (2017), https://proceedings.neurips.cc/paper\_files/paper/2017/file/ 6449f44a102fde848669bdd9eb6b76fa-Paper.pdf
  16. [20]20. Ádám Kovács, Recski, G.: Lettucedetect: A hallucination detection framework for RAG applications (2025), https://arxiv.org/abs/2502.17125 · arXiv
  17. [21]21. Lawrie, D., MacAvaney, S., Mayfield, J., McNamee, P., Oard, D.W., Soldaini, L., Yang, E.: Overview of the trec 2024 neuclir track. arXiv preprint arXiv:2509.14355 (2025) · arXiv
  18. [22]22. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.t., Rocktäschel, T., et al.: Retrieval-augmented generation for - knowledge-intensive nlp tasks. Advances in neural information processing systems 33 , 9459-9474 (2020)
  19. [23]23. Li, J., Yang, B., Dou, Z.Y., Wang, X., Lyu, M.R., Tu, Z.: Information aggregation for multi-head attention with routing-by-agreement. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). pp. 3566-3575. Association for Computational Linguistics, Minneapolis, Minnesota (Jun 2019). https://doi.org/10.18653/v1/N19-1359, https://aclanthology.org/N19-1359/ · DOI
  20. [24]24. Li, T., Zhang, G., Do, Q.D., Yue, X., Chen, W.: Long-context LLMs struggle with long in-context learning. Transactions on Machine Learning Research (2025), https://openreview.net/forum?id=Cw2xlg0e46
  21. [25]25. Li, X., Li, S., Song, S., Yang, J., Ma, J., Yu, J.: Pmet: Precise model editing in a transformer (Mar 2024). https://doi.org/10.1609/aaai.v38i17.29818, https: //ojs.aaai.org/index.php/AAAI/article/view/29818 · DOI
  22. [26]26. Li, X., Mei, S., Liu, Z., Yan, Y., Wang, S., Yu, S., Zeng, Z., Chen, H., Yu, G., Liu, Z., Sun, M., Xiong, C.: RAG-DDR: Optimizing retrieval-augmented generation using differentiable data rewards. In: The Thirteenth International Conference on Learning Representations (2025), https://openreview.net/forum?id=Pnktu2PBXD
  23. [27]27. Liu, W., Wang, X., Owens, J., Li, Y.: Energy-based out-of-distribution detection. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., Lin, H. (eds.) Advances in Neural Information Processing Systems. vol. 33, pp. 21464-21475. Curran Associates, Inc. (2020), https://proceedings.neurips.cc/paper\_files/paper/2020/ file/f5496252609c43eb8a3d147ab9b9c006-Paper.pdf
  24. [30]30. Mak, B., Flanigan, J.: Residual matrix transformers: Scaling the size of the residual stream. In: Forty-second International Conference on Machine Learning (2025), https://openreview.net/forum?id=RR05ym7DNF
  25. [31]31. Malinin, A., Gales, M.: Uncertainty estimation in autoregressive structured prediction (2021), https://openreview.net/forum?id=jN5y-zb5Q7m
  26. [32]32. Manakul, P., Liusie, A., Gales, M.: SelfcheckGPT: Zero-resource black-box hallucination detection for generative large language models (2023), https:// openreview.net/forum?id=RwzFNbJ3Ez
  27. [33]33. Mayfield, J., Yang, E., Lawrie, D., MacAvaney, S., McNamee, P., Oard, D.W., Soldaini, L., Soboroff, I., Weller, O., Kayi, E., Sanders, K., Mason, M., Hibbler, N.: On the evaluation of machine-generated reports. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. p. 1904-1915. SIGIR '24, Association for Computing Machinery, New York, NY, USA (2024). https://doi.org/10.1145/3626772.3657846, https://doi.org/10.1145/3626772.3657846 · DOI
  28. [34]34. Meng, K., Bau, D., Andonian, A., Belinkov, Y.: Locating and editing factual associations in gpt. In: Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K., Oh, A. (eds.) Advances in Neural Information Processing Systems. vol. 35, pp. 17359-17372. Curran Associates, Inc. (2022), https://proceedings.neurips.cc/paper\_files/paper/2022/file/ 6f1d43d5a82a37e89b0665b33bf3a182-Paper-Conference.pdf
  29. [35]35. Meng, K., Sharma, A.S., Andonian, A.J., Belinkov, Y., Bau, D.: Mass-editing memory in a transformer. In: The Eleventh International Conference on Learning Representations (2023), https://openreview.net/forum?id=MkbcAHIYgyS
  30. [36]36. Miroyan, M., Wu, T.H., King, L., Li, T., Pan, J., Hu, X., Chiang, W.L., Angelopoulos, A.N., Darrell, T., Norouzi, N., Gonzalez, J.E.: Search arena: Analyzing search-augmented LLMs (2025), https://arxiv.org/abs/2506.05334 · arXiv
  31. [37]37. Ni, S., Bi, K., Guo, J., Yu, L., Bi, B., Cheng, X.: Towards fully exploiting llm internal states to enhance knowledge boundary perception (2025), https://arxiv. org/abs/2502.11677
  32. [38]38. Niu, C., Wu, Y., Zhu, J., Xu, S., Shum, K., Zhong, R., Song, J., Zhang, T.: RAGTruth: A hallucination corpus for developing trustworthy retrieval-augmented language models. In: Ku, L.W., Martins, A., Srikumar, V. (eds.) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 10862-10878. Association for Computational Linguistics, Bangkok, Thailand (Aug 2024). https://doi.org/10.18653/v1/2024.acl-long.585, https://aclanthology.org/2024.acl-long.585/ · DOI · Paper page
  33. [39]39. Orgad, H., Toker, M., Gekhman, Z., Reichart, R., Szpektor, I., Kotek, H., Belinkov, Y.: LLMs know more than they show: On the intrinsic representation of llm hallucinations (2025), https://arxiv.org/abs/2410.02707 · arXiv
  34. [40]40. Patel, N., Subramanian, S., Garg, S., Banerjee, P., Misra, A.: Towards improved multi-source attribution for long-form answer generation. In: Duh, K., Gomez, H., Bethard, S. (eds.) Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). pp. 3906-3919. Association for Computational Linguistics, Mexico City, Mexico (Jun 2024). https://doi.org/10.18653/v1/2024.naacllong.216, https://aclanthology.org/2024.naacl-long.216/ · DOI
  35. [41]41. Ravi, S.S., Mielczarek, B., Kannappan, A., Kiela, D., Qian, R.: Lynx: An open source hallucination evaluation model (2024), https://arxiv.org/abs/2407. 08488
  36. [42]42. Saad-Falcon, J., Khattab, O., Potts, C., Zaharia, M.: ARES: An automated evaluation framework for retrieval-augmented generation systems (Jun 2024). https://doi.org/10.18653/v1/2024.naacl-long.20, https://aclanthology. org/2024.naacl-long.20/ · DOI · Paper page
  37. [43]43. Shai, A.S., Marzen, S.E., Teixeira, L., Oldenziel, A.G., Riechers, P.M.: Transformers represent belief state geometry in their residual stream. In: Globerson, A., Mackey, L., Belgrave, D., Fan, A., Paquet, U., Tomczak, J., Zhang, C. (eds.) Advances in Neural Information Processing Systems. vol. 37, pp. 75012-75034. Curran Associates, Inc. (2024), https://proceedings.neurips.cc/paper\_files/paper/ 2024/file/8936fa1691764912d9519e1b5673ea66-Paper-Conference.pdf
  38. [45]45. Song, J., Wang, X., Zhu, J., Wu, Y., Cheng, X., Zhong, R., Niu, C.: RAG-HAT: A hallucination-aware tuning pipeline for LLM in retrieval-augmented generation. In: Dernoncourt, F., Preoţiuc-Pietro, D., Shimorina, A. (eds.) Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track. pp. 1548-1558. Association for Computational Linguistics, Miami, Florida, US (Nov 2024). https://doi.org/10.18653/v1/2024.emnlp-industry.113, https:// aclanthology.org/2024.emnlp-industry.113/ · DOI · Paper page
  39. [46]46. Sriramanan, G., Bharti, S., Sadasivan, V.S., Saha, S., Kattakinda, P., Feizi, S.: Llm-check: Investigating detection of hallucinations in large language models. In: Globerson, A., Mackey, L., Belgrave, D., Fan, A., Pa- - quet, U., Tomczak, J., Zhang, C. (eds.) Advances in Neural Information Processing Systems. vol. 37, pp. 34188-34216. Curran Associates, Inc. (2024), https://proceedings.neurips.cc/paper\_files/paper/2024/file/ 3c1e1fdf305195cd620c118aaa9717ad-Paper-Conference.pdf
  40. [49]49. Tan, Y., He, S., Liao, H., Zhao, J., Liu, K.: Dynamic parametric retrieval augmented generation for test-time knowledge enhancement (2025), https://arxiv. org/abs/2503.23895
  41. [50]50. Teller, V.: Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition. MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info . . . (2000)
  42. [51]51. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L.u., Polosukhin, I.: Attention is all you need. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems. vol. 30. Curran Associates, Inc. (2017), https://proceedings.neurips.cc/paper\_files/paper/2017/file/ 3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
  43. [52]52. Wallat, J., Heuss, M., Rijke, M.d., Anand, A.: Correctness is not faithfulness in retrieval augmented generation attributions. In: Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR). p. 22-32. ICTIR '25, Association for Computing Machinery, New York, NY, USA (2025). https://doi.org/10.1145/3731120.3744592, https://doi.org/10.1145/3731120.3744592 · DOI · Paper page
  44. [54]54. Xu, M., Gan, Q., Zhu, Z., Qin, H.: Logprobs know uncertainty: Fighting llm hallucinations. In: Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering. p. 1242-1243. FSE Companion '25, Association for Computing Machinery, New York, NY, USA (2025). https://doi.org/10.1145/3696630.3731433, https://doi.org/10. 1145/3696630.3731433 · DOI

Cited by

Sorted by citations

Authors
Dassen, M., Kotula, R., Murray, K., Yates, A., Lawrie, D., Kayi, E., Mayfield, J., & Duh, K.
Affiliations
  • University of Amsterdam (NL)
  • United States Department of Defense (US)
  • Johns Hopkins University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2601.05866
arXiv
2601.05866
OpenAlex
W7123255347
Cited by
0
References
0
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
citation hallucination, retrieval-augmented generation, hallucination detection, mechanistic interpretability, contextual alignment, model scaling, factual grounding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review