LLMs Will Always Hallucinate, and We Need to Live with This
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some researchers argue that a fraction of hallucinations may be intrinsic to LLM architecture, rooted in the underlying transformer mechanisms and the size and quality of training data26.”
From Multi-model assurance analysis showing large language models are highly vulnerable to adversarial hallucination attacks during clinical decision support (2025) · cites this paper as [26]
In the citing paper
“For instance, LLMs continue to experience hallucinations, producing plausible but factually incorrect results [4].”
From The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelines (2026) · cites this paper as [4]
Citations
Cites
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453
Understanding Media: The Extensions of Man
Levine, S., & McLuhan, M. (1964) · American Quarterly · doi:10.2307/2711172 · Cited by 12,311
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
KAN: Kolmogorov-Arnold Networks
Liu, Z., Wang, Y., Vaidya, S., Ruehle, F., Halverson, J., Soljacic, M., Hou, T. Y., & Tegmark, M. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2404.19756 · Cited by 4,564
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Parameter-efficient transfer learning for NLP
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019) · arXiv · doi:10.48550/arxiv.1902.00751 · Cited by 2,270
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Gu, A., & Dao, T. (2023) · arXiv · doi:10.48550/arxiv.2312.00752 · Cited by 1,579
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
Research works printed but not linked: 10
- Dahl, M., Magesh, V., Suzgun, M., Ho, D.E.: Large legal fictions: profiling legal hallucinations in large language models. J. Legal Anal. 14, 179–217 (2024)
- Huang, L., et al.: A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions. arXiv preprint arXiv:2311.05232 (2023) · arXiv
- Kang, H., Liu, X.-Y.: Deficiency of large language models in finance: an empirical examination of hallucination. arXiv preprint arXiv:2403.15884 (2024) · arXiv
- Khan, M.S., Umer, H.: ChatGPT in finance: applications, challenges, and solutions. Heliyon 10(5), e26859 (2024)
- Marcus, G., Davis, E.: GPT-3, Bloviator: OpenAI’s language generator has no idea what it’s talking about. MIT Technol. Rev. 123(6), 54–61 (2020)
- Nelson, E., Kollias, G., Das, P., Chaudhury, S., Dan, S.: Needle in the haystack for memory based large language models. arXiv preprint arXiv:2405.20329 (2024) · arXiv
- Rawte, V., Priya, P., Tonmoy, S.M.T.I., Zaman, S.M.M., Sheth, A., Das, A.: Exploring the relationship between LLM hallucinations and prompt linguistic nuances: readability, formality, and concreteness. arXiv preprint arXiv:2309.10922 (2023) · arXiv
- Sipser, M.: Introduction to the Theory of Computation. Third edition. Cengage Learning (2006)
- Turing, A.M.: On computable numbers, with an application to the Entscheidungs problem. Proc. Lond. Math. Soc. 42(2), 230–265 (1936)
- Vaswani, A., et al.: Attention is all you need. arXiv preprint arXiv:1706.03762 (2017) · arXiv
Cited by
Omar, M., Sorin, V., Collins, J. D., Reich, D., Freeman, R., Gavin, N., Charney, A., Stump, L., Bragazzi, N. L., Nadkarni, G. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-025-01021-3 · Cited by 204
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective
Lavrinovics, E., Biswas, R., Bjerva, J., & Hose, K. (2024) · Journal of Web Semantics · doi:10.1016/j.websem.2024.100844 · Cited by 146
AI hallucinations can’t be stopped — but these techniques can limit their damage
Jones, N. (2025) · Nature · doi:10.1038/d41586-025-00068-5 · Cited by 118
Qian, K., Liu, S., Li, T., Raković, M., Li, X., Guan, R., Molenaar, I., Nawaz, S., Swiecki, Z., Yan, L., et al. (2026) · Computers & Education · doi:10.1016/j.compedu.2025.105448 · Cited by 39
Language models for materials discovery and sustainability: Progress, challenges, and opportunities
Pei, Z., Yin, J., & Zhang, J. (2025) · Progress in Materials Science · doi:10.1016/j.pmatsci.2025.101495 · Cited by 30
Metadata
- Authors
- Banerjee, S., Agarwal, A., & Singla, S.
- Corresponding author
- Banerjee, Sourav
- ORCID
- Agarwal, Ayushi
- Venue
- Lecture Notes in Networks and Systems
- Publisher
- Springer Nature Switzerland
- Published
- 2025
- Pages
- 624-648
- ISSN
- 2367-3370 (ISSN-L)
- 2367-3389
- OpenAlex
- W4413328432
- Cited by
- 93
- References
- 27
- Citations by year
- 2026: 46 · 2025: 41
- FWCI
- 82.94
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by-nc-sa
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in networks and systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, hallucinations, AI hallucination, Gödel's incompleteness theorems, undecidability, halting problem, information retrieval, intent classification, text generation, fact-checking, human oversight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: LLMs Will Always Hallucinate, and We Need to Live with This. https://app.cochat.ai/papers/10.1007/978-3-031-99965-9_39
- The paper
- Banerjee, S., Agarwal, A., & Singla, S. (2025). LLMs Will Always Hallucinate, and We Need to Live with This. Lecture Notes in Networks and Systems. https://doi.org/10.1007/978-3-031-99965-9_39
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.