A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
Open accessThe DOI matches its Crossref record; 496 of the 496 references it cites were found in a registry or an index; 110 of the 234 sources its claims cite were checked for support.
Abstract
The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating plausible yet nonfactual content. This phenomenon raises significant concerns over the reliability of LLMs in real-world information retrieval (IR) systems and has attracted intensive research to detect and mitigate such hallucinations. Given the open-ended general-purpose attributes inherent to LLMs, LLM hallucinations present distinct challenges that diverge from prior task-specific models. This divergence highlights the urgency for a nuanced understanding and comprehensive overview of recent advances in LLM hallucinations. In this survey, we begin with an innovative taxonomy of hallucination in the era of LLM and then delve into the factors contributing to hallucinations. Subsequently, we present a thorough overview of hallucination detection methods and benchmarks. Our discussion then transfers to representative methodologies for mitigating LLM hallucinations. Additionally, we delve into the current limitations faced by retrieval-augmented LLMs in combating hallucinations, offering insights for developing more robust IR systems. Finally, we highlight the promising research directions on LLM hallucinations, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.
Overview
CoChat Summary
TL;DR
This survey proposes a taxonomy of LLM hallucination into factuality and faithfulness, then reviews causes, detection methods, benchmarks, mitigation strategies, and RAG-specific challenges. It also outlines open directions including hallucinations in large vision-language models and understanding knowledge boundaries in LLMs.
Key findings
- Redefines LLM hallucination as factuality hallucination (factual contradiction: entity-error, relation-error; factual fabrication: unverifiability, overclaim) and faithfulness hallucination (instruction inconsistency, context inconsistency, logical inconsistency).
- Identifies causes across data (misinformation/biases, knowledge boundary, inferior alignment data), training (pre-training, SFT, RLHF), and inference (imperfect decoding, over-confidence, softmax bottleneck, reasoning failure).
- Reviews detection and benchmarks: factuality detection via fact-checking and uncertainty estimation; faithfulness detection via fact-based, classifier-based, QA-based, uncertainty-based, and LLM-based metrics. Reported benchmark sizes include TruthfulQA (817 questions), HaluEval (30,000 task-specific and 5,000 general samples), FreshQA (600 hand-crafted questions), and HaluEval 2.0 (8,770 questions across five domains).
- Mitigation is organized by cause: data filtering, model editing, RAG; pre-training/alignment fixes; and factuality/faithfulness enhanced decoding. RAG still faces retrieval failure and generation bottleneck.
Methods
- Design: a survey/overview that proposes a taxonomy and organizes literature on LLM hallucination principles, causes, detection, benchmarks, mitigation, RAG challenges, and future directions.
- Data or sample: no primary dataset or new experiments; synthesizes existing research and benchmarks such as TruthfulQA, HaluEval, FreshQA, and HaluEval 2.0.
- Main analysis: conceptual categorization and qualitative synthesis; no quantitative meta-analysis is reported.
Limitations
- The paper does not explicitly state limitations of the survey itself.
- It states limitations of reviewed methods: RAG can be impacted by irrelevant retrievals and shallow retriever-generator interactions; fact-checking solely via LLM parametric knowledge may yield inaccurate assessments; classifier-based faithfulness metrics are constrained by scarcity of annotated data.
- Text makes evident: as a survey, it presents no original empirical validation or new benchmark results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
76 Valid · 5 Not valid · 48 Not checked · 108 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recent studies have highlighted a strong correlation between the model's accuracy on general domain questions and the volume of relevant documents [145] or entity popularity [204] within the pre-training corpora.”
What the sources say
- Supportedcites [145] [145] Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023. Large Language Models Struggle to Learn Long-Tail Knowledge. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA (Proceedings of Machine Learning Research, Vol. 202) , Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 15696-15707. https: //proceedings.mlr.press/v202/kandpal23a.html - source
The citation to this paper is attached to the volume of relevant documents, not the separate entity-popularity claim. Section 3.1 (p. 5) reports a strong correlation between question-answering accuracy and relevant pre-training document count across the tested models. (LLM, conf=0.94)
- Partly supportedcites [204] [204] Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023. When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023 , Anna Rogers, Jordan L. Boyd-Graber, and Naoaki Okazaki (Eds.). Association for Computational Linguistics, 9802-9822. https://doi.org/10.18653/v1/2023.acl-long.546 - sourceExperimental — accuracy not yet measured
The “Subject entity popularity predicts memorization” section reports a positive correlation between entity popularity and question-answering accuracy for almost all relationship types. However, the paper measures popularity using Wikipedia page views as a proxy, not entity frequency within pre-training corpora. Its Limitations section also says the experiments rely on synthetic datasets and that applicability to naturally occurring questions is not firmly established. (LLM, conf=0.87)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Such biases can be inadvertently acquired from internet-based texts, which are rife with diverse and biased viewpoints, and subsequently be propagated into the generated content [155].”
What the sources say
- Partly supportedcites [155] [155] Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen McKeown, and Tatsunori Hashimoto. 2023. When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics . Association for Computational Linguistics, Dubrovnik, Croatia, 3206-3219. https://aclanthology.org/2023.eacl-main.234 - sourceExperimental — accuracy not yet measured
The Abstract and §6 Discussion report that pre-training biases can propagate into generated summaries as hallucinated facts. But §6 leaves the source of those biases for future work and treats stereotyping in pre-training data as one possibility; it does not establish that they were acquired from internet-based texts. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Neural networks possess an intrinsic tendency to memorize training data [35]”
What the sources say
- Partly supportedcites [35] [35] Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. 2021. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21) . 2633-2650. - sourceExperimental — accuracy not yet measured
Section 3.1 (p. 3) says memorization is in many ways an essential component of language models, and the Introduction (p. 1) demonstrates that large language models memorize individual training examples. The claim extends that finding to neural networks generally; the cited passages do not establish an intrinsic tendency across all neural networks. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, certain biases are intrinsically tied to hallucinations, especially those related to gender [242] and nationality [155, 226].”
What the sources say
- Not matchedcites [242]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [155] [155] Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen McKeown, and Tatsunori Hashimoto. 2023. When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics . Association for Computational Linguistics, Dubrovnik, Croatia, 3206-3219. https://aclanthology.org/2023.eacl-main.234 - source
The Introduction and Section 3.3 report a strong association between pre-trained models’ name–nationality bias and nationality hallucinations in downstream text summarization. The citation to this paper is attached to nationality; the separate gender citation is not assessed here. (LLM, conf=0.89)
- Not matchedcites [226]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“this memorization tendency grows with model size [34, 54]”
What the sources say
- Supportedcites [34] [34] Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang. 2022. Quantifying memorization across neural language models. ArXiv preprint abs/2202.07646 (2022). https://arxiv.org/ abs/2202.07646 - source
Section 4.1 (p. 4) reports that larger models memorize significantly more than smaller models. The Introduction (p. 2) specifies that this finding is within model families, and the Conclusion (p. 9) describes memorization as scaling with model size. (LLM, conf=0.94)
- Supportedcites [54] [54] Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, H source
Section 7, “Memorization” (p. 35), explicitly concludes that larger models have a higher memorization rate than smaller models. It also reports that the exact-continuation match rate rises from 1.6% for the 8B model to 2.4% for the 540B model. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
102 more claims · 41 with their cited sources checked
Create a free account to see all 237 claims and to verify the 13 references still open.
- Probably not a substantial claim. 97
- It may state two separate claims as one. 55
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, LLMs exhibit hallucination and fabrication errors that are unacceptable for quantitative modeling [19, 20, 21].”
From Structured Schemas for Provenance‐Rich, LLM ‐Assisted QSP Model Calibration (2026) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, the generation of non-existent academic references or legal precedents has been widely recognized as a critical issue [4].”
From Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancy (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Retrieval augmentation, tool use, citation systems, constrained decoding, domain-specific training, and multimodal grounding can all supply partial external anchoring, and they alter both the frequency and the detectability of unsupported claims [15,29].”
From Hallucination as epistemic pollution: epistemic injustice and credibility in futures-oriented science education (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These measures do reduce the frequency of unsupported claims and improve the odds that a learner can detect one, and the argument here does not depend on denying it [15,29].”
From Hallucination as epistemic pollution: epistemic injustice and credibility in futures-oriented science education (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Retrieval-augmented generation evaluation checks whether model claims are factually grounded in retrieved documents.It does not check whether retrieved evidence is attributed to the correct entity.”
From Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation (2026) · cites this paper as Huang et al., 2025
Experimental — accuracy not yet measured
21 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 2.3 Hallucinations in Large Language Models · p. 7
“the final answer of x=4 is inconsistent with the reasoning chain, leading to an incorrect result.”
§ 2.3 Hallucinations in Large Language Models · p. 6
“Step 2: Divide both sides by 2 to get: x = 3. So the result of the equation is x=3.”
Citations
Cites
Items 201–400 of 508
Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus
Zhang, T., Qiu, L., Guo, Q., Deng, C., Zhang, Y., Zhang, Z., Zhou, C., Wang, X., & Fu, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.58 · Cited by 158
Seven Failure Points When Engineering a Retrieval Augmented Generation System
Barnett, S., Kurniawan, S., Thudumu, S., Brannelly, Z., & Abdelrazek, M. (2024) · Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI · doi:10.1145/3644815.3644945 · Cited by 155
Med-HALT: Medical Domain Hallucination Test for Large Language Models
Pal, A., Umapathi, L. K., & Sankarasubbu, M. (2023) · arXiv · doi:10.48550/arxiv.2307.15343 · Cited by 152
Med-HALT: Medical Domain Hallucination Test for Large Language Models
Pal, A., Umapathi, L. K., & Sankarasubbu, M. (2023) · Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL) · doi:10.18653/v1/2023.conll-1.21 · Cited by 152
Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
Liu, F., Lin, K., Li, L., Wang, J., Yacoob, Y., & Wang, L. (2023) · arXiv · doi:10.48550/arxiv.2306.14565 · Cited by 149
Combating misinformation in the age of LLMs: Opportunities and challenges
Chen, C., & Shu, K. (2024) · AI Magazine · doi:10.1002/aaai.12188 · Cited by 148
Slobodkin, A., Goldman, O., Caciularu, A., Dagan, I., & Ravfogel, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.220 · Cited by 143
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs
Ovadia, O., Brief, M., Mishaeli, M., & Elisha, O. (2023) · arXiv · doi:10.48550/arxiv.2312.05934 · Cited by 143
Evaluating Verifiability in Generative Search Engines
Liu, N. F., Zhang, T., & Liang, P. (2023) · arXiv · Cited by 143 · cited 2×
“Another concern lies in the arena of generative retrievals, which occasionally suffer from citation inaccuracies (Rashkin et al.; Liu et al., 2023f; Yue et al., 2023; Gao et al., 2023a; Chen et al., 2023a).”
Large Language Models Struggle to Learn Long-Tail Knowledge
Kandpal, N., Deng, H., Roberts, A., Wallace, E., & Raffel, C. (2022) · arXiv · doi:10.48550/arxiv.2211.08411 · Cited by 143
Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation
Zhang, X., Peng, B., Tian, Y. Z., Zhou, J., Jin, L., Song, L., Mi, H., & Meng, H. M. L. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.107 · Cited by 142
RARR: Researching and revising what language models say, using language models
Gao, L., Dai, Z., Pasupat, P., Chen, A., Chaganty, A. T., Fan, Y., Zhao, V., Lao, N., Lee, H., Juan, D.-C., et al. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.910 · Cited by 141 · cited 2×
“To enhance the trustworthiness and attribution of LLMs, Gao et al. (2023a) adopt the research-then-revise workflow, which initially research relevant evidence and subsequently revise the initial generation based on detected discrepancies with the evidence.”
Gunasekar, S., Zhang, Y., Aneja, J., Mendes, C. C. T., Del Giorno, A., Gopi, S., Javaheripi, M., Kauffmann, P., de Rosa, G., Saarikivi, O., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.11644 · Cited by 138
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs
Ovadia, O., Brief, M., Mishaeli, M., & Elisha, O. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.15 · Cited by 137
Huang, Q., Dong, X., Zhang, P., Wang, B., He, C., Wang, J., Lin, D., Zhang, W., & Yu, N. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01274 · Cited by 136
Contrastive Decoding Improves Reasoning in Large Language ModelsPreprint
O'Brien, S., & Lewis, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.09117 · Cited by 136
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering
Neeman, E., Aharoni, R., Honovich, O., Choshen, L., Szpektor, I., & Abend, O. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.559 · Cited by 135
Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models
Lovenia, H., Dai, W., Cahyawijaya, S., Ji, Z., & Fung, P. (2024) · Workshop on Advances in Language and Vision Research (ALVR) · doi:10.18653/v1/2024.alvr-1.4 · Cited by 135
Reasoning with Language Model Prompting: A Survey
Qiao, S., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S., Tan, C., Huang, F., & Chen, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.294 · Cited by 134
A Survey of Hallucination in Large Foundation Models
Rawte, V., Sheth, A., & Das, A. (2023) · arXiv · doi:10.48550/arxiv.2309.05922 · Cited by 133 · cited 1×
“As the push for reliable generative AI intensifies, LLM hallucination stands out as a major challenge, leading to numerous surveys on its recent advancements (Ji et al., 2023a; Rawte et al., 2023; Liu et al., 2023h; Zhang et al., 2023g; Wang et al., 2023c).”
FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
Jing, L., Li, R., Chen, Y., & Du, X. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.290 · Cited by 130
A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models
Tonmoy, S. M. T. I., Zaman, S. M. M., Jain, V., Rani, A., Rawte, V., Chadha, A., & Das, A. (2024) · arXiv · doi:10.48550/arxiv.2401.01313 · Cited by 129
Reliable, Adaptable, and Attributable Language Models with RetrievalPreprint
Asai, A., Zhong, Z., Chen, D., Koh, P. W., Zettlemoyer, L., Hajishirzi, H., & Yih, W.-T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.03187 · Cited by 125
Hallucinations in Large Multilingual Translation Models
Guerreiro, N. M., Alves, D. M., Waldendorf, J., Haddow, B., Birch, A., Colombo, P., & Martins, A. F. T. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00615 · Cited by 124
Hallucinations in Large Multilingual Translation Models
Guerreiro, N. M., Alves, D., Waldendorf, J., Haddow, B., Birch, A., Colombo, P., & Martins, A. F. T. (2023) · arXiv · doi:10.48550/arxiv.2303.16104 · Cited by 124
Detecting Hallucinated Content in Conditional Neural Sequence Generation
Zhou, C., Neubig, G., Gu, J., Diab, M., Guzmán, F., Zettlemoyer, L., & Ghazvininejad, M. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.120 · Cited by 122
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization
Fabbri, A., Wu, C.-S., Liu, W., & Xiong, C. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.187 · Cited by 119 · cited 1×
“Building on this foundational work, Fabbri et al. (2022) conducted an in-depth evaluation of the components within QA-based metrics, yielding further enhancements in faithfulness evaluation.”
On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation
Wang, C., & Sennrich, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.326 · Cited by 118 · cited 1×
“Such inconsistency can result in hallucinations (Wang and Sennrich, 2020), especially when an erroneous token generated by the model cascades errors throughout the subsequent sequence, akin to a snowball effect (Zhang et al., 2023c).”
Evaluating Hallucinations in Chinese Large Language ModelsPreprint
Cheng, Q., Sun, T., Zhang, W., Wang, S., Liu, X., Zhang, M., He, J., Huang, M., Yin, Z., Chen, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.03368 · Cited by 118
Woodpecker: hallucination correction for multimodal large language models
Yin, S., Fu, C., Zhao, S., Xu, T., Wang, H., Sui, D., Shen, Y., Li, K., Sun, X., & Chen, E. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4251-x · Cited by 118
Self-citationRetrieval-Generation Synergy Augmented Large Language Models
Feng, Z., Feng, X., Zhao, D., Yang, M., & Qin, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448015 · Cited by 117
Self-citationInference-Time Intervention: Eliciting Truthful Answers from a Language Model
Li, K., Patel, O., Viégas, F., Pfister, H., & Wattenberg, M. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1797 · Cited by 117
Hallucination: Philosophy and Psychology
(2013) · The MIT Press eBooks · doi:10.7551/mitpress/9780262019200.001.0001 · Cited by 116
Editing Large Language Models: Problems, Methods, and Opportunities
Yao, Y., Wang, P., Tian, B., Cheng, S., Li, Z., Deng, S., Chen, H., & Zhang, N. (2023) · arXiv · doi:10.48550/arxiv.2305.13172 · Cited by 115 · cited 3×
“…editing techniques can fix factual errors and refresh outdated information to mitigate the knowledge gap, which can be categorized into two classes: changing the model’s behavior by modifying the model parameters or using an external model plug-in with the original model frozen (Yao et al., 2023c).”
(2023) · doi:10.18653/v1/2023.emnlp-main.632 · Cited by 115
Entity-level Factual Consistency of Abstractive Text Summarization
Nan, F., Nallapati, R., Wang, Z., Nogueira dos Santos, C., Zhu, H., Zhang, D., McKeown, K., & Xiang, B. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.235 · Cited by 114 · cited 1×
“Nan et al. (2021) introduced a metric to quantify the extent of entity hallucination, which calculates the precision of named-entities in the summary against the source entities.”
Honovich, O., Choshen, L., Aharoni, R., Neeman, E., Szpektor, I., & Abend, O. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.619 · Cited by 113 · cited 1×
“Notable implementations include (Durmus et al., 2020; Wang et al., 2020a; Scialom et al., 2021; Honovich et al., 2021).”
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models
Wen, Y., Wang, Z., & Sun, J. (2023) · arXiv · doi:10.48550/arxiv.2308.09729 · Cited by 113
MindMap: Knowledge graph prompting sparks graph of thoughts in large language models
Wen, Y., Wang, Z., & Sun, J. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.558 · Cited by 113
Zhang, Z., Fang, M., & Chen, L. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.415 · Cited by 108
On NMT Search Errors and Model Errors: Cat Got Your Tongue?
Stahlberg, F., & Byrne, B. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1331 · Cited by 107 · cited 1×
“The rationale for incorporating randomness into decoding strategies stems from the realization that high likelihood sequences often result in surprisingly low-quality text, which is called likelihood trap (Stahlberg and Byrne, 2019; Holtzman et al., 2020; Meister et al., 2020; Zhang et al., 2021).”
Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded GuidancePreprint
Zhao, L., Deng, Y., Zhang, W., & Gu, Q. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.08680 · Cited by 106
Wang, L., He, J., Li, S., Liu, N., & Lim, E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53302-0_3 · Cited by 104
Contrastive Decoding: Open-ended Text Generation as Optimization
Li, X. L., Holtzman, A., Fried, D., Liang, P., Eisner, J., Hashimoto, T., Zettlemoyer, L., & Lewis, M. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.687 · Cited by 103
Su, W.-H., Tang, Y.-C., Ai, Q.-Y., et al. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2403.10081 · Cited by 102
Zhang, Z., Chen, R., Liu, S., Yao, Z., Ruwase, O., Chen, B., Wu, X., & Wang, Z. (2024) · neural information processing systems · doi:10.52202/079017-1943 · Cited by 102
Asai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101
Entity-Based Knowledge Conflicts in Question Answering
Longpre, S., Perisetla, K., Chen, A., Ramesh, N., DuBois, C., & Singh, S. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.565 · Cited by 101
RaFe: Ranking Feedback Improves Query Rewriting for RAG
Mao, S., Jiang, Y., Chen, B., Li, X., Wang, P., Wang, X., Xie, P., Huang, F., Chen, H., & Zhang, N. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.49 · Cited by 101
Annotating and Modeling Fine-grained Factuality in Summarization
Goyal, T., & Durrett, G. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.114 · Cited by 100 · cited 2×
“…hallucinations, such as abstractive summarization (Kryscinski et al., 2020; Wang et al., 2020a; Maynez et al., 2020; Fabbri et al., 2021; Goyal and Durrett, 2021; Pagnoni et al., 2021; Tang et al., 2022), data-to-text(Tian et al., 2019; Parikh et al., 2020), and machine translation (Zhou et al.,…”
Zhang, Z. (., Chen, R., Liu, S.-W., et al. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2403.04797 · Cited by 100
Li, W., Wu, W., Chen, M., Liu, J., Xiao, X., & Wu, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.05227 · Cited by 99
Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models
Lovenia, H., Dai, W., Cahyawijaya, S., et al. (2023) · ALVR · doi:10.48550/arxiv.2310.05338 · Cited by 99
Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
Chen, Y., Sikka, K., Cogswell, M., Ji, H., & Divakaran, A. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.11 · Cited by 99
Tan, H., Sun, F., Yang, W., Wang, Y., Cao, Q., & Cheng, X. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.337 · Cited by 99
Attribute First, then Generate: Locally-attributable Grounded Text Generation
Slobodkin, A., Hirsch, E., Cattan, A., Schuster, T., & Dagan, I. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.182 · Cited by 97
RaFe: Ranking Feedback Improves Query Rewriting for RAGPreprint
Mao, S., Jiang, Y., Chen, B., Li, X., Wang, P., Wang, X., Xie, P.-J., Huang, F., Chen, H.-J., & Zhang, N.-Y. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2405.14431 · Cited by 95
Exposing Attention Glitches with Flip-Flop Language ModelingPreprint
Liu, B., Ash, J. T., Goel, S., Krishnamurthy, A., & Zhang, C. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2306.00946 · Cited by 94
Chainpoll: A high efficacy method for LLM hallucination detectionPreprint
Friel, R., & Sanyal, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.18344 · Cited by 94
Evaluating Factuality in Generation with Dependency-level Entailment
Goyal, T., & Durrett, G. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.322 · Cited by 93 · cited 1×
“…have proposed methods such as fine-tuning on adversarial datasets (Barrantes et al., 2020), decomposing the entailment decisions at the dependency arc level (Goyal and Durrett, 2020), and segmenting documents into sentence units then aggregating scores between sentence pairs (Laban et al., 2022).”
Zhang, J., Li, Z., Das, K., Malin, B., & Kumar, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1032 · Cited by 93
Ni, S., Bi, K., Guo, J., & Cheng, X. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.675 · Cited by 93
When Large Language Models Meet Vector Databases: A Survey
Jing, Z., Su, Y., & Han, Y. (2025) · 2025 Conference on Artificial Intelligence x Multimedia (AIxMM) · doi:10.1109/aixmm62960.2025.00008 · Cited by 93
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation
Qi, J., Sarti, G., Fernández, R., & Bisazza, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.347 · Cited by 90
FELM: Benchmarking Factuality Evaluation of Large Language ModelsPreprint
Chen, S., Zhao, Y., Zhang, J., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2310.00741 · Cited by 89
He, J., Pan, K., Dong, X., Song, Z., LiuYiBo, L., Qianguosun, Q., Liang, Y., Wang, H., Zhang, E., & Zhang, J. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.736 · Cited by 89
Self-citationRowen: Adaptive Retrieval-Augmented Generation for Hallucination Mitigation in LLMs
Ding, H., Pang, L., Wei, Z., Shen, H., & Cheng, X. (2025) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3767695.3769500 · Cited by 89
SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
Min, S., Gururangan, S., Wallace, E., Shi, W., Hajishirzi, H., Smith, N. A., & Zettlemoyer, L. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2308.04430 · Cited by 88
Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?
Gekhman, Z., Yona, G., Aharoni, R., Eyal, M., Feder, A., Reichart, R., & Herzig, J. (2024) · arXiv · doi:10.48550/arxiv.2405.05904 · Cited by 86
Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?
Gekhman, Z., Yona, G., Aharoni, R., Eyal, M., Feder, A., Reichart, R., & Herzig, J. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.444 · Cited by 86
Pan, L., Saxon, M., Xu, W., Nathani, D., Wang, X., & Wang, W. Y. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00660 · Cited by 86
LM vs LM: Detecting Factual Errors via Cross Examination
Cohen, R., Hamri, M., Geva, M., & Globerson, A. (2023) · arXiv · doi:10.48550/arxiv.2305.13281 · Cited by 85
Alignment for HonestyPreprint
Yang, Y., Chern, E., Qiu, X., Neubig, G., & Liu, P.-F. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2312.07000 · Cited by 84
Exposing Attention Glitches with Flip-Flop Language Modeling
Liu, B., Ash, J. T., Goel, S., Krishnamurthy, A., & Zhang, C. (2023) · neural information processing systems · doi:10.52202/075280-1112 · Cited by 84
A New Benchmark and Reverse Validation Method for Passage-level Hallucination Detection
Yang, S., Sun, R., & Wan, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.256 · Cited by 83
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Shi, W., Han, X., Lewis, M., Tsvetkov, Y., Zettlemoyer, L., & Yih, W.-T. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers) · doi:10.18653/v1/2024.naacl-short.69 · Cited by 83
Effective Large Language Model Adaptation for Improved Grounding and Citation Generation
Ye, X., Sun, R., Arık, S. Ö., & Pfister, T. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.346 · Cited by 82
Zero-Resource Hallucination Prevention for Large Language Models
Luo, J., Xiao, C., & Ma, F. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.204 · Cited by 82
HOW TO CATCH AN AI LIAR: LIE DETECTION IN BLACK-BOX LLMS BY ASKING UNRELATED QUESTIONSPreprint
Pacchiardi, L., Chan, A., Mindermann, S., Moscovitz, I., Pan, A., Gal, Y., Evans, O., & Brauner, J. (2023) · arXiv (Cornell University) · doi:10.17863/cam.112513 · Cited by 82
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding
Dziri, N., Madotto, A., Zaïane, O., & Bose, A. J. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.168 · Cited by 81 · cited 1×
“The diversity introduced by the randomness in decoding strategies comes at a cost, as it is positively correlated with an increased risk of hallucinations (Dziri et al., 2021a; Chuang et al., 2023).”
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Iyer, S., Lin, X. V., Pasunuru, R., Mihaylov, T., Simig, D., Yu, P., Shuster, K., Wang, T., Liu, Q., Koura, P. S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.12017 · Cited by 81
Su, W., Tang, Y., Ai, Q., Wu, Z., & Liu, Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.702 · Cited by 81
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection
Choi, S.-H., Fang, T., Wang, Z., & Song, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.867 · Cited by 80
Controlled Hallucinations: Learning to Generate Faithfully from Noisy Data
Filippova, K. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.76 · Cited by 79 · cited 1×
“Within the realm of NLP, hallucination is typically referred to as a phenomenon in which the generated content appears nonsensical or unfaithful to the provided source content (Filippova, 2020; Maynez et al., 2020).”
On hallucination and predictive uncertainty in conditional language generation
Xiao, Y., & Wang, W. Y. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.236 · Cited by 79 · cited 1×
“Xiao and Wang (2021) Prompting-based Metrics.”
Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender System
Gao, Y., Sheng, T., Xiang, Y., Xiong, Y., Wang, H., & Zhang, J. (2023) · arXiv · doi:10.48550/arxiv.2303.14524 · Cited by 79
Self-citationTrustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
Liu, Y., Yao, Y., Ton, J.-F., Zhang, X., Guo, R., Cheng, H., Klochkov, Y., Taufiq, M. F., & Li, H. (2023) · arXiv · doi:10.48550/arxiv.2308.05374 · Cited by 79
Knowledge Editing for Large Language Models: A Survey
Wang, S., Zhu, Y., Liu, H., Zheng, Z., Chen, C., & Li, J. (2025) · ACM Computing Surveys · doi:10.1145/3698590 · Cited by 79
Ni, S.-Y., Bi, K.-P., Guo, J., et al. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2402.11457 · Cited by 78
The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Models
Zhang, S., Pan, L., Zhao, J., & Wang, W. Y. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.121 · Cited by 78
How Language Model Hallucinations Can Snowball
Zhang, M., Press, O., Merrill, W., Liu, A., & Smith, N. A. (2023) · arXiv · doi:10.48550/arxiv.2305.13534 · Cited by 77 · cited 1×
“Such inconsistency can result in hallucinations (Wang and Sennrich, 2020), especially when an erroneous token generated by the model cascades errors throughout the subsequent sequence, akin to a snowball effect (Zhang et al., 2023c).”
Do Large Language Models Know What They Don’t Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.551 · Cited by 75
Faithfulness-Aware Decoding Strategies for Abstractive Summarization
Wan, D., Liu, M., McKeown, K. R., Dreyer, M., & Bansal, M. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.210 · Cited by 75
Dense X Retrieval: What Retrieval Granularity Should We Use?
Chen, T., Wang, H., Chen, S., Yu, W., Ma, K., Zhao, X., Zhang, H., & Yu, D. (2023) · arXiv · doi:10.48550/arxiv.2312.06648 · Cited by 74
Self-citationEvaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering
Adlakha, V., BehnamGhader, P., Lu, X. H., Meade, N., & Reddy, S. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00667 · Cited by 74 · cited 2×
“Exploiting this capability, researchers have ventured into novel paradigms for assessing the faithfulness of model-generated content (Luo et al., 2023b; Laban et al., 2023; Adlakha et al., 2023; Gao et al., 2023b; Jain et al., 2023).”
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering
Adlakha, V., BehnamGhader, P., Lu, X. H., Meade, N., & Reddy, S. (2023) · arXiv · doi:10.48550/arxiv.2307.16877 · Cited by 74 · cited 2×
“Exploiting this capability, researchers have ventured into novel paradigms for assessing the faithfulness of model-generated content (Luo et al., 2023b; Laban et al., 2023; Adlakha et al., 2023; Gao et al., 2023b; Jain et al., 2023).”
Dense X Retrieval: What Retrieval Granularity Should We Use?
Chen, T., Wang, H., Chen, S., Yu, W., Ma, K., Zhao, X., Zhang, H., & Yu, D. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.845 · Cited by 74
Self-citationFreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
Vu, T., Iyyer, M., Wang, X., Constant, N., Wei, J., Wei, J., Tar, C., Sung, Y.-H., Zhou, D., Le, Q., et al. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.813 · Cited by 73
Jiang, C., Jia, H., Dong, M., Ye, W., Xu, H., Yan, M., Zhang, J., & Zhang, S. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680576 · Cited by 73
Found in the Middle: Permutation Self-Consistency Improves Listwise Ranking in Large Language ModelsPreprint
Tang, R., Zhang, C., Ma, X., Lin, J., & Ture, F. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2310.07712 · Cited by 71
TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction
Liu, J., Li, L., Xiang, T., Wang, B., & Qian, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.655 · Cited by 70
Measuring and Improving Chain-of-Thought Reasoning in Vision-Language ModelsPreprint
Chen, Y., Sikka, K., Cogswell, M., Ji, H., & Divakaran, A. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2309.04461 · Cited by 70
Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method
Zhao, Y., Yan, L., Sun, W., Xing, G., Meng, C., Wang, S., Cheng, Z., Ren, Z., & Yin, D. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.390 · Cited by 70
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models
Li, J., Chen, J., Ren, R., Cheng, X., Zhao, X., Nie, J.-Y., & Wen, J.-R. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.586 · Cited by 70
Aligning Large Language Models with Human: A Survey
Wang, Y., Zhong, W., Li, L., Mi, F., Zeng, X., Huang, W., Shang, L., Jiang, X., & Liu, Q. (2023) · arXiv · doi:10.48550/arxiv.2307.12966 · Cited by 69
Self-citationFactuality Enhanced Language Models for Open-Ended Text Generation
Lee, N., Ping, W., Xu, P., Patwary, M., Fung, P., Shoeybi, M., & Catanzaro, B. (2022) · arXiv · doi:10.48550/arxiv.2206.04624 · Cited by 68
In-context Pretraining: Language Modeling Beyond Document BoundariesPreprint
Shi, W., Min, S., Lomelí, M., Zhou, C., Li, M., Szilvasy, G., James, R., Lin, X. V., Smith, N. A., Zettlemoyer, L., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.10638 · Cited by 68
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection
Choi, S., Fang, T., Wang, Z., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2310.09044 · Cited by 68
(2022) · doi:10.52202/068431-2506 · Cited by 68
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Black, S., Biderman, S., Hallahan, E., Anthony, Q., Gao, L., Golding, L., He, H., Leahy, C., McDonell, K., Phang, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.06745 · Cited by 67
REPLUG: Retrieval-augmented black-box language models
Shi, W., Min, S., Yasunaga, M., Seo, M., James, R., Lewis, M., Zettlemoyer, L., & Yih, W.-T. (2023) · arXiv · doi:10.48550/arxiv.2301.12652 · Cited by 65
Effective Large Language Model Adaptation for Improved Grounding and Citation GenerationPreprint
Ye, X., Sun, R.-X., Arik, S. Ö., & Pfister, T. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2311.09533 · Cited by 65
Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection MethodPreprint
Zhao, Y.-K., Yan, L., Sun, W., et al. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2310.17918 · Cited by 65
Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding
Zhao, L., Feng, X., Feng, X., Zhong, W., Xu, D., Yang, Q., Liu, H., Qin, B., & Liu, T. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.582 · Cited by 65
Self-citationASQA: Factoid Questions Meet Long-Form Answers
Stelmakh, I., Luan, Y., Dhingra, B., & Chang, M.-W. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.566 · Cited by 63
Guerreiro, N. M., Voita, E., & Martins, A. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.75 · Cited by 63
A Review on Language Models as Knowledge Bases
AlKhamissi, B., Li, M., Celikyilmaz, A., Diab, M., & Ghazvininejad, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06031 · Cited by 62
The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey
Huang, Y., Feng, X., Feng, X., & Qin, B. (2021) · arXiv · doi:10.48550/arxiv.2104.14839 · Cited by 62 · cited 1×
“Generally, hallucinations in natural language generation tasks can be categorized into two primary types: intrinsic hallu-cination and extrinsic hallucination (Huang et al., 2021; Li et al., 2022b; Ji et al., 2023a).”
Self-citationPile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
Henderson, P., Krass, M., Zheng, L., Guha, N., Manning, C. D., Jurafsky, D., & Ho, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2119 · Cited by 62
Self-Knowledge Guided Retrieval Augmentation for Large Language Models
Wang, Y., Li, P., Sun, M., & Liu, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.691 · Cited by 61
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
Wang, C., Liu, X., Yue, Y., Tang, X., Zhang, T., Jiayang, C., Yao, Y., Gao, W., Hu, X., Qi, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.07521 · Cited by 61
LM vs LM: Detecting Factual Errors via Cross Examination
Cohen, R., Hamri, M., Geva, M., & Globerson, A. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.778 · Cited by 60
Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation
Tian, R., Narayan, S., Sellam, T., & Parikh, A. P. (2019) · arXiv · doi:10.48550/arxiv.1910.08684 · Cited by 60 · cited 2×
“…such as abstractive summarization (Kryscinski et al., 2020; Wang et al., 2020a; Maynez et al., 2020; Fabbri et al., 2021; Goyal and Durrett, 2021; Pagnoni et al., 2021; Tang et al., 2022), data-to-text(Tian et al., 2019; Parikh et al., 2020), and machine translation (Zhou et al., 2021).”
Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints
Wang, Z., Wang, X., An, B., Yu, D., & Chen, C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.101 · Cited by 59 · cited 1×
“When treating the source content as the reference, traditional n-gram overlap-based evaluation metrics, such as ROUGE (Lin, 2004) and PARENT-T (Wang et al., 2020b), can also be applied to assess faithfulness.”
Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning
Branco, R., Branco, A., Rodrigues, J. A., & Silva, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.113 · Cited by 58 · cited 1×
“They first generate a consistent rationale using contrastive decoding (Li et al., 2022c) and then fine-tune the student model with a counterfactual reasoning objective, which effectively eliminates reasoning shortcuts (Branco et al., 2021) that derive answers without considering the rationale.”
LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examples
Yao, J.-Y., Ning, K.-P., Liu, Z., Ning, M., Li, Y., & Yuan, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.01469 · Cited by 58
Mutual Information Alleviates Hallucinations in Abstractive Summarization
van der Poel, L., Cotterell, R., & Meister, C. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.399 · Cited by 57
KL-Divergence Guided Temperature SamplingPreprint
Chang, C.-C., Reitter, D., Aksitov, R., & Sung, Y.-H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.01286 · Cited by 56
Verify-and-edit: A knowledge-enhanced chain-of-thought framework
Zhao, R., Li, X., Joty, S., Qin, C., & Bing, L. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.320 · Cited by 55
Discovering Latent Knowledge in Language Models Without Supervision
Burns, C., Ye, H., Klein, D., & Steinhardt, J. (2022) · arXiv · doi:10.48550/arxiv.2212.03827 · Cited by 55 · cited 4×
“Several studies have demonstrated that LLM’s activations encapsulate an internal belief related to the truthfulness of its generated statements (Burns et al., 2022; Azaria and Mitchell, 2023).”
InfluentialAttention With Sparsity Regularization for Neural Machine Translation and Summarization
Zhang, J., Zhao, Y., Li, H., & Zong, C. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2883740 · Cited by 53
ChatGPT as a Factual Inconsistency Evaluator for Text Summarization
Luo, Z., Xie, Q., & Ananiadou, S. (2023) · arXiv · doi:10.48550/arxiv.2303.15621 · Cited by 53
Faithful Logical Reasoning via Symbolic Chain-of-Thought
Xu, J., Fei, H., Pan, L., Liu, Q., Lee, M.-L., & Hsu, W. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.720 · Cited by 53
RealTime QA: What's the Answer Right Now?
Kasai, J., Sakaguchi, K., Takahashi, Y., Bras, R. L., Asai, A., Yu, X., Radev, D., Smith, N. A., Choi, Y., & Inui, K. (2022) · arXiv · doi:10.48550/arxiv.2207.13332 · Cited by 52
Zhang, J., Li, Z., Das, K., Malin, B., & Kumar, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.01740 · Cited by 52
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models
Yu, W., Zhang, H., Pan, X., Cao, P., Ma, K., Li, J., Wang, H., & Yu, D. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.813 · Cited by 52
Self-citationRealTime QA: What's the Answer Right Now?
Kasai, J., Sakaguchi, K., Takahashi, Y., Bras, R. L., Asai, A., Yu, X., Radev, D., Smith, N., Choi, Y., & Inui, K. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2130 · Cited by 52
Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering
Baek, J., Aji, A., & Saffari, A. (2023) · Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023) · doi:10.18653/v1/2023.matching-1.7 · Cited by 51 · cited 1×
“These KGs serve as a pivotal tool for prompting LLMs, facilitating their interaction with the most recent knowledge, and eliciting robust reasoning pathways (Wen et al., 2023; Qi et al., 2023; Baek et al., 2023).”
Memory-Based Model Editing at Scale
Mitchell, E., Lin, C., Bosselut, A., Manning, C. D., & Finn, C. (2022) · arXiv · doi:10.48550/arxiv.2206.06520 · Cited by 51
Still no lie detector for language models: probing empirical and conceptual roadblocks
Levinstein, B. A., & Herrmann, D. A. (2025) · Philosophical Studies · doi:10.1007/s11098-023-02094-3 · Cited by 50 · cited 1×
“Nonetheless, Levinstein and Herrmann (2023) have employed empirical and conceptual tools to probe whether or not LLMs have beliefs.”
Unified Active Retrieval for Retrieval Augmented Generation
Cheng, Q., Li, X., Li, S., Zhu, Q., Yin, Z., Shao, Y., Li, L., Sun, T., Yan, H., & Qiu, X. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.999 · Cited by 50
Self-critiquing models for assisting human evaluators
Saunders, W., Yeh, C., Wu, J., Bills, S., Ouyang, L., Ward, J., & Leike, J. (2022) · arXiv · doi:10.48550/arxiv.2206.05802 · Cited by 50 · cited 2×
“This sycophantic behavior can be attributed to the fact that human preference judgments often favor sycophantic responses over more truthful ones (Sharma et al., 2023), paving the way for reward hacking (Saunders et al., 2022).”
Rethinking with Retrieval: Faithful Large Language Model Inference
He, H., Zhang, H., & Roth, D. (2023) · arXiv · doi:10.48550/arxiv.2301.00303 · Cited by 50
Chu, Z., Chen, J., Chen, Q., Yu, W., He, T., Wang, H., Peng, W., Liu, M., Qin, B., & Liu, T. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.65 · Cited by 50
Self-citationPrevent the Language Model from being Overconfident in Neural Machine Translation
Miao, M., Meng, F., Liu, Y., Zhou, X., & Zhou, J. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.268 · Cited by 48 · cited 1×
“Prior studies, particularly in domains like machine translation (Miao et al., 2021) and summarization (Chen et al., 2022b), have highlighted the issue of over-confidence in generative models employing encoder-decoder architectures.”
Nearest Neighbor Speculative Decoding for LLM Generation and Attribution
Li, M., Chen, X., Holtzman, A., Chen, B., Lin, J., Yih, W.-T., & Lin, X. (2024) · neural information processing systems · doi:10.52202/079017-2574 · Cited by 48
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2021) · arXiv · doi:10.48550/arxiv.2105.00071 · Cited by 47
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00506 · Cited by 47
Ask Optimal Questions: Aligning Large Language Models with Retriever’s Preference in Conversation
Yoon, C., Kim, G., Jeon, B., Kim, S., Jo, Y., & Kang, J. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.328 · Cited by 47
Large Language Models with Controllable Working Memory
Li, D., Rawat, A. S., Zaheer, M., Wang, X., Lukasik, M., Veit, A., Yu, F., & Kumar, S. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.112 · Cited by 46
Context-faithful Prompting for Large Language Models
Zhou, W., Zhang, S., Poon, H., & Chen, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.968 · Cited by 46
Zero-Resource Hallucination Prevention for Large Language ModelsPreprint
Luo, J., Xiao, C., & Ma, F. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2309.02654 · Cited by 46
Sun, K., Xu, Y., Zha, H., Liu, Y., & Dong, X. L. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.18 · Cited by 46
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., & Gurevych, I. (2021) · arXiv · doi:10.48550/arxiv.2104.08663 · Cited by 45
Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Images
Xu, S., Hou, D., Pang, L., Deng, J., Xu, J., Shen, H., & Cheng, X. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657750 · Cited by 45
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness
Li, J., Cao, P., Chen, Y., Xu, J., Li, H., Jiang, X., Liu, K., & Zhao, J. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.560 · Cited by 45
Chen, X., He, B., Lin, H., Han, X., Wang, T., Cao, B., Sun, L., & Sun, Y. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.798 · Cited by 44
Chain-of-Verification Reduces Hallucination in Large Language Models
Dhuliawala, S., Komeili, M., Xu, J., Raileanu, R., Li, X., Celikyilmaz, A., & Weston, J. (2023) · arXiv · doi:10.48550/arxiv.2309.11495 · Cited by 42
Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models
Shao, Y., Jiang, Y., Kanell, T., Xu, P., Khattab, O., & Lam, M. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.347 · Cited by 41
Learning to Plan and Generate Text with Citations
Fierro, C., Amplayo, R. K., Huot, F., Cao, N. D., Maynez, J., Narayan, S., & Lapata, M. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.615 · Cited by 41
Evaluation and Enhancement of Semantic Grounding in Large Vision-Language ModelsPreprint
Lu, J., Rao, J., Chen, K., Guo, X., Zhang, Y., Sun, B., Yang, C., & Yang, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.04041 · Cited by 41
Human-like Summarization Evaluation with ChatGPT
Gao, M., Ruan, J., Sun, R., Yin, X., Yang, S., & Wan, X. (2023) · arXiv · doi:10.48550/arxiv.2304.02554 · Cited by 40
Why Does ChatGPT Fall Short in Providing Truthful Answers?
Zheng, S., Huang, J., & Chang, K. C.-C. (2023) · arXiv · doi:10.48550/arxiv.2304.10513 · Cited by 40
Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation
Pan, R., Cao, B., Lin, H., Han, X., Zheng, J., Wang, S., Cai, X., & Sun, L. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.1109 · Cited by 40
Mishra, A., Patel, D., Vijayakumar, A., Li, X. L., Kapanipathi, P., & Talamadupula, K. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.104 · Cited by 39 · cited 1×
“However, Mishra et al. (2021) highlighted that the mismatch in input granularity between conventional NLI datasets and inconsistency detection datasets limits their applicability for effectively detecting inconsistencies.”
Overcoming a Theoretical Limitation of Self-Attention
Chiang, D., & Cholak, P. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.527 · Cited by 39
Nationality Bias in Text Generation
Narayanan Venkit, P., Gautam, S., Panchanadikar, R., Huang, T.-H., & Wilson, S. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.9 · Cited by 39
Fast and Accurate Factual Inconsistency Detection Over Long Documents
Lattimer, B. M., Chen, P. M., Zhang, X., & Yang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.105 · Cited by 39 · cited 1×
“ScreenEval (Lattimer et al., 2023).”
RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented GenerationPreprint
Wang, S., Xu, X., Wang, M., Chen, W., Zhu, Y., & Dou, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.12566 · Cited by 39
Language Modeling Is Compression
Delétang, G., Ruoss, A., Duquenne, P.-A., Catt, E., Genewein, T., Mattern, C., Grau-Moya, J., Wenliang, L. K., Aitchison, M., Orseau, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.10668 · Cited by 39
Fool Your (Vision and) Language Model With Embarrassingly Simple PermutationsPreprint
Zong, Y., Yu, T., Chavhan, R., Zhao, B., & Hospedales, T. M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.01651 · Cited by 39
Qi, Z., Yu, Y., Tu, M., Tan, J., & Huang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.10173 · Cited by 38
How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and ConsistencyPreprint
Zheng, D., Lapata, M., & Pan, J. Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.13578 · Cited by 38
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
Manakul, P., Liusie, A., & Gales, M. J. F. (2023) · arXiv · doi:10.48550/arxiv.2303.08896 · Cited by 38
SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization
Laban, P., Schnabel, T., Bennett, P. N., & Hearst, M. A. (2021) · arXiv · doi:10.48550/arxiv.2111.09525 · Cited by 38
Understanding Neural Abstractive Summarization Models via Uncertainty
Xu, J., Desai, S., & Durrett, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.508 · Cited by 37
Do Language Models Know When They’re Hallucinating References?
Agrawal, A., Suzgun, M., Mackey, L., & Kalai, A. T. (2023) · arXiv · doi:10.48550/arxiv.2305.18248 · Cited by 37
Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models
Feng, S., Shi, W., Bai, Y., Balachandran, V., He, T., & Tsvetkov, Y. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2305.09955 · Cited by 37
A Survey on Hallucination in Large Vision-Language Models
Liu, H., Xue, W., Chen, Y., Chen, D., Zhao, X., Wang, K., Hou, L., Li, R., & Peng, W. (2024) · arXiv · doi:10.48550/arxiv.2402.00253 · Cited by 37
Self-citationDo Language Models Know When They’re Hallucinating References?
Agrawal, A., Suzgun, M., Mackey, L., & Kalai, A. (2024) · Findings of the Association for Computational Linguistics: EACL 2024 · doi:10.18653/v1/2024.findings-eacl.62 · Cited by 37
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., & Manning, C. D. (2024) · arXiv · doi:10.48550/arxiv.2401.18059 · Cited by 36
The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
Berglund, L., Tong, M., Kaufmann, M., Balesni, M., Stickland, A. C., Korbak, T., & Evans, O. (2023) · arXiv · doi:10.48550/arxiv.2309.12288 · Cited by 36 · cited 1×
“Furthermore, Berglund et al. (2023) unveiled a specific reasoning failure in LLMs termed the Reversal Curse .”
SimCSE: Simple Contrastive Learning of Sentence EmbeddingsPreprint
Gao, T., Yao, X., & Chen, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08821 · Cited by 36
Neural Retrievers are Biased Towards LLM-Generated Content
Dai, S., Zhou, Y., Pang, L., Liu, W., Hu, X., Liu, Y., Zhang, X., Wang, G., & Xu, J. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671882 · Cited by 35
Measuring Progress on Scalable Oversight for Large Language Models
Bowman, S. R., Hyun, J., Perez, E., Chen, E., Pettit, C., Heiner, S., Lukošiūtė, K., Askell, A., Jones, A., Chen, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2211.03540 · Cited by 34
Measuring Faithfulness in Chain-of-Thought Reasoning
Lanham, T., Chen, A., Radhakrishnan, A., Steiner, B., Denison, C., Hernandez, D., Li, D., Durmus, E., Hubinger, E., Kernion, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.13702 · Cited by 33
The Instinctive Bias: Spurious Images lead to Illusion in MLLMs
Han, T., Lian, Q., Pan, R., Pi, R., Zhang, J., Diao, S., Lin, Y., & Zhang, T. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.904 · Cited by 33
Entity Cloze By Date: What LMs Know About Unseen Entities
Onoe, Y., Zhang, M., Choi, E., & Durrett, G. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.52 · Cited by 31
Chen, H.-T., Zhang, M., & Choi, E. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.146 · Cited by 31
FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
Jing, L., Li, R., Chen, Y., & Du, X. (2023) · arXiv · doi:10.48550/arxiv.2311.01477 · Cited by 31
On Context Utilization in Summarization with Large Language Models
Ravaut, M., Sun, A., Chen, N. F., & Joty, S. (2023) · arXiv · doi:10.48550/arxiv.2310.10570 · Cited by 31
Chen, H.-T., Zhang, M. J. Q., & Choi, E. (2022) · arXiv · doi:10.48550/arxiv.2210.13701 · Cited by 31
Extracting Latent Steering Vectors from Pretrained Language Models
Subramani, N., Suresh, N., & Peters, M. E. (2022) · arXiv · doi:10.48550/arxiv.2205.05124 · Cited by 31
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization
Ladhak, F., Durmus, E., Suzgun, M., Zhang, T., Jurafsky, D., McKeown, K., & Hashimoto, T. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.234 · Cited by 30 · cited 3×
“By carefully selecting diverse, balanced, and representative training data, we can mitigate biases (Paullada et al., 2021; Narayanan Venkit et al., 2023; Ladhak et al., 2023) that may trigger hallucinations.”
He, J., Pan, K.-H., Dong, X., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2311.09198 · Cited by 30
Self-citationOn Context Utilization in Summarization with Large Language Models
Ravaut, M., Sun, A., Chen, N., & Joty, S. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.153 · Cited by 30
Advancing Large Language Model Attribution through Self-Improving
Huang, L., Feng, X., Ma, W., Zhao, L., Fan, Y., Zhong, W., Xu, D., Yang, Q., Liu, H., & Qin, B. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.223 · Cited by 29
Self-citationChern, I.-C., Chern, S., Chen, S., Yuan, W., Feng, K., Zhou, C., He, J., Neubig, G., & Liu, P. (2023) · arXiv · doi:10.48550/arxiv.2307.13528 · Cited by 29
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29
Research works printed but not linked: 33
- ArXiv. 2023. arxiv dataset. Retrieved from https://www.kaggle.com/datasets/Cornell-University/arxiv/versions/134
- Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems. Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.), 1171–1179. Retrieved from https://proceedings.neurips.cc/paper/2015/hash/e995f98d56967d946471af29d7bf99f1-Abstract.html
- Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. 2022. Improving language models by retrieving from trillions of tokens. In Proceedings of theInternational Conference on Machine Learning (ICML ’22). Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvári, Gang Niu, and Sivan Sabato (Eds.), Proceedings of Machine Learning Research, Vol. 162, PMLR, 2206–2240. Retrieved from https://proceedings.mlr.press/v162/borgeaud22a.html
- 10.5555/3495724.3495883 · doi:10.5555/3495724.3495883
- 10.5555/3600270.3602050 · doi:10.5555/3600270.3602050
- Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.), 4299–4307. Retrieved from https://proceedings.neurips.cc/paper/2017/hash/d5e2c0adad503c91f91df240d0cd4e49-Abstract.html
- Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2020. Plug and play language models: A simple approach to controlled text generation. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=H1edEyBKDS
- Bikash Gyawali, Lucas Anastasiou, and Petr Knoth. 2020. Deduplication of scholarly documents using locality sensitive hashing and word embeddings. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 901–910. Retrieved from https://aclanthology.org/2020.lrec-1.113
- Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020. The curious case of neural text degeneration. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=rygGQyrFvH
- Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, and Zhang Xiong. 2023d. Transformer-Patcher: One mistake worth one neuron. In Proceedings of the 11th International Conference on Learning Representations (ICLR ’23). OpenReview.net. Retrieved from https://openreview.net/pdf?id=4oYUGeGBPm
- Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin and Edouard Grave. 2022. Unsupervised dense information retrieval with contrastive learning. Transactions on Machine Learning Research 2022 (2022). Retrieved from https://openreview.net/forum?id=jKN1pXi7b0
- Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023. Large language models struggle to learn long-tail knowledge. In Proceedings of the International Conference on Machine Learning (ICML ’23). Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.), Proceedings of Machine Learning Research, Vol. 202, PMLR, 15696–15707. Retrieved from https://proceedings.mlr.press/v202/kandpal23a.html
- Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through memorization: Nearest neighbor language models. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=HklBjCEKvH
- 10.5555/3600270.3601883 · doi:10.5555/3600270.3601883
- Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. 2017. Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.), 6402–6413. Retrieved from https://proceedings.neurips.cc/paper/2017/hash/9ef2ed4b7fd2c810847ffa5fa85bce38-Abstract.html
- 10.5555/3600270.3602776 · doi:10.5555/3600270.3602776
- 10.5555/3495724.3496517 · doi:10.5555/3495724.3496517
- Jinming Li, Wentao Zhang, Tian Wang, Guanglei Xiong, Alan Lu, and Gerard Medioni. 2023. GPT4Rec: A generative framework for personalized recommendation and user interests interpretation. In Proceedings of the SIGIR Workshop on eCommerce Co-located with the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 23). Surya Kallumadi, Yubin Kim, Tracy Holloway King, Shervin Malmasi, Maarten de Rijke, and Jacopo Tagliabue (Eds.), CEUR Workshop Proceedings, Vol. 3589, CEUR-WS.org. Retrieved from https://ceur-ws.org/Vol-3589/paper_2.pdf
- Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out. Association for Computational Linguistics, 74–81. Retrieved from https://aclanthology.org/W04-1013
- 10.5555/3600270.3601532 · doi:10.5555/3600270.3601532
- Kevin Meng, Arnab Sen Sharma, Alex J. Andonian, Yonatan Belinkov, and David Bau. 2023. Mass-editing memory in a transformer. In Proceedings of the 11th International Conference on Learning Representations (ICLR ’23). OpenReview.net. Retrieved from https://openreview.net/pdf?id=MkbcAHIYgyS
- Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D. Manning. 2022. Fast model editing at scale. In Proceedings of the 10th International Conference on Learning Representations (ICLR ’22). OpenReview.net. Retrieved from https://openreview.net/forum?id=0DcZxeWfOPt
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. In NeurIPS. Retrieved from http://papers.nips.cc/paper_files/paper/2022/hash/b1efde53be364a73914f58805a001731-Abstract-Conference.html
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- Anton Sinitsin, Vsevolod Plokhotnyuk, Dmitriy Pyrkin, Sergei Popov, and Artem Babenko. 2020. Editable neural networks. In Proceedings of the8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=HJedXaEtvS
- 10.5555/3495724.3495977 · doi:10.5555/3495724.3495977
- Chenmien Tan, Ge Zhang, and Jie Fu. 2024. Massive editing for large language model via meta learning. In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=L6L1CJQ2PE
- Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov and Yuan Cao. 2022. SimVLM: Simple visual language model pretraining with weak supervision. In Proceedings of the 10th International Conference on Learning Representations (ICLR ’22). OpenReview.net. Retrieved from https://openreview.net/forum?id=GUrhfTuf_3
- 10.5555/3600270.3602070 · doi:10.5555/3600270.3602070
- Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, and William W. Cohen. 2018. Breaking the softmax bottleneck: A high-rank RNN language model. In Proceedings of the6th International Conference on Learning Representations (ICLR ’18). OpenReview.net. Retrieved from https://openreview.net/forum?id=HkwZSG-CZ
- Zhilin Yang, Thang Luong, Ruslan Salakhutdinov, and Quoc V. Le. 2019. Mixtape: Breaking the softmax bottleneck efficiently. In Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS ’19). Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.), 15922–15930. Retrieved from https://proceedings.neurips.cc/paper/2019/hash/512fc3c5227f637e41437c999a2d3169-Abstract.html
- Weizhe Yuan, Graham Neubig, and Pengfei Liu. 2021. BARTScore: Evaluating generated text as text generation. In Proceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS ’21). Marc’Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.), 27263–27277. Retrieved from https://proceedings.neurips.cc/paper/2021/hash/e4d2b6e6fdeca3e60e0f1a62fee3d9dd-Abstract.html
- Hugh Zhang, Daniel Duckworth, Daphne Ippolito, and Arvind Neelakantan. 2021. Trading off diversity and quality in natural language generation. In Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval). Association for Computational Linguistics, 25–33. Retrieved from https://aclanthology.org/2021.humeval-1.3
Cited by
Multi-Agent Collaboration Mechanisms: A Survey of LLMs
Tran, K.-T., Dao, D., Nguyen, M.-D., Pham, Q.-V., O'Sullivan, B., & Nguyen, H. D. (2025) · arXiv · doi:10.48550/arxiv.2501.06322 · Cited by 680
A Survey on the Memory Mechanism of Large Language Model based Agents
Zhang, Z., Bo, X., Ma, C., Li, R., Chen, X., Dai, Q., Zhu, J., Dong, Z., & Wen, J.-R. (2024) · arXiv · doi:10.48550/arxiv.2404.13501 · Cited by 149
A framework to assess clinical safety and hallucination rates of LLMs for medical text summarisation
Asgari, E., Montaña-Brown, N., Dubois, M., Khalil, S., Balloch, J., Yeung, J. A., & Pimenta, D. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01670-7 · Cited by 423
Large Language Models for Mental Health Applications: Systematic Review
Guo, Z., Lai, A., Thygesen, J. H., Farrington, J., Keen, T., & Li, K. (2024) · JMIR Mental Health · doi:10.2196/57400 · Cited by 269
“Furthermore, hallucinations may stem from overfitting the training data or a lack of context understanding [134].”
BackgroundThe landscape of agentic reinforcement learning for LLMs: a survey
Zhang, G., Geng, H., Yu, X., Yin, Z., Zhang, Z., Tan, Z., Zhou, H., Li, Z., Xue, X., Li, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.02547 · Cited by 229
Self-citation
Metadata
- Authors
- Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., & Liu, T.
- Affiliations
- Harbin Institute of Technology (CN)
- Huawei Technologies (China) (CN)
- ORCID
- Venue
- ACM Transactions on Information Systems
- Published
- 2025-01-24
- Volume
- 43
- Issue
- 2
- Pages
- 1-55
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W4404534210
- Semantic Scholar
- 1e909e2a8cdacdcdff125ebcc566f37cb869a1c8
- Cited by
- 4,688
- References
- 229
- Citations by year
- 2026: 2433 · 2025: 1643
- FWCI
- 504.87
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Information Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- LLM hallucination, large language models, hallucination taxonomy, hallucination detection, hallucination mitigation, retrieval-augmented generation, information retrieval systems, factual reliability, large vision-language models, knowledge boundaries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.