Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Open accessAbstract
Language models (LMs) often struggle to pay enough attention to the input context, and generate texts that are unfaithful or contain hallucinations. To mitigate this issue, we present context-aware decoding (CAD), which follows a contrastive output distribution that amplifies the difference between the output probabilities when a model is used with and without context. Our experiments show that CAD, without additional training, significantly improves the faithfulness of different LM families, including OPT, GPT, LLaMA and FLAN-T5 for summarization tasks (e.g., 14.3% gain for LLaMA in factuality metrics). Furthermore, CAD is particularly effective in overriding a model's prior knowledge when it contradicts the provided context, leading to substantial improvements in tasks where resolving the knowledge conflict is essential.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CAD exploits the difference in logits with and without context.
“Similarly, CAD (Context-Aware Decoding) [231] exploits the difference in logits with and without context.”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [231]
When prioritizing contextual information, context-aware decoding techniques can be employed to decrease dependence on parametric memory.
“When prioritizing contextual information, context-aware decoding techniques can be employed to decrease dependence on parametric memory. This approach, detailed by Shi et al. [158], modifies the output probability distribution to accentuate differences when the model uses contextual information in generation versus when it does not.”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [158]
Context-aware decoding modifies the output probability distribution to accentuate differences when the model uses contextual information in generation versus when it does not, encouraging the model to rely more heavily on provided context during inference, enhancing accuracy and relevance.
“This adjustment encourages the model to rely more heavily on the provided context during inference, enhancing its accuracy and relevance.”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [158]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · cited 6× · see citing works
“, 2021), LLaMA (Touvron et al., 2023) and instruction-finetuned LMs such as FLAN (Chung et al.”
BackgroundMethodInfluentialGet To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775 · cited 4× · see citing works
“Summarization We conduct summarization experiments on two news datasets: CNN-DM (See et al., 2017) and XSUM (Narayan et al., 2018).”
MethodInfluentialMaclean, U. (1970) · doi:10.1177/003591577006300427 · Cited by 2,173
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · cited 2× · see citing works
“NQ-Swap is based on a QA dataset, natural questions (NQ) (Kwiatkowski et al., 2019), where the objective is to answer questions based on a reliable gold document.”
BackgroundMethodInfluentialA Diversity-Promoting Objective Function for Neural Conversation Models
Li, J., Galley, M., Brockett, C., Gao, J., & Dolan, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1014 · Cited by 1,981 · see citing works
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441 · cited 5× · see citing works
“In Tables 2 and 3, we show that CAD could be used to enhance a diverse set of LM families, including OPT, GPT-Neo, LLaMA, and FLAN-T5.”
BackgroundMethodInfluentialThe Curious Case of Neural Text Degeneration
Holtzman, A., Buys, J., Du, L., Forbes, M., & Choi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09751 · Cited by 1,304 · cited 1× · see citing works
“From the adjusted output distribution ˜ p , we can apply various sampling strategies, such as nucleus sampling (Holtzman et al., 2019).”
MethodNarayan, S., Cohen, S. B., & Lapata, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1206 · Cited by 1,207 · cited 5× · see citing works
“Summarization We conduct summarization experiments on two news datasets: CNN-DM (See et al., 2017) and XSUM (Narayan et al., 2018).”
MethodInfluentialOn Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.173 · Cited by 1,185 · cited 3× · see citing works
“This can lead to hallu-cination in summarization (Maynez et al., 2020; Pagnoni et al., 2021), where the generated summaries include facts not present in the input document.”
BackgroundClassifier-Free Diffusion Guidance
Ho, J., & Salimans, T. (2022) · arXiv · doi:10.48550/arxiv.2207.12598 · Cited by 1,126 · cited 1× · see citing works
“A similar contrastive objective is universal in image generation, where classifier-free diffusion models (Ho and Salimans, 2022) predict diffusion noise with (1+α)εθ(x, c)−αεθ(x), with c being a control to the image.”
BackgroundContrastive Decoding: Open-ended Text Generation as OptimizationPreprint
Li, X. L., Holtzman, A., Fried, D., Liang, P., Eisner, J., Hashimoto, T. B., Zettlemoyer, L., & Lewis, M. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2210.15097 · Cited by 805 · cited 5× · see citing works
“This provides a new form of contrastive decoding (Li et al., 2022), which effectively downweights the prior knowledge when more relevant contextual information is provided.”
BackgroundMethodInfluentialSelf-citationEvaluating the Factual Consistency of Abstractive Text Summarization
Kryscinski, W., McCann, B., Xiong, C., & Socher, R. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.750 · Cited by 669 · see citing works
Benchmarking Large Language Models for News Summarization
Zhang, T., Ladhak, F., Durmus, E., Liang, P., McKeown, K., & Hashimoto, T. B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00632 · Cited by 415 · cited 1× · see citing works
“Following prior work (Zhang et al., 2023; Zhou et al., 2023), we evaluate the models using prompting.”
MethodFaithful to the Original: Fact Aware Neural Abstractive Summarization
Cao, Z., Wei, F., Li, W., & Li, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11912 · Cited by 359 · cited 2× · see citing works
“tual consistency, including applying attentions to fact triples extracted from source documents (Cao et al., 2018; Zhu et al., 2021), optimizing summarization models towards a factual consistency metrics (Nan et al.”
BackgroundGPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow
Black, S., Leo, G., Wang, P., Leahy, C., & Biderman, S. (2021) · Zenodo · doi:10.5281/zenodo.5297715 · Cited by 324 · cited 7× · see citing works
“In Tables 2 and 3, we show that CAD could be used to enhance a diverse set of LM families, including OPT, GPT-Neo, LLaMA, and FLAN-T5.”
BackgroundMethodInfluentialGeneralization through Memorization: Nearest Neighbor Language Models
Khandelwal, U., Levy, O., Jurafsky, D., Zettlemoyer, L., & Lewis, M. (2019) · arXiv · doi:10.48550/arxiv.1911.00172 · Cited by 285 · cited 1× · see citing works
“MMI-based decoding (Li et al., 2015) uses a contrastive formulation to improve output diversity in dialog generation.”
BackgroundSelf-citationCommonsense Knowledge Mining from Pretrained Models
Davison, J., Feldman, J., & Rush, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1109 · Cited by 264 · see citing works
<scp>SummaC</scp>: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization
Laban, P., Schnabel, T., Bennett, P. N., & Hearst, M. A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00453 · Cited by 238 · cited 3× · see citing works
“Knowledge Conflicts We evaluate performance on two knowledge conflict datasets: MemoTrap (Liu and Liu, 2023) and NQ-Swap (Longpre et al., 2021).”
MethodDExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
Liu, A., Sap, M., Lu, X., Swayamdipta, S., Bhagavatula, C., Smith, N. A., & Choi, Y. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.522 · Cited by 199 · cited 2× · see citing works
“Instead of using a single model θ in this work, different models can also be used in the distribution adjustments to demote unwanted model behaviors or distill expert model’s capability (Liu et al., 2021; Li et al., 2022).”
BackgroundMethodUnderstanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics
Pagnoni, A., Balachandran, V., & Tsvetkov, Y. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.383 · Cited by 197 · cited 5× · see citing works
“Summarization Factuality Summarization models have shown a tendency to generate hallucinated texts (Maynez et al., 2020; Pagnoni et al., 2021).”
BackgroundMethodInfluentialSelf-citationCLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization
Cao, S., & Wang, L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.532 · Cited by 135 · cited 1× · see citing works
“, 2021), optimizing summarization models towards a factual consistency metrics (Nan et al., 2021; Cao and Wang, 2021),”
BackgroundEnhancing Factual Consistency of Abstractive Summarization
Zhu, C., Hinthorn, W., Xu, R., Zeng, Q., Zeng, M., Huang, X., & Jiang, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.58 · Cited by 127 · cited 2× · see citing works
“tual consistency, including applying attentions to fact triples extracted from source documents (Cao et al., 2018; Zhu et al., 2021), optimizing summarization models towards a factual consistency metrics (Nan et al.”
BackgroundSurface Form Competition: Why the Highest Probability Answer Isn’t Always Right
Holtzman, A., West, P., Shwartz, V., Choi, Y., & Zettlemoyer, L. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.564 · Cited by 127 · see citing works
Self-citationContext-faithful Prompting for Large Language Models
Zhou, W., Zhang, S., Poon, H., & Chen, M. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2303.11315 · Cited by 122 · cited 5×
“method (Zhou et al., 2023), are limited in that they could only apply to large-scale instructionfinetuned LMs like OpenAI’s text-davinci-003.”
MethodInfluentialMulti-Fact Correction in Abstractive Text Summarization
Dong, Y., Wang, S., Gan, Z., Cheng, Y., Cheung, J. C. K., & Liu, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.749 · Cited by 105 · cited 1× · see citing works
“…(Cao et al., 2018; Zhu et al., 2021), optimizing summarization models towards a factual consistency metrics (Nan et al., 2021; Cao and Wang, 2021), learning a post-editing error corrector (Dong et al., 2020) and removing noisy training samples (Kang and Hashimoto, 2020; Goyal and Durrett, 2021).”
BackgroundEntity-Based Knowledge Conflicts in Question Answering
Longpre, S., Perisetla, K., Chen, A., Ramesh, N., DuBois, C., & Singh, S. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.565 · Cited by 101 · cited 9× · see citing works
“We use Exact Match (EM) as the evaluation metric for NQ-Swap, NQ and MemoTrap.”
BackgroundMethodInfluentialAnnotating and Modeling Fine-grained Factuality in Summarization
Goyal, T., & Durrett, G. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.114 · Cited by 100 · cited 1× · see citing works
“, 2020) and removing noisy training samples (Kang and Hashimoto, 2020; Goyal and Durrett, 2021).”
BackgroundMutual Information Alleviates Hallucinations in Abstractive Summarization
van der Poel, L., Cotterell, R., & Meister, C. (2022) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2210.13210 · Cited by 91
Improving Factual Consistency of Abstractive Summarization via Question Answering
Nan, F., Nogueira dos Santos, C., Zhu, H., Ng, P., McKeown, K., Nallapati, R., Zhang, D., Wang, Z., Arnold, A. O., & Xiang, B. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.536 · Cited by 78 · cited 2× · see citing works
“…triples extracted from source documents (Cao et al., 2018; Zhu et al., 2021), optimizing summarization models towards a factual consistency metrics (Nan et al., 2021; Cao and Wang, 2021), learning a post-editing error corrector (Dong et al., 2020) and removing noisy training samples (Kang and…”
BackgroundMethodImproved Natural Language Generation via Loss Truncation
Kang, D. D., & Hashimoto, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.66 · Cited by 71 · cited 1× · see citing works
“, 2020) and removing noisy training samples (Kang and Hashimoto, 2020; Goyal and Durrett, 2021).”
BackgroundData Distributional Properties Drive Emergent In-Context Learning in Transformers
Chan, S. C. Y., Santoro, A., Lampinen, A. K., Wang, J. X., Singh, A., Richemond, P. H., McClelland, J., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2205.05055 · Cited by 69 · see citing works
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual KnowledgePreprint
Feng, S., Balachandran, V., Bai, Y., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2305.08281 · Cited by 69 · cited 2× · see citing works
“To measure the factual consistency of summaries, we adopt BERT-Precision (Pagnoni et al., 2021) as well as FactKB (Feng et al., 2023), which has been demonstrated to achieve high correlations with human judgment on the two summarization datasets.”
BackgroundMethodSelf-citationREPLUG: Retrieval-augmented black-box language models
Shi, W., Min, S., Yasunaga, M., Seo, M., James, R., Lewis, M., Zettlemoyer, L., & Yih, W.-T. (2023) · arXiv · doi:10.48550/arxiv.2301.12652 · Cited by 65 · cited 1× · see citing works
“This setting is especially valuable to retrieval-augmented language models (Khandelwal et al., 2020; Shi et al., 2023; Min et al., 2022; Yasunaga et al., 2023), where documents retrieved from external databases are used as additional input to provide LMs additional knowledge.”
MethodSelf-citationNonparametric Masked Language Modeling
Min, S., Shi, W., Lewis, M., et al. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.01349 · Cited by 61 · cited 1×
“This setting is especially valuable to retrieval-augmented language models (Khandelwal et al., 2020; Shi et al., 2023; Min et al., 2022; Yasunaga et al., 2023), where documents retrieved from external databases are used as additional input to provide LMs additional knowledge.”
MethodSelf-citationRetrieval-Augmented Multimodal Language ModelingPreprint
Yasunaga, M., Aghajanyan, A., Shi, W., James, R., Leskovec, J., Liang, P., Lewis, M., Zettlemoyer, L., & Yih, W.-T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.12561 · Cited by 37 · cited 1× · see citing works
“This setting is especially valuable to retrieval-augmented language models (Khandelwal et al., 2020; Shi et al., 2023; Min et al., 2022; Yasunaga et al., 2023), where documents retrieved from external databases are used as additional input to provide LMs additional knowledge.”
MethodSelf-citationKing, D., Shen, S. Z., Subramani, N., et al. (2022) · IEEE Games Entertainment Media Conference · doi:10.48550/arxiv.2203.08436 · Cited by 36 · cited 1×
“Here we further investigate whether CAD is effective in improving language models of different sizes.”
BackgroundChen, H.-T., Zhang, M. J. Q., & Choi, E. (2022) · arXiv · doi:10.48550/arxiv.2210.13701 · Cited by 31 · cited 1× · see citing works
“However, simply adding documents does not always change the model predictions, as current LMs often overlook the contexts and rely heavily on their prior parametric knowledge (Longpre et al., 2021; Chen et al., 2022).”
BackgroundCoherence boosting: When your pretrained language model is not paying enough attention
Malkin, N., Wang, Z., & Jojić, N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.565 · Cited by 20 · see citing works
Improved Beam Search for Hallucination Mitigation in Abstractive SummarizationPreprint
Sridhar, A., & Visser, E. M. (2022) · arXiv.org · doi:10.48550/arxiv.2212.02712 · Cited by 17 · see citing works
Decoding Symbolism in Language Models
Guo, M., Hwa, R., & Kovashka, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.186 · Cited by 3 · see citing works
OPT: Open Pre-trained Transformer Language Models
Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., Lin, X. V., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.01068 · cited 7×
“In Tables 2 and 3, we show that CAD could be used to enhance a diverse set of LM families, including OPT, GPT-Neo, LLaMA, and FLAN-T5.”
BackgroundMethodInfluentialSelf-citation
Flagged first, then by citations
5 of the 46 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Chin-Yew Lin. 2004. ROUGE: A package for auto- matic evaluation of summaries. In Text Summariza- tion Branches Out, pages 74-81, Barcelona, Spain. Association for Computational Linguistics.
Cited by
Sorted by citations
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · see citing works
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 2,142 · see citing works
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E. (2024) · Journal of Legal Analysis · doi:10.1093/jla/laae003 · Cited by 288 · see citing works
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.05232 · Cited by 2,516 · see citing works
“Shi et al. (2023b) propose context-aware decoding (CAD), which modifies the output distribution by reducing reliance on prior knowledge, thereby promoting the model’s focus on the contextual information, similar to that presented by (van der Poel et al., 2022).”
Hallucination is Inevitable: An Innate Limitation of Large Language Models
Xu, Z., Jain, S., & Kankanhalli, M. (2024) · arXiv · doi:10.48550/arxiv.2401.11817 · Cited by 180 · see citing works
“During inference, hallucination can also be caused by sampling randomness [1, 14], insufficient context attention [55], and softmax bottleneck [9, 73].”
BackgroundThe Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models
Li, J., Chen, J., Ren, R., Cheng, X., Zhao, X., Nie, J.-Y., & Wen, J.-R. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.586 · Cited by 70 · see citing works
Cognitive Mirage: A Review of Hallucinations in Large Language Models
Ye, H., Liu, T., Zhang, A., Hua, W., & Jia, W. (2023) · arXiv · doi:10.48550/arxiv.2309.06794 · Cited by 61 · see citing works
Fostering effective hybrid human-LLM reasoning and decision making
Passerini, A., Gema, A. P., Minervini, P., Sayin, B., & Tentori, K. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1464690 · Cited by 35 · see citing works
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29 · see citing works
“Table 1 shows DoLa outperforms baselines by 2-4%, and is more effective than CD, except for 13B on Wiki.”
MethodInfluentialFlores, L. J. Y., Huang, H., Shi, K., Chheang, S., & Cohan, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.322 · Cited by 13 · see citing works
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3 · see citing works
“This approach, detailed by Shi et al. [152], modifies the output probability distribution to accentuate differences when the model uses contextual information in generation versus when it does not.”
A Survey on Hallucination in Large Language and Foundation ModelsPreprint
Ahadian, P., & Guan, Q. (2025) · Preprints.org · doi:10.20944/preprints202504.1236.v2 · Cited by 3 · see citing works
A Survey on Hallucination in Large Language and Foundation ModelsPreprint
Ahadian, P., & Guan, Q. (2025) · Preprints.org · doi:10.20944/preprints202504.1236.v1 · Cited by 2 · see citing works
Do as We Do, Not as You Think: the Conformity of Large Language Models
Weng, Z., Chen, G., & Wang, W. (2025) · arXiv · doi:10.48550/arxiv.2501.13381 · Cited by 1 · see citing works
Hallucinations in LLMs: a lifecycle-based survey of causes, detection, mitigation, and prevention
Lamba, N., Tiwari, S., & Gaur, M. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01214-6 · Cited by 1 · see citing works
“• Adversarial Training: This procedure increases the robustness against LLMs by introducing adversarial prompts, e.g. counter-factual or misleading prompts, and, in this way, proving the decision boundaries to be more robust [16].”
From Illusion to Insight: A Taxonomic Survey of Hallucination Mitigation Techniques in LLMs
Kazlaris, I., Antoniou, E., Diamantaras, K., & Bratsas, C. (2025) · doi:10.20944/preprints202508.1942.v1 · Cited by 13 · see citing works
- Authors
- Shi, W., Han, X., Lewis, M., Tsvetkov, Y., Zettlemoyer, L., & Yih, S. W.-T.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2305.14739
- OpenAlex
- W4378473839
- Semantic Scholar
- 984d4a1d41bfc8184fb77b8aa0eb8e96d536d048
- Cited by
- 6
- References
- 46
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- hallucination mitigation, factuality, summarization, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
