Survey of Hallucination in Natural Language Generation
Open accessThe DOI matches its Crossref record; 355 of the 360 references it cites were found in a registry or an index, and 4 are not checked yet; 224 of the 256 sources its claims cite were checked for support.
Abstract
Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and coherent NLG, leading to improved development in downstream tasks such as abstractive summarization, dialogue generation, and data-to-text generation. However, it is also apparent that deep learning based generation is prone to hallucinate unintended text, which degrades the system performance and fails to meet user expectations in many real-world scenarios. To address this issue, many studies have been presented in measuring and mitigating hallucinated texts, but these have never been reviewed in a comprehensive manner before. In this survey, we thus provide a broad overview of the research progress and challenges in the hallucination problem in NLG. The survey is organized into two parts: (1) a general overview of metrics, mitigation methods, and future directions, and (2) an overview of task-specific research progress on hallucinations in the following downstream tasks, namely abstractive summarization, dialogue generation, generative question answering, data-to-text generation, and machine translation. This survey serves to facilitate collaborative efforts among researchers in tackling the challenge of hallucinated texts in NLG.
Verified 2026-11-19 · 4 references not checked yet
Overview
CoChat Summary
TL;DR
This survey provides a broad overview of hallucination in natural language generation, covering definitions, contributors, metrics, mitigation methods, and task-specific progress across summarization, dialogue, GQA, data-to-text, machine translation, vision-language generation, and LLMs. It distinguishes intrinsic from extrinsic hallucination and argues that hallucination must be treated differently across tasks and sources.
Key findings
- The survey categorizes hallucination into intrinsic hallucination, where generated output contradicts the source, and extrinsic hallucination, where output cannot be verified from the source; extrinsic hallucination is not always erroneous because it may come from factually correct external information.
- It reports prevalence examples from cited work: 25% of summaries generated by state-of-the-art abstractive summarization systems have hallucinated content; 62% of first sentences in WIKIBIO have additional information not stated in the corresponding infobox; and 74% of samples in the QMSum dataset consist of inconsistent facts.
- It reviews hallucination metrics as statistical, model-based (IE-based, QA-based, NLI-based, faithfulness classification, LM-based), and human evaluation, and mitigation methods as data-related and modeling/inference methods including architecture changes, planning/sketching, RL, multi-task learning, controllable generation, and post-processing.
- For LLMs, it notes that RLHF reduced the hallucination rate from 41% to 21% in closed-domain tasks for InstructGPT, and discusses reference-dependent and reference-free hallucination metrics plus mitigation via data refinement, RAG, safety fine-tuning, model editing, decoding methods, chain-of-thought variants, post-processing, and ensembling.
Methods
- Literature survey design: the paper reviews existing research on hallucination in NLG rather than conducting new experiments or primary data collection.
- Coverage: general NLG hallucination topics (definitions, contributors, metrics, mitigation, future directions) plus task-specific sections on abstractive summarization, dialogue generation, generative question answering, data-to-text generation, neural machine translation, vision-language generation, and large language models.
- Analysis: synthesizes and compares definitions, metrics, mitigation approaches, and future directions across tasks, with examples in tables and figures; the LLM section was updated in Jan 2024.
Limitations
- The paper states that GQA has no standard definition or categorization of hallucination and no automatic metric specifically for hallucination in GQA; it also notes that open-domain dialogue lacks a standard hallucination metric and that VL hallucination research is still in its early stage.
- The paper states that extrinsic hallucination has been somewhat overlooked and is more challenging to reduce, and that most existing mitigation methods do not distinguish between intrinsic and extrinsic hallucination.
- Evident from the text: as a survey, it does not provide new empirical validation of metrics or mitigation methods, and its LLM coverage is explicitly updated only through Jan 2024, so later work is not included.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
124 Valid · 26 Not valid · 19 Not checked · 135 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Furthermore, perturbation, where the insertions of most common tokens are placed at the beginning of the sentence, seems to be the most successful in hallucination mitigation.”
What the sources say
- Not checked — no full text of the sourcecites [133] [133] Katherine Lee, Orhan Firat, Ashish Agarwal, Clara Fannjiang, and David Sussillo. 2019. Hallucinations in Neural Machine Translation. ICLR (2019). -
- Disputedcites [215] [215] Vikas Raunak, Arul Menezes, and Marcin Junczys-Dowmunt. 2021. The Curious Case of Hallucinations in Neural Machine Translation. (4 2021), 1172-1183. https://arxiv.org/abs/2104.06683v1 - sourceExperimental — accuracy not yet measured
In the passage describing the perturbation procedure (page unavailable), the paper says that inserting common tokens at the beginning is used to generate hallucinations, not mitigate them. Its prevention section instead discusses approaches such as robust learning and corpus-level filtering. (LLM, conf=0.92)
Checked by a reasoning model — may be wrong.
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“While there are works on the visual extension of faithfulness-oriented RLHF [303], these essentially involve labeling more data, which is expensive and difficult to scale.”
What the sources say
- Disputedcites [303] [303] Tianyu Yu, Yuan Yao, Haoye Zhang, Taiwen He, Yifeng Han, Ganqu Cui, Jinyi Hu, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun, and Tat-Seng Chua. 2023. RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback. CoRR abs/2312.00849 (2023). https://doi.org/10.48550/ARXIV.2312.00849 arXiv:2312.00849 - sourceExperimental — accuracy not yet measured
RLHF-V does use human annotation for visual-model alignment, but it makes the contrary point about needing more labeled data. The Fine-grained Correctional Human Preference Collection section says its corrections improve data efficiency, and Section 4.3 reports comparable hallucination rates using only 200 preference examples versus an order of magnitude more ranking-labeled examples. Our copy does not establish a separate claim about annotation cost or scalability. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“Nevertheless, as illustrated by Falke et al. [66], off-the-shelf NLI models tend to transfer poorly to the abstractive summarization task.”
What the sources say
- Supportedcites [66] [66] Tobias Falke, Leonardo FR Ribeiro, Prasetya Ajie Utama, Ido Dagan, and Iryna Gurevych. 2019. Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language Inference. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . 2214-2220. - source
The Introduction states that models trained on NLI datasets transfer poorly to the paper’s downstream task of ranking generated summaries by correctness. The Conclusions likewise say that out-of-the-box NLI models do not perform well on that task. (LLM, conf=0.94)
- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Such wrong association results in generation with facts mixed up between two similar entities [60, 233].”
What the sources say
- Partly supportedcites [60] [60] Nouha Dziri, Andrea Madotto, Osmar Zaiane, and Avishek Joey Bose. 2021. Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding. EMNLP (2021). - sourceExperimental — accuracy not yet measured
The GPT2-KG passage describes an incorrect association between entities, and G Error Analysis gives an example of a generated response assigning a book to the wrong author. These support the claim that facts can be mixed up, but the paper does not say the entities involved are similar. The supplied passages do not provide page numbers. (LLM, conf=0.83)
- Supportedcites [233] [233] Kurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela, and Jason Weston. 2021. Retrieval Augmentation Reduces Hallucination in Conversation. EMNLP (2021). - source
The Introduction states that language models often mix up facts between two similar entities when generating factually incorrect statements. This directly supports the cited description of the resulting error. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“As a result, the target reference may contain information that cannot be supported by the source [198, 268].”
What the sources say
- Supportedcites [198] [198] Ankur Parikh, Xuezhi Wang, Sebastian Gehrmann, Manaal Faruqui, Bhuwan Dhingra, Diyi Yang, and Dipanjan Das. 2020. ToTTo: A Controlled Table-To-Text Generation Dataset. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) . 1173-1186. - source
The Dataset section says that reference targets selected from web sentences may contain information that cannot be inferred from the source. The Data Annotation Process section also describes deleting phrases unsupported by table cells. (LLM, conf=0.93)
- Supportedcites [268] [268] Hongmin Wang. 2019. Revisiting Challenges in Data-to-Text Generation with Fact Grounding. In Proceedings of the 12th International Conference on Natural Language Generation . 311-322. - source
The Introduction reports that about 40% of human-written game-summary content cannot be directly mapped to the input boxscore records and draws on information beyond those inputs. Section 2.1 likewise describes reference content not licensed by the boxscore table. This supports the claim that a target reference may contain information the source does not support. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
117 more claims · 74 with their cited sources checked
Create a free account to see all 304 claims and to verify the 2 references still open.
- Borderline: one of the tests for a substantial claim is unclear. 1
- It may state two separate claims as one. 90
- Probably not a substantial claim. 142
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Hallucination can lead to serious consequences such as incorrect or misleading code, security risks, and ethical issues [186].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [186]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“citation fabrication constitutes a form of extrinsic hallucination in the absence of retrieval augmentation, since the model generates references not grounded in any provided source material [4].”
From How LLMs Cite and Why It Matters: A Cross-Model Audit of Reference Fabrication in AI-Assisted Academic Writing and Methods to Detect Phantom Citations (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent taxonomic work distinguishes at least seven cases [15,18].”
From Hallucination as epistemic pollution: epistemic injustice and credibility in futures-oriented science education (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs struggle to generate accurate and up-to-date responses on current topics, due to outdated knowledge, lack of domain-specific expertise, or hallucination13–17.”
From Leveraging long context in retrieval augmented language models for medical question answering (2025) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Fine-tuning can enrich LLMs with domain knowledge, enhance their specific ability, improve the fairness and reliability of the outputs, and prevent certain damage caused by hallucination [26].”
From FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning (2024) · cites this paper as [26]
Experimental — accuracy not yet measured
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Extrinsic Object Hallucination
“CHAIR (Caption Hallucination Assessment with Image Relevance) metric, which calculates what proportion of object words generated are actually in the image according to the ground truth captions.”
§ Extrinsic Object Hallucination
“CHAIR 𝑖 measures per-instance object hallucination, i.e. what fraction of object instances in each generated caption are hallucinated.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 7.1 Hallucination Definition in Abstractive Summarization
“For instance, in Table 1, given the input article shown in the caption, an example of intrinsic hallucination is ' The Ebola vaccine was rejected by the FDA in 2019, '”
§ 2.1 Categorization
“in the abstractive summarization task from Table 1, the generated summary ' The first Ebola vaccine was approved in 2021 ' contradicts the source content”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Survey of Hallucination in Natural Language Generation
“The survey is organized into two parts: (1) a general overview of metrics, mitigation methods, and future directions; (2) an overview of task-specific research progress on hallucinations in the following downstream tasks, namely abstractive summarization, dialogue generation, generative question answering, data-to-text generation, machine translation, and visual-language generation; and (3) hallucinations in large language models (LLMs)”
§ 1 INTRODUCTION
“The third part discusses this phenomenon in LLMs in Section 13.”
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 3×
“Recently, the rapid development of NLG has captured the imagination of many thanks to the advances in deep learning technologies, especially Transformer [189]-based models like BERT [29], BART [100], GPT-2 [149], and GPT-3 [16].”
BackgroundAn Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 1×
“This work investigates the performances of GPT-3 [13], GPT-Neo/J [141], GPT-2 [105] and a T5-based model [106].”
BackgroundAdvances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 1×
“Recently, the development of NLG has conquered the imagination of many thanks to the advances in deep learning technologies, especially the Transformer [159]-based models like BERT [24], BART [83], GPT-2 [127], and GPT3 [13].”
BackgroundLewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816 · cited 1×
“Recently, the development of NLG has conquered the imagination of many thanks to the advances in deep learning technologies, especially the Transformer [159]-based models like BERT [24], BART [83], GPT-2 [127], and GPT3 [13].”
Background
Research works printed but not linked: 16
- [4] Joshua Albrecht and Rebecca Hwa. 2007. A Re-examination of Machine Learning Approaches for Sentence-Level MT Evaluation. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics . Association for Computational Linguistics, Prague, Czech Republic, 880-887. https://aclanthology.org/P07-1111 -
- [16] Andrzej Białecki, Robert Muir, Grant Ingersoll, and Lucid Imagination. 2012. Apache lucene 4. In SIGIR 2012 workshop on open source information retrieval . 17. -
- [53] Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. 2023. Improving Factuality and Reasoning in Language Models through Multiagent Debate. In Forty-first International Conference on Machine Learning . -
- [121] Philipp Koehn and Rebecca Knowles. 2017. Six Challenges for Neural Machine Translation. In First Workshop on Neural Machine Translation . Association for Computational Linguistics, 28-39. -
- [145] Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. In ICML . -
- [149] Tian Li, Ahmad Beirami, Maziar Sanjabi, and Virginia Smith. 2020. Tilted Empirical Risk Minimization. In International Conference on Learning Representations . -
- [164] Jiasen Lu, Jianwei Yang, Dhruv Batra, and Devi Parikh. 2018. Neural Baby Talk. In CVPR . -
- [165] Yukun Ma, Khanh Linh Nguyen, Frank Z Xing, and Erik Cambria. 2020. A Survey on Empathetic Dialogue Systems. Information Fusion 64 (2020), 50-70. -
- [175] Marianna J. Martindale, Marine Carpuat, Kevin Duh, and Paul McNamee. 2019. Identifying Fluently Inadequate Output in Neural and Statistical Machine Translation. In MTSummit . -
- [179] Kathleen McKeown. 1992. Text Generation . Cambridge University Press. -
- [209] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. OpenAI Blog 1, 8 (2019), 9. -
- [238] Hui Su, Xiaoyu Shen, Sanqiang Zhao, Zhou Xiao, Pengwei Hu, Cheng Niu, and Jie Zhou. 2020. Diversifying Dialogue Generation with Non-Conversational Text. In 58th Annual Meeting of the Association for Computational Linguistics . ACL, 7087-7097. -
- [256] Zhaopeng Tu, Yang Liu, Lifeng Shang, Xiaohua Liu, and Hang Li. 2017. Neural Machine Translation with Reconstruction. In Thirty-First AAAI Conference on Artificial Intelligence . -
- [261] Neeraj Varshney, Wenlin Yao, Hongming Zhang, Jianshu Chen, and Dong Yu. 2023. A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation. CoRR abs/2307.03987 (2023). https://doi.org/10.48550/arXiv.2307.03987 arXiv:2307.03987 - · arXiv · doi:10.48550/arxiv.2307.03987 · Paper page
- [285] Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, et al. 2021. A Controllable Model of Grounded Response Generation. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 35. 14085-14093. -
- [291] Xinnuo Xu, Ondřej Dušek, Verena Rieser, and Ioannis Konstas. 2021. AGGGEN: Ordering and Aggregating while Generating. roceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL2021) (2021). -
Cited by
Items 701–800 of 4,844
LLM-Powered AI Agent Systems and Their Applications in Industry
Liang, G., & Tong, Q. (2025) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot65859.2025.11105299 · Cited by 70
“…implemented via Retrieval-Augmented Generation (RAG) [51], [52], ensures the agent can access external knowledge and avoid hallucination [53], [54]; (4) Environmental sensing , which is achieved through multi-modal inputs—such as text, images, speech, or sensor data—captured by models or…”
Agency and authorship in AI art: Transformational practices for epistemic troubles
Bomba, F., & Angeli, A. D. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103652 · Cited by 46
Reclaiming the Digital Commons: A Public Data Trust for Training Data
Chan, A., Bradley, H., & Rajkumar, N. (2023) · AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604658 · Cited by 26
“Even when used with the best of intentions, LMs still generate falsehoods that may be difficult to detect [55, 64].”
BackgroundCan ChatGPT explain it? Use of artificial intelligence in multiple sclerosis communication
Inojosa, H., Gilbert, S., Kather, J. N., Proschmann, U., Akgün, K., & Ziemssen, T. (2023) · Neurological Research and Practice · doi:10.1186/s42466-023-00270-8 · Cited by 25
“Of special importance is the tendency to “halluci-nate” text based on inexistent information, with the risk of misleading medical doctors or patients if this information is misinterpreted [15, 16].”
BackgroundRadiology Reading Room for the Future: Harnessing the Power of Large Language Models Like ChatGPT
Tippareddy, C., Jiang, S., Bera, K., & Ramaiya, N. H. (2023) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2023.08.018 · Cited by 25
Ito, T., Yamashita, N., Kuribayashi, T., Hidaka, M., Suzuki, J., Gao, G., Jamieson, J., & Inui, K. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606810 · Cited by 36
Sood, A., Mansoor, N. M., Memmi, C., Lynch, M., & Lynch, J. (2024) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-024-03071-9 · Cited by 21
Li, Z., Babar, P. P., Barry, M., & Peiris, R. L. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651996 · Cited by 35
Transformers in source code generation: A comprehensive survey
Ghaemi, H., Alizadehsani, Z., Shahraki, A., & Corchado, J. M. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103193 · Cited by 31
AlRyalat, S. A., Musleh, A. M., & Kahook, M. Y. (2024) · Frontiers in Ophthalmology · doi:10.3389/fopht.2024.1387190 · Cited by 30
“The hallucination phenomenon was described in literature as “ arti fi cial hallucination ” , which is commonly understood as AI generating content that deviates from sense or truth, yet appears to be credible (16, 17).”
BackgroundAngel, M. C., Rinehart, J. B., Canneson, M. P., & Baldi, P. (2023) · medRxiv · doi:10.1101/2023.05.10.23289805 · Cited by 20
“12,13 However, it is important to acknowledge that complex systems operating in large domains are bound to make errors occasionally, similar to visual illusions in the human visual cortex.”
BackgroundEthics of Artificial Intelligence in Academia
Khan, Z. R. (2024) · Springer International Handbooks of Education · doi:10.1007/978-3-031-54144-5_188 · Cited by 19
Srba, I., Razuvayevskaya, O., Leite, J. A., Moro, R., Schlicht, I. B., Tonelli, S., García, F. M., Lottmann, S. B., Teyssou, D., Porcellini, V., et al. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3770077 · Cited by 19
Li, Z., Zhang, H., Peng, C., & Peiris, R. (2025) · 2025 IEEE Conference Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr59515.2025.00025 · Cited by 24
“However, challenges were identified, including LLM agents’ inaccuracies in managing complex multi-step planning [26, 45, 41] and their tendency to ‘ hallucinate ’ environments and interactions [25], leading to unnatural and inconsistent interactions.”
Watts, K. J. (2025) · Education Sciences · doi:10.3390/educsci15101304 · Cited by 18
PREFER: Prompt Ensemble Learning via Feedback-Reflect-Refine
Zhang, C., Liu, L., Wang, C., Sun, X., Wang, H., Wang, J., & Cai, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29924 · Cited by 60
Corradi, M., Luechtefeld, T. H., de Haan, A. M., Pieters, R. H. H., Freedman, J. H., Vanhaecke, T., Vinken, M., & Teunis, M. (2024) · Frontiers in Toxicology · doi:10.3389/ftox.2024.1393662 · Cited by 27
Guo, J., Mohanty, V., Ono, J. P., Hao, H., Gou, L., & Ren, L. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651042 · Cited by 42
Wysocka, M., Wysocki, O., Delmas, M., Mutel, V., & Freitas, A. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104724 · Cited by 45
“The knowledge extracted by prompting these models has been widely discussed in the context of its factuality Ji et al. [2023b], Bavaresco et al. [2024].”
MethodHan, Y., Du, Q., Huang, Y., Wu, J., Tian, F., & He, C. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695475 · Cited by 55
Klotz, R., Pausch, T. M., Kaiser, J., Joos, M. C., Hecktor, R., Ahmed, A., Dörr-Harim, C., Mehrabi, A., Loos, M., Roth, S., et al. (2025) · HPB · doi:10.1016/j.hpb.2024.11.012 · Cited by 18
Xu, Z., Song, T., & Lee, Y.-C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103455 · Cited by 18
Simon, F. M. (2025) · New Media & Society · doi:10.1177/14614448251336423 · Cited by 40
“…a human because its output cannot be fully trusted – a pressing concern especially with forms of ‘generative’ AI which are prone to producing responses which contain false, misleading, and made-up information presented as factually accurate due to their systems architecture (see Ji et al., 2023).”
Unified multimodal multidomain polymer representation for property prediction
Huang, Q., Li, Y., Zhu, L., Zhao, Q., & Yu, W. (2025) · npj Computational Materials · doi:10.1038/s41524-025-01652-z · Cited by 42
The Responsible Development of Automated Student Feedback with Generative AI
Lindsay, E. D., Zhang, M., Johri, A., & Bjerva, J. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016572 · Cited by 53
“Furthermore, the underlying model has issues in terms of hallucinations, and a general lack of factuality [39].”
Mapping the Impact of Generative AI on Disinformation: Insights from a Scoping Review
López‐Borrull, A., & Lopezosa, C. (2025) · Publications · doi:10.3390/publications13030033 · Cited by 62
Development and evaluation of LLM-based suicide intervention chatbot
Cui, X., Gu, Y., Fang, H., & Zhu, T. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1634714 · Cited by 29
Can Large Language Models Match Tutoring System Adaptivity? A Benchmarking Study
Borchers, C., & Shou, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98417-4_29 · Cited by 52
Graph retrieval augmented large language models for facial phenotype associated rare genetic disease
Song, J., Xu, Z., He, M., Feng, J., & Shen, B. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01955-x · Cited by 35
Diagnostic Performance of Large Language Models in Multimodal Analysis of Radiolucent Jaw Lesions
Kim, K., & Kim, B.-C. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.103910 · Cited by 27
“13,14 This underscores the importance of human-in-the-loop (HITL) systems, which integrate expert oversight in AI-assisted workflows.”
Streamline automated biomedical discoveries with agentic bioinformatics
Zhou, J., Jiang, J., Han, Z., Wang, Z., & Gao, X. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf505 · Cited by 36
Multi-step retrieval and reasoning improves radiology question answering with large language models
Wind, S., Sopa, J., Truhn, D., Lotfinia, M., Nguyen, T.-T., Bressem, K. K., Adams, L. C., Rusu, M., Koestler, H., Wellein, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02250-5 · Cited by 41
“Larger and clinically tuned models demonstrated robustness by correctly responding even when retrieved evidence was irrelevant or insuf fi cient, likely relying on internal knowledge 15 .”
Agentic AI and the rise of in silico team science in biomedical research
Li, B., Saini, A. K., Hernandez, J. G., & Moore, J. H. (2026) · Nature Biotechnology · doi:10.1038/s41587-026-03035-1 · Cited by 45
“Various techniques can reduce but not eliminate LLM hallucinations due to LLM’s nature as probabilistic models 13,14 .”
Improving open data web API documentation through interactivity and natural language generation
González-Mora, C., Barros, C., Garrigós, I., Zubcoff, J., Lloret, E., & Mazón, J.-N. (2022) · Computer Standards & Interfaces · doi:10.1016/j.csi.2022.103657 · Cited by 24
Unraveling ChatGPT: A Critical Analysis of AI-Generated Goal-Oriented Dialogues and Annotations
Labruna, T., Brenna, S., Zaninello, A., & Magnini, B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47546-7_11 · Cited by 43
Performance of large language models at the MRCS Part A: a tool for medical education?
Yiu, A. J., & Lam, K. (2023) · Annals of The Royal College of Surgeons of England · doi:10.1308/rcsann.2023.0085 · Cited by 20
“26 It is important for future LLM iterations to further develop basic insights in order to be able to appreciate these errors and for the development of training algorithms to ensure outputs follow the latest clinical guidance.”
Zhang, J., Li, Z., Das, K., Malin, B., & Kumar, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1032 · Cited by 94
Systematic Assessment of Factual Knowledge in Large Language Models
Luo, L., Vu, T.-T., Phung, D., & Haf, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.885 · Cited by 47
Avital, M. (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00873 · Cited by 22
“In contrast, there has also been much discussion on how AI may mislead researchers by providing them with misinformation and how AI may be misused to create convincing false content (Ji et al., 2023).”
BackgroundIntegration of cognitive tasks into artificial general intelligence test for large models
Qu, Y., Wei, C., Du, P., Che, W., Zhang, C., Ouyang, W., Bian, Y., Xu, F., Hu, B., Du, K., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109550 · Cited by 25
CareerSim: Gamification Design Leveraging LLMs For Career Development Reflection
Du, W., Zhu, Z., Xu, X., Che, H., & Chen, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650928 · Cited by 24
Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools
Buschek, D. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660681 · Cited by 44
LUNA: A Model-Based Universal Analysis Framework for Large Language Models
Song, D., Xie, X., Song, J., Zhu, D., Huang, Y., Juefei-Xu, F., & Ma, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3411928 · Cited by 41
“For example, recent research indicates that existing LLMs can occasionally generate content that is toxic, biased, insecure, or erroneous [9], [13], [14].”
BackgroundArtificial intelligence as a catalyst for combustion science and engineering
Ihme, M., & Chung, W. T. (2024) · Proceedings of the Combustion Institute · doi:10.1016/j.proci.2024.105730 · Cited by 29
Health information for all: do large language models bridge or widen the digital divide?
Tang, A., Tung, N., Nguyen, H. Q., Kwok, K. O., Luong, S., Bui, N., Nguyen, G., & Tam, W. (2024) · BMJ · doi:10.1136/bmj-2024-080208 · Cited by 21
Detecting Hallucinations in Large Language Model Generation: A Token Probability Approach
Quevedo, E., Yero, J., Koerner, R., Rivas, P., & Cerny, T. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-86623-4_13 · Cited by 78
An Overview on Language Models: Recent Developments and OutlookPreprint
Wei, C., Wang, Y.-C., Wang, B., & Kuo, C. ‐. J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.05759 · Cited by 15
“It is critical to develop an interpretable LM to avoid its hallucination in natural language generation [223].”
BackgroundExamining risks of racial biases in NLP tools for child protective services
Field, A., Coston, A., Gandhi, N., Chouldechova, A., Putnam-Hornstein, E., Steier, D., & Tsvetkov, Y. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594094 · Cited by 18
“However, current models are prone to hallucinating fictional information [27], severely imitating their usability in high-stakes domains.”
BackgroundTeng, D., Tan, L., Cao, Q., Xia, Y., Zhang, N., Li, J., & Zhao, D. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02547-z · Cited by 18
From Understanding to Utilization: A Survey on Explainability for Large Language Models
Luo, H., & Specia, L. (2024) · arXiv · doi:10.48550/arxiv.2401.12874 · Cited by 18
Du, S. Q., Tang, S., Wang, W., Li, X., & Guo, R. (2023) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-w2-2023-1729-2023 · Cited by 45
HALO: an ontology for representing and categorizing hallucinations in large language models
Nananukul, N., & Kejriwal, M. (2023) · Defense + Commercial Sensing · doi:10.1117/12.3014048 · Cited by 7
“21,22 Inevitably, as we have learned more about hallucinations as a community, their definition and scope has expanded.”
BackgroundA generative AI-driven interactive listening assessment task
Runge, A., Attali, Y., LaFlair, G. T., Park, Y., & Church, J. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1474019 · Cited by 26
Influence of External Information on Large Language Models Mirrors Social Cognitive Patterns
Bian, N., Lin, H., Liu, P., Lu, Y., Zhang, C.-P., He, B., Han, X., & Sun, L. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3476030 · Cited by 72
“So, it is essential to investigate their susceptibility to external influences and the potential biases that arise during this process, which is critical for the ethical and responsible application of these models in broader society [29], [30].”
Assessing the Efficacy and Clinical Utility of Artificial Intelligence Scribes in Urology
Moryousef, J., Nadesan, P., Uy, M., Matti, D., & Guo, Y. (2024) · Urology · doi:10.1016/j.urology.2024.11.061 · Cited by 26
Leite, M. V., Abe, J. M., Souza, M. L. H., & Nääs, I. D. A. (2025) · AgriEngineering · doi:10.3390/agriengineering7010012 · Cited by 27
Poretsky, E., Blake, V. C., Andorf, C. M., & Sen, T. Z. (2025) · Database · doi:10.1093/database/baaf011 · Cited by 17
Ortloff, A.-M., Martius, F., Meier, M., Sans-Raimbault, T., Geierhaas, L., & Smith, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713671 · Cited by 30
Angi, A., Sacco, A., & Marchetto, G. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3570017 · Cited by 38
“This analysis allowed us to address two main challenges: the human language’s ambiguity and the potential instability observed in LLMs [64], which could lead to the generation of inconsistent but plausible information, a phenomenon known as hallucination.”
A framework for considering the use of generative AI for health
Hunt, I. D. V., Jin, K.-X., & Linos, E. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01695-y · Cited by 25
ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning
Luo, L., Ju, J., Xiong, B., Li, Y.-F., Haffari, G., & Pan, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8173-0_25 · Cited by 117
Building hybrid AI models in chemical engineering: A tutorial review
Chakraborty, A., Taskiran, N. P., Kottooru, R., Mann, V., & Venkatasubramanian, V. (2025) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2025.109236 · Cited by 23
Chen, G., Song, T., Wang, Q., Ma, Z., Hu, J., Li, Q., & Wu, C. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131230 · Cited by 28
Aligning generalization between humans and machines
Ilievski, F., Hammer, B., van Harmelen, F., Paaßen, B., Saralajew, S., Schmid, U., Biehl, M. L., Bolognesi, M., Dong, X., Gashteovski, K., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01109-4 · Cited by 59
“A well-known overgeneralization phenomenon is hallucination, which refers to models that deviate from the source of the information 15 .”
Artificial Intelligence Threatens Critical Thinking in Education Systems
Özer, M., Tanberkan, H., & Perc, M. (2025) · Journal of Higher Education and Science · doi:10.5961/higheredusci.1747885 · Cited by 47
A systematic review of multi-modal large language models on domain-specific applications
Li, S., Wong, K. W., Wang, G., & Duong, T.-T. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11398-1 · Cited by 27
“Existing survey papers (Ji et al. 2023; Minaee et al. 2024) have typically focused on specific technical aspects of multi-modal LLMs, such as their underly - ing frameworks.”
I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation
Bhagavatula, C., Hwang, J. D., Downey, D., Bras, R. J. L., Lu, X., Qin, L., Sakaguchi, K., Swayamdipta, S., West, P., & Choi, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.535 · Cited by 44
Towards Improving the Reliability and Transparency of ChatGPT for Educational Question Answering
Wu, Y., Henriksson, A., Duneld, M., & Nouri, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42682-7_32 · Cited by 29
Autrán, R. R. (2023) · Entretextos (en línea, León, Gto.)/Entretextos · doi:10.59057/iberoleon.20075316.202339664 · Cited by 58
Hallucination Detection for Generative Large Language Models by Bayesian Sequential Estimation
Wang, X., Yan, Y.-L., Huang, L., Zheng, X., & Huang, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.949 · Cited by 53
Yin, C., Du, K., Nong, Q., Zhang, H., Yang, L., Yan, B., Huang, X., Wang, X., & Zhang, X. (2023) · Expert Systems · doi:10.1111/exsy.13513 · Cited by 26
“Researchers have already created instruction datasets in the general domain, including general dialogue-based instruction datasets (Ji et al., 2023b; Peng et al., 2023; Zhang et al., 2023).”
BackgroundChIP-GPT: a managed large language model for robust data extraction from biomedical database records
Cinquin, O. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbad535 · Cited by 26
“We observed ChIP-GPT to be affected by low-frequency ‘hallucinations’ [23] at the summarization stage, whereby sentences would appear in the output that had a topic similar to bona fide input sentences, but that did not appear as such in the input.”
BackgroundStress-induced failure of embodied cognition: A general model
Wallace, R., & Fricchione, G. L. (2024) · Biosystems · doi:10.1016/j.biosystems.2024.105193 · Cited by 20
Regulatory and Ethical Considerations on Artificial Intelligence for Occupational Medicine
Baldassarre, A., & Padovan, M. (2024) · La Medicina del Lavoro · doi:10.23749/mdl.v115i2.15881 · Cited by 33
“The risks arising from digitization in the work-place fall within the scope of Council Directive 89/391/EEC [32], the framework directive on occupational health and safety, and the national legislation that has implemented it.”
Explainability for Transparent Conversational Information-Seeking
Łajewska, W., Spina, D., Trippas, J. R., & Balog, K. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657768 · Cited by 26
Computational Argumentation-based Chatbots: A Survey
Castagna, F., Kökciyan, N., Sassoon, I. K., Parsons, S., & Sklar, E. I. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15407 · Cited by 44
“…being said, LLMs and the chatbots based on them also suffer from a number of downsides (Frieder et al., 2023; Bang et al., 2023; Wei et al., 2022a; Ji et al., 2023; Zhuo et al., 2023) including: faulty reasoning, inexplicable appearance of previously unknown abilities (a phenomenon denoted as…”
BackgroundUtilizing Large Language Models in Ophthalmology: The Current Landscape and Challenges
Chotcomwongse, P., Ruamviboonsuk, P., & Grzybowski, A. E. (2024) · Ophthalmology and Therapy · doi:10.1007/s40123-024-01018-6 · Cited by 25
“This phenomenon is called “falsehood mimicry” and is observed when the user input lacks clarity or accuracy [2, 54, 55].”
BackgroundBomba, F., Menéndez-Blanco, M., Grigis, P., Cremaschi, M., & Angeli, A. D. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3689040 · Cited by 33
Promises and Pitfalls: Using Large Language Models to Generate Visualization Items
Cui, Y., Ge, L. W., Ding, Y., Harrison, L., Yang, F., & Kay, M. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456309 · Cited by 32
“This may be related to the concept of hallucination in language models [21, 24], where the LLM -generated content is nonsensical or unfaithful to the provided source content [21].”
L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models
Ni, A., Yin, P.-C., Zhao, Y., Riddell, M., Feng, T., Shen, R., Yin, S., Liu, Y., Yavuz, S., Xiong, C.-M., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00705 · Cited by 50
Cheng, M., Zhang, Q., Liang, H., Wang, Y., Qin, J., Gong, L., Wang, S., Li, L., & Xiao, X. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1559265 · Cited by 17
Leveraging Large Language Models for Scalable and Explainable Cybersecurity Log Analysis
Palma, G., Cecchi, G., Caronna, M., & Rizzo, A. (2025) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp5030055 · Cited by 17
Elevating entrepreneurship with generative artificial intelligence
Li, Y., Ring, J. K., Jin, D., & Bajaba, S. M. (2025) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2025.100820 · Cited by 46
“Issues, such as hallucinations, bias, lack of algorithmic transparency, and domain-specific accuracy, can lead to flawed insights and suboptimal decisions (Ferreira et al., 2025; Ji et al., 2023).”
Generative Artificial Intelligence in Marketing: The Invisible Danger of AI Hallucinations
Yaprak, B. (2024) · Journal of Economy Business and Management · doi:10.7596/jebm.1588897 · Cited by 24
MacKay, E. J., Goldfinger, S., Chan, T. J., Grasfield, R. H., Eswar, V., Li, K., Cao, Q., & Pouch, A. M. (2025) · British Journal of Anaesthesia · doi:10.1016/j.bja.2025.01.028 · Cited by 20
Yang, Z., Yin, Y., Kong, C., Chi, T., Tao, W., Zhang, Y., & Xu, T. (2025) · Cell Discovery · doi:10.1038/s41421-025-00776-2 · Cited by 23
Nguyen, L., & Quan, T. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4285-4_7 · Cited by 28
Bridging Generations using AI-Supported Co-Creative Activities
Kim, C. Y., Sato, A. J., White, N. T., Ho, H.-R., Lee, C. P., Hwang, Y., & Mutlu, B. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713718 · Cited by 35
Ranasinghe, N., Mohammed, W. M., Stefanidis, K., & Lastra, J. L. M. (2025) · IEEE Access · doi:10.1109/access.2025.3565918 · Cited by 24
“Hallucinations can be defined as outputs generated by LLMs that, while appearing plausible and coherent, are ultimately unfaithful to the underlying data and present information that may be inaccurate or nonsensical [12].”
From text to traits: exploring the role of large language models in plant breeding
Yoosefzadeh-Najafabadi, M. (2025) · Frontiers in Plant Science · doi:10.3389/fpls.2025.1583344 · Cited by 23
“Additionally, NLMs can integrate data from genetic markers, phenotypic images, gene sequences, and environmental data, forming multimodal models that deliver more comprehensive insights into crop traits and breeding strategies (Ji et al., 2023).”
Between fact and fairy: tracing the hallucination metaphor in AI discourse
Förster, S., & Skop, Y. (2025) · AI & Society · doi:10.1007/s00146-025-02392-w · Cited by 33
Leveraging Large Language Models to Detect NPM Malicious Packages
Zahan, N., Burckhardt, P., Lysenko, M., Aboukhadijeh, F., & Williams, L. A. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00146 · Cited by 59
Cui, H., Zheng, P., Ren, M., & Yan, Y. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.104017 · Cited by 24
SciSciGPT: advancing human–AI collaboration in the science of science
Shao, E., Wang, Y., Qian, Y., Pan, Z., Liu, H., & Wang, D. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00906-6 · Cited by 77
Large language models enable semantic-guided hierarchical games for intelligent battery coordination
Zou, Y., Lin, Z., Zhang, Q., Liu, Z., & Xu, Z. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.104312 · Cited by 26
Evaluating large language models for accuracy incentivizes hallucinations
Kalai, A. T., Nachum, O., Vempala, S., & Zhang, E. (2026) · Nature · doi:10.1038/s41586-026-10549-w · Cited by 813
NeuS: Neutral Multi-News Summarization for Mitigating Framing Bias
Lee, N., Bang, Y., Yu, T., Madotto, A., & Fung, P. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.228 · Cited by 45
Self-citationHeck, T. G. (2023) · Cell Stress and Chaperones · doi:10.1007/s12192-023-01340-1 · Cited by 15
“Thus, the text that AI writes requires revision, so it is important for human authors to carefully review and validate the information that ChatGPT generates (Kim 2023), although there are proposed hallucination metrics and a revision process that ChatGPT utilizes (Ji et al. 2023).”
BackgroundEvaluation on ChatGPT for Chinese Language Understanding
Li, L., Zhang, H., Li, C., You, H., & Cui, W. (2023) · Data Intelligence · doi:10.1162/dint_a_00232 · Cited by 34
“The hallucination of generative models can be observed in this example, where the model generates fluent but meaningless text [42].”
BackgroundLarge Language Models in Uro-oncology
Ferber, D., & Kather, J. N. (2023) · European Urology Oncology · doi:10.1016/j.euo.2023.09.019 · Cited by 16
Metadata
- Authors
- Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- ORCID
- Venue
- ACM Computing Surveys
- Published
- 2023-03-03
- Volume
- 55
- Issue
- 12
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4309674289
- Semantic Scholar
- 3def68bd0f856886d34272840a7f81588f2bc082
- Cited by
- 5,025
- References
- 111
- Citations by year
- 2026: 2296 · 2025: 1441 · 2024: 817 · 2023: 453
- FWCI
- 224.36
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- hallucinations, natural language generation, hallucination mitigation, abstractive summarization, dialogue generation, generative question answering, data-to-text generation, machine translation, large language models, transformer models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.




