A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
Open accessThe DOI matches its Crossref record; 496 of the 496 references it cites were found in a registry or an index; 110 of the 234 sources its claims cite were checked for support.
Abstract
The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating plausible yet nonfactual content. This phenomenon raises significant concerns over the reliability of LLMs in real-world information retrieval (IR) systems and has attracted intensive research to detect and mitigate such hallucinations. Given the open-ended general-purpose attributes inherent to LLMs, LLM hallucinations present distinct challenges that diverge from prior task-specific models. This divergence highlights the urgency for a nuanced understanding and comprehensive overview of recent advances in LLM hallucinations. In this survey, we begin with an innovative taxonomy of hallucination in the era of LLM and then delve into the factors contributing to hallucinations. Subsequently, we present a thorough overview of hallucination detection methods and benchmarks. Our discussion then transfers to representative methodologies for mitigating LLM hallucinations. Additionally, we delve into the current limitations faced by retrieval-augmented LLMs in combating hallucinations, offering insights for developing more robust IR systems. Finally, we highlight the promising research directions on LLM hallucinations, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.
Overview
CoChat Summary
TL;DR
This survey proposes a taxonomy of LLM hallucination into factuality and faithfulness, then reviews causes, detection methods, benchmarks, mitigation strategies, and RAG-specific challenges. It also outlines open directions including hallucinations in large vision-language models and understanding knowledge boundaries in LLMs.
Key findings
- Redefines LLM hallucination as factuality hallucination (factual contradiction: entity-error, relation-error; factual fabrication: unverifiability, overclaim) and faithfulness hallucination (instruction inconsistency, context inconsistency, logical inconsistency).
- Identifies causes across data (misinformation/biases, knowledge boundary, inferior alignment data), training (pre-training, SFT, RLHF), and inference (imperfect decoding, over-confidence, softmax bottleneck, reasoning failure).
- Reviews detection and benchmarks: factuality detection via fact-checking and uncertainty estimation; faithfulness detection via fact-based, classifier-based, QA-based, uncertainty-based, and LLM-based metrics. Reported benchmark sizes include TruthfulQA (817 questions), HaluEval (30,000 task-specific and 5,000 general samples), FreshQA (600 hand-crafted questions), and HaluEval 2.0 (8,770 questions across five domains).
- Mitigation is organized by cause: data filtering, model editing, RAG; pre-training/alignment fixes; and factuality/faithfulness enhanced decoding. RAG still faces retrieval failure and generation bottleneck.
Methods
- Design: a survey/overview that proposes a taxonomy and organizes literature on LLM hallucination principles, causes, detection, benchmarks, mitigation, RAG challenges, and future directions.
- Data or sample: no primary dataset or new experiments; synthesizes existing research and benchmarks such as TruthfulQA, HaluEval, FreshQA, and HaluEval 2.0.
- Main analysis: conceptual categorization and qualitative synthesis; no quantitative meta-analysis is reported.
Limitations
- The paper does not explicitly state limitations of the survey itself.
- It states limitations of reviewed methods: RAG can be impacted by irrelevant retrievals and shallow retriever-generator interactions; fact-checking solely via LLM parametric knowledge may yield inaccurate assessments; classifier-based faithfulness metrics are constrained by scarcity of annotated data.
- Text makes evident: as a survey, it presents no original empirical validation or new benchmark results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
76 Valid · 5 Not valid · 48 Not checked · 108 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recent studies have highlighted a strong correlation between the model's accuracy on general domain questions and the volume of relevant documents [145] or entity popularity [204] within the pre-training corpora.”
What the sources say
- Supportedcites [145] [145] Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023. Large Language Models Struggle to Learn Long-Tail Knowledge. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA (Proceedings of Machine Learning Research, Vol. 202) , Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 15696-15707. https: //proceedings.mlr.press/v202/kandpal23a.html - source
The citation to this paper is attached to the volume of relevant documents, not the separate entity-popularity claim. Section 3.1 (p. 5) reports a strong correlation between question-answering accuracy and relevant pre-training document count across the tested models. (LLM, conf=0.94)
- Partly supportedcites [204] [204] Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023. When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023 , Anna Rogers, Jordan L. Boyd-Graber, and Naoaki Okazaki (Eds.). Association for Computational Linguistics, 9802-9822. https://doi.org/10.18653/v1/2023.acl-long.546 - sourceExperimental — accuracy not yet measured
The “Subject entity popularity predicts memorization” section reports a positive correlation between entity popularity and question-answering accuracy for almost all relationship types. However, the paper measures popularity using Wikipedia page views as a proxy, not entity frequency within pre-training corpora. Its Limitations section also says the experiments rely on synthetic datasets and that applicability to naturally occurring questions is not firmly established. (LLM, conf=0.87)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Such biases can be inadvertently acquired from internet-based texts, which are rife with diverse and biased viewpoints, and subsequently be propagated into the generated content [155].”
What the sources say
- Partly supportedcites [155] [155] Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen McKeown, and Tatsunori Hashimoto. 2023. When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics . Association for Computational Linguistics, Dubrovnik, Croatia, 3206-3219. https://aclanthology.org/2023.eacl-main.234 - sourceExperimental — accuracy not yet measured
The Abstract and §6 Discussion report that pre-training biases can propagate into generated summaries as hallucinated facts. But §6 leaves the source of those biases for future work and treats stereotyping in pre-training data as one possibility; it does not establish that they were acquired from internet-based texts. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Neural networks possess an intrinsic tendency to memorize training data [35]”
What the sources say
- Partly supportedcites [35] [35] Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. 2021. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21) . 2633-2650. - sourceExperimental — accuracy not yet measured
Section 3.1 (p. 3) says memorization is in many ways an essential component of language models, and the Introduction (p. 1) demonstrates that large language models memorize individual training examples. The claim extends that finding to neural networks generally; the cited passages do not establish an intrinsic tendency across all neural networks. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, certain biases are intrinsically tied to hallucinations, especially those related to gender [242] and nationality [155, 226].”
What the sources say
- Not matchedcites [242]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [155] [155] Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen McKeown, and Tatsunori Hashimoto. 2023. When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics . Association for Computational Linguistics, Dubrovnik, Croatia, 3206-3219. https://aclanthology.org/2023.eacl-main.234 - source
The Introduction and Section 3.3 report a strong association between pre-trained models’ name–nationality bias and nationality hallucinations in downstream text summarization. The citation to this paper is attached to nationality; the separate gender citation is not assessed here. (LLM, conf=0.89)
- Not matchedcites [226]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“this memorization tendency grows with model size [34, 54]”
What the sources say
- Supportedcites [34] [34] Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang. 2022. Quantifying memorization across neural language models. ArXiv preprint abs/2202.07646 (2022). https://arxiv.org/ abs/2202.07646 - source
Section 4.1 (p. 4) reports that larger models memorize significantly more than smaller models. The Introduction (p. 2) specifies that this finding is within model families, and the Conclusion (p. 9) describes memorization as scaling with model size. (LLM, conf=0.94)
- Supportedcites [54] [54] Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, H source
Section 7, “Memorization” (p. 35), explicitly concludes that larger models have a higher memorization rate than smaller models. It also reports that the exact-continuation match rate rises from 1.6% for the 8B model to 2.4% for the 540B model. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
102 more claims · 41 with their cited sources checked
Create a free account to see all 237 claims and to verify the 13 references still open.
- Probably not a substantial claim. 97
- It may state two separate claims as one. 55
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, LLMs exhibit hallucination and fabrication errors that are unacceptable for quantitative modeling [19, 20, 21].”
From Structured Schemas for Provenance‐Rich, LLM ‐Assisted QSP Model Calibration (2026) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, the generation of non-existent academic references or legal precedents has been widely recognized as a critical issue [4].”
From Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancy (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Retrieval augmentation, tool use, citation systems, constrained decoding, domain-specific training, and multimodal grounding can all supply partial external anchoring, and they alter both the frequency and the detectability of unsupported claims [15,29].”
From Hallucination as epistemic pollution: epistemic injustice and credibility in futures-oriented science education (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These measures do reduce the frequency of unsupported claims and improve the odds that a learner can detect one, and the argument here does not depend on denying it [15,29].”
From Hallucination as epistemic pollution: epistemic injustice and credibility in futures-oriented science education (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Retrieval-augmented generation evaluation checks whether model claims are factually grounded in retrieved documents.It does not check whether retrieved evidence is attributed to the correct entity.”
From Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation (2026) · cites this paper as Huang et al., 2025
Experimental — accuracy not yet measured
21 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 2.3 Hallucinations in Large Language Models · p. 7
“the final answer of x=4 is inconsistent with the reasoning chain, leading to an incorrect result.”
§ 2.3 Hallucinations in Large Language Models · p. 6
“Step 2: Divide both sides by 2 to get: x = 3. So the result of the equation is x=3.”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 1×
“To align with human preferences, RLHF optimizes the LLM to generate outputs that maximize the reward provided by the trained preference model, typically employing a reinforcement learning algorithm, such as Proximal Policy Optimization (PPO)(Schulman et al., 2017).”
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“While scaling up pre-training data substantially enhances the competencies of LLMs (Kaplan et al., 2020; Hoffmann et al., 2022), challenges arise in maintaining consistent data quality, which can potentially introduce misinformation and biases (Bender et al., 2021; Weidinger et al., 2021).”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 10×
“By retrieving evidence from external knowledge bases, RAG enables LLMs to be equipped with up-to-date knowledge and generate responses conditioning on relevant evidence.”
InfluentialLewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2017) · doi:10.1109/cvpr35066.2017 · Cited by 7,141
Research works printed but not linked: 33
- ArXiv. 2023. arxiv dataset. Retrieved from https://www.kaggle.com/datasets/Cornell-University/arxiv/versions/134
- Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems. Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.), 1171–1179. Retrieved from https://proceedings.neurips.cc/paper/2015/hash/e995f98d56967d946471af29d7bf99f1-Abstract.html
- Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. 2022. Improving language models by retrieving from trillions of tokens. In Proceedings of theInternational Conference on Machine Learning (ICML ’22). Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvári, Gang Niu, and Sivan Sabato (Eds.), Proceedings of Machine Learning Research, Vol. 162, PMLR, 2206–2240. Retrieved from https://proceedings.mlr.press/v162/borgeaud22a.html
- 10.5555/3495724.3495883 · doi:10.5555/3495724.3495883
- 10.5555/3600270.3602050 · doi:10.5555/3600270.3602050
- Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.), 4299–4307. Retrieved from https://proceedings.neurips.cc/paper/2017/hash/d5e2c0adad503c91f91df240d0cd4e49-Abstract.html
- Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2020. Plug and play language models: A simple approach to controlled text generation. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=H1edEyBKDS
- Bikash Gyawali, Lucas Anastasiou, and Petr Knoth. 2020. Deduplication of scholarly documents using locality sensitive hashing and word embeddings. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 901–910. Retrieved from https://aclanthology.org/2020.lrec-1.113
- Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020. The curious case of neural text degeneration. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=rygGQyrFvH
- Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, and Zhang Xiong. 2023d. Transformer-Patcher: One mistake worth one neuron. In Proceedings of the 11th International Conference on Learning Representations (ICLR ’23). OpenReview.net. Retrieved from https://openreview.net/pdf?id=4oYUGeGBPm
- Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin and Edouard Grave. 2022. Unsupervised dense information retrieval with contrastive learning. Transactions on Machine Learning Research 2022 (2022). Retrieved from https://openreview.net/forum?id=jKN1pXi7b0
- Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023. Large language models struggle to learn long-tail knowledge. In Proceedings of the International Conference on Machine Learning (ICML ’23). Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.), Proceedings of Machine Learning Research, Vol. 202, PMLR, 15696–15707. Retrieved from https://proceedings.mlr.press/v202/kandpal23a.html
- Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through memorization: Nearest neighbor language models. In Proceedings of the 8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=HklBjCEKvH
- 10.5555/3600270.3601883 · doi:10.5555/3600270.3601883
- Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. 2017. Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.), 6402–6413. Retrieved from https://proceedings.neurips.cc/paper/2017/hash/9ef2ed4b7fd2c810847ffa5fa85bce38-Abstract.html
- 10.5555/3600270.3602776 · doi:10.5555/3600270.3602776
- 10.5555/3495724.3496517 · doi:10.5555/3495724.3496517
- Jinming Li, Wentao Zhang, Tian Wang, Guanglei Xiong, Alan Lu, and Gerard Medioni. 2023. GPT4Rec: A generative framework for personalized recommendation and user interests interpretation. In Proceedings of the SIGIR Workshop on eCommerce Co-located with the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 23). Surya Kallumadi, Yubin Kim, Tracy Holloway King, Shervin Malmasi, Maarten de Rijke, and Jacopo Tagliabue (Eds.), CEUR Workshop Proceedings, Vol. 3589, CEUR-WS.org. Retrieved from https://ceur-ws.org/Vol-3589/paper_2.pdf
- Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out. Association for Computational Linguistics, 74–81. Retrieved from https://aclanthology.org/W04-1013
- 10.5555/3600270.3601532 · doi:10.5555/3600270.3601532
- Kevin Meng, Arnab Sen Sharma, Alex J. Andonian, Yonatan Belinkov, and David Bau. 2023. Mass-editing memory in a transformer. In Proceedings of the 11th International Conference on Learning Representations (ICLR ’23). OpenReview.net. Retrieved from https://openreview.net/pdf?id=MkbcAHIYgyS
- Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D. Manning. 2022. Fast model editing at scale. In Proceedings of the 10th International Conference on Learning Representations (ICLR ’22). OpenReview.net. Retrieved from https://openreview.net/forum?id=0DcZxeWfOPt
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. In NeurIPS. Retrieved from http://papers.nips.cc/paper_files/paper/2022/hash/b1efde53be364a73914f58805a001731-Abstract-Conference.html
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- Anton Sinitsin, Vsevolod Plokhotnyuk, Dmitriy Pyrkin, Sergei Popov, and Artem Babenko. 2020. Editable neural networks. In Proceedings of the8th International Conference on Learning Representations (ICLR ’20). OpenReview.net. Retrieved from https://openreview.net/forum?id=HJedXaEtvS
- 10.5555/3495724.3495977 · doi:10.5555/3495724.3495977
- Chenmien Tan, Ge Zhang, and Jie Fu. 2024. Massive editing for large language model via meta learning. In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=L6L1CJQ2PE
- Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov and Yuan Cao. 2022. SimVLM: Simple visual language model pretraining with weak supervision. In Proceedings of the 10th International Conference on Learning Representations (ICLR ’22). OpenReview.net. Retrieved from https://openreview.net/forum?id=GUrhfTuf_3
- 10.5555/3600270.3602070 · doi:10.5555/3600270.3602070
- Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, and William W. Cohen. 2018. Breaking the softmax bottleneck: A high-rank RNN language model. In Proceedings of the6th International Conference on Learning Representations (ICLR ’18). OpenReview.net. Retrieved from https://openreview.net/forum?id=HkwZSG-CZ
- Zhilin Yang, Thang Luong, Ruslan Salakhutdinov, and Quoc V. Le. 2019. Mixtape: Breaking the softmax bottleneck efficiently. In Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS ’19). Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.), 15922–15930. Retrieved from https://proceedings.neurips.cc/paper/2019/hash/512fc3c5227f637e41437c999a2d3169-Abstract.html
- Weizhe Yuan, Graham Neubig, and Pengfei Liu. 2021. BARTScore: Evaluating generated text as text generation. In Proceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS ’21). Marc’Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.), 27263–27277. Retrieved from https://proceedings.neurips.cc/paper/2021/hash/e4d2b6e6fdeca3e60e0f1a62fee3d9dd-Abstract.html
- Hugh Zhang, Daniel Duckworth, Daphne Ippolito, and Arvind Neelakantan. 2021. Trading off diversity and quality in natural language generation. In Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval). Association for Computational Linguistics, 25–33. Retrieved from https://aclanthology.org/2021.humeval-1.3
Cited by
Items 301–400 of 2,243
SysTemp: A Multi-agent System for Template-Based Generation of SysML V2
Bouamra, Y., Yun, B., Poisson, A., & Armetta, F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-07638-0_4 · Cited by 16
WIP: Large Language Model-Enhanced Smart Tutor for Undergraduate Circuit Analysis
Chen, L., Xie, H., Rohde, J. A., & Zhang, Y. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328403 · Cited by 10
“The main challenges of integrating LLMs into engineering education include their inability to recognize and interpret scientific and engineering diagrams [12], limited mathematical capabilities [13], and the prevalence of hallucinations [14].”
Erden, M., Chiappetti, A., & Kho, R. M. (2026) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2026.02.014 · Cited by 8
Won, J., & Lee, C. H. (2026) · Journal of Hospitality and Tourism Technology · doi:10.1108/jhtt-10-2025-0937 · Cited by 10
VeriTrail-RCA: Evidence-Verified Root Cause Localization for Microservice Backends
Hu, R., Zheng, Y., Fang, R., & Zhou, J. (2026) · International Conference on Machine Learning and Intelligent Systems Engineering (MLISE) · doi:10.1109/mlise70044.2026.11607533 · Cited by 10
“When the retrieved telemetry is partial or contradictory, hallucinations and confirmation bias drive the agent toward a plausible-sounding but unsupported root cause [8].”
Zhu, Z., Zhao, Y., Qiu, S., Xu, K., Yin, Q., Huang, J., Liu, Z., & Wang, F. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3451649 · Cited by 13
Large Language Models for Electronic Health Record De-Identification in English and German
Sousa, S., Jantscher, M., Kröll, M., & Kern, R. (2025) · Information · doi:10.3390/info16020112 · Cited by 12
A Survey on Recent Advances in Conversational Data Generation
Soudani, H., Petcu, R., Kanoulas, E., & Hasibi, F. (2026) · ACM Computing Surveys · doi:10.1145/3795686 · Cited by 39
Expertise or Hallucination? A Comprehensive Evaluation of ChatGPT's Aptitude in Clinical Genetics
Zhang, Y., Ren, S., Wang, J., Zhan, C., He, M., Liu, X., Wu, R., Zhao, J., Wu, C., Fan, C., et al. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3536939 · Cited by 7
“…phenomenonof“knowledgehallucination”hasfoundthatthe heterogeneity of training data, the imperfection of models, and the lack of assessment are the fundamental reasons leading to knowledge hallucinations in large language models such as ChatGPT, PaLM, Gopher, etc [41].”
Jiang, C., Fan, Y., Xie, J., Kuang, E., Feng, B., Zhang, K., & Fan, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713677 · Cited by 8
Edelman, B., & Skolnick, J. (2025) · BMC Bioinformatics · doi:10.1186/s12859-025-06159-4 · Cited by 12
“Yet, when deployed as stand-alone tools for scientific claim verification, LLMs often struggle with hallucinations—fabricating data or citing non-existent sources— thereby undermining their utility as reliable evidence synthesizers [6].”
ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemaking
Ye, R., Lee, P. Y. K., Varona, M., Huang, O., & Nobre, C. (2025) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3707640.3731913 · Cited by 17
AI-driven design: powered by large language model and intelligent computation
Sa, G., Li, Z., Liu, Z., & Tan, J. (2025) · International Journal of Extreme Manufacturing · doi:10.1088/2631-7990/adea23 · Cited by 8
Using a Large Language Model as Design Material for an Interactive Museum Installation
Engstrøm, M. P., & Løvlie, A. S. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715668.3736359 · Cited by 14
Enhancing the Robustness of Vision-Language Foundation Models by Alignment Perturbation
Zhang, C., Wang, S., Li, X., Zhu, Y. T., Qi, H., & Huang, Q. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3586430 · Cited by 9
Knowledge fusion in deep learning-based medical vision-language models: A review
Xu, D., Chen, Y., Chai, Z., Xiao, Y., Yan, Y., Ding, W., Wang, H., Jin, Z. J., Jiao, W., Yue, W., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103455 · Cited by 16
Self-citationThe Impact of Generative AI on Test & Evaluation: Challenges and Opportunities
Freeman, L., Robert, J., & Wojton, H. M. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728723 · Cited by 6
ColBERT Retrieval and Ensemble Response Scoring for Language Model Question Answering
Gichamba, A., Idris, T. K., Ebiyau, B., Nyberg, E., & Mitamura, T. (2024) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshp64532.2024.11100297 · Cited by 11
“Furthermore, LLMs can sometimes produce responses that conflict with established facts [6], posing a significant challenge in domain-specific QA where factual accuracy is crucial.”
Direct Automated Feedback Delivery for Student Submissions based on LLMs
Sölch, M., Dietrich, F. T. J., & Krusche, S. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3727247 · Cited by 13
Catch me if you search: When contextual web search results affect the detection of hallucinations
Nahar, M., Lee, E.-J., Park, J. W., & Lee, D. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108763 · Cited by 7
Song, M. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104368 · Cited by 16
Donner, S., Knauer, P., Kienzle, A., Dinneen, J. D., Burger, J. A., Perka, C., & Donner, S. (2025) · Journal of Medical Internet Research · doi:10.2196/73717 · Cited by 14
“Second, we evaluated the level to which the AI chatbot produced so-called hallucinations, that is, “content that is either nonsensical or unfaithful to the provided source content” [33,34].”
Kadian, A., Merhi, M. I., Gupta, M., Ghafoori, A., & Dennehy, D. (2025) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2025.3606352 · Cited by 9
“Although progress has been made in examining the technical aspects of GAIH [28], [29].”
InfluentialDeng, J., Wu, F., & Qi, J. (2025) · Applied Sciences · doi:10.3390/app151910322 · Cited by 15
DeepSeek in Education: Exploring the Transformative Potential of AI‐Driven Educational Intelligence
Liao, J., Sun, F., Liu, Y., & Hu, Y. (2025) · Future in Educational Research · doi:10.1002/fer3.70022 · Cited by 6
RAI: Flexible Agent Framework for Embodied AI
Rachwał, K., Majek, M., Boczek, B., Dąbrowski, K., Liberadzki, P., Dąbrowski, A., & Ganzha, M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-05925-3_16 · Cited by 16
Peet, B. M., Sidoti, A., Allen, R. J., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14217821 · Cited by 6
Accelerating earth science discovery via multi-agent LLM systems
Pantiukhin, D., Shapkin, B., Kuznetsov, I., Jost, A. A., & Koldunov, N. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1674927 · Cited by 40
Li, X., He, H., Lu, G., Yue, P., Chen, J., Yang, Z., & Hon, C. (2025) · Chinese Medicine · doi:10.1186/s13020-025-01249-0 · Cited by 11
MCeT: Behavioral Model Correctness Evaluation using Large Language Models
Ahmed, K. A. M., Song, J., Chen, B., Ou, W., & Zheng, B. (2025) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1109/models67397.2025.00014 · Cited by 14
“However, directly evaluating the entire diagram against the requirements using LLMs does not work due to hallucinations [11] and failures to focus on the entire context [31].”
Bello, M., Bello, R., García, M.-M., Nowé, A., Sevillano-García, I., & Herrera, F. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10668-1 · Cited by 23
“Another important consideration when incorporating LLMs into explainability frameworks is the potential risk of hallucinations—instances where the model generates plausible but factually incorrect information [77].”
Uncovering novel scientific insights with a synergistic GNN-LLM framework
Wang, Q., Lyu, D., & Chen, Q. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114527 · Cited by 7
Self-citationDo Large Language Models Favor Recent Content? A Study on Recency Bias in LLM-Based Reranking
Fang, H., Tao, S., Chen, N., Chang, K.-X., & Sakai, T. (2025) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3767695.3769493 · Cited by 25
Exploring the Potential of Using ChatGPT in Chemistry Education
Christian Morbidoni, B., Mascitti, A., Sarra, A., Tonucci, L., & Coccia, F. (2026) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5c00854 · Cited by 9
A Reusable Prompting Framework for Applying Large Language Models to Legal Tasks
Sriram, S., Vijayaraj, N., Krishna, G. R., Bhanu, S. V., Choudhary, G., & Murugan, T. (2026) · IEEE Access · doi:10.1109/access.2026.3650941 · Cited by 11
“Large language models currently struggle with producing consistent results, often hallucinating by fabricating legal outcomes or precedents, missing jurisdictional nuances, generating unreliable or incorrect references, and exhibiting variability across tasks and prompts [2].”
An LLM-based multi-agent system for remote sensing analysis
Sun, Z., Zhou, Y., & Yang, J. (2026) · Big Earth Data · doi:10.1080/20964471.2025.2600178 · Cited by 12
Analyzing the Behavior of LLM Under Concurrency and Token-Based DoS Attacks
Barek, M. A., Riad, A. K. I., Rashid, M. B., Francia, G., Shahriar, H., & Ahamed, S. I. (2025) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc68382.2025.00017 · Cited by 8
Global Marketing Research: Gains, Gaps, and Guardrails
Lim, W. M., Sethuraman, R., Jain, D. C., Huang, L., Souda, P., & Manrai, A. K. (2026) · Journal of Global Marketing · doi:10.1080/08911762.2025.2610128 · Cited by 7
“…leaps (Friedman et al., 2025), while wider reviews of LLM use in research highlight persistent problems of bias, hallucination, and opacity that directly threaten the validity of both qualitative interpretations and quantitative text-based measures (Anthis et al., 2025; Huang et al., 2025).”
Self-citationSagynbayeva, A., Pyo, A., Yoon, S.-H., & Yang, S. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108952 · Cited by 6
A Survey of Multimodal Hallucination Evaluation and Detection
Chen, Z., Min, Y., Zhang, J., Yan, B., Wang, J., Wang, X., & Shan, S. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02756-9 · Cited by 46
“These kinds of hallucinations may arise from factors like noisy training data, strong language priors, cross-modal misalignment, and other related issues (Huang et al., 2025).”
InfluentialA Comprehensive Study on Large Language Models for Mutation Testing
Wang, B., Chen, M., Deng, M., Lin, Y., Harman, M., Papadakis, M., & Zhang, J. M. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3805038 · Cited by 35
Evidence-Verified LLM Agents for Safe Backend Incident Remediation
Zheng, Y., Zhou, J., Hu, R., & Fang, R. (2026) · International Conference on Image Processing and Artificial Intelligence (ICIPAI) · doi:10.1109/icipai70034.2026.11605740 · Cited by 10
“When LLM agents execute remediation actions directly—such as restarting services, scaling resources, or rolling back deployments—the risk of erroneous fixes becomes substantial due to hallucination [7].”
FakeWatch : a framework for detecting fake news to ensure credible elections
Raza, S., Khan, T., Chatrath, V., Paulen-Patterson, D., Rahman, M., & Bamgbose, O. (2024) · Social Network Analysis and Mining · doi:10.1007/s13278-024-01290-1 · Cited by 11
“Table 5 Example of fake news articles with highlighted words.”
Extracting Information from Brazilian Legal Documents with Retrieval Augmented Generation
de Aquino, I. V., dos Santos, M. M., Dorneles, C. F., & Carvalho, J. T. (2024) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd_estendido.2024.244241 · Cited by 9
LmRaC: a functionally extensible tool for LLM interrogation of user experimental results
Craig, D. B., & Drăghici, S. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae679 · Cited by 8
Tsui, K. M., Baggett, R., & Chiang, C. (2025) · Applied Sciences · doi:10.3390/app15020891 · Cited by 7
Context and Layers in Harmony: A Unified Strategy for Mitigating LLM Hallucinations
Yu, S., Kim, G., & Kang, S. (2025) · Mathematics · doi:10.3390/math13111831 · Cited by 11
Chu, T., Chen, Y., Wilson, J. P., & Liu, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128760 · Cited by 6
Fine-tuning Large Language Models in Behavioral Psychology for Scalable Physical Activity CoachingPreprint
Mantena, S., Johnson, A., Oppezzo, M., Schütz, N., Tolas, A., Doijad, R., Mattsson, C. M., Lawrie, A., Ramírez‐Posada, M., Linos, E., et al. (2025) · medRxiv · doi:10.1101/2025.02.19.25322559 · Cited by 7
“47,48 In summary, MHC-Coach demonstrates the promise of integrating behavioral science frameworks with LLMs to deliver scalable, stage-specific health coaching.”
Accessible IoT Dashboard Design with AI-Enhanced Descriptions for Visually Impaired Users
Stelea, G. A., Sangeorzan, L., & Enache-David, N. (2025) · Future Internet · doi:10.3390/fi17070274 · Cited by 5
A novel recommender framework with chatbot to stratify heart attack risk
Wali, T., Bolatbekov, A., Maimaitijiang, E., Salman, D., & Mamatjan, Y. (2024) · Discover Medicine · doi:10.1007/s44337-024-00174-9 · Cited by 6
“The emergence of LLMs has marked a significant breakthrough in natural language processing (NLP), leading to remarkable advancements in text understanding and generation [37].”
Learning Human Feedback from Large Language Models for Content Quality-aware Recommendation
Wang, H., Wu, C., Huang, Y., & Qi, T. (2025) · ACM Transactions on Information Systems · doi:10.1145/3727144 · Cited by 11
Self-citationNegotiation Backtable Bots: Using GenAI to Improve Multiparty Negotiation Instruction
Dinnar, S., Susskind, L. E., Sibanda, L. K., & Olaleye, O. O. (2025) · Negotiation Journal · doi:10.1162/ngtn_a_00015 · Cited by 7
Tailoring Scientific Knowledge: How Generative AI Personalizes Academic Reading Experiences
Kamińska, A. M. (2025) · Publications · doi:10.3390/publications13020018 · Cited by 10
“Despite these promising findings, it must be acknowledged that the underlying LLM technology remains susceptible to hallucinations Huang et al. (2025) and biases Dai et al. (2024) that originate from the training datasets.”
Cognitive Echo: Enhancing think‐aloud protocols with LLM ‐based simulated students
Zheng, L., He, A., Qi, C., Zhang, H., & Gu, X. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13590 · Cited by 17
Cifliku, B., & Heuer, H. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719856 · Cited by 13
“A larger participant pool, including more non-technically skilled journalists, could reveal additional automation use cases.”
Chen, M., Ma, J., Cui, X., Dai, Q., Hu, H., Wu, Y., Husaiyin, S., Wu, A., & Qiao, Y. (2025) · Medical Teacher · doi:10.1080/0142159x.2025.2513419 · Cited by 6
“The origins of LLM hallucinations are multifaceted, spanning the entire spectrum of model development, from data to training to inference [15].”
Chen, Y., Sun, S., & Hu, X. (2025) · Applied Sciences · doi:10.3390/app15126722 · Cited by 7
An fMRI visual neural encoding method with multimodal large language model
Ma, S., Wang, L., Hou, L., Hou, S., & Yan, B. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114049 · Cited by 6
Jonnala, R., Yang, J. Y., Lee, Y., Liang, G., & Cao, Z. (2025) · IEEE Access · doi:10.1109/access.2025.3585742 · Cited by 12
“Furthermore, the phenomenon of hallucinations [16], [17], [18], [19], potentially arising from training on vast datasets containing both efficient and inefficient code, misunderstandings of prompt nuances, and other factors, can contribute to excessive energy consumption and reduced performance in…”
Optical image processing and applications empowered by vision-language models
Xiao, J., Sun, Z., An, H., Zhao, H., Qiu, M., & Li, X. (2025) · iOptics · doi:10.1016/j.iopt.2025.100003 · Cited by 10
Tian, Z., He, Y., Zhang, N., Lin, Q., Shi, H., Zhuge, J., Mao, J., & Chang, D. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3587211 · Cited by 5
“This dual-role approach can ensure the reliability of information extraction and eliminate the hallucinations and inaccuracies [28], [29], [30] introduced by LLMs. Challenge 2: Probing Internet-connected Devices via Binary Protocols: The proliferation of di ff erent binary protocols used by…”
LLM-based Query Expansion Fails for Unfamiliar and Ambiguous Queries
Abe, K., Takeoka, K., Kato, M. P., & Oyamada, M. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730222 · Cited by 25
Transforming Catalysis with Machine Learning: Emerging Tools and Next-Gen Strategies
Pu, P., Feng, H., Song, X. L., Wang, S., Bao, J. J., & Zhang, X. (2025) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.5c09626 · Cited by 7
Treitler, P. C., Digioia-laird, V., & Long, B. (2025) · Health & Justice · doi:10.1186/s40352-025-00358-0 · Cited by 14
“This process was only done after both human reviewers had already independently completed their extraction, and any new information extracted by the LLM was carefully reviewed for accuracy given their tendency toward hallucination (Huang et al., 2025).”
Self-Corrective Task Planning by Inverse Prompting with Large Language Models
Lee, J., Lee, H., Kim, J., Lee, K., & Kim, E. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128028 · Cited by 7
“However, LLMs continue to produce outputs that, while plausibly worded, are often inaccurate or infeasible [9].”
User-defined trade-offs in LLM benchmarking: balancing accuracy, scale, and sustainability
Gjorgjevikj, A., Nikolikj, A., Seljak, B. K., & Eftimov, T. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114405 · Cited by 12
Xu, Q., Liu, Z., & Ma, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104392 · Cited by 6
Zou, X., Li, X., Hu, P., & Dong, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114470 · Cited by 10
A Semi-Automated Framework for Flood Ontology Construction with an Application in Risk Communication
Li, S., Erickson, C., Zajac, M., Guo, X., Duan, Q., & Gong, J. (2025) · Water · doi:10.3390/w17192801 · Cited by 6
“The literature on LLM-based ontology construction highlights significant risks, including factual “hallucination", “semantic drift” away from the core domain, and the creation of isolated “ontology silos” that lack definitional clarity [8,56,57].”
Challener, D. W., Ayanian, S., Ryu, A. J., O’Horo, J. C., & Heaton, H. A. (2025) · Journal of Hospital Medicine · doi:10.1002/jhm.70163 · Cited by 10
Liu, Z., Kou, J., Zhang, W., Gu, C., Fang, X., Huang, Z., Hao, Y., Li, H., Lu, X., Yin, A., et al. (2024) · International Conference on Universal Village (UV) · doi:10.1109/uv63228.2024.11189137 · Cited by 12
Zhang, W., Chen, Y., Liu, X., & Zhang, H. (2025) · Land Use Policy · doi:10.1016/j.landusepol.2025.107807 · Cited by 10
From limitation to possibility: affordances and tactical evolution in user–GenAI interaction
Zhao, H., Han, Z., Yang, N., & Zeng, Z. (2025) · Journal of Documentation · doi:10.1108/jd-07-2025-0183 · Cited by 8
Venkatasubramanian, K., Hardie, H., & Ranalli, T.-M. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746359 · Cited by 7
Teles, A. S., Chaturvedi, J., Wang, T., Scazufca, M., Msosa, Y. J., Stahl, D. R., & Roberts, A. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000488 · Cited by 8
“Without such validation, there is a risk that models may produce outputs that are factually incorrect, contextually inappropriate, or potentially harmful hallucinations [92].”
A survey of foundation models for IoT: taxonomy and criteria-based analysis
Wei, H., Lee, D. Y., Rohal, S., Hu, Z., Rossi, R. A., Fang, S., & Pan, S. (2025) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-025-00208-w · Cited by 13
Panda, M., Singh, K., Raj, A., & Puri, R. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00730-x · Cited by 13
Zhu, Y., Shu, X., Liu, X., Li, Y., Yi, B., & Ma, D. (2025) · Anesthesiology and Perioperative Science · doi:10.1007/s44254-025-00156-9 · Cited by 9
Merchant, S. A., Merchant, N., Varghese, S. L., & Shaikh, M. J. S. (2025) · World Journal of Radiology · doi:10.4329/wjr.v17.i11.114754 · Cited by 6
Shingleton, J., & Basiri, A. (2025) · Journal of Location Based Services · doi:10.1080/17489725.2025.2594193 · Cited by 7
“The propensity for LLMs to hallucinate information is now well known (Huang et al. 2025).”
Khapre, S., Mersha, M. A., Shakil, H., Baruah, J., & Kalita, J. K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129832 · Cited by 15
“Third, generative AI hallucinates, ie, it produces misleading or fabricated information, contributing to misinformation and digital harm [134].”
Daryanto, T., Stil, S., Ding, X., Manesh, D., Lee, S. W., Lee, T., Lunn, S. J., Rodriguez, S. L., Brown, C., & Rho, E. H. R. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00029 · Cited by 7
“This collaborative approach also mitigates the risk of hallucinations that can occur when examples are entirely generated by LLM without human involvement [93].”
Debsarkar, S. S., & Prasath, V. B. S. (2026) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2026.102704 · Cited by 7
Wang, X., Long, Z., Zhu, B., Cao, Y., Tang, H., He, K., & Zhang, S. (2026) · Scientific Reports · doi:10.1038/s41598-025-31874-6 · Cited by 9
“One notable issue is hallucination 28 , where the model produces answers that appear plausible but are factually incorrect.”
Security and privacy in LLMs: A comprehensive survey of threats and mitigation strategies
Berini, A. D. E., Jamil, N., Benrazek, A., Lakas, A., Ismail, L., Ferrag, M. A., & Lam, K. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104241 · Cited by 23
Trustworthy AI in digital health: a comprehensive review of robustness and explainability
Mamun, A., Soumma, S. B., & Ghasemzadeh, H. G. (2026) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/ae4e74 · Cited by 11
“…avoid implying diagnosis or prescribing actions; instead, they should provide conservative, evidence-aligned education and encourage clinical confirmation—a design choice supported by findings that dangerous content can appear across a range of common symptom scenarios in chatbot evaluations [192].”
Abbineni, P., Aldowaish, S., Liechty, C., Noorzad, S., Ghalati, A. G., & Fayazi, M. (2026) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac66049.2026.11420505 · Cited by 12
“This matter gets exacerbated because of the hallucinating [3] nature of LLMs generative process.”
InfluentialArtificial Truth: Algorithmic Power, Epistemic Authority, and the Crisis of Democratic Knowledge
Palese, R. (2026) · Societies · doi:10.3390/soc16030102 · Cited by 21
Zhu, Z., Yu, J., & Luo, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790697 · Cited by 12
Retevoi, A., Devittori, G., Kowatsch, T., & Lambercy, O. (2024) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3652988.3673924 · Cited by 6
LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Tasks
Dona, M. A. M., Cabrero‐Daniel, B., Yu, Y., & Berger, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-80889-0_8 · Cited by 10
Yang, J. J., & Hwang, S. (2025) · Blood Research · doi:10.1007/s44313-025-00062-w · Cited by 11
“The integration of LLMs in Scientific writing requires robust quality assurance protocols to ensure scientific accuracy and reliability [41].”
Jaganathan, G. S., Kahanda, I., & Kanewala, U. (2025) · Smart Health · doi:10.1016/j.smhl.2025.100564 · Cited by 10
IOAgent: Democratizing Trustworthy HPC I/O Performance Diagnosis Capability via LLMs
Egersdoerfer, C., Sareen, A., Bez, J. L., Byna, S., Xu, D., & Dai, D. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00036 · Cited by 11
Towards Reliable Large Language Models: A Survey on Hallucination Detection
Pan, Y., Kong, L., Wu, J., Yang, Y., Zuo, H., Xiu, Z., & Wang, X. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0014-7_37 · Cited by 10
Benchmarking Large Language Models on Homework Assessment in Circuit Analysis
Chen, L., Qin, Z., Guo, Y., Rohde, J. A., & Zhang, Y. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00501-w · Cited by 18
Rethinking Code Review Workflows with LLM Assistance: An Empirical Study
Aðalsteinsson, F. S., Magnússon, B. B., Milicevic, M., Davidsson, A. N., & Cheng, C. (2025) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem64174.2025.00013 · Cited by 30
“We do not consider LLMs as human replacements mainly due to the fundamental concern that LLMs are still prone to hallucinations [11].”
Towards AI for Software Systems
Eskandani, N., & Salvaneschi, G. (2024) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3664646.3664767 · Cited by 7
Bodaghi, A., Fung, B. C. M., & Schmitt, K. (2024) · ACM Transactions on the Web · doi:10.1145/3700791 · Cited by 12
Metadata
- Authors
- Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., & Liu, T.
- Affiliations
- Harbin Institute of Technology (CN)
- Huawei Technologies (China) (CN)
- ORCID
- Venue
- ACM Transactions on Information Systems
- Published
- 2025-01-24
- Volume
- 43
- Issue
- 2
- Pages
- 1-55
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W4404534210
- Semantic Scholar
- 1e909e2a8cdacdcdff125ebcc566f37cb869a1c8
- Cited by
- 4,688
- References
- 229
- Citations by year
- 2026: 2433 · 2025: 1643
- FWCI
- 504.87
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Information Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- LLM hallucination, large language models, hallucination taxonomy, hallucination detection, hallucination mitigation, retrieval-augmented generation, information retrieval systems, factual reliability, large vision-language models, knowledge boundaries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.