Improving Generative Ai Reliability: A Qualitative Study of Hallucination in Large Language Models
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
Mattley, C., Strauss, A., & Corbin, J. (1999) · Contemporary Sociology · doi:10.2307/2655359 · Cited by 2,408
An Overview of Overfitting and its Solutions
Ying, X. (2019) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1168/2/022022 · Cited by 2,352
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
On Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.173 · Cited by 1,185
On Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · arXiv · doi:10.48550/arxiv.2005.00661 · Cited by 1,185
Retrieval Augmentation Reduces Hallucination in Conversation
Shuster, K., Poff, S., Chen, M., Kiela, D., & Weston, J. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.320 · Cited by 575
Unleashing the potential of prompt engineering for large language models
Chen, B., Zhang, Z., Langrené, N., & Zhu, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101260 · Cited by 490
Persuasion, Social Influence, and Compliance Gaining
Gass, R. H., & Seiter, J. S. (1998) · Digital Commons - USU (Utah State University) · Cited by 403
Athaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023) · Cureus · doi:10.7759/cureus.37432 · Cited by 403
High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content
Bhattacharyya, M., Miller, V. M., Bhattacharyya, D., & Miller, L. E. (2023) · Cureus · doi:10.7759/cureus.39238 · Cited by 294
ChatGPT: these are not hallucinations – they’re fabrications and falsifications
Emsley, R. (2023) · Schizophrenia · doi:10.1038/s41537-023-00379-4 · Cited by 258
Errors in Planning and Decision‐making and the Nature of Human Information Processing
Dörner, D., & Schaub, H. (1994) · Applied Psychology · doi:10.1111/j.1464-0597.1994.tb00839.x · Cited by 212
The Risks of Using ChatGPT to Obtain Common Safety-Related Information and AdvicePreprint
Oviedo-Trespalacios, O., Peden, A., Cole-Hunter, T., Costantini, A., Haghani, M., Rod, J., Kelly, S., Torkamaan, H., Tariq, A., Newton, J. D. A., et al. (2023) · Social Science Research Network · doi:10.2139/ssrn.4346827 · Cited by 166
Unleashing the potential of prompt engineering for large language modelsPreprint
CHEN, B. ‐., Zhang, Z., Langrené, N., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.14735 · Cited by 138
Artificial intelligence hallucinations
Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023) · Critical Care · doi:10.1186/s13054-023-04473-y · Cited by 136
The Art and Science of Prompt Engineering: A New Literacy in the Information Age
Lo, L. S. (2023) · Internet Reference Services Quarterly · doi:10.1080/10875301.2023.2227621 · Cited by 136
Artificial hallucination: GPT on LSD?
Beutel, G., Geerits, E., & Kielstein, J. T. (2023) · Critical Care · doi:10.1186/s13054-023-04425-6 · Cited by 111
Using ChatGPT in Education: Human Reflection on ChatGPT’s Self-Reflection
Loos, E. F., Gröpler, J., & Goudeau, M.-L. S. (2023) · Societies · doi:10.3390/soc13080196 · Cited by 111
Hadi, M. U., tashi, Q. A., Qureshi, R., Shah, A., muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 103
Hadi, M. U., tashi, Q. A., Qureshi, R., Shah, A., muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741 · Cited by 83
Internet-augmented language models through few-shot prompting for open-domain question answering
Lazaridou, A., Gribovskaya, E., Stokowiec, W., & Grigorev, N. (2022) · arXiv · doi:10.48550/arxiv.2203.05115 · Cited by 64
Introduction to Advertising and Promotion Management
Belch, G. E., & Belch, M. A. (1990) · Medical Entomology and Zoology · Cited by 59
Artificial Hallucinations by Google Bard: Think Before You Leap
Kumar, M., Mani, U. A., Tripathi, P., Saalim, M., & Roy, S. (2023) · Cureus · doi:10.7759/cureus.43313 · Cited by 59
Kim, Y., Lee, J., Kim, S., Park, J., & Kim, J. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645148 · Cited by 55
Self-citationLee, S.-W., & Choi, W.-J. (2023) · Anesthesia and Pain Medicine · doi:10.17085/apm.23056 · Cited by 35
Uncertainty in Information Seeking.
Wilson, T. D., Ellis, D., Ford, N. J., & Foster, A. E. (2000) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 19
Jajodia, S., Samarati, P., & Yung, M. (2025) · Springer eBooks · doi:10.1007/978-3-030-71522-9_300689 · Cited by 17
The Risks of Using Chatgpt to Obtain Common Safety-Related Information and AdvicePreprint
Oviedo-Trespalacios, Ó., Peden, A. E., Cole‐Hunter, T., Costantini, A., Haghani, M., Rod., J. E., Kelly, S., Torkamaan, H., Tariq, A., Newton, J. D. A., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4370050 · Cited by 13
Revolutionizing Retrieval-Augmented Generation with Enhanced PDF Structure RecognitionPreprint
Lin, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.12599 · Cited by 10
The Direction of the Religious Communities through Two Keywords Focusing on ‘Endemic’ and ‘ChatGPT’
디지털영상문화콘텐츠학과, 한., & Shin, K. (2023) · Peace and Religions · doi:10.25168/kaprs.2023.15.9 · Cited by 1
Research works printed but not linked: 19
- A I Data, 2023, Generative AI survey results: Customers expect brands to be transparent, TELUS International, 22
- G L Brodeur, 2023, ChatGPT for legal and tax professionals: 'Worldaltering power' requires kid gloves, CPA J, 93, 68
- W J Doherty, 1982, The economic value of rapid response time, IBM Report, 1
- 2023, EU AI Act: first regulation on artificial intelligence, 22
- M H Go, 2023, The serious 'hallucination phenomenon' of generative AI... LG, 22
- Y J Han, 2023, Study on the Appearance of ChatGPT and the Fairness of Journalism: Focusing on In-depth Interviews with Current Journalist. Korea University Graudate School of Media & Communication
- J H Heo, 2023, The age of artificial intelligence, the challenges and prospects of contemporary Korean poetry-Centering on the generative artificial intelligence ChatGPT, Korean Poet. Stud. Assoc, 74, 45
- C Jeong, 2023, Generative AI service implementation using LLM application architecture: Based on RAG model and LangChain framework, J. Intell. Inf. Syst, 19, 129
- J M Kang, 2023, Reflections on hallucination security in an autonomous vehicle service (in terms of preventing incorrect answers and biased judgments from AI hallucination), Proceedings of the KIIT Conference, 23
- H Kaur, 2023, Dictionary.com's word of the year is a common one, CNN
- G K Liu, 2023, Transforming human interactions with AI via reinforcement learning with human feedback (RLHF): Envisioning the future of computing prize. Social and Ethical Responsibilities of Computing
- R Mason, 2023, Generative AI use is on the rise and so are concerns about bias, privacy and more
- N Norlen, 2023, The Dictionary.com Word of the Year is hallucinate, Dictionary.com
- M O'brien, 2023, Tech experts are starting to doubt that ChatGPT and A.I. 'hallucinations' will ever go away: 'This isn't fixable', FORTUNE, 22
- H Patil, 2023, Don't be a victim of AI hallucinations, 22
- M Sadeghi, 2024, Tracking AI-enabled misinformation: 725 'unreliable AI-generated news' websites (and counting), plus the top false narratives generated by artificial intelligence tools, 22
- S L Yvonna, 1985, Naturalistic Inquiry
- D Zhou, 2023, International Conference on Learning Representations, 1
- Improving Generative AI Reliability: A Qualitative Study of Hallucination in Large Language Models Hyeon Jeong Gwon Yonsei University, Department of Library and Information Science, 50 Yonsei-ro Seodaemun-gu, Seoul, 03722, Republic of Korea. khj90733@naver.com Youngjae Yoo Corresponding author Yonsei University, Graduate School of Information, 50
Cited by
LLM Hallucinations in Conversational AI for Customer Service: Framework and End-User Perceptions
Larsen, A. G., Skjuve, M. B., Følstad, A., & van As, N. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2580540 · Cited by 16
Quantifying Factual Divergence in Generative Models: SHAP-LIME Based Hallucination Score for LLMs
Haq, I., Saqib, M., Zhang, Y., & Khan, I. A. (2026) · Multimedia Systems · doi:10.1007/s00530-025-02150-4 · Cited by 4
Kallam, A. R. (2025) · Journal of Information Systems Engineering & Management · doi:10.52783/jisem.v10i53s.11163
Generative Artificial Intelligence
Shrivastav, A., Sankathala, S., Chaturvedi, K., Patre, K., Das, S., & Shaikh, R. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5616-7.ch002
Metadata
- Authors
- Gwon, H. J., Yoo, Y., & Lee, J. Y.
- Affiliations
- Yonsei University (KR)
- Corresponding author
- Lee, Jee Yeon
- ORCID
- Lee, Jee Yeon
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2025
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4407265024
- Cited by
- 4
- References
- 29
- Citations by year
- 2026: 1 · 2025: 3
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- AI hallucination, large language models, user experience, trust in AI, interface design, usability, think-aloud, AI-assisted writing, AI search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.