CoChat
Sign Up
PreprintCited by 0

The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.

Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models

Li, Chaozhuo, Wang, Pengbo, Wang, Chenxu, Zhang, Litian, Liu, Zheng, Ye, Qiwei, Xu, Yuanbo, Huang, Feiran, Zhang, Xi, Yu, Philip S.·2025·arXiv
DOI 10.48550/arxiv.2507.02870arXiv 2507.02870
Open this paper in CoChat — free account

Abstract

Edgar Allan Poe noted, "Truth often lurks in the shadow of error," highlighting the deep complexity intrinsic to the interplay between truth and falsehood, notably under conditions of cognitive and informational asymmetry. This dynamic is strikingly evident in large language models (LLMs). Despite their impressive linguistic generation capabilities, LLMs sometimes produce information that appears factually accurate but is, in reality, fabricated, an issue often referred to as 'hallucinations'. The prevalence of these hallucinations can mislead users, affecting their judgments and decisions. In sectors such as finance, law, and healthcare, such misinformation risks causing substantial economic losses, legal disputes, and health risks, with wide-ranging consequences.In our research, we have methodically categorized, analyzed the causes, detection methods, and solutions related to LLM hallucinations. Our efforts have particularly focused on understanding the roots of hallucinations and evaluating the efficacy of current strategies in revealing the underlying logic, thereby paving the way for the development of innovative and potent approaches. By examining why certain measures are effective against hallucinations, our study aims to foster a comprehensive approach to tackling this issue within the domain of LLMs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2507.02870

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Lack of transparency and interpretability in AI model decision-making is a critical barrier to widespread adoption of AI in healthcare.

    “However, despite these advancements, a critical barrier to the widespread adoption of AI in healthcare is the lack of transparency and interpretability in model decision-making processes [7,8].”

    From Explainable AI in Clinical Decision Support Systems: A Meta-Analysis of Methods, Applications, and Usability Challenges (2025) · cites this paper as [7]

    The Introduction (p. 1) discusses patient-safety risks from hallucinated diagnostic recommendations, not transparency or interpretability as a barrier to healthcare AI adoption. The Method Exploration section (p. 26) proposes more transparent expressions of model uncertainty, but does not connect them to healthcare adoption. Searches for healthcare adoption and model interpretability found no passage making the attributed point. (LLM, conf=0.75)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Scaling Laws for Neural Language Models

    Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×

    “As elucidated by Kaplan et al. [146], model performance is profoundly contingent on both the model’s parameterization and the scale of its training corpus—with contemporary LLMs being trained on datasets comprising in excess of 10 trillion tokens.”

  • Hallucination of Multimodal Large Language Models: A Survey

    Bai, Z., Wang, P., Xiao, T., He, T., Han, Z., Zhang, Z., & Shou, M. Z. (2024) · arXiv · doi:10.48550/arxiv.2404.18930 · Cited by 38 · cited 1×

    “…has precipitated a critical research challenge: the Tonmo et al. [4] Rawte et al. [12] Zhang et al. [13] Huang et al. [14] Bai et al. [15] Jiang et al. [16] Rawte et al. [17] Mathematical Formalization emergence of hallucinatory phenomena that exhibit escalating prevalence across…”
    Self-citation

Flagged first, then by citations

Research works printed but not linked: 206

  1. [1][1] B. Min, H. Ross, E. Sulem, A. P. B. Veyseh, T. H. Nguyen, O. Sainz, E. Agirre, I. Heintz, and D. Roth, 'Recent advances in natural language processing via large pre-trained language models: A survey,' ACM Computing Surveys , vol. 56, no. 2, pp. 1-40, 2023. -
  2. [2][2] OpenAI, 'Gpt-4 technical report,' arXiv preprint , vol. abs/2303.08774, 2023. [Online]. Available: https://arxiv.org/abs/2303.08774 - · arXiv
  3. [3][3] D. Guo, D. Yang, H. Zhang, J. Song, R. Zhang, R. Xu, Q. Zhu, S. Ma, P. Wang, X. Bi et al. , 'Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning,' arXiv preprint arXiv:2501.12948 , 2025. - · arXiv
  4. [4][4] S. Tonmoy, S. Zaman, V. Jain, A. Rani, V. Rawte, A. Chadha, and A. Das, 'A comprehensive survey of hallucination mitigation techniques in large language models,' arXiv preprint arXiv:2401.01313 , 2024. - · arXiv
  5. [7][7] G. F´ enelon, F. Mahieux, R. Huon, and M. Ziegler, 'Hallucinations in schizophrenia and parkinson's disease,' Psychopathology , vol. 33, no. 6, pp. 299-306, 2000. [Online]. Available: https://pubmed.ncbi.nlm.nih.gov/11124598/ -
  6. [8][8] P. Koehn and R. Knowles, 'Six challenges for neural machine translation,' arXiv preprint arXiv:1706.03872 , 2017. - · arXiv
  7. [9][9] J. Maynez, S. Narayan, B. Bohnet, and R. McDonald, 'On faithfulness and factuality in abstractive summarization,' arXiv preprint arXiv:2005.00661 , 2020. - · arXiv
  8. [10][10] Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung, 'Survey of hallucination in natural language generation,' ACM Computing Surveys , vol. 55, no. 12, pp. 1-38, 2023. -
  9. [11][11] S. Banerjee, A. Agarwal, and S. Singla, 'Llms will always hallucinate, and we need to live with this,' arXiv preprint arXiv:2409.05746 , 2024. - · arXiv
  10. [12][12] V. Rawte, A. Sheth, and A. Das, 'A survey of hallucination in large foundation models,' arXiv preprint arXiv:2309.05922 , 2023. - · arXiv
  11. [13][13] Y. Zhang, Y. Li, L. Cui, D. Cai, L. Liu, T. Fu, X. Huang, E. Zhao, Y. Zhang, Y. Chen et al. , 'Siren's song in the ai ocean: a survey on hallucination in large language models,' arXiv preprint arXiv:2309.01219 , 2023. - · arXiv
  12. [14][14] L. Huang, W. Yu, W. Ma, W. Zhong, Z. Feng, H. Wang, Q. Chen, W. Peng, X. Feng, B. Qin et al. , 'A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions,' arXiv preprint arXiv:2311.05232 , 2023. - · arXiv
  13. [16][16] X. Jiang, Y. Tian, F. Hua, C. Xu, Y. Wang, and J. Guo, 'A survey on large language model hallucination via a creativity perspective,' arXiv preprint arXiv:2402.06647 , 2024. - · arXiv
  14. [17][17] V. Rawte, S. Chakraborty, A. Pathak, A. Sarkar, S. Tonmoy, A. Chadha, A. P. Sheth, and A. Das, 'The troubling emergence of hallucination in large language models-an extensive definition, quantification, and prescriptive remediations,' arXiv preprint arXiv:2310.04988 , 2023. - · arXiv
  15. [19][19] E. Buchicchio, A. De Angelis, A. Moschitta, F. Santoni, L. San Marco, and P. Carbone, 'Design, validation, and risk assessment of llm-based generative ai systems operating in the legal sector,' in 2024 IEEE International Symposium on Systems Engineering (ISSE) . IEEE, 2024, pp. 1-8. -
  16. [20][20] M. Yuan, P. Bao, J. Yuan, Y. Shen, Z. Chen, Y. Xie, J. Zhao, Y. Chen, L. Zhang, L. Shen, and B. Dong, 'Large language models illuminate a progressive pathway to artificial healthcare assistant: A review,' arXiv preprint arXiv:2311.01918 , 2023. [Online]. Available: https://arxiv.org/abs/2311.01918 - · arXiv
  17. [21][21] Z. Z. Chen, J. Ma, X. Zhang, N. Hao, A. Yan, A. Nourbakhsh, X. Yang, J. McAuley, L. Petzold, and W. Y. Wang, 'A survey on large language models for critical societal domains: Finance, healthcare, and law,' arXiv preprint arXiv:2405.01769 , 2024. [Online]. Available: https://arxiv.org/abs/2405.01769 - · arXiv
  18. [22][22] X. Chen, Z. Liu, and L. Zhang, 'Ai in education: The risks and opportunities of large language models in learning systems,' arXiv preprint arXiv:2404.12218 , 2024. [Online]. Available: https://arxiv.org/abs/2404.12218 - · arXiv
  19. [23][23] A. Author and B. Coauthor, 'Hallucination is inevitable: An innate limitation of large language models,' Journal of Machine Learning Research , vol. 25, no. 1, pp. 1-30, 2024, theoretical proof that LLM hallucinations arise from fundamental trade-offs in autoregressive generation. [Online]. Available: https://jmlr.org/papers/v25/author2024.html -
  20. [24][24] A. Suzuki, Y. He, F. Tian, and Z. Wang, 'Hallucinations are inevitable but statistically negligible,' arXiv preprint arXiv:2502.12187 , 2025. - · arXiv
  21. [25][25] A. T. Kalai and S. S. Vempala, 'Calibrated language models must hallucinate,' in Proceedings of the 56th Annual ACM Symposium on Theory of Computing , ser. STOC 2024. New York, NY, USA: Association for Computing Machinery, 2024, p. 160-171. [Online]. Available: https://doi.org/10.1145/3618260.3649777 - · DOI · Paper page
  22. [26][26] Z. Lin, S. Guan, W. Zhang, H. Zhang, Y. Li, and H. Zhang, 'Towards trustworthy llms: a review on debiasing and dehallucinating in large language models,' Artificial Intelligence Review , vol. 57, no. 9, p. 243, 2024. -
  23. [27][27] E. Lavrinovics, R. Biswas, J. Bjerva, and K. Hose, 'Knowledge graphs, large language models, and hallucinations: An nlp perspective,' Journal of Web Semantics , vol. 85, p. 100844, 2025. -
  24. [28][28] A. Pal, L. K. Umapathi, and M. Sankarasubbu, 'Med-HALT: Medical domain hallucination test for large language models,' in Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL) , J. Jiang, D. Reitter, and S. Deng, Eds. Singapore: Association for Computational Linguistics, Dec. 2023, pp. 314-334. [Online]. Available: https://aclanthology.org/2023.conll-1.21/ -
  25. [29][29] Z. Ahmad, W. Kaiser, and S. Rahim, 'Hallucinations in chatgpt: An unreliable tool for learning,' Rupkatha Journal on Interdisciplinary Studies in Humanities , vol. 15, no. 4, p. 12, 2023. -
  26. [30][30] W. Zhang and J. Zhang, 'Hallucination mitigation for retrievalaugmented large language models: A review,' Mathematics , vol. 13, no. 5, p. 856, 2025. -
  27. [31][31] J. Li, X. Cheng, W. X. Zhao, J.-Y. Nie, and J.-R. Wen, 'Halueval: A large-scale hallucination evaluation benchmark for large language models,' arXiv preprint arXiv:2305.11747 , 2023. - · arXiv
  28. [32][32] A. Rahman, S. Anwar, M. Usman, and A. Mian, 'Defan: Definitive answer dataset for llms hallucination evaluation,' arXiv preprint arXiv:2406.09155 , 2024. - · arXiv
  29. [33][33] Y. Sun, Z. Yin, Q. Guo, J. Wu, X. Qiu, and H. Zhao, 'Benchmarking hallucination in large language models based on unanswerable math word problem,' arXiv preprint arXiv:2403.03558 , 2024. - · arXiv
  30. [34][34] R. Sachdeva, Y. Song, M. Iyyer, and I. Gurevych, 'Fine-grained hallucination detection and mitigation in long-form question answering,' arXiv preprint arXiv:2407.11930 , 2024. - · arXiv
  31. [35][35] S. Lin, J. Hilton, and O. Evans, 'Truthfulqa: Measuring how models mimic human falsehoods,' arXiv preprint arXiv:2109.07958 , 2021. - · arXiv
  32. [36][36] X. Chen, C. Wang, Y. Xue, N. Zhang, X. Yang, Q. Li, Y. Shen, J. Gu, and H. Chen, 'Unified hallucination detection for multimodal large language models,' arXiv preprint arXiv:2402.03190 , 2024. - · arXiv
  33. [37][37] W. Su, C. Wang, Q. Ai, Y. Hu, Z. Wu, Y. Zhou, and Y. Liu, 'Unsupervised real-time hallucination detection based on the internal states of large language models,' arXiv preprint arXiv:2403.06448 , 2024. - · arXiv
  34. [38][38] X. Zhang, Z. Yao, J. Zhang, K. Yun, J. Yu, J. Li, and J. Tang, 'Transferable and efficient non-factual content detection via probe training with offline consistency checking,' arXiv preprint arXiv:2404.06742 , 2024. - · arXiv
  35. [39][39] Z. Ji, D. Chen, E. Ishii, S. Cahyawijaya, Y. Bang, B. Wilie, and P. Fung, 'Llm internal states reveal hallucination risk faced with a query,' arXiv preprint arXiv:2407.03282 , 2024. - · arXiv
  36. [40][40] L. Liu, Y. Pan, X. Li, and G. Chen, 'Uncertainty estimation and quantification for llms: A simple supervised approach,' arXiv preprint arXiv:2404.15993 , 2024. - · arXiv
  37. [41][41] A. Kumar, R. Morabito, S. Umbet, J. Kabbara, and A. Emami, 'Confidence under the hood: An investigation into the confidence-probability alignment in large language models,' arXiv preprint arXiv:2405.16282 , 2024. - · arXiv
  38. [42][42] L. Kuhn, Y. Gal, and S. Farquhar, 'Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation,' arXiv preprint arXiv:2302.09664 , 2023. - · arXiv
  39. [43][43] S. Farquhar, J. Kossen, L. Kuhn, and Y. Gal, 'Detecting hallucinations in large language models using semantic entropy,' Nature , vol. 630, no. 8017, pp. 625-630, 2024. -
  40. [44][44] Y. Xiao and W. Y. Wang, 'On hallucination and predictive uncertainty in conditional language generation,' arXiv preprint arXiv:2103.15025 , 2021. - · arXiv
  41. [45][45] C. Chen, K. Liu, Z. Chen, Y. Gu, Y. Wu, M. Tao, Z. Fu, and J. Ye, 'Inside: Llms' internal states retain the power of hallucination detection,' arXiv preprint arXiv:2402.03744 , 2024. - · arXiv
  42. [46][46] Y. Zhang, S. Li, J. Liu, P. Yu, Y. R. Fung, J. Li, M. Li, and H. Ji, 'Knowledge overshadowing causes amalgamated hallucination in large language models,' 2024. [Online]. Available: https://arxiv.org/abs/2407.08039 - · arXiv
  43. [47][47] Y.-S. Chuang, L. Qiu, C.-Y. Hsieh, R. Krishna, Y. Kim, and J. R. Glass, 'Lookback lens: Detecting and mitigating contextual hallucinations in large language models using only attention maps,' in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 1419-1436. [Online]. Available: https://aclanthology.org/2024.emnlp-main.84/ -
  44. [48][48] N. Nonkes, S. Agaronian, E. Kanoulas, and R. Petcu, 'Leveraging graph structures to detect hallucinations in large language models,' in Proceedings of TextGraphs-17: Graph-based Methods for Natural Language Processing , D. Ustalov, Y. Gao, A. Panchenko, E. Tutubalina, I. Nikishina, A. Ramesh, A. Sakhovskiy, R. Usbeck, G. Penn, and M. Valentino, Eds. Bangkok, Thailand: Association for Computational Linguistics, Aug. 2024, pp. 93-104. [Online]. Available: https://aclanthology.org/2024.textgraphs-1.7/ -
  45. [49][49] J. Wu, Y. Yu, and H.-Y. Zhou, 'Uncertainty estimation of large language models in medical question answering,' arXiv preprint arXiv:2407.08662 , 2024. - · arXiv
  46. [50][50] T. Xue, Z. Wang, Z. Wang, C. Han, P. Yu, and H. Ji, 'Rcot: Detecting and rectifying factual inconsistency in reasoning by reversing chainof-thought,' arXiv preprint arXiv:2305.11499 , 2023. - · arXiv
  47. [51][51] P. Manakul, A. Liusie, and M. J. Gales, 'Selfcheckgpt: Zero-resource black-box hallucination detection for generative large language models,' arXiv preprint arXiv:2303.08896 , 2023. - · arXiv
  48. [52][52] Y. Qiu, Y. Ziser, A. Korhonen, E. M. Ponti, and S. B. Cohen, 'Detecting and mitigating hallucinations in multilingual summarisation,' arXiv preprint arXiv:2305.13632 , 2023. - · arXiv
  49. [53][53] J. Zhang, Z. Li, K. Das, B. A. Malin, and S. Kumar, 'Sac3: Reliable hallucination detection in black-box language models via semanticaware cross-check consistency,' arXiv preprint arXiv:2311.01740 , 2023. - · arXiv
  50. [54][54] D. Park, Z. Qian, G. Han, and S.-N. Lim, 'Mitigating dialogue hallucination for large multi-modal models via adversarial instruction tuning,' arXiv preprint arXiv:2403.10492 , 2024. - · arXiv
  51. [55][55] H. Kim, A. Bibi, P. Torr, and Y. Gal, 'Detecting llm hallucination through layer-wise information deficiency: Analysis of unanswerable questions and ambiguous prompts,' 2024. [Online]. Available: https://arxiv.org/abs/2412.10246 - · arXiv
  52. [56][56] S. Lin, J. Hilton, and O. Evans, 'Teaching models to express their uncertainty in words,' arXiv preprint arXiv:2205.14334 , 2022. - · arXiv
  53. [57][57] M. Xiong, Z. Hu, X. Lu, Y. Li, J. Fu, J. He, and B. Hooi, 'Can llms express their uncertainty? an empirical evaluation of confidence elicitation in llms,' arXiv preprint arXiv:2306.13063 , 2023. - · arXiv
  54. [58][58] G. Yona, R. Aharoni, and M. Geva, 'Can large language models faithfully express their intrinsic uncertainty in words?' arXiv preprint arXiv:2405.16908 , 2024. - · arXiv
  55. [59][59] K. Zhou, D. Jurafsky, and T. Hashimoto, 'Navigating the grey area: Expressions of overconfidence and uncertainty in language models. arxiv abs/2302.13439 (2023),' 2023. - · arXiv
  56. [60][60] T. Li, E. Dayanik, S. Tyagi, and A. Pierleoni, 'Hallucana: Fixing llm hallucination with a canary lookahead,' 2024. [Online]. Available: https://arxiv.org/abs/2412.07965 - · arXiv
  57. [61][61] X. Zheng, L. Wang, Y. Liu, X. Ma, C. Shen, and C. Wang, 'Calm: Curiosity-driven auditing for large language models,' 2025. [Online]. Available: https://arxiv.org/abs/2501.02997 - · arXiv
  58. [62][62] K. Pelrine, A. Imouza, C. Thibault, M. Reksoprodjo, C. Gupta, J. Christoph, J.-F. Godbout, and R. Rabbany, 'Towards reliable misinformation mitigation: Generalization, uncertainty, and gpt-4,' arXiv preprint arXiv:2305.14928 , 2023. - · arXiv
  59. [63][63] F. Kirstein, T. Ruas, and B. Gipp, 'What's wrong? refining meeting summaries with llm feedback,' arXiv preprint arXiv:2407.11919 , 2024. - · arXiv
  60. [64][64] E. Y. Chang, 'Uncovering biases with reflective large language models,' arXiv preprint arXiv:2408.13464 , 2024. - · arXiv
  61. [65][65] M. Hu, R. Xu, D. Lei, Y. Li, M. Wang, E. Ching, E. Kamal, and A. Deng, 'Slm meets llm: Balancing latency, interpretability and consistency in hallucination detection,' arXiv preprint arXiv:2408.12748 , 2024. - · arXiv
  62. [66][66] H. Deng, H. Zhang, J. Ou, and C. Feng, 'Can llm be a good path planner based on prompt engineering? mitigating the hallucination for path planning,' 2024. [Online]. Available: https://arxiv.org/abs/2408.13184 - · arXiv
  63. [67][67] A. Amayuelas, L. Pan, W. Chen, and W. Wang, 'Knowledge of knowledge: Exploring known-unknowns uncertainty with large language models,' arXiv preprint arXiv:2305.13712 , 2023. - · arXiv
  64. [68][68] H. Zhang, S. Diao, Y. Lin, Y. Fung, Q. Lian, X. Wang, Y. Chen, H. Ji, and T. Zhang, 'R-tuning: Instructing large language models to say 'i don't know',' in Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) , 2024, pp. 7106-7132. -
  65. [69][69] Q. Cheng, T. Sun, X. Liu, W. Zhang, Z. Yin, S. Li, L. Li, K. Chen, and X. Qiu, 'Can ai assistants know what they don't know?' arXiv preprint arXiv:2401.13275 , 2024. - · arXiv
  66. [70][70] N. Band, X. Li, T. Ma, and T. Hashimoto, 'Linguistic calibration of long-form generations,' in Forty-first International Conference on Machine Learning , 2024. -
  67. [71][71] T. Xu, S. Wu, S. Diao, X. Liu, X. Wang, Y. Chen, and J. Gao, 'Sayself: Teaching llms to express confidence with self-reflective rationales,' arXiv preprint arXiv:2405.20974 , 2024. - · arXiv
  68. [72][72] G. He, J. Chen, and J. Zhu, 'Preserving pre-trained features helps calibrate fine-tuned language models,' arXiv preprint arXiv:2305.19249 , 2023. - · arXiv
  69. [73][73] K. Tian, E. Mitchell, A. Zhou, A. Sharma, R. Rafailov, H. Yao, C. Finn, and C. D. Manning, 'Just ask for calibration: Strategies for eliciting calibrated confidence scores from language models fine-tuned with human feedback,' arXiv preprint arXiv:2305.14975 , 2023. - · arXiv
  70. [74][74] X. L. Li, U. Khandelwal, and K. Guu, 'Few-shot recalibration of language models,' arXiv preprint arXiv:2403.18286 , 2024. - · arXiv
  71. [75][75] R. Ren, Y. Wang, Y. Qu, W. X. Zhao, J. Liu, H. Tian, H. Wu, J.R. Wen, and H. Wang, 'Investigating the factual knowledge boundary of large language models with retrieval augmentation,' arXiv preprint arXiv:2307.11019 , 2023. - · arXiv
  72. [76][76] Z. Yin, Q. Sun, Q. Guo, J. Wu, X. Qiu, and X. Huang, 'Do large language models know what they don't know?' arXiv preprint arXiv:2305.18153 , 2023. - · arXiv
  73. [77][77] S. Anjum, H. Zhang, W. Zhou, E. J. Paek, X. Zhao, and Y. Feng, 'Halo: Hallucination analysis and learning optimization to empower llms with retrieval-augmented context for guided clinical decision making,' arXiv preprint arXiv:2409.10011 , 2024. - · arXiv
  74. [78][78] K. Zhu, X. Feng, X. Du, Y. Gu, W. Yu, H. Wang, Q. Chen, Z. Chu, J. Chen, and B. Qin, 'An information bottleneck perspective for effective noise filtering on retrieval-augmented generation,' arXiv preprint arXiv:2406.01549 , 2024. - · arXiv
  75. [79][79] S. Xu, L. Pang, M. Yu, F. Meng, H. Shen, X. Cheng, and J. Zhou, 'Unsupervised information refinement training of large language models for retrieval-augmented generation,' arXiv preprint arXiv:2402.18150 , 2024. - · arXiv
  76. [80][80] H. Qian, Z. Liu, K. Mao, Y. Zhou, and Z. Dou, 'Grounding language model with chunking-free in-context retrieval,' arXiv preprint arXiv:2402.09760 , 2024. - · arXiv
  77. [81][81] Z. Sun, X. Zang, K. Zheng, Y. Song, J. Xu, X. Zhang, W. Yu, and H. Li, 'Redeep: Detecting hallucination in retrieval-augmented generation via mechanistic interpretability,' arXiv preprint arXiv:2410.11414 , 2024. - · arXiv
  78. [82][82] X. Guan, Y. Liu, H. Lin, Y. Lu, B. He, X. Han, and L. Sun, 'Mitigating large language model hallucinations via autonomous knowledge graphbased retrofitting,' in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38, no. 16, 2024, pp. 18 126-18 134. -
  79. [83][83] J. Jiang, K. Zhou, W. X. Zhao, and J.-R. Wen, 'Unikgqa: Unified retrieval and reasoning for solving multi-hop question answering over knowledge graph,' arXiv preprint arXiv:2212.00959 , 2022. - · arXiv
  80. [84][84] X. Liu, Y. Liu, and W. Hu, 'Knowledge graph error detection with contrastive confidence adaption,' in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38, no. 8, 2024, pp. 8824-8831. -
  81. [85][85] Y. Gao, L. Qiao, Z. Kan, Z. Wen, Y. He, and D. Li, 'Two-stage generative question answering on temporal knowledge graph using large language models,' arXiv preprint arXiv:2402.16568 , 2024. - · arXiv
  82. [86][86] L. Pusch and T. O. Conrad, 'Combining llms and knowledge graphs to reduce hallucinations in question answering,' arXiv preprint arXiv:2409.04181 , 2024. - · arXiv
  83. [87][87] J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al. , 'Chain-of-thought prompting elicits reasoning in large language models,' Advances in neural information processing systems , vol. 35, pp. 24 824-24 837, 2022. -
  84. [88][88] D. Zhou, N. Sch¨ arli, L. Hou, J. Wei, N. Scales, X. Wang, D. Schuurmans, C. Cui, O. Bousquet, Q. Le et al. , 'Least-to-most prompting enables complex reasoning in large language models,' arXiv preprint arXiv:2205.10625 , 2022. - · arXiv
  85. [89][89] Z. Zhang, A. Zhang, M. Li, and A. Smola, 'Automatic chain of thought prompting in large language models,' arXiv preprint arXiv:2210.03493 , 2022. - · arXiv
  86. [90][90] O. Press, M. Zhang, S. Min, L. Schmidt, N. A. Smith, and M. Lewis, 'Measuring and narrowing the compositionality gap in language models,' arXiv preprint arXiv:2210.03350 , 2022. - · arXiv
  87. [91][91] N. M¨ undler, J. He, S. Jenko, and M. Vechev, 'Self-contradictory hallucinations of large language models: Evaluation, detection and mitigation,' arXiv preprint arXiv:2305.15852 , 2023. - · arXiv
  88. [92][92] A. Diallo, A. Bikakis, L. Dickens, A. Hunter, and R. Miller, 'Iao prompting: Making knowledge flow explicit in llms through structured reasoning templates,' 2025. [Online]. Available: https://arxiv.org/abs/2502.03080 - · arXiv
  89. [93][93] X. Zhang, B. Peng, Y. Tian, J. Zhou, L. Jin, L. Song, H. Mi, and H. Meng, 'Self-alignment for factuality: Mitigating hallucinations in llms via self-evaluation,' arXiv preprint arXiv:2402.09267 , 2024. - · arXiv
  90. [94][94] W. Zhang, Y. Shen, L. Wu, Q. Peng, J. Wang, Y. Zhuang, and W. Lu, 'Self-contrast: Better reflection through inconsistent solving perspectives,' 2024. [Online]. Available: https://arxiv.org/abs/2401.02009 - · arXiv
  91. [95][95] J. Chen, J. Yoon, S. Ebrahimi, S. O. Arik, T. Pfister, and S. Jha, 'Adaptation with self-evaluation to improve selective prediction in llms,' arXiv preprint arXiv:2310.11689 , 2023. - · arXiv
  92. [96][96] X. Huang, S. Cheng, S. Huang, J. Shen, Y. Xu, C. Zhang, and Y. Qu, 'Queryagent: A reliable and efficient reasoning framework with environmental feedback based self-correction,' arXiv preprint arXiv:2403.11886 , 2024. - · arXiv
  93. [97][97] W. Watson, N. Cho, and N. Srishankar, 'Is there no such thing as a bad question? h4r: Hallucibot for ratiocination, rewriting, ranking, and routing,' 2024. [Online]. Available: https://arxiv.org/abs/2404.12535 - · arXiv
  94. [98][98] E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, W. Chen et al. , 'Lora: Low-rank adaptation of large language models.' ICLR , vol. 1, no. 2, p. 3, 2022. -
  95. [99][99] Z. Zhao, L. Hu, H. Zhao, Y. Shao, and Y. Wang, 'Knowledgeable parameter efficient tuning network for commonsense question answering,' in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2023, pp. 90519063. -
  96. [100][100] W. Chen, Z. Huang, L. Xie, B. Lin, H. Li, L. Lu, X. Tian, D. Cai, Y. Zhang, W. Wan et al. , 'From yes-men to truth-tellers: Addressing sycophancy in large language models with pinpoint tuning,' arXiv preprint arXiv:2409.01658 , 2024. - · arXiv
  97. [101][101] Y. Wang, R. Zheng, L. Ding, Q. Zhang, D. Lin, and D. Tao, 'Uncertainty aware learning for language model alignment,' arXiv preprint arXiv:2406.04854 , 2024. - · arXiv
  98. [102][102] J. Fang, H. Jiang, K. Wang, Y. Ma, X. Wang, X. He, and T.-s. Chua, 'Alphaedit: Null-space constrained knowledge editing for language models,' arXiv preprint arXiv:2410.02355 , 2024. - · arXiv
  99. [103][103] H. Orgad, M. Toker, Z. Gekhman, R. Reichart, I. Szpektor, H. Kotek, and Y. Belinkov, 'Llms know more than they show: On the intrinsic representation of llm hallucinations,' arXiv preprint arXiv:2410.02707 , 2024. - · arXiv
  100. [104][104] Z. Yu and S. Ananiadou, 'Interpreting arithmetic mechanism in large language models through comparative neuron analysis,' arXiv preprint arXiv:2409.14144 , 2024. - · arXiv
  101. [105][105] H. Chen, C. Vondrick, and C. Mao, 'Selfie: Self-interpretation of large language model embeddings,' arXiv preprint arXiv:2403.10949 , 2024. - · arXiv
  102. [106][106] P. Verma and M. Pilanci, 'Adaptive large language models by layerwise attention shortcuts,' arXiv preprint arXiv:2409.10870 , 2024. - · arXiv
  103. [107][107] K. Li, O. Patel, F. Vi´ egas, H. Pfister, and M. Wattenberg, 'Inferencetime intervention: Eliciting truthful answers from a language model,' Advances in Neural Information Processing Systems , vol. 36, 2024. -
  104. [108][108] S. Zhang, T. Yu, and Y. Feng, 'Truthx: Alleviating hallucinations by editing large language models in truthful space,' arXiv preprint arXiv:2402.17811 , 2024. - · arXiv
  105. [109][109] X. Liang, S. Song, Z. Zheng, H. Wang, Q. Yu, X. Li, R.-H. Li, F. Xiong, and Z. Li, 'Internal consistency and self-feedback in large language models: A survey,' arXiv preprint arXiv:2407.14507 , 2024. - · arXiv
  106. [110][110] G. Alain, 'Understanding intermediate layers using linear classifier probes,' arXiv preprint arXiv:1610.01644 , 2016. - · arXiv
  107. [111][111] K. Wang, A. Variengien, A. Conmy, B. Shlegeris, and J. Steinhardt, 'Interpretability in the wild: a circuit for indirect object identification in gpt-2 small,' arXiv preprint arXiv:2211.00593 , 2022. - · arXiv
  108. [112][112] W. Shi, X. Han, M. Lewis, Y. Tsvetkov, L. Zettlemoyer, and S. W.t. Yih, 'Trusting your evidence: Hallucinate less with context-aware decoding,' arXiv preprint arXiv:2305.14739 , 2023. - · arXiv
  109. [113][113] Y.-S. Chuang, L. Qiu, C.-Y. Hsieh, R. Krishna, Y. Kim, and J. Glass, 'Lookback lens: Detecting and mitigating contextual hallucinations in large language models using only attention maps,' arXiv preprint arXiv:2407.07071 , 2024. - · arXiv
  110. [114][114] H. Zhang, K. Chen, X. Bai, Y. Xiang, and M. Zhang, 'Paying more attention to source context: Mitigating unfaithful translations from large language model,' arXiv preprint arXiv:2406.07036 , 2024. - · arXiv
  111. [115][115] Z. Zhao, E. Monti, J. Lehmann, and H. Assem, 'Enhancing contextual understanding in large language models through contrastive decoding,' arXiv preprint arXiv:2405.02750 , 2024. - · arXiv
  112. [116][116] A. P. Gema, C. Jin, A. Abdulaal, T. Diethe, P. Teare, B. Alex, P. Minervini, and A. Saseendran, 'Decore: decoding by contrasting retrieval heads to mitigate hallucinations,' arXiv preprint arXiv:2410.18860 , 2024. - · arXiv
  113. [117][117] S. Wang, L. Ding, L. Shen, Y. Luo, Z. He, W. Yu, and D. Tao, 'Uscd: Improving code generation of llms by uncertainty-aware selective contrastive decoding,' arXiv preprint arXiv:2409.05923 , 2024. - · arXiv
  114. [118][118] Y. Zhang, L. Cui, W. Bi, and S. Shi, 'Alleviating hallucinations of large language models through induced hallucinations,' arXiv preprint arXiv:2312.15710 , 2023. - · arXiv
  115. [119][119] Y.-S. Chuang, Y. Xie, H. Luo, Y. Kim, J. Glass, and P. He, 'Dola: Decoding by contrasting layers improves factuality in large language models,' arXiv preprint arXiv:2309.03883 , 2023. - · arXiv
  116. [120][120] L. Du, Y. Wang, X. Xing, Y. Ya, X. Li, X. Jiang, and X. Fang, 'Quantifying and attributing the hallucination of large language models via association analysis,' arXiv preprint arXiv:2309.05217 , 2023. - · arXiv
  117. [121][121] D. Schuurmans, 'Memory augmented large language models are computationally universal,' arXiv preprint arXiv:2301.04589 , 2023. - · arXiv
  118. [122][122] A. Edwards, J. Camacho-Collados, H. De Ribaupierre, and A. Preece, 'Go simple and pre-train on domain-specific corpora: On the role of training data for text classification,' in Proceedings of the 28th international conference on computational linguistics , 2020, pp. 55225529. -
  119. [123][123] S.-C. Lin, L. Gao, B. Oguz, W. Xiong, J. Lin, W.-t. Yih, and X. Chen, 'Flame: Factuality-aware alignment for large language models,' arXiv preprint arXiv:2405.01525 , 2024. - · arXiv
  120. [124][124] K. Liao, S. Li, M. Zhao, L. Liu, M. Xue, Z. Hu, H. Han, and C. Yin, 'Enhancing reinforcement learning with label-sensitive reward for natural language understanding,' arXiv preprint arXiv:2405.19763 , 2024. - · arXiv
  121. [125][125] T. Eisape, M. H. Tessler, I. Dasgupta, F. Sha, S. van Steenkiste, and T. Linzen, 'A systematic comparison of syllogistic reasoning in humans and language models,' arXiv preprint arXiv:2311.00445 , 2023. - · arXiv
  122. [126][126] Y. Wang, Y. Zhang, P. Li, and Y. Liu, 'Gradual syntactic label replacement for language model pre-training,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 32, pp. 486-496, 2023. -
  123. [127][127] N. Sadeq, B. Kang, P. Lamba, and J. McAuley, 'Unsupervised improvement of factual knowledge in language models,' arXiv preprint arXiv:2304.01597 , 2023. - · arXiv
  124. [128][128] S. Lv, Y. Wang, D. Guo, D. Tang, N. Duan, F. Zhu, M. Gong, L. Shou, R. Ma, D. Jiang et al. , 'Pre-training text representations as meta learning,' arXiv preprint arXiv:2004.05568 , 2020. - · arXiv
  125. [129][129] J. Li, S. Zeng, H.-T. Wai, C. Li, A. Garcia, and M. Hong, 'Getting more juice out of the sft data: Reward learning from human demonstration improves sft for llm alignment,' arXiv preprint arXiv:2405.17888 , 2024. - · arXiv
  126. [130][130] T. Zhang, F. Liu, J. Wong, P. Abbeel, and J. E. Gonzalez, 'The wisdom of hindsight makes language models better instruction followers,' in International Conference on Machine Learning . PMLR, 2023, pp. 41 414-41 428. -
  127. [131][131] V. Mehta, V. Das, O. Neopane, Y. Dai, I. Bogunovic, J. Schneider, and W. Neiswanger, 'Sample efficient reinforcement learning from human feedback via active exploration,' 2023. [Online]. Available: https://arxiv.org/abs/2312.00267 - · arXiv
  128. [132][132] Z. Teng, Y. Song, X. Ye, and Y. Ouyang, 'Fine-tuning llms for multiturn dialogues: Optimizing cross-entropy loss with kl divergence for all rounds of responses,' in Proceedings of the 2024 16th International Conference on Machine Learning and Computing , 2024, pp. 128-133. -
  129. [133][133] Y. Luo, Z. Yang, F. Meng, Y. Li, J. Zhou, and Y. Zhang, 'An empirical study of catastrophic forgetting in large language models during continual fine-tuning,' arXiv preprint arXiv:2308.08747 , 2023. - · arXiv
  130. [134][134] L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray et al. , 'Training language models to follow instructions with human feedback,' Advances in neural information processing systems , vol. 35, pp. 27 730-27 744, 2022. -
  131. [135][135] F. Liu et al. , 'Learning to summarize from human feedback,' in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020. -
  132. [136][136] G. Mukobi, P. Chatain, S. Fong, R. Windesheim, G. Kutyniok, K. Bhatia, and S. Alberti, 'Superhf: Supervised iterative learning from human feedback,' arXiv preprint arXiv:2310.16763 , 2023. - · arXiv
  133. [137][137] R. Zheng, S. Dou, S. Gao, Y. Hua, W. Shen, B. Wang, Y. Liu, S. Jin, Q. Liu, Y. Zhou et al. , 'Secrets of rlhf in large language models part i: Ppo,' arXiv preprint arXiv:2307.04964 , 2023. - · arXiv
  134. [138][138] A. Gorbatovski and S. Kovalchuk, 'Reinforcement learning for question answering in programming domain using public community scoring as a human feedback,' arXiv preprint arXiv:2401.10882 , 2024. - · arXiv
  135. [139][139] A. Havrilla, Y. Du, S. C. Raparthy, C. Nalmpantis, J. Dwivedi-Yu, M. Zhuravinskyi, E. Hambro, S. Sukhbaatar, and R. Raileanu, 'Teaching large language models to reason with reinforcement learning,' arXiv preprint arXiv:2403.04642 , 2024. - · arXiv
  136. [140][140] B. Pikus, W. LeVine, T. Chen, and S. Hendryx, 'A baseline analysis of reward models' ability to accurately analyze foundation models under distribution shift,' arXiv preprint arXiv:2311.14743 , 2023. - · arXiv
  137. [141][141] E. Stengel-Eskin, P. Hase, and M. Bansal, 'Lacie: Listener-aware finetuning for confidence calibration in large language models,' arXiv preprint arXiv:2405.21028 , 2024. - · arXiv
  138. [142][142] A. Bouyamourn, 'Why LLMs hallucinate, and how to get (evidential) closure: Perceptual, intensional, and extensional learning for faithful natural language generation,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, Dec. 2023, pp. 3181-3193. [Online]. Available: https://aclanthology.org/2023.emnlp-main.192/ -
  139. [143][143] Z. Xu, S. Jain, and M. Kankanhalli, 'Hallucination is inevitable: An innate limitation of large language models,' arXiv preprint arXiv:2401.11817 , 2024. - · arXiv
  140. [145][145] H. Rogers Jr, Theory of recursive functions and effective computability . MIT press, 1987. -
  141. [147][147] Z. Gekhman, G. Yona, R. Aharoni, M. Eyal, A. Feder, R. Reichart, and J. Herzig, 'Does fine-tuning llms on new knowledge encourage hallucinations?' arXiv preprint arXiv:2405.05904 , 2024. - · arXiv
  142. [148][148] W. Wang and Q. Li, 'Schrodinger's memory: Large language models,' arXiv preprint arXiv:2409.10482 , 2024. - · arXiv
  143. [149][149] Y. Li, Q. Zhou, Y. Luo, S. Ma, Y. Li, H.-T. Zheng, X. Hu, and P. S. Yu, 'When llms meet cunning questions: A fallacy understanding benchmark for large language models,' arXiv preprint arXiv:2402.11100 , 2024. - · arXiv
  144. [150][150] Y. Bai, X. Du, Y. Liang, Y. Jin, Z. Liu, J. Zhou, T. Zheng, X. Zhang, N. Ma, Z. Wang et al. , 'Coig-cqia: Quality is all you need for chinese instruction fine-tuning,' arXiv preprint arXiv:2403.18058 , 2024. - · arXiv
  145. [151][151] C. Si, C. Zhao, S. Min, and J. Boyd-Graber, 'Re-examining calibration: The case of question answering,' arXiv preprint arXiv:2205.12507 , 2022. - · arXiv
  146. [152][152] X. Huang, S. Li, M. Yu, M. Sesia, H. Hassani, I. Lee, O. Bastani, and E. Dobriban, 'Uncertainty in language models: Assessment through rank-calibration,' arXiv preprint arXiv:2404.03163 , 2024. - · arXiv
  147. [153][153] M. Zhang, M. Huang, R. Shi, L. Guo, C. Peng, P. Yan, Y. Zhou, and X. Qiu, 'Calibrating the confidence of large language models by eliciting fidelity,' arXiv preprint arXiv:2404.02655 , 2024. - · arXiv
  148. [154][154] C. Tomani, K. Chaudhuri, I. Evtimov, D. Cremers, and M. Ibrahim, 'Uncertainty-based abstention in llms improves safety and reduces hallucinations,' 2024. [Online]. Available: https://arxiv.org/abs/2404.10960 - · arXiv
  149. [155][155] Y. Gu, Z. Ji, W. Zhang, C. Lyu, D. Lin, and K. Chen, 'Anah-v2: Scaling analytical hallucination annotation of large language models,' arXiv preprint arXiv:2407.04693 , 2024. - · arXiv
  150. [156][156] F. Ridder and M. Schilling, 'The hallurag dataset: Detecting closeddomain hallucinations in rag applications using an llm's internal states,' arXiv preprint arXiv:2412.17056 , 2024. - · arXiv
  151. [157][157] M. Elaraby, M. Lu, J. Dunn, X. Zhang, Y. Wang, S. Liu, P. Tian, Y. Wang, and Y. Wang, 'Halo: Estimation and reduction of hallucinations in open-source weak large language models,' arXiv preprint arXiv:2308.11764 , 2023. - · arXiv
  152. [158][158] A. Azaria and T. Mitchell, 'The internal state of an llm knows when it's lying,' arXiv preprint arXiv:2304.13734 , 2023. - · arXiv
  153. [159][159] Y. Miao, H. Liu, W. Lei, N. Chen, and M.-Y. Kan, 'Discursive socratic questioning: Evaluating the faithfulness of language models' understanding of discourse relations,' in Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2024, pp. 6277-6295. -
  154. [160][160] N. Dziri, E. Kamalloo, S. Milton, O. Zaiane, M. Yu, E. M. Ponti, and S. Reddy, 'Faithdial: A faithful benchmark for informationseeking dialogue,' Transactions of the Association for Computational Linguistics , vol. 10, pp. 1473-1490, 2022. -
  155. [161][161] J. Zhou, T. Lu, S. Mishra, S. Brahma, S. Basu, Y. Luan, D. Zhou, and L. Hou, 'Instruction-following evaluation for large language models,' arXiv preprint arXiv:2311.07911 , 2023. - · arXiv
  156. [162][162] M. Geva, D. Khashabi, E. Segal, T. Khot, D. Roth, and J. Berant, 'Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies,' Transactions of the Association for Computational Linguistics , vol. 9, pp. 346-361, 2021. -
  157. [163][163] M. Joshi, E. Choi, D. S. Weld, and L. Zettlemoyer, 'Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension,' arXiv preprint arXiv:1705.03551 , 2017. - · arXiv
  158. [164][164] Z. Yang, P. Qi, S. Zhang, Y. Bengio, W. W. Cohen, R. Salakhutdinov, and C. D. Manning, 'Hotpotqa: A dataset for diverse, explainable multi-hop question answering,' arXiv preprint arXiv:1809.09600 , 2018. - · arXiv
  159. [165][165] F. Ridder and M. Schilling, 'The hallurag dataset: Detecting closeddomain hallucinations in rag applications using an llm's internal states,' 2024. [Online]. Available: https://arxiv.org/abs/2412.17056 - · arXiv
  160. [166][166] Y. Chen, Q. Fu, Y. Yuan, Z. Wen, G. Fan, D. Liu, D. Zhang, Z. Li, and Y. Xiao, 'Hallucination detection: Robustly discerning reliable answers in large language models,' 2024. [Online]. Available: https://arxiv.org/abs/2407.04121 - · arXiv
  161. [167][167] Y. Gu, Z. Ji, W. Zhang, C. Lyu, D. Lin, and K. Chen, 'Anah-v2: Scaling analytical hallucination annotation of large language models,' 2024. [Online]. Available: https://arxiv.org/abs/2407.04693 - · arXiv
  162. [168][168] S. Ni, X. Kong, C. Li, X. Hu, R. Xu, J. Zhu, and M. Yang, 'Training on the benchmark is not all you need,' arXiv preprint arXiv:2409.01790 , 2024. - · arXiv
  163. [169][169] S. Valentin, J. Fu, G. Detommaso, S. Xu, G. Zappella, and B. Wang, 'Cost-effective hallucination detection for llms,' 2024. [Online]. Available: https://arxiv.org/abs/2407.21424 - · arXiv
  164. [170][170] C. Burns, H. Ye, D. Klein, and J. Steinhardt, 'Discovering latent knowledge in language models without supervision,' arXiv preprint arXiv:2212.03827 , 2022. - · arXiv
  165. [171][171] S. S. Kim, Q. V. Liao, M. Vorvoreanu, S. Ballard, and J. W. Vaughan, '' i'm not sure, but...': Examining the impact of large language models' uncertainty expression on user reliance and trust,' in The 2024 ACM Conference on Fairness, Accountability, and Transparency , 2024, pp. 822-835. -
  166. [172][172] Z. Jiang, J. Araki, H. Ding, and G. Neubig, 'How can we know when language models know? on the calibration of language models for question answering,' Transactions of the Association for Computational Linguistics , vol. 9, pp. 962-977, 2021. -
  167. [173][173] Y. Wu, Y. Wang, T. Chen, C. Liu, N. Xi, Q. Gu, H. Lei, Z. Jiang, Y. Chen, and L. Ji, 'Alleviating hallucinations in large language models with scepticism modeling,' arXiv preprint arXiv:2409.06601 , 2024. - · arXiv
  168. [174][174] Y. Yang, H. Li, Y. Wang, and Y. Wang, 'Improving the reliability of large language models by leveraging uncertainty-aware in-context learning,' arXiv preprint arXiv:2310.04782 , 2023. - · arXiv
  169. [175][175] X. Li, R. Zhao, Y. K. Chia, B. Ding, S. Joty, S. Poria, and L. Bing, 'Chain-of-knowledge: Grounding large language models via dynamic knowledge adapting over heterogeneous sources,' arXiv preprint arXiv:2305.13269 , 2023. - · arXiv
  170. [176][176] Z. Wang, S. X. Teo, J. Ouyang, Y. Xu, and W. Shi, 'M-rag: Reinforcing large language model performance through retrieval-augmented generation with multiple partitions,' arXiv preprint arXiv:2405.16420 , 2024. - · arXiv
  171. [177][177] D. Li, J. Yan, T. Zhang, C. Wang, X. He, L. Huang, H. Xue, and J. Huang, 'On the role of long-tail knowledge in retrieval augmented large language models,' arXiv preprint arXiv:2406.16367 , 2024. - · arXiv
  172. [178][178] S. Feng, W. Shi, Y. Bai, V. Balachandran, T. He, and Y. Tsvetkov, 'Knowledge card: Filling llms' knowledge gaps with plug-in specialized language models,' arXiv preprint arXiv:2305.09955 , 2023. - · arXiv
  173. [179][179] S. Yoon, E. Lee, J. Kim, Y. Kim, H. Yun, and S.-w. Hwang, 'Listt5: Listwise reranking with fusion-in-decoder improves zero-shot retrieval,' arXiv preprint arXiv:2402.15838 , 2024. - · arXiv
  174. [180][180] C. Niu, Y. Wu, J. Zhu, S. Xu, K. Shum, R. Zhong, J. Song, and T. Zhang, 'Ragtruth: A hallucination corpus for developing trustworthy retrieval-augmented language models,' arXiv preprint arXiv:2401.00396 , 2023. - · arXiv
  175. [181][181] V. Magesh, F. Surani, M. Dahl, M. Suzgun, C. D. Manning, and D. E. Ho, 'Hallucination-free? assessing the reliability of leading ai legal research tools; 2024,' URL https://arxiv. org/abs/2405.20362 , 2024. -
  176. [182][182] A. Hogan, E. Blomqvist, M. Cochez, C. d'Amato, G. D. Melo, C. Gutierrez, S. Kirrane, J. E. L. Gayo, R. Navigli, S. Neumaier et al. , 'Knowledge graphs,' ACM Computing Surveys (Csur) , vol. 54, no. 4, pp. 1-37, 2021. -
  177. [183][183] G. Agrawal, T. Kumarage, Z. Alghamdi, and H. Liu, 'Can knowledge graphs reduce hallucinations in llms?: A survey,' arXiv preprint arXiv:2311.07914 , 2023. - · arXiv
  178. [184][184] P. Panda, A. Agarwal, C. Devaguptapu, M. Kaul et al. , 'Holmes: Hyper-relational knowledge graphs for multi-hop question answering using llms,' arXiv preprint arXiv:2406.06027 , 2024. - · arXiv
  179. [185][185] J. Liu, Q. Mao, W. Jiang, and J. Li, 'Knowformer: Revisiting transformers for knowledge graph reasoning,' arXiv preprint arXiv:2409.12865 , 2024. - · arXiv
  180. [186][186] D. Sanmartin, 'Kg-rag: Bridging the gap between knowledge and creativity,' arXiv preprint arXiv:2405.12035 , 2024. - · arXiv
  181. [187][187] H. Sansford, N. Richardson, H. P. Maretic, and J. N. Saada, 'Grapheval: A knowledge-graph based llm hallucination evaluation framework,' arXiv preprint arXiv:2407.10793 , 2024. - · arXiv
  182. [188][188] E. Mitchell, C. Lin, A. Bosselut, C. D. Manning, and C. Finn, 'Memory-based model editing at scale,' in ICML , vol. 162. PMLR, 2022, pp. 15 817-15 831. -
  183. [189][189] X. L. Li and P. Liang, 'Prefix-tuning: Optimizing continuous prompts for generation,' arXiv preprint arXiv:2101.00190 , 2021. - · arXiv
  184. [190][190] E. Jones, H. Palangi, C. Sim˜ oes, V. Chandrasekaran, S. Mukherjee, A. Mitra, A. Awadallah, and E. Kamar, 'Teaching language models to hallucinate less with synthetic tasks,' arXiv preprint arXiv:2310.06827 , 2023. - · arXiv
  185. [191][191] J. Liu, S. Chen, Y. Cheng, and J. He, 'On the universal truthfulness hyperplane inside llms,' arXiv preprint arXiv:2407.08582 , 2024. - · arXiv
  186. [192][192] R. Mehta, A. Hoblitzell, J. O'keefe, H. Jang, and V. Varma, 'Halu-NLP at SemEval-2024 task 6: MetaCheckGPT - a multi-task hallucination detection using LLM uncertainty and meta-models,' in Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval2024) , A. K. Ojha, A. S. Do˘ gru¨ oz, H. Tayyar Madabushi, G. Da San Martino, S. Rosenthal, and A. Ros´ a, Eds. Mexico City, Mexico: Association for Computational Linguistics, Jun. 2024, pp. 342-348. [Online]. Available: https://aclanthology.org/2024.semeval1.52/ -
  187. [193][193] Z. Chen, X. Sun, X. Jiao, F. Lian, Z. Kang, D. Wang, and C. Xu, 'Truth forest: Toward multi-scale truthfulness in large language models through intervention without tuning,' in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38, no. 19, 2024, pp. 20 96720 974. -
  188. [194][194] D. Yang, D. Xiao, J. Wei, M. Li, Z. Chen, K. Li, and L. Zhang, 'Improving factuality in large language models via decoding-time hallucinatory and truthful comparators,' arXiv preprint arXiv:2408.12325 , 2024. - · arXiv
  189. [195][195] G. Cui, W. Li, N. Ding, L. Huang, Z. Liu, and M. Sun, 'Decoder tuning: Efficient language understanding as decoding,' arXiv preprint arXiv:2212.08408 , 2022. - · arXiv
  190. [196][196] B. Yang, M. A. A. Mamun, J. M. Zhang, and G. Uddin, 'Hallucination detection in large language models with metamorphic relations,' 2025. [Online]. Available: https://arxiv.org/abs/2502.15844 - · arXiv
  191. [197][197] S. S. Ravi, B. Mielczarek, A. Kannappan, D. Kiela, and R. Qian, 'Lynx: An open source hallucination evaluation model,' 2024. [Online]. Available: https://arxiv.org/abs/2407.08488 - · arXiv
  192. [198][198] A. Bavaresco, R. Bernardi, L. Bertolazzi, D. Elliott, R. Fern´ andez, A. Gatt, E. Ghaleb, M. Giulianelli, M. Hanna, A. Koller, A. F. T. Martins, P. Mondorf, V. Neplenbroek, S. Pezzelle, B. Plank, D. Schlangen, A. Suglia, A. K. Surikuchi, E. Takmaz, and A. Testoni, 'Llms instead of human judges? a large scale empirical study across 20 nlp evaluation tasks,' 2024. [Online]. Available: https://arxiv.org/abs/2406.18403 - · arXiv
  193. [199][199] M. Dahl, V. Magesh, M. Suzgun, and D. E. Ho, 'Large legal fictions: Profiling legal hallucinations in large language models,' Journal of Legal Analysis , vol. 16, no. 1, pp. 64-93, 2024. -
  194. [200][200] K. Zuo and Y. Jiang, 'Medhallbench: A new benchmark for assessing hallucination in medical large language models,' 2025. [Online]. Available: https://arxiv.org/abs/2412.18947 - · arXiv
  195. [201][201] Y. Li, Y. Guo, F. Guerin, and C. Lin, 'An open-source data contamination report for large language models,' in Findings of the Association for Computational Linguistics: EMNLP 2024 , Y. AlOnaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 528-541. [Online]. Available: https://aclanthology.org/2024.findings-emnlp.30/ -
  196. [202][202] S. Huang, L. Yang, Y. Song, S. Chen, L. Cui, Z. Wan, Q. Zeng, Y. Wen, K. Shao, W. Zhang, J. Wang, and Y. Zhang, 'Thinkbench: Dynamic out-of-distribution evaluation for robust llm reasoning,' 2025. [Online]. Available: https://arxiv.org/abs/2502.16268 - · arXiv
  197. [203][203] W. Su, C. Wang, Q. Ai, Y. HU, Z. Wu, Y. Zhou, and Y. Liu, 'Unsupervised real-time hallucination detection based on the internal states of large language models,' 2024. [Online]. Available: https://arxiv.org/abs/2403.06448 - · arXiv
  198. [204][204] S. Wang, Z. Long, Z. Fan, Z. Wei, and X. Huang, 'Benchmark self-evolving: A multi-agent framework for dynamic llm evaluation,' 2024. [Online]. Available: https://arxiv.org/abs/2402.11443 - · arXiv
  199. [205][205] K. Zhu, J. Wang, Q. Zhao, R. Xu, and X. Xie, 'Dynamic evaluation of large language models by meta probing agents,' 2024. [Online]. Available: https://arxiv.org/abs/2402.14865 - · arXiv
  200. [207][207] F. Diaz and M. Madaio, Scaling Laws Do Not Scale . AAAI Press, 2025, p. 341-357. -

200 of 206 shown

Metadata

Authors
Li, C., Wang, P., Wang, C., Zhang, L., Liu, Z., Ye, Q., Xu, Y., Huang, F., Zhang, X., & Yu, P. S.
Venue
arXiv
Publisher
arXiv
Published
2025
DOI
10.48550/arxiv.2507.02870
arXiv
2507.02870
References
2
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review