Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Open accessThe DOI matches its Crossref record; 158 of the 158 references it cites were found in a registry or an index; 29 of the 52 sources its claims cite were checked for support.
Abstract
Abstract Do large language models (LLMs) know the law? LLMs are increasingly being used to augment legal practice, education, and research, yet their revolutionary potential is threatened by the presence of “hallucinations”—textual output that is not consistent with legal facts. We present the first systematic evidence of these hallucinations in public-facing LLMs, documenting trends across jurisdictions, courts, time periods, and cases. Using OpenAI’s ChatGPT 4 and other public models, we show that LLMs hallucinate at least 58% of the time, struggle to predict their own hallucinations, and often uncritically accept users’ incorrect legal assumptions. We conclude by cautioning against the rapid and unsupervised integration of popular LLMs into legal tasks, and we develop a typology of legal hallucinations to guide future research in this area.
Overview
CoChat Summary
TL;DR
This paper provides the first systematic evidence that public LLMs frequently hallucinate on verifiable questions about U.S. federal case law, with hallucination rates ranging from 58% for ChatGPT 4 to 88% for Llama 2. It also documents correlates of hallucination and two additional failure modes: susceptibility to false legal premises and poor calibration about their own accuracy.
Key findings
- Hallucinations are widespread across all tested LLMs on direct, verifiable federal case questions: ChatGPT 4 hallucinates 58% of the time, while Llama 2 hallucinates 88%; GPT 4 performs best overall, followed by GPT 3.5, PaLM 2, and Llama 2.
- Hallucination rates increase with task complexity and vary by court hierarchy, jurisdiction, case prominence, and case year. For reference-free high-complexity tasks, the reported rates are lower bounds: at least 49% for factual background and procedural posture, at least 59% for core legal question, and at least 63% for central holding; doctrinal agreement is near 0.5, little better than random guessing.
- LLMs often accept false legal premises: on the false dissent premise, GPT 4 hallucinates 0.691 at SCOTUS and 0.842 at USCOA; on the false overruling premise, GPT 4 hallucinates 0.531, GPT 3.5 0.821, PaLM 2 1.000, and Llama 2 0.027. Llama 2’s low contra-factual rate reflects its tendency to reject premises, which harms its performance on other tasks such as Existence.
- Calibration is poor and systematically overconfident: pooled expected calibration error is 0.057 for PaLM 2, 0.099 for GPT 3.5, 0.190 for GPT 4, and 0.421 for Llama 2. Although GPT 4 has the lowest raw hallucination rate, it is less calibrated than PaLM 2 and GPT 3.5.
Methods
- The authors develop 14 legal knowledge QA tasks grouped into low, moderate, and high complexity. The first nine are reference-based and scored against metadata from the Caselaw Access Project, Supreme Court Database, Appeals Courts Database Project, Library of Congress, and Shepard’s Citations; the final five are reference-free and detected via self-contradiction between repeated stochastic responses, using GPT 4 for contradiction labeling.
- They draw 5,000 cases each from SCOTUS, USCOA, and USDC using stratified random sampling, then query four off-the-shelf LLMs—OpenAI ChatGPT 4, OpenAI ChatGPT 3.5, Google PaLM 2, and Meta Llama 2—under zero-shot and three-shot prompting. They execute more than 800,000 queries, over 200,000 per LLM, generally at temperature 0 for reference-based tasks.
- Analyses estimate population-level hallucination rates, heterogeneity across task, court, jurisdiction, prominence, and year, plus contra-factual bias and expected calibration error.
Limitations
- The paper states that reference-free hallucination rates are only lower bounds because self-contradiction guarantees hallucination but logically consonant answers may still be false; it also cannot capture repeated incorrect answers as hallucinations, and notes that the SCOTUS Subsequent history estimate likely understates hallucination by a larger margin.
- The paper states that it relies on GPT 4 for contradiction detection, though it validates this with human intercoder reliability (Cohen’s κ: Coder 1 vs. GPT 4 = 0.87; Coder 2 vs. GPT 4 = 0.77; Coder 1 vs. Coder 2 = 0.79). It also notes that closed-source models do not expose conditional probabilities, so calibration is estimated by sampling at temperature 1, and that ex post temperature scaling improves but does not fully solve calibration.
- Evident from the text: the study tests specific public model versions available at the time, so results may not generalize to newer LLMs or to retrieval-augmented, fine-tuned, or proprietary legal systems; the tasks are limited to published federal case law and to metadata available for constructing ground truth.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
16 Valid · 5 Not valid · 9 Not checked · 105 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“since hallucinations of some kind are generally inevitable at the token level (Kalai and Vempala 2023; Xu, Jain, and Kankanhalli 2024)”
What the sources say
- Disputedcites Kalai and Vempala 2023Experimental — accuracy not yet measured
The Introduction (p. 1) explicitly says the paper's lower bounds for calibrated predictors of facts should not be taken to mean hallucination is inevitable. The discussion on p. 2 distinguishes its semantic-level calibration from token-level calibration, so it does not establish inevitability at the token level. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
- Partly supportedcites Xu, Jain, and Kankanhalli 2024 sourceExperimental — accuracy not yet measured
Section 3.2 (p. 7) concludes that LLM hallucination cannot be eliminated, supporting the inevitability claim. But Section 2.1 (p. 2) describes token-by-token generation, while the paper defines hallucination by comparing complete output strings with ground truth; it does not establish inevitability specifically at the token level. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“as Kalai and Vempala (2023) show, LMs that assign a positive probability to every response token must hallucinate at least some of the time”
What the sources say
- Supportedcites Kalai and Vempala (2023)
The Introduction (p. 1) explicitly says that an LM predicting every string with positive probability will necessarily hallucinate with positive probability. This supports the claim's paraphrase that such hallucination occurs at least some of the time. (LLM, conf=0.93)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Xu, Jain, and Kankanhalli (2024) agree, arguing that 'hallucination is inevitable for any computable LLM, regardless of model architecture, learning algorithms, prompting techniques, or training data.'”
What the sources say
- Supportedcites Xu, Jain, and Kankanhalli (2024) source
The Introduction (p. 2) states the attributed claim nearly verbatim. It frames the result under the paper’s formal definition of hallucination and says it applies to real-world LLMs. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“increased reliance on LLMs also has the potential to produce a kind of legal monoculture (Creel and Hellman 2022; Kleinberg and Raghavan 2021), with users being fed information from only a limited subset of judicial sources that elide many of the deeper nuances of the law.”
What the sources say
- Partly supportedcites Creel and Hellman 2022 sourceExperimental — accuracy not yet measured
Section 3.a, “Why arbitrariness at scale arises” (page unavailable), says that reliance on similar datasets can standardize different algorithms and produce uniform outcomes. That supports the general concern about algorithmic monoculture, but the paper does not address LLMs feeding users a limited subset of judicial sources or eliding nuances of law. (LLM, conf=0.84)
- Partly supportedcites Kleinberg and Raghavan 2021 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes algorithmic curation making choices more homogeneous, and the Conclusion (p. 12) says shared evaluations can cause valuable options to be overlooked. Those passages support the general possibility of monoculture, but the paper examines algorithmic screening, not LLMs or whether users receive a limited subset of judicial sources that omits legal nuance. (LLM, conf=0.87)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“the problem of legal hallucination has so far only been studied in closed-domain applications, such as when a model is used to summarize the content of a given judicial opinion (Deroy, Ghosh, and Ghosh 2023; Feijo and Moreira 2023) or to synthesize provided legal text (Savelka et al. 2023)”
What the sources say
- Partly supportedcites Deroy, Ghosh, and Ghosh 2023 sourceExperimental — accuracy not yet measured
The Abstract describes a study of hallucinations in summaries generated from Indian court case judgments, supporting this paper as an example of a closed-domain legal application. The Introduction’s “Novelty of this work” section says that, to the authors’ knowledge, hallucination had not previously been studied in legal summarization. Neither passage establishes the broader claim that legal hallucination had only been studied in closed-domain applications. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites Feijo and Moreira 2023 source
- Partly supportedcites Savelka et al. 2023 sourceExperimental — accuracy not yet measured
The Proposed Method (pp. 6–7) describes an augmented setup that synthesizes retrieved case-law sentences into an explanation, supporting the example attributed to Savelka et al. But it also studies a baseline that generates explanations without those retrieved sentences, and the Conclusions (p. 13) report hallucinated case-law citations in that baseline. The paper therefore does not support the claim that legal hallucination had only been studied in closed-domain applications. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
60 more claims · 3 with their cited sources checked
Create a free account to see all 135 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 42
- It may state two separate claims as one. 44
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In high-stake domains such as legal consultation or scientific research, these hallucinations can lead to severe misjudgments and erode user trust [190,191].”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [190]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent research has shown that leading language models – ChatGPT, Deepseek, Grok, PaLM, Claude, Qwen, and Llama – were on average producing hallucinations in 75 % of the cases (Dahl et al., 2024), with many users unaware of this prevalence (Williamson & Prybutok, 2024).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Dahl et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Dahl et al. [7] showed that even models with high bar exam scores systematically fabricate case references when applied to real legal tasks.”
From Citation Grounding: Detecting and Reducing LLM Citation Hallucinations via Legal Citation Graphs (2026) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“a confident legal summary can make uncertain advice feel authoritative [93]”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [93]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work has found that general- purpose LLMs hallucinate on legal queries on average between 58% and 82% of the time (Dahl et al. 2024).”
From Hallucination‐Free? Assessing the Reliability of Leading AI Legal Research Tools (2025) · cites this paper as Dahl et al. 2024
Experimental — accuracy not yet measured
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ E.1 Fake Case Existence Task · p. 61
“GPT 4 and Llama 2, on the other hand, appear immune from this behavior, but recall from Table 2 that this is just bias in the opposite direction: they simply prefer to deny the existence of any case, real or fake.”
§ 6 Discussion · p. 38
“| Existence | Zero-shot | 0.204 (0.006) | 0.004 (0.001) | 0.054 (0.003) | 0.303 (0.006)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 5.1.2 Hallucinations Vary by Court · p. 24
“We find that across all tasks and all LLMs, hallucinations are lowest in the highest levels of the judiciary, and vice-versa (Figure 3).”
§ 6 Discussion · p. 38
“| Citation | Few-shot | 0.689 (0.007) | 0.641 (0.007) | 0.833 (0.005) | 0.953 (0.003) | 0.468 (0.007)”
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · cited 1×
“…(the tendency of an LLM to agree with a user’s preferences or beliefs, even when the LLM would reject the belief as wrong without the user’s prompting; Sharma et al., 2023; Wei et al., 2023) or general cognitive error (Tversky and Kahneman, 1974; Jones and Steinhardt, 2022; Suri et al., 2023).”
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationLlama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
Sharma, M., Tong, M., Korbak, T., Duperrouzel, D., Was, H., Korbak, J., Cheng, M., Askell, A., Bai, Y., Brain, C., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.13548 · Cited by 1,313
Dell’Acqua, F., McFowland, E., Mollick, E., Lifshitz, H., Kellogg, K. C., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2026) · Organization Science · doi:10.1287/orsc.2025.21838 · Cited by 1,189
On Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.173 · Cited by 1,185
On Faithfulness and Factuality in Abstractive Summarization
Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020) · arXiv · doi:10.48550/arxiv.2005.00661 · Cited by 1,185
TruthfulQA: Measuring How Models Mimic Human Falsehoods
Lin, S., Hilton, J., & Evans, O. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.229 · Cited by 904 · cited 1×
“One effective way to study hallucinations in the open-domain setting is to use a test oracle—or an external reference —to detect and adjudge non-factual responses (Lin et al., 2022; Lee et al., 2023; Li et al., 2023).”
TruthfulQA: Measuring How Models Mimic Human Falsehoods
Lin, S., Hilton, J., & Evans, O. (2021) · arXiv · doi:10.48550/arxiv.2109.07958 · Cited by 899
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876
Anil, R., Dai, A. M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S., Taropa, E., Bailey, P., Chen, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.10403 · Cited by 834
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1973) · doi:10.21236/ad0767426 · Cited by 756
Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
Xiong, M., Hu, Z., Lu, X., Li, Y., Fu, J., He, J., & Hooi, B. (2023) · arXiv · doi:10.48550/arxiv.2306.13063 · Cited by 618
Retrieval Augmentation Reduces Hallucination in Conversation
Shuster, K., Poff, S., Chen, M., Kiela, D., & Weston, J. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.320 · Cited by 575 · cited 1×
“Second, precisely because these queries can be answered with tabular data, legal database-augmented LLMs (Cui et al., 2023; Savelka et al., 2023) are likely to soon solve or at least mask hal-lucinated responses to these queries (Shuster et al., 2021; Peng et al., 2023).”
Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture
Cui, J., Ning, M., Li, Z., Li, H., Yang, Y., Chen, B., Ling, B., Tian, Y., & Yuan, L. (2026) · Fundamental Research · doi:10.1016/j.fmre.2026.03.026 · Cited by 574
CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
Gou, Z., Shao, Z., Gong, Y., Shen, Y., Yang, Y., Duan, N., & Chen, W. (2023) · arXiv · doi:10.48550/arxiv.2305.11738 · Cited by 561
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
Manakul, P., Liusie, A., & Gales, M. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.557 · Cited by 557
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Xu, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.01219 · Cited by 544
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Chen, Y., et al. (2025) · Computational Linguistics · doi:10.1162/coli.a.16 · Cited by 534
Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4335905 · Cited by 485
Benchmarking Large Language Models in Retrieval-Augmented Generation
Chen, J., Lin, H., Han, X., & Sun, L. (2023) · arXiv · doi:10.48550/arxiv.2309.01431 · Cited by 455
Benchmarking Large Language Models in Retrieval-Augmented Generation
Chen, J., Lin, H., Han, X., & Sun, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29728 · Cited by 454
In-Context Retrieval-Augmented Language Models
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00605 · Cited by 449
Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2023) · doi:10.2139/ssrn.4389233 · Cited by 422
Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.741 · Cited by 407
Discrimination in the Age of Algorithms
Kleinberg, J., Ludwig, J., Mullainathan, S., & Sunstein, C. R. (2018) · Journal of Legal Analysis · doi:10.1093/jla/laz001 · Cited by 401
Survey on Factuality in Large Language Models
Wang, C., Liu, X., Yue, Y., Guo, Q., Hu, X., Tang, X., Zhang, T., Cheng, J., Yao, Y., Hu, X., et al. (2025) · ACM Computing Surveys · doi:10.1145/3742420 · Cited by 396
Tractatus logico-philosophicus
Buchheister, K., & Steuer, D. (1992) · Ludwig Wittgenstein · doi:10.1007/978-3-476-03968-2_2 · Cited by 368
Faithful to the Original: Fact Aware Neural Abstractive Summarization
Cao, Z., Wei, F., Li, W., & Li, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11912 · Cited by 355 · cited 1×
“This is a major concern in tasks requiring a high degree of accuracy between the response and a long-form input, such as machine translation (Xu et al., 2023) or summarization (Cao et al., 2018).”
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models
Li, J., Cheng, X., Zhao, X., Nie, J.-Y., & Wen, J.-R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.397 · Cited by 343
Mallen, A., Asai, A., Zhong, V., Das, R., Khashabi, D., & Hajishirzi, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.546 · Cited by 340
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models
Li, J., Cheng, X., Zhao, W. X., Nie, J.-Y., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2305.11747 · Cited by 340
Siriwardhana, S., Weerasekera, R., Wen, E., Kaluarachchi, T., Rana, R., & Nanayakkara, S. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00530 · Cited by 337
Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation
Mündler, N., He, J., Jenko, S., & Vechev, M. (2023) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000719979 · Cited by 335
LawBench: Benchmarking Legal Knowledge of Large Language Models
Fei, Z., Shen, X., Zhu, D., Zhou, F., Han, Z. R., Huang, A., Zhang, S., Chen, K., Yin, Z., Shen, Z., et al. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.452 · Cited by 293
Prompting GPT-3 To Be ReliablePreprint
Si, C., Gan, Z., Yang, Z., Wang, S., Wang, J., Boyd-Graber, J. L., & Wang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.09150 · Cited by 292
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models
Yu, W., Zhang, H., Pan, X., Cao, P., Ma, K., Li, J., Wang, H., & Yu, D. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.813 · Cited by 289
Chain-of-Verification Reduces Hallucination in Large Language Models
Dhuliawala, S., Komeili, M., Xu, J., Raileanu, R., Li, X., Celikyilmaz, A., & Weston, J. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.212 · Cited by 282
Verified Uncertainty CalibrationPreprint
Kumar, A., Liang, P., & Ma, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10155 · Cited by 276
Network Analysis and the Law: Measuring the Legal Importance of Precedents at the U.S. Supreme Court
Fowler, J. H., Johnson, T. R., Spriggs, J. F., Jeon, S., & Wahlbeck, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpm011 · Cited by 271 · cited 2×
“Finally, we merge these units with metadata obtained from the Caselaw Access Project (2023), the Supreme Court Database (Spaeth et al., 2022), the Appeals Courts Database Project (Songer, 2008; Kuersten and Haire, 2011), the Library of Congress (Congress.gov, 2023), and Shepard’s Citations (Fowler et al., 2007; Black…”
Government by Algorithm: Artificial Intelligence in Federal Administrative Agencies
Engstrom, D. F., Ho, D. E., Sharkey, C. M., & Cuéllar, M.-F. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3551505 · Cited by 262
Self-citationTowards Mitigating LLM Hallucination via Self Reflection
Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., & Fung, P. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.123 · Cited by 253
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language ModelsPreprint
Yu, W., Zhang, H.-M., Pan, X., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2311.09210 · Cited by 251
Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM CollaborationPreprint
Feng, S., Shi, W., Wang, Y., et al. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2402.00367 · Cited by 250
LawBench: Benchmarking Legal Knowledge of Large Language ModelsPreprint
Fei, Z., Shen, X., Zhu, D., Zhou, F., Han, Z., Zhang, S., Chen, K., Shen, Z., & Ge, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.16289 · Cited by 235
Factuality of Large Language Models: A Survey
Wang, Y., Wang, M., Manzoor, M. A., Liu, F., Georgiev, G. N., Das, R. J., & Nakov, P. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.1088 · Cited by 219
Can GPT-3 Perform Statutory Reasoning?
Blair-Stanek, A., Holzenberger, N., & Durme, B. V. (2023) · International Conference on Artificial Intelligence and Law · doi:10.1145/3594536.3595163 · Cited by 210
Quantifying Memorization Across Neural Language Models
Carlini, N., Ippolito, D., Jagielski, M., Lee, K., Tramer, F., & Zhang, C. (2022) · arXiv · doi:10.48550/arxiv.2202.07646 · Cited by 204
Meta-Prompting: Enhancing Language Models with Task-Agnostic ScaffoldingPreprint
Süzgün, M., & Kalai, A. T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.12954 · Cited by 195
Gillis, T. B., & Spiess, J. (2019) · The University of Chicago Law Review · Cited by 193
Language Models (Mostly) Know What They Know
Kadavath, S., Conerly, T., Askell, A., Henighan, T., Drain, D., Perez, E., Schiefer, N., Hatfield-Dodds, Z., DasSarma, N., Tran-Johnson, E., et al. (2022) · arXiv · doi:10.48550/arxiv.2207.05221 · Cited by 187 · cited 2×
“Ideally, a well-calibrated model would be confident in its factual responses, and not confident in its hallucinated ones (Kadavath et al., 2022; Xiong et al., 2023; Tian et al., 2023b; Yin et al., 2023; Azaria and Mitchell, 2023).”
Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
Li, K., Patel, O., Viégas, F., Pfister, H., & Wattenberg, M. (2023) · arXiv · doi:10.48550/arxiv.2306.03341 · Cited by 184
(2024) · doi:10.1145/3704435 · Cited by 184
Tool Learning with Foundation Models
Qin, Y., Hu, S., Lin, Y., Chen, W., Ding, N., Cui, G., Zeng, Z., Huang, Y., Xiao, C., Han, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.08354 · Cited by 184
Lift Yourself Up: Retrieval-augmented Text Generation with Self MemoryPreprint
Cheng, X., Luo, D., Chen, X.-Y., Liu, L.-M., Zhao, D., & Yan, R. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.02437 · Cited by 181
Hallucination is Inevitable: An Innate Limitation of Large Language Models
Xu, Z., Jain, S., & Kankanhalli, M. (2024) · arXiv · doi:10.48550/arxiv.2401.11817 · Cited by 180
The Internal State of an LLM Knows When It's Lying
Azaria, A., & Mitchell, T. (2023) · arXiv · doi:10.48550/arxiv.2304.13734 · Cited by 179
The Internal State of an LLM Knows When It’s Lying
Azaria, A., & Mitchell, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.68 · Cited by 175
Faithful to the Original: Fact Aware Neural Abstractive SummarizationPreprint
Cao, Z., Wei, F., Li, W., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04434 · Cited by 173
Peng, B., Galley, M., He, P., Cheng, H., Xie, Y., Hu, Y., Huang, Q., Liden, L., Yu, Z., Chen, W., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.12813 · Cited by 156
Legalbench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
Guha, N., Nyarko, J., Ho, D. E., Ré, C., Chilton, A., Narayana, A., Chohlas-Wood, A., Peters, A., Waldon, B., Rockmore, D., et al. (2023) · doi:10.2139/ssrn.4583531 · Cited by 154
Self-citationAlgorithmic monoculture and social welfare
Kleinberg, J., & Raghavan, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2018340118 · Cited by 147
Lift Yourself Up: Retrieval-augmented Text Generation with Self-Memory
Chen, X., Luo, D., Chen, X., Liu, L., Zhao, D., & Yan, R. (2023) · neural information processing systems · doi:10.52202/075280-1899 · Cited by 146
Discrimination In The Age Of Algorithms
Kleinberg, J. M., Ludwig, J., Mullainathan, S., & Sunstein, C. R. (2019) · National Bureau of Economic Research · doi:10.3386/w25548 · Cited by 138
A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models
Tonmoy, S. M. T. I., Zaman, S. M. M., Jain, V., Rani, A., Rawte, V., Chadha, A., & Das, A. (2024) · arXiv · doi:10.48550/arxiv.2401.01313 · Cited by 129
Do Large Language Models Show Decision Heuristics Similar to Humans? A Case Study Using GPT-3.5Preprint
Suri, G., Slater, L. R., Ziaee, A., & Nguyen, M. (2023) · Journal of experimental psychology. General · doi:10.48550/arxiv.2305.04400 · Cited by 128
Tian, K., Mitchell, E., Zhou, A., Sharma, A., Rafailov, R., Yao, H., Finn, C., & Manning, C. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.330 · Cited by 123
The Implications of ChatGPT For Legal Services and Society
Perlman, A. M. (2024) · Michigan Technology Law Review · doi:10.36645/mtlr.30.1.implications · Cited by 118 · cited 1×
“These findings temper recent enthusiasm for the ability of off-the-shelf, publicly available LLMs to accelerate access to justice (Tito, 2017; Perlman, 2023; Tan et al., 2023).”
Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
Li, K., Patel, O., Viégas, F., Pfister, H., & Wattenberg, M. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1797 · Cited by 117
Hurdles to Progress in Long-form Question Answering
Krishna, K., Roy, A., & Iyyer, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.393 · Cited by 114 · cited 1×
“Such oracles are usually difficult and costly to construct (Krishna et al., 2021), but we exploit the tabular metadata described in Section 4.1 to develop ours.”
InfluentialUnderstanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection
Xu, W., Agrawal, S., Briakou, E., Martindale, M. J., & Carpuat, M. J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00563 · Cited by 106 · cited 1×
“This is a major concern in tasks requiring a high degree of accuracy between the response and a long-form input, such as machine translation (Xu et al., 2023) or summarization (Cao et al., 2018).”
A Mathematical Investigation of Hallucination and Creativity in GPT Models
Lee, M. (2023) · Mathematics · doi:10.3390/math11102320 · Cited by 105
The Citation and Depreciation of U . S . Supreme Court Precedent
Black, R. C., & Spriggs, J. F. (2013) · Journal of Empirical Legal Studies · doi:10.1111/jels.12012 · Cited by 102 · cited 1×
“…obtained from the Caselaw Access Project (2023), the Supreme Court Database (Spaeth et al., 2022), the Appeals Courts Database Project (Songer, 2008; Kuersten and Haire, 2011), the Library of Congress (Congress.gov, 2023), and Shepard’s Citations (Fowler et al., 2007; Black and Spriggs, 2013).”
Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture
Cui, J., Ning, M., Li, Z., Chen, B., Yan, Y., Li, H., Ling, B., Tian, Y., & Yuan, L. (2023) · arXiv · doi:10.48550/arxiv.2306.16092 · Cited by 94
Calibrated Language Models Must Hallucinate
Kalai, A. T., & Vempala, S. S. (2024) · Proceedings of the 56th Annual ACM Symposium on Theory of Computing · doi:10.1145/3618260.3649777 · Cited by 91
Calibrated Language Models Must Hallucinate
Kalai, A. T., & Vempala, S. S. (2023) · arXiv · Cited by 90
Algorithmic Harm in Consumer Markets
Bar‐Gill, O., Sunstein, C. R., & Talgam-Cohen, I. (2023) · The Journal of Legal Analysis · doi:10.1093/jla/laad003 · Cited by 88
Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization
Cao, M., Dong, Y., & Cheung, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.236 · Cited by 87 · cited 1×
“…desirable to lawyers if they resulted in generated language that, for example, removed unnecessary information from a given ar-gument (at the expense of being faithful to it) or invented a novel analogy never yet proposed (at the expense of being grounded in the lexicon) (Cao et al., 2022).”
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Shi, W., Han, X., Lewis, M., Tsvetkov, Y., Zettlemoyer, L., & Yih, W.-T. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers) · doi:10.18653/v1/2024.naacl-short.69 · Cited by 83
AI Assistance in Legal Analysis: An Empirical Study
Choi, J. H., & Schwarcz, D. (2023) · doi:10.2139/ssrn.4539836 · Cited by 80
Do Large Language Models Know What They Don’t Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.551 · Cited by 75
Do Large Language Models Know What They Don't Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · arXiv · doi:10.48550/arxiv.2305.18153 · Cited by 75
An automated framework for assessing how well LLMs cite relevant medical references
Wu, K., Wu, E., Wei, K., Zhang, A., Casasola, A., Nguyen, T., Riantawan, S., Shi, P., Ho, D., & Zou, J. (2025) · Nature Communications · doi:10.1038/s41467-025-58551-6 · Cited by 72
Self-citationFactuality Enhanced Language Models for Open-Ended Text Generation
Lee, N., Ping, W., Xu, P., Patwary, M., Fung, P., Shoeybi, M., & Catanzaro, B. (2022) · arXiv · doi:10.48550/arxiv.2206.04624 · Cited by 68 · cited 1×
“Second, precisely because these queries can be answered with tabular data, legal database-augmented LLMs (Cui et al., 2023; Savelka et al., 2023) are likely to soon solve or at least mask hal-lucinated responses to these queries (Shuster et al., 2021; Peng et al., 2023).”
(2022) · doi:10.52202/068431-2506 · Cited by 68
Creel, K., & Hellman, D. (2022) · Canadian Journal of Philosophy · doi:10.1017/can.2022.3 · Cited by 67
Remedies for RobotsPreprint
Lemley, M. A., & Casey, B. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3223621 · Cited by 67
The Implications of ChatGPT for Legal Services and Society
(2022) · doi:10.2139/ssrn.4294197 · Cited by 63
Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
Henderson, P., Krass, M., Zheng, L., Guha, N., Manning, C. D., Jurafsky, D., & Ho, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2119 · Cited by 62
Self-citationSurvey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
Wang, C., Liu, X., Yue, Y., Tang, X., Zhang, T., Jiayang, C., Yao, Y., Gao, W., Hu, X., Qi, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.07521 · Cited by 61
Improving Abstractive Summarization of Legal Rulings through Textual Entailment
Feijo, D. D. V., & Moreira, V. P. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09305-4 · Cited by 59
(2020) · bepress Legal Repository · Cited by 54
Self-citationPile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
Henderson, P., Krass, M. S., Zheng, L., Guha, N., Manning, C. D., Jurafsky, D., & Ho, D. E. (2022) · arXiv · doi:10.48550/arxiv.2207.00220 · Cited by 49
Self-citationCapturing Failures of Large Language Models Via Human Cognitive Biases
Jones, E., & Steinhardt, J. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-0856 · Cited by 48
(2010) · Choice Reviews Online · doi:10.5860/choice.47-4801 · Cited by 48
Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation
Mündler, N., He, J., Jenko, S., & Vechev, M. (2023) · arXiv · doi:10.48550/arxiv.2305.15852 · Cited by 47
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities EmergencePreprint
Nay, J. J., Karamardian, D., Lawsky, S. B., Tao, W., Bhat, M., Jain, R., Lee, A. T., Choi, J. H., & Kasai, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4476325 · Cited by 46
Capturing Failures of Large Language Models via Human Cognitive Biases
Jones, E., & Steinhardt, J. (2022) · arXiv · doi:10.48550/arxiv.2202.12299 · Cited by 43 · cited 1×
“…(the tendency of an LLM to agree with a user’s preferences or beliefs, even when the LLM would reject the belief as wrong without the user’s prompting; Sharma et al., 2023; Wei et al., 2023) or general cognitive error (Tversky and Kahneman, 1974; Jones and Steinhardt, 2022; Suri et al., 2023).”
Chain-of-Verification Reduces Hallucination in Large Language Models
Dhuliawala, S., Komeili, M., Xu, J., Raileanu, R., Li, X., Celikyilmaz, A., & Weston, J. (2023) · arXiv · doi:10.48550/arxiv.2309.11495 · Cited by 42
How well do LLMs cite relevant medical references? An evaluation framework and analyses
Wu, K., Wu, E., Cassasola, A., Zhang, A., Wei, K., Nguyen, T., Riantawan, S., Riantawan, P. S., Ho, D. E., & Zou, J. (2024) · arXiv · doi:10.48550/arxiv.2402.02008 · Cited by 41
Self-citationThe 1998 Year-End Report of the Federal Judiciary
Rehnquist, W. H. (1998) · Federal Sentencing Reporter · doi:10.2307/20640151 · Cited by 41
Don’t Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaboration
Feng, S., Shi, W., Wang, Y., Ding, W., Balachandran, V., & Tsvetkov, Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.786 · Cited by 40
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
Manakul, P., Liusie, A., & Gales, M. J. F. (2023) · arXiv · doi:10.48550/arxiv.2303.08896 · Cited by 38
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
Nay, J. J., Karamardian, D., Lawsky, S. B., Tao, W., Bhat, M., Jain, R., Lee, A. T., Choi, J. H., & Kasai, J. (2023) · arXiv · doi:10.48550/arxiv.2306.07075 · Cited by 38
Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation
Lucas, J., Uchendu, A., Yamashita, M., Lee, J., Rohatgi, S., & Lee, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.883 · Cited by 37
Do Language Models Know When They’re Hallucinating References?
Agrawal, A., Suzgun, M., Mackey, L., & Kalai, A. T. (2023) · arXiv · doi:10.48550/arxiv.2305.18248 · Cited by 37
Do Language Models Know When They’re Hallucinating References?
Agrawal, A., Suzgun, M., Mackey, L., & Kalai, A. (2024) · Findings of the Association for Computational Linguistics: EACL 2024 · doi:10.18653/v1/2024.findings-eacl.62 · Cited by 37
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29
Chern, I.-C., Chern, S., Chen, S., Yuan, W., Feng, K., Zhou, C., He, J., Neubig, G., & Liu, P. (2023) · arXiv · doi:10.48550/arxiv.2307.13528 · Cited by 29
The Privacy-Bias Tradeoff: Data Minimization and Racial Disparity Assessments in U.S. Government
King, J., Ho, D. E., Gupta, A., Wu, V. Y., & Webley-Brown, H. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594015 · Cited by 29
Self-citationTrozze, A., Davies, T., & Kleinberg, B. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-024-09399-6 · Cited by 29
Simple synthetic data reduces sycophancy in large language models
Wei, J., Huang, D., Lu, Y., Zhou, D., & Le, Q. V. (2023) · arXiv · doi:10.48550/arxiv.2308.03958 · Cited by 28
R-Tuning: Instructing Large Language Models to Say ‘I Don’t Know’
Zhang, H., Diao, S., Lin, Y., Fung, Y., Lian, Q., Wang, X., Chen, Y., Ji, H., & Zhang, T. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.394 · Cited by 28
How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization?
Deroy, A., Ghosh, K., & Ghosh, S. (2023) · arXiv · doi:10.48550/arxiv.2306.01248 · Cited by 27 · cited 1×
“…al., 2023), but the problem of legal hallucination has so far only been studied in closed-domain applications, e.g., where a model is used to summarize the content of a given judicial opinion (Deroy et al., 2023; Feijo and Moreira, 2023) or to synthesize provided legal text (Savelka et al., 2023).”
How Technology Is (or Is Not) Transforming Law Firms
Rodgers, I., Armour, J., & Sako, M. (2023) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-111522-074716 · Cited by 23
Creel, K., & Hellman, D. S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445942 · Cited by 22
Where's the Liability in Harmful AI Speech?Preprint
Henderson, P., Hashimoto, T., & Lemley, M. A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.04635 · Cited by 22
eyecite: A tool for parsing legal citations
Cushman, J., Dahl, M., & Lissner, M. (2021) · The Journal of Open Source Software · doi:10.21105/joss.03617 · Cited by 21 · cited 2×
“We test for citation equality using eyecite (Cushman et al., 2021).”
Self-citationAdministering Artificial IntelligencePreprint
Solow-Niederman, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3495725 · Cited by 20
Do Large Language Models Show Decision Heuristics Similar to Humans? A Case Study Using GPT-3.5Preprint
Suri, G., Slater, L. R., Ziaee, A., & Nguyen, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4440608 · Cited by 20
Where's the Liability in Harmful AI Speech?Preprint
Lemley, M. A., Henderson, P., & Hashimoto, T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4531029 · Cited by 20
Ben‐Shahar, O. (2023) · The Journal of Legal Analysis · doi:10.1093/jla/laad008 · Cited by 18
Explaining Legal Concepts with Augmented Large Language Models (GPT-4)
Savelka, J., Ashley, K. D., Gray, M. A., Westermann, H., & Xu, H. (2023) · arXiv · doi:10.48550/arxiv.2306.09525 · Cited by 18 · cited 2×
“…al., 2023), but the problem of legal hallucination has so far only been studied in closed-domain applications, e.g., where a model is used to summarize the content of a given judicial opinion (Deroy et al., 2023; Feijo and Moreira, 2023) or to synthesize provided legal text (Savelka et al., 2023).”
Translating Legalese: Enhancing Public Understanding of Court Opinions with Legal Summarizers
Ash, E., Kesari, A., Naidu, S., Song, L., & Stammbach, D. (2024) · ACM Symposium on Computer Science and Law (CSLAW) · doi:10.1145/3614407.3643700 · Cited by 17
Engel, C., & Grgić-Hlača, N. (2021) · Journal of Legal Analysis · doi:10.1093/jla/laab001 · Cited by 16
Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization
Cao, M., Dong, Y., & Cheung, J. C. K. (2021) · arXiv · doi:10.48550/arxiv.2109.09784 · Cited by 16
Fine-tuning Language Models for Factuality
Tian, K., Mitchell, E., Yao, H., Manning, C. D., & Finn, C. (2023) · arXiv · doi:10.48550/arxiv.2311.08401 · Cited by 14 · cited 1×
“Even more importantly, if an LLM knew when it was likely to be hallucinat-ing, the hallucination problem could be in principle solvable through some form of reinforcement learning from human feedback (RLHF) or fine-tuning, with unconfident answers simply being suppressed (Tian et al., 2023a).”
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P. W., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · arXiv · doi:10.48550/arxiv.2305.14251 · Cited by 14
Razumovskaia, E., Vulić, I., Marković, P., Cichy, T., Zheng, Q., Wen, T.-H., & Budzianowski, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.09800 · Cited by 14
Large Language Models in Cryptocurrency Securities Cases: Can ChatGPT Replace Lawyers?Preprint
Trozze, A., Davies, T. P., & Kleinberg, B. (2023) · arXiv.org · doi:10.48550/arxiv.2308.06032 · Cited by 13 · cited 2×
“…research and analysis tasks (Blair-Stanek et al., 2023; Choi et al., 2022; Fei et al., 2023; Guha et al., 2023; Nay et al., 2023; OpenAI, 2023a; Trozze et al., 2023), but the problem of legal hallucination has so far only been studied in closed-domain applications, e.g., where a model is used…”
The Pitfalls of Defining Hallucination
Deemter, K. V. (2024) · Computational Linguistics · doi:10.1162/coli_a_00509 · Cited by 13
Language Model Interpretability and Empirical Legal Studies
Livermore, M. A., Herron, F., & Rockmore, D. N. (2024) · Journal of Institutional and Theoretical Economics · doi:10.1628/jite-2024-0009 · Cited by 11
Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations
Lei, D., Li, Y., Hu, M., Wang, M., Yun, V., Ching, E., & Kamal, E. (2023) · arXiv · doi:10.48550/arxiv.2310.03951 · Cited by 10
Large Libel Models? Liability for AI Output
Volokh, E. (2023) · eScholarship (California Digital Library) · Cited by 9
R-Tuning: Instructing Large Language Models to Say `I Don't Know'Preprint
Zhang, H., Diao, S., Lin, Y., Fung, Y. R., Lian, Q., Wang, X., Chen, Y., Ji, H., & Zhang, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.09677 · Cited by 7
Razumovskaia, E., Vulić, I., Marković, P., Cichy, T., Zheng, Q., Wen, T.-H., & Budzianowski, P. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.998 · Cited by 7
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Shi, W., Han, X., Lewis, M., Tsvetkov, Y., Zettlemoyer, L., & Yih, S. W.-T. (2023) · arXiv · doi:10.48550/arxiv.2305.14739 · Cited by 6
Tian, K., Mitchell, E., Zhou, A., Sharma, A., Rafailov, R., Yao, H., Finn, C., & Manning, C. D. (2023) · arXiv · doi:10.48550/arxiv.2305.14975 · Cited by 5
Comparing Hallucination Detection Metrics for Multilingual Generation
Kang, H., Blevins, T., & Zettlemoyer, L. (2024) · arXiv · doi:10.48550/arxiv.2402.10496 · Cited by 3
Ben‐Shahar, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4486471
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
Guha, N., Nyarko, J., Ho, D., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1915
Self-citationAlgorithmic Harm in Consumer Markets
Bar-Gill, O., Sunstein, C. R., & Talgam-Cohen, I. (2023) · doi:10.2139/ssrn.4321763
Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection
Xu, W., Agrawal, S., Briakou, E., Martindale, M. J., & Carpuat, M. (2023) · arXiv · doi:10.48550/arxiv.2301.07779
Entailment as Few-Shot Learner
Wang, S., Fang, H., Khabsa, M., Mao, H., & Ma, H. (2021) · arXiv · doi:10.48550/arxiv.2104.14690
Research works printed but not linked: 8
- Ambrogi, 2023, As Allen & Overy Deploys GPT-based Legal App Harvey Firmwide, Founders Say Other Firms Will Soon Follow, LawSites
- Chien, 2024, How Generative AI Can Help Address the Access to Justice Gap Through the Courts, Loyola Los Angeles Law Rev.
- Draper, 2023, The Potential for Jurisdictional Challenges to AI or LLM Training Datasets
- Dworkin, 1986, Law’s Empire
- Mayson, 2019, Bias In, Bias Out, Yale Law J., 128, 2122
- Romoser, 2023, No, Ruth Bader Ginsburg Did Not Dissent in Obergefell — and Other Things ChatGPT Gets Wrong about the Supreme Court, SCOTUSblog
- Simshaw, 2022, Access to A.I. Justice: Avoiding an Inequitable Two-Tiered System of Legal Services, Yale J. Law Technol., 24, 150
- Weiser, 2023, Here’s What Happens When Your Lawyer Uses ChatGPT, New York Times
Cited by
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · arXiv · doi:10.48550/arxiv.2505.10468 · Cited by 295
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 671
“In high-stake domains such as legal consultation or scientific research, these hallucinations can lead to severe misjudgments and erode user trust [190,191].”
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186
Hallucination‐Free? Assessing the Reliability of Leading AI Legal Research Tools
Magesh, V., Surani, F., Dahl, M., Suzgun, M., Manning, C. D., & Ho, D. E. (2025) · Journal of Empirical Legal Studies · doi:10.1111/jels.12413 · Cited by 182
Self-citationGenerative AI in EU law: Liability, privacy, intellectual property, and cybersecurity
Novelli, C., Casolari, F., Hacker, P., Spedicato, G., & Floridi, L. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.106066 · Cited by 124
Metadata
- Authors
- Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E.
- Affiliations
- Yale University (US)
- Stanford University (US)
- Corresponding author
- Dahl, Matthew
- Venue
- Journal of Legal Analysis
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-01-01
- Volume
- 16
- Issue
- 1
- Pages
- 64-93
- ISSN
- 1946-5319 (ISSN-L)
- 2161-7201
- OpenAlex
- W4400047099
- Cited by
- 559
- References
- 158
- Citations by year
- 2026: 355 · 2025: 148 · 2024: 55
- FWCI
- 677.59
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- The Journal of Legal Analysis (publishedVersion, cc-by-nc)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Law › Artificial Intelligence in Law
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- large language models, ChatGPT, legal knowledge, legal reasoning, legal education, legal practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.