The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Science in the age of large language models
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One important related yet underexplored issue is that chatbots may overlook uncertainties, limitations, and nuances in original research by omitting qualifiers and oversimplifying text [11,12], leading to overgeneralizations, i.e. generalizations that are broader than those in the original text and that may therefore be unwarranted by the original findings.”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [11]
In the citing paper
“some systems are open in name only.”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [3]
In the citing paper
“Ubiquity and free availability are not equal to openness and transparency [3, 9, 21].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [3]
In the citing paper
“However, the specific question of whether LLMs accurately capture the generalizations of scientific research remains unexamined, leaving a critical knowledge gap regarding the societal risks of using LLMs for science summarization that has led several commentators to call for a systematic investigation [11].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [11]
In the citing paper
“However, when summarizing scientific texts, LLMs may omit details that limit the scope of research conclusions, leading to generalizations of results broader than warranted by the original study.”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [11]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Hybrid Corn: An Exploration in the Economics of Technological Change
Griliches, Z. (1957) · Econometrica · doi:10.2307/1905380 · Cited by 3,330
Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
Bender, E. M., & Koller, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.463 · Cited by 1,082
Can AI-Generated Text be Reliably Detected?
Sadasivan, V. S., Kumar, A., Balasubramanian, S., Wang, W., & Feizi, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11156 · Cited by 810
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
Self-citationExperience and Prediction. An Analysis of the Foundations and the Structure of Knowledge.
N., E., & Reichenbach, H. (1938) · The Journal of Philosophy · doi:10.2307/2017743 · Cited by 484
On scientific understanding with artificial intelligence
Krenn, M., Pollice, R., Guo, S. Y., Aldeghi, M., Cervera-Lierta, A., Friederich, P., dos Passos Gomes, G., Häse, F., Jinich, A., Nigam, A., et al. (2022) · Nature Reviews Physics · doi:10.1038/s42254-022-00518-3 · Cited by 372
In Conversation with Artificial Intelligence: Aligning language Models with Human Values
Kasirzadeh, A., & Gabriel, I. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00606-x · Cited by 127
Self-citationHow Nature readers are using ChatGPT
Owens, B. (2023) · Nature · doi:10.1038/d41586-023-00500-8 · Cited by 109
Cited by
Artificial intelligence and illusions of understanding in scientific research
Messeri, L., & Crockett, M. J. (2024) · Nature · doi:10.1038/s41586-024-07146-0 · Cited by 707
Security and Privacy Challenges of Large Language Models: A Survey
Das, B. C., Amini, M. H., & Wu, Y. (2025) · ACM Computing Surveys · doi:10.1145/3712001 · Cited by 445
Theodosiou, A. A., & Read, R. C. (2023) · Journal of Infection · doi:10.1016/j.jinf.2023.07.006 · Cited by 237
Larger and more instructable language models become less reliable
Zhou, L., Schellaert, W., Martínez-Plumed, F., Moros-Daval, Y., Ferri, C., & Hernández-Orallo, J. (2024) · Nature · doi:10.1038/s41586-024-07930-y · Cited by 203
How Interpretable Machine Learning Can Benefit Process Understanding in the Geosciences
Jiang, S., Sweet, L., Blougouras, G., Brenning, A., Li, W., Reichstein, M., Denzler, J., Shangguan, W., Yu, G., Huang, F., et al. (2024) · Earth's Future · doi:10.1029/2024ef004540 · Cited by 182
Metadata
- Authors
- Birhane, A., Kasirzadeh, A., Leslie, D., & Wachter, S.
- Affiliations
- Trinity College Dublin (IE)
- The Alan Turing Institute (GB)
- Queen Mary University of London (GB)
- University of Oxford (GB)
- Corresponding author
- Birhane, Abeba
- Kasirzadeh, Atoosa
- Leslie, David
- Wachter, Sandra
- Venue
- Nature Reviews Physics
- Published
- 2023-04-26
- Volume
- 5
- Issue
- 5
- Pages
- 277-280
- ISSN
- 2522-5820 (ISSN-L)
- OpenAlex
- W4367188881
- Cited by
- 344
- References
- 11
- Citations by year
- 2026: 72 · 2025: 109 · 2024: 127 · 2023: 36
- FWCI
- 70.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Physics (publishedVersion)
- Funders
- Alfred P. Sloan Foundation (g-2021-16779)
- Queen Mary University of London
- Wellcome Trust (223765/Z/21/Z)
- Alan Turing Institute
- Department of Health and Social Care
- University of Oxford
- University of Edinburgh
- Trinity College Dublin
- Mozilla Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, artificial intelligence in science, AI ethics, AI policy, AI risks, responsible AI use, public trust in science, scientific practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Science in the age of large language models. https://app.cochat.ai/papers/10.1038/s42254-023-00581-4
- The paper
- Birhane, A., Kasirzadeh, A., Leslie, D., & Wachter, S. (2023). Science in the age of large language models. Nature Reviews Physics. https://doi.org/10.1038/s42254-023-00581-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.