What ChatGPT and generative AI mean for science
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, there is not a clear pathway to implement and integrate generative AI in healthcare delivery.”
From Generative AI in healthcare: an implementation science informed translational path on application, integration and governance (2024) · cites this paper as [15]
In the citing paper
“Generative AI models often require significant computational power and resources for training and inference such as GPUs or cloud computing services [8, 15].”
From Generative AI in healthcare: an implementation science informed translational path on application, integration and governance (2024) · cites this paper as [15]
In the citing paper
“However, GenAI has raised concerns about developing trust in these artifacts, controlling their creation and managing their adoption [2,3].”
From Using Generative Artificial Intelligence Tools to Explain and Enhance Experiential Learning for Authentic Assessment (2024) · cites this paper as [3]
In the citing paper
“Among the specific application tools of GenAI, ChatGPT 3.5 (Chat Generative Pre-Trained Transformer) is the most famous because it was one of the first tools that were made free and easily accessible online [3].”
From Using Generative Artificial Intelligence Tools to Explain and Enhance Experiential Learning for Authentic Assessment (2024) · cites this paper as [3]
In the citing paper
“In health care practice and academic writing, factual inaccuracies, ethical issues, and the fear of misuse including the spread of misinformation should be considered [14,15,16].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [14]
17 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Improving alignment of dialogue agents via targeted human judgements
Glaese, A., McAleese, N., Trębacz, M., Aslanides, J., Firoiu, V., Ewalds, T., Rauh, M., Weidinger, L., Chadwick, M., Thacker, P., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.14375 · Cited by 134
(2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00613-9 · Cited by 64
A publishing infrastructure for AI-assisted academic authoring
Pividori, M., & Greene, C. S. (2023) · doi:10.1101/2023.01.21.525030 · Cited by 52
A publishing infrastructure for Artificial Intelligence (AI)-assisted academic authoring
Pividori, M., & Greene, C. S. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae139 · Cited by 50
Research works printed but not linked: 2
- GPT, Osmanovic Thunström, A. & Steingrimsson, S. Preprint at HAL https://hal.science/hal-03701250 (2022).
- Kirchenbauer, J. et al. Preprint at https://arxiv.org/abs/2301.10226 (2023). · arXiv
Cited by
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development
Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q.-L., & Tang, Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123618 · Cited by 1,452
“Till now, ChatGPT/GPT4 has shown promising performance as a general purpose multimodal task-solver [30], which has been widely used in the field of we-media, data analysis, etc.”
BackgroundA SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
“ChatGPT doesn’t have access to the Internet and currently has limited knowledge of world events after 2021 (Stokel-Walker & van Noorden, 2023).”
BackgroundThe future landscape of large language models in medicine
Clusmann, J., Kolbinger, F. R., Muti, H. S., Carrero, Z. I., Eckardt, J.-N., Laleh, N. G., Löffler, C. M. L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G. P., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00370-1 · Cited by 1,045
“However, while they have the potential to democratize access to scienti fi c evidence, they could result in misinformation and facilitate scienti fi c misconduct 44 – 46 .”
BackgroundLund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Metadata
- Authors
- Stokel-Walker, C., & Van Noorden, R.
- Venue
- Nature
- Published
- 2023-02-06
- Volume
- 614
- Issue
- 7947
- Pages
- 214-216
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W4319332853
- Semantic Scholar
- 5f996fd3592478b6923590ed5347d6206357e95a
- Cited by
- 828
- References
- 3
- Citations by year
- 2026: 122 · 2025: 191 · 2024: 267 · 2023: 245
- FWCI
- 77.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- ChatGPT, generative AI, artificial intelligence in science
- MeSH terms
- Algorithms, Artificial Intelligence, Science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What ChatGPT and generative AI mean for science. https://app.cochat.ai/papers/10.1038/d41586-023-00340-6
- The paper
- Stokel-Walker, C., & Van Noorden, R. (2023). What ChatGPT and generative AI mean for science. Nature. https://doi.org/10.1038/d41586-023-00340-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.