AI et al.: Machines Are About to Change Scientific Publishing Forever
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
A rtificial intelligence (AI)-powered text generation will change scientific publishing fundamentally.In the past year, multiple AI systems have showcased production of visual and textual content increasingly indistinguishable from human-generated work, creating almost overnight new possibilities for intellectual workers, and at the same time raising similarly potent concerns.While artists and journalists are more evidently at the forefront of this incipient revolution, it is not hard to imagine a researcher looking away from the frustratingly sparse draft of a research article and wondering: "Could a machine write it for me?" (Figure 1).This question might have passed for a flight of fancy until recently, as machine-generated scientific arguments were easily distinguishable from human output, and paper-generating software mainly highlighted the permeability of the peer-review process to nonsensical papers. 1 However, these technologies have progressed so rapidly that we have likely entered a new phase, one in which machine-generated text can be integrated in human-generated scientific articles in a seamless fashion.To help illustrate the point in concrete terms, let's directly ask one of the involved parties:Question: Can AI write a scientific paper?Answer in two paragraphs.ChatGPT's answer: Yes, AI can write a scientific paper.In fact, there are already AI systems that can write scientific papers by using advanced natural language processing techniques to analyze existing scientific literature and generate text that is similar to human-written scientific papers.This allows AI to quickly and efficiently generate a large amount of text based on a given topic or research area, which can be useful for researchers who want to quickly generate a draft of a paper or for organizations that need to produce a large number of papers on a particular topic.However, it is important to note that these AI-generated papers are typically not original research, but rather are based on existing research in a particular field.This means that they may not contain any new insights or findings, and are not likely to be published in academic journals.Additionally, the accuracy and validity of the information in the paper may not be as high as a human-written paper, so it is important for a human researcher to review and verify the information before it is published.This well-structured answer makes reasonable points on both the potential and limitations of its author.As we write, the "assisted-driving" approach suggested by ChatGPT (AI-
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Human-level play in the game of Diplomacy by combining language models with strategic reasoning
Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., et al. (2022) · Science · doi:10.1126/science.ade9097 · Cited by 241
Could AI help you to write your next paper?
Hutson, M. (2022) · Nature · doi:10.1038/d41586-022-03479-w · Cited by 236
Automatic Detection of Machine Generated Text: A Critical Survey
Jawahar, G., Abdul-Mageed, M., & Lakshmanan, V. S. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.208 · Cited by 156
Hundreds of gibberish papers still lurk in the scientific literature
Van Noorden, R. (2021) · Nature · doi:10.1038/d41586-021-01436-7 · Cited by 16
Cited by
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708
ChatGPT for (Finance) research: The Bananarama Conjecture
Dowling, M., & Lucey, B. (2023) · Finance Research Letters · doi:10.1016/j.frl.2023.103662 · Cited by 591
Dalalah, D., & Dalalah, O. M. A. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100822 · Cited by 218
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · doi:10.31234/osf.io/sdx3j · Cited by 202
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · Royal Society Open Science · doi:10.1098/rsos.230658 · Cited by 202
Metadata
- Authors
- Grimaldi, G., & Ehrler, B.
- Venue
- ACS Energy Letters
- Publisher
- American Chemical Society (ACS)
- Published
- 2023-01-04
- Volume
- 8
- Issue
- 1
- Pages
- 878-880
- ISSN
- 2380-8195 (ISSN-L)
- OpenAlex
- W4313592949
- Cited by
- 91
- References
- 5
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI et al.: Machines Are About to Change Scientific Publishing Forever. https://app.cochat.ai/papers/10.1021/acsenergylett.2c02828
- The paper
- Grimaldi, G., & Ehrler, B. (2023). AI et al.: Machines Are About to Change Scientific Publishing Forever. ACS Energy Letters. https://doi.org/10.1021/acsenergylett.2c02828
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.