CoChat

ChatGPT for academic writing: A game changer or a disruptive tool?

Open access
Bhatia, Pradeep · 2023 · Journal of Anaesthesiology Clinical Pharmacology
Cited by 39

The DOI matches its Crossref record.

Abstract

ChatGPT (Chat Generative Pre-trained Transformer), launched recently by OpenAI, is a complex machine learning model that is able to carry out natural language generation (NLG) tasks with high accuracy. It generates human-like text, based on the inputs provided to it. The initial model of ChatGPT was trained on a huge amount of data from the internet, using supervised learning. Thereafter, the model was trained using reinforcement learning from human feedback, and subsequently, a reward model for reinforcement learning was created. ChatGPT can provide answers to questions, write fiction and non-fiction content from prompts, summarize a given text, and generate computer codes. It remembers what the user said earlier in the conversation, and can answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. ChatGPT produces very good-quality text and is a potentially attractive tool for writers due to its capacity to produce, in an instant, logical, coherent sounding text. Sometimes, it also writes plausible-sounding but incorrect or non-sensical answers. It may occasionally produce harmful instructions or biased content and has limited knowledge of the world and events after 2021.[1,2] Alternatives to ChatGPT include the upcoming artificial intelligence chatbot, called Bard, from Google. Researchers have found that ChatGPT can pass parts of the US medical licensing exam,[3] raising questions about whether the AI chatbot could one day help write the exam or help students prepare for it. Interestingly, when the researchers decided to publish the results, ChatGPT wrote the abstract and results sections with minimal prompting and largely cosmetic adjustments from the human co-authors.” The bot also contributed large sections to the introduction and methods sections. Artificial intelligence can assist in several aspects of scientific research reports. It can process and analyze large amounts of data, can help researchers perform a comprehensive literature review by searching and summarizing relevant papers and articles, can help optimize the design of experiments, and assist in the writing of reports. ChatGPT may help researchers, students, and educators generate ideas,[4] and even write essays of reasonable quality on a particular topic.[5] While ChatGPT can assist in many aspects of scientific research, there are several challenges and limitations with using AI for scientific research reports, including lack of transparency, quality control, ethical concerns, and amplification of existing biases in data and algorithms. It is still important to have human experts involved in the process to provide context, insights, and verification of results. ChatGPT may produce fraudulent literature. Fake scientific research reports generated by AI are misleading and fabricated and can be used for malicious purposes, such as manipulating scientific discourse or advancing personal agendas. The use of AI to generate fake scientific research reports is concerning as it can undermine the credibility and trust in scientific research and lead to incorrect or harmful decisions based on false information. Additionally, peer review may not distinguish ChatGPT-generated abstracts from those written by authors[6] as they may be designed to mimic the style and format of genuine reports. A group led by Catherine Gao at Northwestern University in Chicago used ChatGPT to generate artificial research paper abstracts to test whether scientists can spot them.[6] The ChatGPT-generated abstracts remained undetected by the plagiarism checker: the median originality score was 100%, indicating that no plagiarism was detected. The AI-output detector spotted 66% of the generated abstracts. However, human reviewers were no better. They correctly identified only 68% of the generated abstracts and 86% of the genuine abstracts. Several AI content detector tools are available to check if the text is written by AI/chatbots. Chatbots are not legal entities and do not have a legal personality. One cannot sue in court, or punish a chatbot in any way. ChatGPT’s creator OpenAI accepts no responsibility for any text produced using their product. Fake scientific reports and data fabrication are clearly unethical practices. However, it is foreseen that the use of ChatGPT (and similar tools) will be increasingly used by authors to assist them in text generation. Journals have published papers in which chatbots such as ChatGPT are shown as co-authors. The World Association of Medical Editors (WAME) has given the following recommendations on ChatGPT and Chatbots in relation to scholarly publications.[7] Chatbots cannot be authors Authors should be transparent when chatbots are used and provide information about how they were used. Authors are responsible for the work performed by a chatbot in their paper (including the accuracy of what is presented and the absence of plagiarism) and for acknowledging all sources (inclu

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.4103/joacp.joacp_84_23

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

See all 39

Metadata

Authors
Bhatia, P.
Venue
Journal of Anaesthesiology Clinical Pharmacology
Publisher
Medknow
Published
2023-01
Volume
39
Issue
1
Pages
1-2
ISSN
  • 0970-9185 (ISSN-L)
  • 2231-2730
OpenAlex
W4327886413
Cited by
39
References
0
FWCI
34.15
Type
journal article
Language
en
Open access
diamond

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ChatGPT for academic writing: A game changer or a disruptive tool? https://app.cochat.ai/papers/10.4103/joacp.joacp_84_23
The paper
Bhatia, P. (2023). ChatGPT for academic writing: A game changer or a disruptive tool? Journal of Anaesthesiology Clinical Pharmacology. https://doi.org/10.4103/joacp.joacp_84_23

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.