CoChat

What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature

Open access
Lo, Chung Kwan · 2023 · Education Sciences

The DOI matches its Crossref record; 74 of the 76 references it cites were found in a registry or an index.

Abstract

An artificial intelligence-based chatbot, ChatGPT, was launched in November 2022 and is capable of generating cohesive and informative human-like responses to user input. This rapid review of the literature aims to enrich our understanding of ChatGPT’s capabilities across subject domains, how it can be used in education, and potential issues raised by researchers during the first three months of its release (i.e., December 2022 to February 2023). A search of the relevant databases and Google Scholar yielded 50 articles for content analysis (i.e., open coding, axial coding, and selective coding). The findings of this review suggest that ChatGPT’s performance varied across subject domains, ranging from outstanding (e.g., economics) and satisfactory (e.g., programming) to unsatisfactory (e.g., mathematics). Although ChatGPT has the potential to serve as an assistant for instructors (e.g., to generate course materials and provide suggestions) and a virtual tutor for students (e.g., to answer questions and facilitate collaboration), there were challenges associated with its use (e.g., generating incorrect or fake information and bypassing plagiarism detectors). Immediate action should be taken to update the assessment methods and institutional policies in schools and universities. Instructor training and student education are also essential to respond to the impact of ChatGPT on the educational environment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/educsci13040410

Cites

74 of 76 references verified0 citation errors · 2 not checkable

Statistics

Figures

Figure 1 PRISMA flow diagram of article selection. Figure 1. PRISMA flow diagram of article selection.
Figure 1 PRISMA flow diagram of article selection. Figure 1. PRISMA flow diagram of article selection.CC-BY · From the PDF
Figure 2 Countries/locations of the included articles ( N = 50). Figure 2. Countries/locations of the included articles ( N = 50).
Figure 2 Countries/locations of the included articles ( N = 50). Figure 2. Countries/locations of the included articles ( N = 50).CC-BY · From the PDF
Figure 3 Publication sources of the included articles ( N = 50). Figure 3. Publication sources of the included articles ( N = 50).
Figure 3 Publication sources of the included articles ( N = 50). Figure 3. Publication sources of the included articles ( N = 50).CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

11 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 76 references

Research works printed but not linked: 7

  1. Creswell, J.W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, Pearson. [4th ed.].
  2. Geerling, W., Mateer, G.D., Wooten, J., and Damodaran, N. (2023). Is ChatGPT Smarter than a Student in Principles of Economics?. SSRN, 4356034.
  3. Marusenko, R. (2023, March 01). New Challenges in Assessing Students’ Knowledge: Chatbot ChatGPT and Real-Time Deepfakes. Available online: https://www.researchgate.net/profile/Roman-Marusenko/publication/368450665_New_challenges_in_assessing_students'_knowledge_chatbot_ChatGPT_and_real-time_deepfakes/links/63e815e8e2e1515b6b8bad02/New-challenges-in-assessing-students-knowledge-chatbot-ChatGPT-and-real-time-deepfakes.pdf.
  4. 2023, The Perception of Artificial Intelligence in Educational Contexts after the Launch of ChatGPT: Disruption or Panic?, Educ. Knowl. Soc., 24, 1
  5. (2023, March 10). SSRN. Available online: https://www.ssrn.com.
  6. (2023, March 10). arXiv. Available online: https://arxiv.org.
  7. (2023, March 10). ResearchGate. Available online: https://www.researchgate.net.

Cited by

Metadata

Authors
Lo, C. K.
Affiliations
Education University of Hong Kong (HK)
Corresponding author
Lo, Chung Kwan
Venue
Education Sciences
Publisher
MDPI AG
Published
2023-04-18
Volume
13
Issue
4
Pages
410
ISSN
2227-7102 (ISSN-L)
OpenAlex
W4366420437
Cited by
2,024
References
58
Citations by year
2026: 478 · 2025: 588 · 2024: 703 · 2023: 255
FWCI
475.47
Type
journal article
Language
en
Open access
Locations
  • Education Sciences (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
ChatGPT, large language models, artificial intelligence in education, chatbots, virtual tutors, instructor training, academic integrity, plagiarism detection, assessment methods, institutional policy, generative AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.