Cited by 112Artificial Intelligence in EducationArtificial Intelligence in Healthcare and EducationEducational Technology and Pedagogy

The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index; 39 of the 69 sources its claims cite were checked for support.

A systematic review of the early impact of artificial intelligence on higher education curriculum, instruction, and assessment

Open access
Liang, Jingjing, Stephens, Jason M., Brown, Gavin T. L.·2025·Frontiers in Education

Abstract

Introduction: The emergence of generative artificial intelligence (AI) presents many opportunities and challenges to teaching and learning in higher education. However, compared to student- or administration-facing AI, little attention has been given to the impact of AI on faculty's perspective or their curriculum, instruction, and assessment (CIA) practices. Methods: To address this gap, we conducted a systematic review of articles published within the first nine months following the release of ChatGPT. After screening following PRISMA statement guidelines, our review yielded 33 studies that met the inclusion criteria. Results: Most of these studies (n = 17) were conducted in Asia, and simulation and modeling were the most frequently used methods (n = 15). Thematic analysis of the studies resulted in four themes about the impact of AI on CIA triad: (a) generation of new material, (b) reduction of staff workload, (c) automation/optimization of evaluation, and (d) challenges for CIA. Discussion: Overall, this review informs the promising contribution of AI to higher education CIA practices as well as the potential challenges and problems it introduces. Implications for future research and practices are proposed.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This systematic review synthesizes 33 empirical studies published in the first nine months after ChatGPT’s release on how AI affects higher education curriculum, instruction, and assessment (CIA). It finds early benefits in material generation, workload reduction, and assessment automation, alongside challenges around academic integrity, ethics, training, and curriculum integration.

Key findings

  • The review included 33 studies. Asia accounted for 17 of 33, predominantly China; Europe had 8, North America 5, Latin America 3, Middle East 2, and Australia 2. Modeling/simulation was the most frequent method (15), followed by experiment (7), interview (7), and survey (6).
  • Thematic analysis yielded four themes: (a) generation of new material, (b) reduction of staff workload, (c) automation/optimization of evaluation, and (d) challenges for CIA. Instruction was addressed in 21 studies (64%), assessment in 17 (52%), and curriculum in 9 (27%); only 11 studies integrated two or more CIA aspects, and only three attempted all three.
  • Reported benefits include AI-generated curriculum content and immersive learning environments, personalized instruction (e.g., teaching effect increased by 9.44% in one embedded-glasses study; piano teaching efficacy increased by 7.31%), workload reduction via virtual assistants, and automated assessment (e.g., one model correctly assigned 85% of students to at-risk/leader clusters; another rated teaching quality almost 7/10).
  • Challenges include uncertainty about integrating AI into curricula, concerns about instructors’ AI competencies and ethics, inadequate technical support/training, and assessment threats such as AI-assisted cheating and difficulty detecting AI-generated work.

Methods

  • Systematic review following PRISMA; searched Scopus, Web of Science, and EBSCOhost for peer-reviewed English journal articles published December 2022–August 2023. The search yielded 2,810 records; after deduplication, 279 were screened; 33 articles met inclusion criteria.
  • Inclusion required empirical analysis of AI’s relationship to one or more of higher education curriculum, instruction, or assessment; excluded non-HE contexts, non-empirical work, and broad AI perspectives.
  • Inductive thematic analysis (Braun & Clarke, 2006) produced 25 initial descriptive codes, merged into four themes; the first author extracted and coded data, and other authors reviewed coding and themes.

Limitations

  • Paper states: the review was limited to English-language articles, so generalizability to non-English contexts is cautioned; it was limited to the first 9 months after ChatGPT’s release (30 November 2022), making it preliminary and likely already superseded.
  • Paper-stated weaknesses of the reviewed literature: research is narrow and largely from WEIRD societies, with developing countries poorly represented; little research on real-world HE classroom pedagogical activities, course development, and assessment design; and a lack of crossdisciplinary collaboration between computer and social scientists.
  • Evident in the text: data extraction and coding were led by the first author, with other authors reviewing, and no independent duplicate coding of all included articles is described.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/feduc.2025.1522841

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

21 Not checked yet · 20 Partly supported · 18 Own interpretation · 18 Own result · 15 No full text of the sources · 13 Supported · 12 No basis given · 5 Sources not found · 5 Own method · 1 Mixed support · 1 Not supported · accuracy not yet measured

Show all 42 claims

  • Probably not a substantial claim. 55
  • It may state two separate claims as one. 51
  • The quote only partly states this claim. 3
87 of 87
  • The paper relies on this without support.

    The first nine months of literature could capture the critical early phase when educators and researchers started to publish responses to newly released AI tools such as ChatGPT.

    “The first 9 months of literature could capture the critical early phase, when educators and researchers started to publish their responses to newly released AI tools, such as ChatGPT.”
  • The authors state this as an assumption.

    Reading in an assessment should not be harder than that used in instruction.

    “on the assumption that reading in an assessment should not be harder than that used in instruction.”
  • The paper relies on this without support.

    Most academics have little understanding of how AI tools are designed and what large language models can do.

    “Most academics have little understanding of how AI tools are designed and what large language models can do.”
  • The paper relies on this without support.

    Currently AI cannot identify fabrication or error in the text that it assembles.

    “This is all the more important because currently AI cannot identify fabrication or error in the text that it assembles.”
  • The paper relies on this without support.

    AI is simply programming and thus not human.

    “While AI seems to be able to do many things, it is simply programming and thus not human.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Cited works that were retracted

Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.

3 of 3

Citations

Cites

3 retracted

Show all 53 references

Research works printed but not linked: 5

  1. Cuban, 2001, Oversold and Underused: Computers in the Classroom, 10.4159/9780674030107 · DOI
  2. Devi, 2023, Role of artificial intelligence (AI) in sustainable education of higher education institutions in Guwahati City: teacher's perception, Int. Manage. Rev., 111
  3. Patton, 2003, Qualitative evaluation checklist, Eval. Checkl. Proj., 21, 1
  4. Stahlschmidt, 2020, Comparison of web of science, scopus and dimensions databases, KB forschungspoolprojekt, 2020, 37
  5. Tang, 2023, Design and implementation of intelligent evaluation system based on pattern recognition for microteaching skills training, Int. J. Innov. Comput. Inf. Control, 19, 153, 10.24507/ijicic.19.01.153 · DOI

Cited by

Sorted by citations

Metadata

Authors
Liang, J., Stephens, J. M., & Brown, G. T. L.
Affiliations
University of Auckland (NZ)
Corresponding author
Liang, Jingjing
Venue
Frontiers in Education
Published
2025-04-25
Volume
10
ISSN
2504-284X (ISSN-L)
OpenAlex
W4409804936
Cited by
112
References
53
Citations by year
2026: 88 · 2025: 24
FWCI
13.90
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Education (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • ResearchSpace (University of Auckland) (submittedVersion, cc-by)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Educational Technology and Pedagogy
Keywords
generative AI, ChatGPT, higher education, course program, instruction, assessment, faculty perspectives, staff workload, automated assessment, AI-generated content, artificial intelligence in education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review