Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.

ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering

Open access

Abstract

More than a year has passed since reports of ChatGPT-3.5’s capability to pass exams sent shockwaves through education circles. These initial concerns led to a multi-institutional and multi-disciplinary study to assess the performance of Generative Artificial Intelligence (GenAI) against assessment tasks used across 10 engineering subjects, showcasing the capability of GenAI. Assessment types included online quiz, numerical, oral, visual, programming and writing (experimentation, project, reflection and critical thinking, and research). Twelve months later, the study was repeated using new and updated tools ChatGPT-4, Copilot, Gemini, SciSpace and Wolfram. The updated study investigated the performance and capability differences, identifying the best tool for each assessment type. The findings show that increased performance and features can only heighten academic integrity concerns. While cheating concerns are central, opportunities to integrate GenAI to enhance teaching and learning are possible. While each GenAI tool had specific strengths and weaknesses, ChatGPT-4 was well-rounded. A GenAI Assessment Security and Opportunity Matrix is presented to provide the community practical guidance on managing assessment integrity risks and integration opportunities to enhance learning.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/22054952.2024.2372154

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

2 retracted

Show all 61 references

Research works printed but not linked: 6

  1. Borsotti, V., A. Begel, and P. Bjorn. 2024. Neurodiversity and the Accessible University: Exploring Organizational Barriers.” In Proceedings of the ACM on Human-Computer Interaction. Vol. 8. Access Labor and Opportunities for Change.
  2. Chung, H.-H., F.-L. Chung, S.-M. Lin, and Y.-J. Lan. 2023. “Tools and Approaches of Generative Artificial Intelligence Used in Education.” 31st International Conference on Computers in Education, Japan.
  3. Daniel, S., and S. Nikolic. 2023. “Benchmarking AI Tools and Assessing Integrity: Assessment Integrity in the AI Age.” In SEFI Ethics SIG. Editorial. https://www.sefi.be/2023/10/14/benchmarking-ai-tools-and-assessing-integrity-assessment-integrity-in-the-ai-age/.
  4. Groch, S. 2024. “These Students Cheated on a Test and Got Away with It. Then the Blackmail Started.” Sydney Morning Herald. Accessed March 29, 2024. https://www.smh.com.au/education/these-students-cheated-on-a-test-and-got-away-with-it-then-the-blackmail-started-20240320-p5fe1x.html?btis=
  5. 10.1080/03043797.2023.2213169 · DOI · Paper page
  6. Purtill, J. 2023. “ChatGPT Was Tipped to Cause Widespread Cheating. Here’s What Students Say Happened.” ABC Australia. Accessed November 22, 2023. https://www.abc.net.au/news/science/2023-11-22/how-high-school-students-used-chatgpt-2023-education-cheating/103108620.

Cited by

See all 99

Metadata

Authors
Nikolic, S., Sandison, C., Haque, R., Daniel, S., Grundy, S., Belkina, M., Lyden, S., Hassan, G. M., & Neal, P.
Affiliations
  • University of Wollongong (AU)
  • University of the Sunshine Coast (AU)
  • University of Technology Sydney (AU)
  • UNSW Sydney (AU)
  • Western Sydney University (AU)
  • University of Tasmania (AU)
  • The University of Western Australia (AU)
Corresponding author
Nikolic, Sasha
Venue
Australasian Journal of Engineering Education
Published
2024-07-02
Volume
29
Issue
2
Pages
126-153
ISSN
  • 1324-5821 (ISSN-L)
  • 2205-4952
  • 1325-4340
OpenAlex
W4400530818
Cited by
98
References
61
Citations by year
2026: 36 · 2025: 53 · 2024: 9
FWCI
40.74
Type
journal article
Language
en
Open access
Locations
  • Australasian journal of engineering education (publishedVersion, cc-by-nc-nd)
  • OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion, other-oa)
  • Figshare (submittedVersion, cc-by)
  • UWA Profiles and Research Repository (UWA) (submittedVersion, cc-by-nc-nd)
  • UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
  • Figshare (cc-by)
Funders
Australian Council of Engineering Deans (ACED) and the Australasian Association of Engineering Education
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
generative AI, academic integrity, engineering education, assessment, ChatGPT-4, Copilot, Gemini, SciSpace, Wolfram Alpha, cheating, AI-assisted learning, assessment security

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering. https://app.cochat.ai/papers/10.1080/22054952.2024.2372154
The paper
Nikolic, S., Sandison, C., Haque, R., Daniel, S., Grundy, S., Belkina, M., Lyden, S., Hassan, G. M., & Neal, P. (2024). ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering. Australasian Journal of Engineering Education. https://doi.org/10.1080/22054952.2024.2372154

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.