Are AI detection and plagiarism similarity scores worthwhile in the age of ChatGPT and other Generative AI?
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Recent advancements in chatbots have provided students and academics with a new mode of how knowledge can be sourced and composed. Within a very short space of time, students and academics have flocked to use ChatGPT and other Generative Artificial Intelligence (GAI) platforms owing to their capable responses. Additionally, apart from the generative chatbots (such as ChatGPT and Gemini), AI writing tools for paraphrasing, summarising, and co-writing have also become capable and increasingly prevalent to such a degree that the public is spoilt for choice. Having conducted tests on popular chatbots and AI writing tools, it became clear that while programs like Turnitin are developing new algorithms to detect plagiarism and AI-generated content, the initial findings from this study suggest that this may be an increasingly difficult task. These tests were published on YouTube, and within a few weeks, the evidence garnered tens of thousands of views as students and educators seemed uncertain about the strengths, weaknesses, and legalities of these AI tools. What is clear is that we have passed the tipping point, and AI assistance is no longer just a grammar fixer. The implications of this are concerning and far-reaching, as plagiarism is already a significant problem in universities. This position paper reports on tests conducted using Turnitin software and AI writing tools such as ChatGPT and QuillBot. These real-world tests support the paper’s position that it is becoming increasingly difficult to determine what constitutes original work in a world of GAI. The aim of this article is to provide evidence that educators who rely on similarity checking and AI detectors in their current form may inadvertently be supporting plagiarism rather than reducing it. A new method of academic plagiarism detection is proposed, utilizing large language models to generate and track ideas, thereby serving as an idea database. The proposed method focuses on the "understanding" of the work rather than on text similarity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Yu, H. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e24289 · Cited by 225 · cited 2×
“In turn, many educators have embraced the presence of GAI by adapting their teaching approach to align with AI (Trust, Whalen & Mouza, 2023; Elbanna & Armstrong, 2024; Yu, 2024).”
BackgroundRetractedBaidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004 · cited 1×
“The ease of use that GAI exhibits makes it enticing and it is unsurprising that students worldwide have flocked to using ChatGPT and other similar platforms (Baidoo-Anu & Ansah, 2023).”
BackgroundCan AI-Generated Text be Reliably Detected?
Sadasivan, V. S., Kumar, A., Balasubramanian, S., Wang, W., & Feizi, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11156 · Cited by 810 · cited 1×
“Although the specific AI detection algorithms used by Turnitin are not publicly disclosed, the initial findings of this study align with Sadasivan et al .”
ResultGPT detectors are biased against non-native English writers
Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023) · Patterns · doi:10.1016/j.patter.2023.100779 · Cited by 673
A large-scale comparison of human-written versus ChatGPT-generated essays
Herbold, S., Hautli-Janisz, A., Heuer, U., Kikteva, Z., & Trautsch, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-45644-9 · Cited by 338
Evaluating Academic Answers Generated Using ChatGPT
Fergus, S., Botha, M., & Ostovar, M. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00087 · Cited by 300
Study and Analysis of Chat GPT and its Impact on Different Fields of Study
Kalla, D., Smith, N., Kuraku, S., & Samaah, F. (2023) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.5281/zenodo.7767674 · Cited by 284
Exploring the integration of ChatGPT in education: adapting for the future
Elbanna, S., & Armstrong, L. (2024) · Management & Sustainability: An Arab Review · doi:10.1108/msar-03-2023-0016 · Cited by 238
Bozkurt, A. (2023) · Zenodo · doi:10.5281/zenodo.7716416 · Cited by 224
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · doi:10.31234/osf.io/sdx3j · Cited by 202
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · Royal Society Open Science · doi:10.1098/rsos.230658 · Cited by 202
The toolbox for local and global plagiarism detection
Butakov, S., & Scherbinin, V. (2009) · Computers & Education · doi:10.1016/j.compedu.2008.12.001 · Cited by 79 · cited 1×
“…or proper citation, paraphrasing someone else's work without giving credit, interleaving and/or interweaving various sources together in the work without citation, or even providing proper citation but failing to change the wording sufficiently (Butakov & Scherbinin, 2009; Gregory & Leeman, 2021).”
Background
Cited by
Mulaudzi, L. V., & Hamilton, J. (2025) · Journal of Academic Ethics · doi:10.1007/s10805-025-09615-1 · Cited by 56
Generative AI governance in higher education: a case study from Africa
Thaldar, D., Botes, M., Badru, A., Chenia, H., Duma, S., Dlamini, S. B., Amin, N., Hugo, W., Govender, R., Bruce-Brand, J., et al. (2025) · Frontiers in Political Science · doi:10.3389/fpos.2025.1666661 · Cited by 40
(2025) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2025.8.1.20 · Cited by 7
AI Detection Tools: A Systematic Review of Empirical Evidence and Their Implications for Education
CANER, H. N. (2025) · Khazar Journal of Humanities and Social Sciences · doi:10.5782/2223-2621.1580 · Cited by 2
GİRAY, L., CANER, H. N., & AMOOZEGAR, A. (2026) · Journal of Narrative and Language Studies · doi:10.59045/nalans.2026.109
Metadata
- Authors
- Baron, P.
- Venue
- Scholarship of Teaching and Learning in the South
- Publisher
- University of Johannesburg
- Published
- 2024-09-02
- Volume
- 8
- Issue
- 2
- Pages
- 151-179
- ISSN
- 2523-1154 (ISSN-L)
- OpenAlex
- W4402205339
- Cited by
- 35
- References
- 12
- FWCI
- 14.03
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.