The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Detection of GPT-4 Generated Text in Higher Education: Combining Academic Judgement and Software to Identify Generative AI Tool Misuse
Open accessPublished version of a preprint
Abstract
This study explores the capability of academic staff assisted by the Turnitin Artificial Intelligence (AI) detection tool to identify the use of AI-generated content in university assessments. 22 different experimental submissions were produced using Open AI’s ChatGPT tool, with prompting techniques used to reduce the likelihood of AI detectors identifying AI-generated content. These submissions were marked by 15 academic staff members alongside genuine student submissions. Although the AI detection tool identified 91% of the experimental submissions as containing AI-generated content, only 54.8% of the content was identified as AI-generated, underscoring the challenges of detecting AI content when advanced prompting techniques are used. When academic staff members marked the experimental submissions, only 54.5% were reported to the academic misconduct process, emphasising the need for greater awareness of how the results of AI detectors may be interpreted. Similar performance in grades was obtained between student submissions and AI-generated content (AI mean grade: 52.3, Student mean grade: 54.4), showing the capabilities of AI tools in producing human-like responses in real-life assessment situations. Recommendations include adjusting the overall strategies for assessing university students in light of the availability of new Generative AI tools. This may include reducing the overall reliance on assessments where AI tools may be used to mimic human writing, or by using AI-inclusive assessments. Comprehensive training must be provided for both academic staff and students so that academic integrity may be preserved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The integration of AI in text generation risks undermining students' analytical and writing skills, complicating the assessment process, and directly impacts teaching, writing, and research objectives (Perkins et al. 2024).”
From Addressing student non-compliance in AI use declarations: implications for academic integrity and assessment in higher education (2025) · cites this paper as Perkins et al. 2024
In the citing paper
“Although a large body of studies have demonstrated that people struggle to discriminate between human and machine generated texts when passively reading them [25,30,40]”
From People cannot distinguish GPT-4 from a human in a Turing test (2025) · cites this paper as [40]
In the citing paper
“Most current governance measures remain focused on behavioral norm declarations (Prifti & Fosch-Villaronga, 2024), the enhancement of detection tools (Perkins et al., 2023), and case-based corrective actions (Pudasaini et al., 2024), which are essentially 'peripheral patchwork' responses.”
From The Attention Mismatch: Mapping the Structural Academic Governance Deficit in the Age of Generative AI (2026) · cites this paper as Perkins et al., 2023
In the citing paper
“Perkins et al. (2024) demonstrate that relatively simple manipulations can significantly degrade the accuracy of AI-text detectors, with implications for inclusivity and the risk of false accusation.”
From From Cognitive Necessity to Cognitive Choice: Higher Education Assessment and Learning in the Age of Generative AI (2026) · cites this paper as Perkins et al., 2024
In the citing paper
“AI-text detectors are prone to false positives and can be easily circumvented, raising concerns about fairness, inclusivity, and trust (Perkins et al., 2024)”
From From Cognitive Necessity to Cognitive Choice: Higher Education Assessment and Learning in the Age of Generative AI (2026) · cites this paper as Perkins et al., 2024
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
1 retracted
Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models
Zhang, S. J., Florin, S., Lee, A. N., Niknafs, E., Marginean, A., Wang, A., Tyser, K., Chin, Z., Hicke, Y., Singh, N., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.08997 · Cited by 19
RetractedVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1×
“…there are multiple benefits to the use of LLMs, including assisting Non-Native English Speakers (NNES) with structured academic writing (Roe et al., 2023), supporting personalised learning (Kasneci et al., 2023), and providing formative feedback for students (Baidoo-Anu & Owusu Ansah, 2023).”
BAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004 · cited 1×
“…there are multiple benefits to the use of LLMs, including assisting Non-Native English Speakers (NNES) with structured academic writing (Roe et al., 2023), supporting personalised learning (Kasneci et al., 2023), and providing formative feedback for students (Baidoo-Anu & Owusu Ansah, 2023).”
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806 · cited 3×
“This advancement in AI has sparked serious ethical concerns related to the potential misrepresentation of authorship and authenticity of academic work (Cotton et al., 2023 ; Perkins, 2023; Rahman & Watanobe, 2023 ; Rodgers et al., 2023 ; Rudolph et al., 2023).”
Research works printed but not linked: 3
- Kirchenbauer, J., Geiping, J., Wen, Y., Katz, J., Miers, I., & Goldstein, T. (2023). A watermark for large language models (arXiv:2301.10226). arXiv. http://arxiv.org/abs/2301.10226 · arXiv
- Kumar, R., Mindzak, M., Eaton, S. E., & Morrison, R. (2022). AI & AI: Exploring the contemporary intersections of artificial intelligence and academic integrity. Canadian Society for the Study of Higher Education Annual Conference, Online. Werklund School of Education. https://tinyurl.com/ycknz8fd.
- OpenAI (2023a). GPT-4 Technical Report (arXiv:2303.08774). arXiv. http://arxiv.org/abs/2303.08774. · arXiv
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Perkins, M., Furze, L., Roe, J., & MacVaugh, J. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/q3azde36 · Cited by 291
Self-citationBatista, J., Mesquita, A., & Carnaz, G. (2024) · Information · doi:10.3390/info15110676 · Cited by 256
Generative AI in Higher Education: The ChatGPT Effect
Chan, C. K. Y., & Colloton, T. (2024) · Routledge · doi:10.4324/9781003459026 · Cited by 203
Khlaif, Z. N., Ayyoub, A., Hamamra, B., Bensalem, E., Mitwally, M. A. A., Ayyoub, A., Hattab, M. K., & Shadid, F. (2024) · Education Sciences · doi:10.3390/educsci14101090 · Cited by 177
Metadata
- Authors
- Perkins, M., Roe, J., Postma, D., McGaughran, J., & Hickerson, D.
- Affiliations
- British University Vietnam (VN)
- James Cook University Singapore (SG)
- Corresponding author
- Perkins, Mike
- Venue
- Journal of Academic Ethics
- Published
- 2023-10-31
- Volume
- 22
- Issue
- 1
- Pages
- 89-113
- ISSN
- 1570-1727 (ISSN-L)
- 1572-8544
- OpenAlex
- W4388108480
- Semantic Scholar
- 496dab67b98785b46867173f0d777eaa9a32ca9c
- Cited by
- 234
- References
- 51
- Citations by year
- 2026: 94 · 2025: 82 · 2024: 49 · 2023: 9
- FWCI
- 58.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Journal of Academic Ethics (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- ResearchOnline at James Cook University (James Cook University) (submittedVersion)
- Durham Research Online (Durham University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Keywords
- generative AI detection, AI-generated text, academic integrity, academic misconduct, university evaluation, ChatGPT, prompting techniques, higher education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Detection of GPT-4 Generated Text in Higher Education: Combining Academic Judgement and Software to Identify Generative AI Tool Misuse. https://app.cochat.ai/papers/10.1007/s10805-023-09492-6
- The paper
- Perkins, M., Roe, J., Postma, D., McGaughran, J., & Hickerson, D. (2024). Detection of GPT-4 Generated Text in Higher Education: Combining Academic Judgement and Software to Identify Generative AI Tool Misuse. Journal of Academic Ethics. https://doi.org/10.1007/s10805-023-09492-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.