The Problem with False Positives: AI Detection Unfairly Accuses Scholars of AI Plagiarism
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
By examining the experiences of scholars from various institutions around the globe, this paper looks into how AI detection tools, which are meant to keep academic integrity intact, may backfire by unfairly accusing scholars of AI plagiarism. This paper shows that false positives disproportionately affect non-native English speakers and scholars with distinctive writing styles. This results in unwarranted accusations that may cause significant harm to their academic careers. Identified also in this paper are several critical issues with current AI detection tools, including algorithmic biases, vulnerabilities to manipulation, and a lack of understanding of context. These shortcomings not only make AI detection tools less effective but also create a climate of anxiety and distrust within academic communities. While scholars are dedicated to maintaining integrity in their writing, AI detection tools may tarnish their reputations by labeling them as cheaters or frauds based on some flawed AI detection results. Therefore, institutions should set clear guidelines and limitations on how AI and AI detection may be used in scholarly work. Also, they should ensure that scholars remain transparent about any AI involvement by including declarations on how it contributed to their writing process. While AI detection tools have value, a healthy skepticism is needed due to the risk of false positives and other limitations. Indeed, AI detection should complement human decision-making, not replace it. This approach could help create a fairer academic environment that balances innovation with the integrity scholars strive for in their work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The tools most widely deployed in university assessment workflows are commercial platforms whose training data remain proprietary”
From ARE AI DETECTORS FAIR TO EFL LEARNERS? A LIBRARY RESEARCH ON DETECTION BIAS AND ACADEMIC INTEGRITY (2026) · cites this paper as Giray, 2024
In the citing paper
“the independent testing record shows that these platforms have not yet achieved the performance parity that experimental models demonstrate under controlled conditions”
From ARE AI DETECTORS FAIR TO EFL LEARNERS? A LIBRARY RESEARCH ON DETECTION BIAS AND ACADEMIC INTEGRITY (2026) · cites this paper as Giray, 2024
In the citing paper
“This disparity has been replicated across different detection platforms, linguistic populations, and testing conditions”
From ARE AI DETECTORS FAIR TO EFL LEARNERS? A LIBRARY RESEARCH ON DETECTION BIAS AND ACADEMIC INTEGRITY (2026) · cites this paper as Giray, 2024
In the citing paper
“The consequences of bias in AI-supported evaluation in high-stakes medical education settings include more than the interpretation of scores; they also impact the long-term opportunity structure for physicians [19, 20].”
From The impact of generative artificial intelligence tools on assessment equity for non-native English-speaking medical students: a systematic review (2026) · cites this paper as [20]
In the citing paper
“There is strong evidence of the potential bias against nonnative English writers (Giray 2024).”
From Guidance on the Use of Generative Artificial Intelligence for SPUR Authors, Reviewers, and Readers (2025) · cites this paper as Giray 2024
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Rodger, D., Mann, S. P., Earp, B., Savulescu, J., Bobier, C., & Blackshaw, B. P. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104461 · Cited by 64
“As there is no reliable way of detecting AI content, it is difficult for educators to allocate credit fairly (Pudasaini et al., 2024; Giray, 2024).”
Ittefaq, M., Zain, A., Arif, R., Taufiq, A., Khan, M. L., & Seo, H. (2025) · Journal of International Students · doi:10.32674/fnwdpn48 · Cited by 47
Kangwa, D., Msafiri, M. M., & Fute, A. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70109 · Cited by 22
Wu, C., Moorhouse, B. L., Wan, Y., & Wu, M. (2025) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2025.101612 · Cited by 51
Pratama, A. R. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2953 · Cited by 22
Metadata
- Authors
- Giray, L.
- Affiliations
- Mapúa University (PH)
- Corresponding author
- Giray, Louie
- ORCID
- Giray, Louie
- Venue
- The Serials Librarian
- Publisher
- Informa UK Limited
- Published
- 2024-07-03
- Volume
- 85
- Issue
- 5-6
- Pages
- 181-189
- ISSN
- 0361-526X (ISSN-L)
- 1541-1095
- OpenAlex
- W4405331273
- Semantic Scholar
- a2a783ce47ed826744eb525859c0e5ebdf294c30
- Cited by
- 60
- References
- 0
- Citations by year
- 2026: 41 · 2025: 19
- FWCI
- 24.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Serials Librarian (publishedVersion, public-domain)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- AI detection tools, false positives, academic integrity, algorithmic bias, non-native English speakers, writing style, academic reputation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Problem with False Positives: AI Detection Unfairly Accuses Scholars of AI Plagiarism. https://app.cochat.ai/papers/10.1080/0361526x.2024.2433256
- The paper
- Giray, L. (2024). The Problem with False Positives: AI Detection Unfairly Accuses Scholars of AI Plagiarism. The Serials Librarian. https://doi.org/10.1080/0361526x.2024.2433256
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.