Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education
Open accessPublished version of a preprint
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index; 127 of the 149 sources its claims cite were checked for support.
Abstract
The rapid rise of generative AI tools such as ChatGPT has prompted significant shifts in how higher education institutions approach academic integrity. Many universities have implemented AI detection tools like Turnitin AI, GPTZero, Copyleaks, and ZeroGPT to identify AI-generated content in student work. This qualitative evidence synthesis draws on peer-reviewed journal articles published between 2021 and 2024 to evaluate the effectiveness, limitations, and ethical implications of AI detection tools in academic settings. While AI detectors offer scalable solutions, they frequently produce false positives and lack transparency, especially for multilingual or non-native English speakers. Ethical concerns surrounding surveillance, consent, and fairness are central to the discussion. The review also highlights gaps in institutional policies, inconsistent enforcement, and limited faculty training. It calls for a shift away from punitive approaches toward AI-integrated pedagogies that emphasize ethical use, student support, and inclusive assessment design. Emerging innovations such as watermarking and hybrid detection systems are discussed, though implementation challenges persist. Overall, the findings suggest that while AI detection tools play a role in preserving academic standards, institutions must adopt balanced, transparent, and student-centered strategies that align with evolving digital realities and uphold academic integrity without compromising rights or equity.
Overview
CoChat Summary
TL;DR
This narrative literature review synthesizes 24 peer-reviewed studies (2021–2024) on AI detection tools in higher education, concluding that detectors are unreliable, frequently produce false positives (especially for non-native English speakers), and are often deployed without transparency or consent. The authors call for a shift from punitive detection toward AI-integrated pedagogy, inclusive assessment redesign, and clearer institutional policy.
Key findings
- Detection accuracy is inconsistent and degrades against newer models: detectors performed well on ChatGPT-3.5 output but poorly on GPT-4 output, and paraphrasing with DIPPER dropped DetectGPT accuracy from 70.3% to 4.6% at a fixed 1% false positive rate. In one evaluation of ten free tools against ChatGPT-3.5 content and its paraphrased versions, only five detected original AI content error-free, with accuracy ranging from 0% to 100%; Sapling and Undetectable AI showed 100% accuracy even after paraphrasing.
- False positives disproportionately threaten non-native English speakers and students using formal or polished prose; Turnitin advises against integrity decisions based solely on AI detection scores when the likelihood of AI authorship is under 40%.
- Human judgment is also weak: ESL instructors were only 33%–66% correct in identifying whether texts were student- or AI-written, and in an Oxford Old English poetry comparison, AI essays averaged 60.46 versus 63.57 for human essays (difference not statistically significant, p = 0.10), while Quillbot reached 95.59% detection accuracy.
- Ethical and procedural problems are pervasive: tools are typically deployed without informed consent or transparency, some retain student data indefinitely or train models on it, and 87% of surveyed students showed inadequate comprehension of AI misuse ramifications. Institutions lack standardized procedures, appeal mechanisms, and evidence standards.
Methods
- Design: narrative literature review, justified via interpretivist/subjectivist paradigms and methodological flexibility; appraised using SANRA criteria (six items, 0–2 each, total 12; original validation Cronbach's α = 0.68, ICC = 0.77) and documented with a PRISMA-ScR flow diagram.
- Data: peer-reviewed English-language articles published 2021–2024 from ERIC, EBSCOhost, and JSTOR, restricted to higher education settings and tool-specific content (Turnitin AI, GPTZero, Copyleaks, ZeroGPT, CrossPlag, OpenAI classifiers); the initial search yielded 128 records, with 24 studies included after screening.
- Analysis: qualitative thematic analysis yielding three inductively derived domains aligned to three research questions — institutional policy/implementation, detection accuracy and system performance, and ethical/pedagogical implications.
Limitations
- Stated by the authors: the narrative design lacks the systematic rigor and transparency of scoping/systematic reviews, is vulnerable to subjectivity and selective interpretation, and has limited reproducibility; database coverage excluded Scopus, Web of Science, IEEE, and institutional policy documents, reducing generalizability; no interrater validation or structured thematic coding was used; SANRA was used as a guiding framework without explicit scoring or comparative quality tables; the review covered only text-based detection, excluding code, audio, and multimedia; and no explicit theoretical frameworks (e.g., academic integrity theory, surveillance ethics, technology acceptance models) were applied, so the review should be regarded as exploratory rather than definitive.
- Evident from the text: several reported figures are drawn from secondary citations of other studies rather than independent testing by the authors, and the abstract and conclusions sections appear in the provided text in a fragmented, out-of-order form, with some sections (e.g., 1.2, 4.3.3, 5) split across multiple locations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
118 Valid · 8 Not valid · 20 Not checked · 41 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, existing contract cheating laws are insufficient to address the challenges posed by general-purpose AI tools, such as ChatGPT [12].”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 1.2. Assessing the Effectiveness of AI Detection Tools and Ethical Issues in Teaching and Practice
What the sources say
- Supportedcites [12] Gaumann, 2024, AI providers as criminal essay mills? Large language models meet contract cheating law, Inf. Commun. Technol. Law source
The Concluding remarks (pp. 48–49) say contract cheating law is not a good way to regulate general-purpose AI systems and that legislation needs updating to clarify boundaries and support effective enforcement. This supports the claim of insufficiency, although the paper also notes that existing laws already cover such systems on paper in some jurisdictions. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Non-native English students are most at risk for such mistakes because of the similarities in syntax and structure with AI-written language.”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 1.2. Assessing the Effectiveness of AI Detection Tools and Ethical Issues in Teaching and Practice
What the sources say
- Partly supportedcites [11] Ibrahim, 2023, Using AI-based detectors to control AI-assisted plagiarism in ESL writing: “The Terminator Versus the Machines”, Lang. Test. Asia sourceExperimental — accuracy not yet measured
The GPT Output Detector Demo results report that 16 of 120 human-written student essays received incorrectly low originality scores, supporting the possibility of mistaken flags. The paper does not compare non-native with native English students to establish who is most at risk, or attribute the errors to similarities in syntax and structure with AI-written text. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Students' real-world experiences, especially their struggles with unclear institutional guidelines on AI usage, remain underexplored and insufficiently documented [14].”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 1.3. Identifying Gaps in Existing Research and Rationale for Study
What the sources say
- Partly supportedcites [14] Waltzer, 2024, Can you spot the bot? Identifying AI-generated writing in college essays, Int. J. Educ. Integr. sourceExperimental — accuracy not yet measured
In “Attitudes toward AI in education” (page unavailable), the paper reports that some students wanted guidance on whether uses such as converting a document to MLA format would violate academic integrity. In “How AI-generated content poses challenges for educational assessment” (page unavailable), it says there is little empirical evidence about ChatGPT’s impact on education and best practices. It does not specifically establish that students’ real-world experiences with unclear institutional guidelines are underexplored or insufficiently documented. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The unilateral deployment of AI detection software could breach students' due process rights, especially in ESL situations where language usage could be similar to AI-produced writing [13].”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 1.2. Assessing the Effectiveness of AI Detection Tools and Ethical Issues in Teaching and Practice
What the sources say
- Partly supportedcites [13] Perkins, 2023, Academic Integrity considerations of AI Large Language Models in the post-pandemic era: Chatgpt and beyond, J. Univ. Teach. Learn. Pract. sourceExperimental — accuracy not yet measured
In “Technological methods of detection” (p. 15), the paper warns that detectors may incorrectly label EFL students’ writing as machine-written and that untested tools could lead to inadvertent misconduct accusations. It does not address unilateral deployment or students’ due process rights, nor does it explain the false positives as a similarity between ESL language usage and AI writing. (LLM, conf=0.86)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Notably, some tools yielded false positives by misclassifying human-written content as AI-generated [16].”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 1.3. Identifying Gaps in Existing Research and Rationale for Study
What the sources say
- Supportedcites [16] Elkhatat, 2023, Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text, Int. J. Educ. Integr. source
The Results report false positives on human-written control responses: WRITER classified Human 1 and Human 2 as “Likely AI-Generated,” and GPTZERO gave Human 2 the same classification. The Methodology defines that classification of human-generated content as a false positive. (LLM, conf=0.95)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
69 more claims · 50 with their cited sources checked
Create a free account to see all 187 claims and every source verdict.
- Borderline: one of the tests for a substantial claim is unclear. 1
- Probably not a substantial claim. 55
- It may state two separate claims as one. 76
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deep et al. (2025) find that detection accuracy for non-native speakers falls below acceptable thresholds for use in high-stakes academic decisions.”
From Harms and Ethical Risks of AI Detection Tools in Education: False Positives, Bias, Surveillance, and Student Rights (2026) · cites this paper as Deep et al. (2025)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Deep et al. (2025) further highlight the ethical implications of this dynamic, contending that AI detection tools, when employed as primary indicators of authorship, may inadvertently reward those who learn to circumvent them while disadvantaging students who engage in authentic scholarly work.”
From Harms and Ethical Risks of AI Detection Tools in Education: False Positives, Bias, Surveillance, and Student Rights (2026) · cites this paper as Deep et al. (2025)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > Criteria Inclusion Exclusion Rationale
“Articles published before 2021.”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 7. Conclusions
“| | Kaplan (2019) [7] | location-based; | scholars, and | historical | review/editorial | historical development of AI |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 4.2.1. Effectiveness and Shortcomings of Current AI Detection Tools
“A recent evaluation tested a series of AI content detection programs OpenAI, Writer, Copyleaks, GPTZero, and CrossPlag by looking at whether they could accurately distinguish content written by ChatGPT-3.5,ChatGPT-4, and human writers [25].”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > References
“25. Pan, W.H.; Chok, M.J.; Wong, J.L.S.; Shin, Y.X.; Poon, Y.S.; Yang, Z.; Chong, C.Y.; Lo, D.; Lim, M.K. Assessing AI detectors in identifying AI-generated code: Implications for education.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 7. Conclusions
“| 13 | Kar et al. (2025) | India | Academic | To assess how | Quantitative | Detection capability varied |”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > References
“18. Kar, S.K.; Bansal, T.; Modi, S.; Singh, A. How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools. Indian J. Psychol. Med. 2024, 47, 275-278. [CrossRef]”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 5. Limitations of Current Research
“In addition, the review focused on 24 studies addressing text-based detection tools.Emerging areas such as AI detection for code, audio, or multimedia assignments were beyond the scope, representing opportunities for future inquiry.”
§ Evaluating the Effectiveness and Ethical Implications of AI Detection Tools in Higher Education > 7. Conclusions
“| 18 | Pan et al. (2024) | Malaysia & | Higher education | To assess the | Empirical | AIGC detectors struggled to | | | [25] | Singapore | students | performance and | (Quantitative) | distinguish between AI-and | | | | | | limitations of | | human-written code. Most |”
Citations
Cites
SANRA—a scale for the quality assessment of narrative review articles
Baethge, C., Goldbeck-Wood, S., & Mertens, S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0064-8 · Cited by 3,469
Haenlein, M., & Kaplan, A. (2019) · California Management Review · doi:10.1177/0008125619864925 · Cited by 2,655
Narrative Reviews: Flexible, Rigorous, and Practical
Sukhera, J. (2022) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-22-00480.1 · Cited by 1,062
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839
Testing of detection tools for AI-generated text
Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S., Foltýnek, T., Guerrero-Dib, J., Popoola, O., Šigut, P., & Waddington, L. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00146-z · Cited by 582
Abbas, M., Jam, F. A., & Khan, T. I. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00444-7 · Cited by 531
Elkhatat, A. M., Elsaid, K., & Almeer, S. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00140-5 · Cited by 392
Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense
Krishna, K., Song, Y., Karpinska, M., Wieting, J., & Iyyer, M. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1195 · Cited by 150
Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense
Krishna, K., Song, Y., Karpinska, M., Wieting, J., & Iyyer, M. (2023) · arXiv · doi:10.48550/arxiv.2303.13408 · Cited by 150
Academic integrity in the age of Artificial Intelligence (AI) authoring apps
Yeo, M. A. (2023) · TESOL Journal · doi:10.1002/tesj.716 · Cited by 142
AI Chatbots in Education: Challenges and Opportunities
Davar, N. F., Dewan, M. A. A., & Zhang, X. (2025) · Information · doi:10.3390/info16030235 · Cited by 123
Al-Zahrani, A. M. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2271445 · Cited by 120
Alexander, K., Savvidou, C., & Alexander, C. (2023) · Teaching English With Technology · doi:10.56297/buka4060/xhld5365 · Cited by 101
Transforming Assessment: The Impacts and Implications of Large Language Models and Generative AI
Hao, J., von Davier, A. A., Yaneva, V., Lottridge, S., von Davier, M., & Harris, D. J. (2024) · Educational Measurement: Issues and Practice · doi:10.1111/emip.12602 · Cited by 93
Generative AI detection in higher education assessments
Ardito, C. G. (2025) · New Directions for Teaching and Learning · doi:10.1002/tl.20624 · Cited by 86
Nelson, A. S., Santamaría, P. V., Javens, J. S., & Ricaurte, M. (2025) · Education Sciences · doi:10.3390/educsci15050611 · Cited by 79
Linking artificial intelligence facilitated academic misconduct to existing prevention frameworks
Birks, D., & Clare, J. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00142-3 · Cited by 69
Ibrahim, K. (2023) · Language Testing in Asia · doi:10.1186/s40468-023-00260-2 · Cited by 66
Assessing AI Detectors in Identifying AI-Generated Code: Implications for Education
Pan, W. H., Chok, M. J., Wong, J. L. S., Shin, Y. X., Poon, Y. S., Yang, Z., Chong, C. Y., Lo, D., & Lim, M. K. (2024) · Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training · doi:10.1145/3639474.3640068 · Cited by 66
Revell, T., Yeadon, W., Cahilly-Bretzin, G., Clarke, I., Manning, G., Jones, J., Mulley, C., Pascual, R. J., Bradley, N., Thomas, D., et al. (2024) · International Journal for Educational Integrity · doi:10.1007/s40979-024-00161-8 · Cited by 51
Can you spot the bot? Identifying AI-generated writing in college essays
Waltzer, T., Pilegard, C., & Heyman, G. D. (2024) · International Journal for Educational Integrity · doi:10.1007/s40979-024-00158-3 · Cited by 49
Kar, S. K., Bansal, T., Modi, S., & Singh, A. (2025) · Indian Journal of Psychological Medicine · doi:10.1177/02537176241247934 · Cited by 49
Lund, B. D., Wang, T., Mannuru, N. R., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4389887 · Cited by 42
ChatGPT in ESL Higher Education: Enhancing Writing, Engagement, and Learning Outcomes
Deep, P. D., Martirosyan, N., Ghosh, N., & Rahaman, M. S. (2025) · doi:10.20944/preprints202503.1665.v1 · Cited by 30
Self-citationChatGPT in ESL Higher Education: Enhancing Writing, Engagement, and Learning Outcomes
(2025) · doi:10.3390/info16040316 · Cited by 30
AI providers as criminal essay mills? Large language models meet contract cheating law
Gaumann, N., & Veale, M. (2024) · Information & Communications Technology Law · doi:10.1080/13600834.2024.2352692 · Cited by 17
Admissions in the age of AI: detecting AI-generated application materials in higher education
Zhao, Y., Borelli, A., Martinez, F., Xue, H., & Weiss, G. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-77847-z · Cited by 16
Revell, T., Yeadon, W., Cahilly-Bretzin, G., Clarke, I., Manning, G. C., Jones, J., Mulley, C., Pascual, R., Bradley, N., Thomas, D., et al. (2023) · Research Square · doi:10.21203/rs.3.rs-3483059/v1 · Cited by 5
Towards AI-Generated Essay Classification Using Numerical Text Representation
Krawczyk, N., Probierz, B., & Kozak, J. (2024) · Applied Sciences · doi:10.3390/app14219795 · Cited by 4
Ibrahim, K. H. S. (2023) · Language Testing in Asia · doi:10.1186/s40468-023-00268-8 · Cited by 2
AI Chatbots in Education: Challenges and Opportunities
Davar, N. F., Dewan, M. A. A., & Zhang, X. (2024) · doi:10.20944/preprints202411.1286.v1
Linking artificial intelligence facilitated academic misconduct to existing prevention frameworks
Birks, D., & Clare, J. (2023) · doi:10.31235/osf.io/5cvs7
Cited by
Evaluating the accuracy and reliability of AI content detectors in academic contexts
Hadra, M., Cambridge, K., & Mesbah, M. (2026) · International Journal for Educational Integrity · doi:10.1007/s40979-026-00213-1 · Cited by 27
“Several recent evaluations reported inconsistent accuracy, high false-positive rates, and documented biases against non-native writers (Deep et al. 2025).”
Governing generative AI in higher education: a global Delphi study on policy and practice
Crompton, H., Burke, D., Nickel, C. E., Bozkurt, A., Miao, F., Sharples, M., Greene, J. A., Parsons, D., Gill-Simmen, L., Edmett, A., et al. (2026) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-026-00602-z · Cited by 56
“Corrobo-rating this view, extant literature (viz., Deep et al., 2025; Zhao et al., 2024) notes that early institutional responses to GenAI focused on plagiarism detection and prevention.”
Pérez-Pérez, I., González-Afonso, M. C., Plasencia-Carballo, Z., & Pérez-Jorge, D. (2026) · Computers · doi:10.3390/computers15020111 · Cited by 10
“In this context, a significant portion of recent literature examines how GenAI reshapes the conditions under which assessable work is produced, thereby challenging traditional foundations of grading and performance attribution [5–7].”
InfluentialAssurance by design: embedding the SAGE Defend step in AI-integrated higher education assessment
Elkhodr, M., & Gide, E. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1872630 · Cited by 2
Rethinking assessment integrity in the GenAI era: Making provenance the design principle
Hu, H., & Hashim, H. B. (2026) · Innovations in Education and Teaching International · doi:10.1080/14703297.2026.2628013 · Cited by 2
Metadata
- Authors
- Deep, P. D., Edgington, W. D., Ghosh, N., & Rahaman, M. S.
- Affiliations
- Sam Houston State University (US)
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2025-10-16
- Volume
- 16
- Issue
- 10
- Pages
- 905
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4415282254
- Cited by
- 26
- References
- 25
- Citations by year
- 2026: 26
- FWCI
- 26.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Information (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- AI detection tools, academic integrity, generative AI, higher education, AI-generated content, false positives, ethical implications, surveillance, student consent, fairness, institutional policy, faculty training, watermarking, multilingual learners, non-native English speakers, inclusive assessment, student-centered approach
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.