Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.

Survey on AI-Generated Plagiarism Detection: The Impact of Large Language Models on Academic Integrity

Open access
Pudasaini, Shushanta, Miralles-Pechuán, Luis, Lillis, David, Llorens Salvador, Marisa · 2025 · Journal of Academic Ethics

Abstract

A survey conducted in 2023 surveyed 3,017 high school and college students. It found that almost one-third of them confessed to using ChatGPT for assistance with their homework. The rise of Large Language Models (LLMs) such as ChatGPT and Gemini has led to a surge in academic misconduct. Students can now complete their assignments and exams just by asking an LLM for solutions to the given problem, without putting in the effort required for learning. And, what is more worrying, educators do not have the proper tools to detect it. The more advanced AI tools become, the more human-like text they generate, and the more difficult they are to detect. Additionally, some educators find it difficult to adapt their teaching and assessment methods to avoid plagiarism. This paper is focused on how LLMs and AI-Generated Content (AIGC) have affected education. It first shows the relationship between LLMs and academic dishonesty. Then, it reviews state-of-the-art solutions for preventing academic plagiarism in detail, including a survey of the main datasets, algorithms, tools, and evasion strategies for plagiarism detection. Lastly, it identifies gaps in existing solutions and presents potential long-term solutions based on AI tools and educational approaches to address plagiarism in an ever-changing world.

Overview

Integrity signals

Registry

Crossref · 10.1007/s10805-024-09576-x

Cites

95 of 95 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 72 references

Research works printed but not linked: 29

  1. Abd-Elaal, E.-S., Gamage, S., Mills, J. E., et al. (2019). Artificial intelligence is a tool for cheating academic integrity. In 30th annual conference for the australasian association for engineering education (aaee 2019): Educators becoming agents of change: Innovate, integrate, motivate (pp. 397–403).
  2. Abdelhamid, M., Azouaou, F., & Batata, S. (2022). A survey of plagiarism detection systems: Case of use with english, french, and arabic languages. arXiv Preprint. Available at arxiv:2201.03423 · arXiv
  3. Alzahrani, S. (2015). Arabic plagiarism detection using word correlation in n-grams with k-overlapping approach. In Proceedings of the Workshops at the 7th Forum for Information Retrieval Evaluation (FIRE) (pp. 123–125).
  4. Bao, G., Zhao, Y., Teng, Z., Yang, L., & Zhang, Y. (2023). Fast-detectgpt: Efficient zero-shot detection of machine-generated text via conditional probability curvature. arXiv preprint[SPACE]arXiv:2310.05130 · arXiv
  5. Chelba, C., Norouzi, M., & Bengio, S. (2017). N-gram language modeling using recurrent neural networks estimation. Retrieved from https://arxiv.org/pdf/1703.10724.pdf · arXiv
  6. Chitra, A., & Rajkumar, A. (2016). Plagiarism detection using machine learning-based paraphrase recognizer. Journal of Intelligent Systems, 25(3), 351–359. https://doi.org/10.1515/jisys-2016-0025 · doi:10.1515/jisys-2016-0025
  7. Chui, H. C. (2024). Chatgpt as a tool for developing paraphrasing skills among esl learners. Retrieved from https://www.researchgate.net/publication/375799764_ChatGPT_as_a_Tool_for_Developing_Paraphrasing_Skills_Among_ESL_Learners
  8. Elkhatat, A. M., Elsaid, K., & Almeer, S. (2021). Some students’ plagiarism tricks and tips for effective check. International Journal for Educational Integrity, 17, 1–12. https://doi.org/10.1007/s40979-021-00092-w · doi:10.1007/s40979-021-00092-w
  9. Ghosal, S. S., Chakraborty, S., Geiping, J., Huang, F., Manocha, D., & Bedi, A. S. (2023). Towards possibilities & impossibilities of ai-generated text detection: A survey. arXiv preprint[SPACE]arXiv:2310.15264 · arXiv
  10. Giboulot, E., & Teddy, F. (2024). Watermax: Breaking the llm watermark detectability-robustness-quality trade-off. arXiv preprint. Retrieved from arXiv:2403.04808 · arXiv
  11. Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., . . . Wu, Y. (2023). How close is chatgpt to human experts? comparison corpus, evaluation, and detection. arXiv Preprint. Available at arXiv:2301.07597 · arXiv
  12. Hans, A., Schwarzschild, A., Cherepanova, V., Kazemi, H., Saha, A., Goldblum, M., . . . Goldstein, T. (2024). Spotting llms with binoculars: Zero-shot detection of machine-generated text. arXiv preprint[SPACE]arXiv:2401.12070 · arXiv
  13. Herbold, S., Hautli-Janisz, A., Heuer, U., Kikteva, Z., & Trautsch, A. (2023). A largescale comparison of human-written versus chatgpt-generated essays. Scientific Reports, 13(1), 18617. https://doi.org/10.1038/s41598-023-41872-6 · doi:10.1038/s41598-023-41872-6
  14. Huo, M., Somayajula, S. A., Liang, Y., Zhang, R., Koushanfar, F., & Xie, P. (2024). Token-specific watermarking with enhanced detectability and semantic coherence for large language models. arXiv preprint. Retrieved from arXiv:2402.18059 · arXiv
  15. Kashnitsky, Y. (2022). Source code for the coling workshop competition “detecting automatically generated scientific papers”. https://github.com/Yorko/fake-papers-competition-data. GitHub repository. GitHub.
  16. Koupaee, M., & Wang, W. Y. (2018). Wikihow: A large-scale text summarization dataset. arXiv Preprint. Available at arXiv:1810.09305 · arXiv
  17. Lu, N., Liu, S., He, R., Wang, Q., Ong, Y.-S., & Tang, K. (2023). Large language models can be guided to evade ai-generated text detection. arXiv preprint arXiv:2305.10847 · arXiv
  18. Mao, C., Vondrick, C., Wang, H., & Yang, J. (2024). Raidar: Generative ai detection via rewriting. arXiv preprint[SPACE]arXiv:2401.12970 · arXiv
  19. Mosca, E., Szigeti, F., Tragianni, S., Gallagher, D., & Groh, G. (2022). Shap-based explanation methods: A review for nlp interpretability. In Proceedings of the 29th international conference on computational linguistics (pp. 4593–4603).
  20. Mphahlele, A., & McKenna, S. (2019). The use of turnitin in the higher education sector: Decoding the myth. Assessment & Evaluation in Higher Education, 44(7), 1079–1089. https://doi.org/10.1080/02602938.2018.1526767 · doi:10.1080/02602938.2018.1526767
  21. Nicks, C., Mitchell, E., Rafailov, R., Sharma, A., Manning, C. D., Finn, C., & Ermon, S. (2023). Language model detectors are easily optimized against. In The twelfth international conference on learning representations.
  22. Patel, A., Bakhtiyari, K., & Taghavi, M. (2011). Evaluation of cheating detection methods in academic writings. Library Hi Tech, 29(4), 623–640. https://doi.org/10.1108/07378831111189554 · doi:10.1108/07378831111189554
  23. Porter, J. (2023). Chatgpt continues to be one of the fastest-growing services ever. Retrieved from https://www.theverge.com/2023/11/6/23948386/chatgpt-active-user-count-openai-developer-conference
  24. Shijaku, R., & Canhasi, E. (2023). Chatgpt generated text detection. Publisher: Unpublished.
  25. Stokel-Walker, C. (2023b). Chatgpt listed as author on research papers: Many scientists disapprove. Retrieved from https://www.nature.com/articles/d41586-023-00107-z
  26. Turnitin. (2024). Turnitin celebrates 25 years in global academic integrity. Retrieved from https://www.turnitin.com/press/turnitin-celebrates-25-years-in-global-academic-integrity. Accessed 09 Aug 2024.
  27. Yang, X., Chen, K., Zhang, W., Liu, C., Qi, Y., Zhang, J., . . . Yu, N. (2023). Watermarking text generated by black-box language models. arXiv preprint. Retrieved from arXiv:2305.08883 · arXiv
  28. Yang, X. [Xianjun], Cheng, W., Petzold, L.,Wang, W. Y., & Chen, H. (2023). Dna-gpt: Divergent n-gram analysis for training-free detection of gpt-generated text. arXiv preprint. Retrieved from arXiv:2305.17359 · arXiv
  29. Zhao, X., Ananth, P., Li, L., & Wang, Y.-X. (2023). Provable robust watermarking for ai-generated text. arXiv preprint. Retrieved from arXiv:2306.17439 · arXiv

Cited by

See all 123

Metadata

Authors
Pudasaini, S., Miralles-Pechuán, L., Lillis, D., & Llorens Salvador, M.
Affiliations
  • Technological University Dublin (IE)
  • University College Dublin (IE)
Corresponding author
Pudasaini, Shushanta
Venue
Journal of Academic Ethics
Published
2024-11-04
Volume
23
Issue
3
Pages
1137-1170
ISSN
  • 1570-1727 (ISSN-L)
  • 1572-8544
OpenAlex
W4404051654
Cited by
70
References
72
Citations by year
2026: 34 · 2025: 35 · 2024: 1
FWCI
29.01
Type
journal article
Language
en
Open access
Licence
Locations
Journal of Academic Ethics (publishedVersion, cc-by)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Education › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
Keywords
large language models, ChatGPT, academic integrity, academic dishonesty, AI-generated content

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Survey on AI-Generated Plagiarism Detection: The Impact of Large Language Models on Academic Integrity. https://app.cochat.ai/papers/10.1007/s10805-024-09576-x
The paper
Pudasaini, S., Miralles-Pechuán, L., Lillis, D., & Llorens Salvador, M. (2025). Survey on AI-Generated Plagiarism Detection: The Impact of Large Language Models on Academic Integrity. Journal of Academic Ethics. https://doi.org/10.1007/s10805-024-09576-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.