The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Detection of fake papers in the era of artificial intelligence
Abstract
Objectives: Paper mills, companies that write scientific papers and gain acceptance for them, then sell authorships of these papers, present a key challenge in medicine and other healthcare fields. This challenge is becoming more acute with artificial intelligence (AI), where AI writes the manuscripts and then the paper mills sell the authorships of these papers. The aim of the current research is to provide a method for detecting fake papers. Methods: The method reported in this article uses a machine learning approach to create decision trees to identify fake papers. The data were collected from Web of Science and multiple journals in various fields. Results: The article presents a method to identify fake papers based on the results of decision trees. Use of this method in a case study indicated its effectiveness in identifying a fake paper. Conclusions: This method to identify fake papers is applicable for authors, editors, and publishers across fields to investigate a single paper or to conduct an analysis of a group of manuscripts. Clinicians and others can use this method to evaluate articles they find in a search to ensure they are not fake articles and instead report actual research that was peer reviewed prior to publication in a journal.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are already more sophisticated cases (Dadkhah et al., 2023) as well as cases involving fabricated images (Gu et al., 2022).”
From GPT-fabricated scientific papers on Google Scholar: Key features, spread, and implications for preempting evidence manipulation (2024) · cites this paper as Dadkhah et al., 2023
Citations
Cites
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842
Gravel, J., D’Amours-Gravel, M., & Osmanlliu, E. (2023) · Mayo Clinic Proceedings: Digital Health · doi:10.1016/j.mcpdig.2023.05.004 · Cited by 222
Threats to scholarly research integrity arising from paper mills: a rapid scoping review
Pérez-Neri, I., Pineda, C., & Sandoval, H. (2022) · Clinical Rheumatology · doi:10.1007/s10067-022-06198-9 · Cited by 70
Byrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
Combatting the rise of paper mills
Calver, M. (2021) · Pacific Conservation Biology · doi:10.1071/pcv27n1_ed · Cited by 6
Research works printed but not linked: 32
- COPE, STM. Paper mills research report from COPE & STM [Internet]; 2022. Available from: https://doi.org/10.24318/jtbG8IHL. · DOI
- Abalkina, A, Bishop, D. Paper mills: a novel form of publishing malpractice affecting psychology. PsyArXiv 2022:1–24. https://doi.org/10.31234/osf.io/2yf8z. · DOI
- Santos-d’Amorim, K, Wang, T, Lund, B, Macedo Dos Santos, RN. From plagiarism to scientific paper mills: a profile of retracted articles within the SciELO Brazil collection. Ethics Behav 2022:1–18. https://doi.org/10.1080/10508422.2022.2141747. · DOI
- Day, A. Exploratory analysis of text duplication in peer-review reveals peer-review fraud and paper mills. Scientometrics 2022;127:5965–87. https://doi.org/10.1007/s11192-022-04504-5. · DOI
- Dadkhah, M, Raja, AM, Memon, AR, Borchardt, G, Nedungadi, P, Abu-Eteen, K, et al.. A toolkit for detecting fallacious calls for papers from potential predatory journals. Adv Pharm Bull 2023;13:1–8. · DOI
- Dadkhah, M, Bianciardi, G. Ranking predatory journals: solve the problem instead of removing it. Adv Pharmaceut Bull 2016;6:1. https://doi.org/10.15171/apb.2016.001. · DOI
- Mathew, RP, Patel, V, Low, G. Predatory journals-The power of the predator versus the integrity of the honest. Curr Probl Diagn Radiol 2022;51:740–6. https://doi.org/10.1067/j.cpradiol.2021.07.005. · DOI
- Oermann, MH, Wrigley, J, Nicoll, LH, Ledbetter, LS, Carter-Templeton, H, Edie, AH. Integrity of databases for literature searches in nursing: avoiding predatory journals. Adv Nurs Sci 2021;44:102. https://doi.org/10.1097/ans.0000000000000349. · DOI
- Sureda‐Negre, J, Calvo‐Sastre, A, Comas‐Forgas, R. Predatory journals and publishers: characteristics and impact of academic spam to researchers in educational sciences. Learn Publ 2022;35:441–7. https://doi.org/10.1002/leap.1450. · DOI
- Dadkhah, M, Rahimnia, F, Darbyshire, P, Borchardt, G. Ten (Bad) reasons researchers publish their papers in hijacked journals. J Clin Nurs 2021;30:e60–3. · DOI
- Dadkhah, M, Borchardt, G. Hijacked journals: an emerging challenge for scholarly publishing. Aesthetic Surg J 2016;36:739–41. https://doi.org/10.1093/asj/sjw026. · DOI
- Dadkhah, M, Lagzian, M, Borchardt, G. Questionable papers in citation databases as an issue for literature review. J Cell Commun Signal 2017;11:181–5. https://doi.org/10.1007/s12079-016-0370-6. · DOI · Paper page
- Cabanac, G, Labbé, C. Prevalence of nonsensical algorithmically generated papers in the scientific literature. J Assoc Inf Sci Technol 2021;72:1461–76. https://doi.org/10.1002/asi.24495. · DOI
- Ali, MJ, Djalilian, A. Readership awareness series – paper 4: chatbots and ChatGPT – ethical considerations in scientific publications. Semin Ophthalmol 2023;1–2:403–4. https://doi.org/10.1016/j.jtos.2023.04.001. · DOI
- Gao, CA, Howard, FM, Markov, NS, Dyer, EC, Ramesh, S, Luo, Y, et al.. Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. NPJ Digit Med 2023;6:1–5. · DOI · Paper page
- Sun, GH, Hoelscher, SH. The ChatGPT storm and what faculty can do. Nurse Educat 2023;48:119–24. https://doi.org/10.1097/nne.0000000000001390. · DOI
- Oermann. Writing for publication in nursing. New York: Springer Publishing; 2024.
- The retraction watch hijacked journal checker [Internet]. 2022 [cited 2023 Mar 31]. Available from: https://retractionwatch.com/the-retraction-watch-hijacked-journal-checker/.
- Candal-Pedreira, C, Ross, JS, Ruano-Ravina, A, Egilman, DS, Fernández, E, Pérez-Ríos, M. Retracted papers originating from paper mills: cross sectional study. BMJ 2022;379. https://doi.org/10.1136/bmj-2022-071517. · DOI · Paper page
- Campos-Varela, I, Ruano-Raviña, A. Misconduct as the main cause for retraction. A descriptive study of retracted publications and their authors. Gac Sanit 2019;33:356–60. https://doi.org/10.1016/j.gaceta.2018.01.009. · DOI · Paper page
- Martinson, BC, Anderson, MS, De Vries, R. Scientists behaving badly. Nature 2005;435:737–8. https://doi.org/10.1038/435737a. · DOI · Paper page
- Anderson, N, Belavy, DL, Perle, SM, Hendricks, S, Hespanhol, L, Verhagen, E, et al.. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in Sports & Exercise Medicine manuscript generation. BMJ Open Sport Exerc Med 2023;9:e001568. https://doi.org/10.1136/bmjsem-2023-001568. · DOI · Paper page
- Stokel-Walker, C, Van Noorden, R. What ChatGPT and generative AI mean for science. Nature 2023;614:214–6. https://doi.org/10.1038/d41586-023-00340-6. · DOI · Paper page
- El Naqa, I, Murphy, MJ. What is machine learning? In: El Naqa, I, Li, R, Murphy, MJ, editors Machine learning in radiation oncology: theory and applications [Internet]. Cham: Springer International Publishing; 2015. pp. 3–11. · DOI
- Theobald, O. Machine learning for absolute beginners: a plain English introduction, 157. UK: Scatterplot press London; 2017.
- Myles, AJ, Feudale, RN, Liu, Y, Woody, NA, Brown, SD. An introduction to decision tree modeling. J Chemometr 2004;18:275–85. https://doi.org/10.1002/cem.873. · DOI
- Breiman, L. Classification and regression trees. New York: Routledge; 2017. · DOI · Paper page
- Quinlan, JR. C4. 5: programs for machine learning. Burlington: Elsevier; 2014.
- Kass, GV. An exploratory technique for investigating large quantities of categorical data. J Roy Stat Soc Ser C 1980;29:119–27. https://doi.org/10.2307/2986296. · DOI · Paper page
- Hermawan, DR, Fatihah, MFG, Kurniawati, L, Helen, A. Comparative study of J48 decision tree classification algorithm, random tree, and random forest on in-vehicle CouponRecommendation data. In: 2021 International conference on artificial intelligence and big data analytics. 2021. pp. 1–6. · DOI
- Song, YY, Ying, L. Decision tree methods: applications for classification and prediction. Shanghai Arch Psychiatry 2015;27:130. https://doi.org/10.11919/j.issn.1002-0829.215044. · DOI
- Oermann, MH, Nicoll, LH, Carter-Templeton, H, Owens, JK, Wrigley, J, Ledbetter, LS, et al.. How to identify predatory journals in a search: precautions for nurses. Nursing 2022;52:41–5. https://doi.org/10.1097/01.nurse.0000823280.93554.1a. · DOI
Cited by
Sorted by citations
Haider, J., Söderström, K. R., Ekström, B., & Rödl, M. (2024) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-156 · Cited by 70
Qorich, M., & El Ouazzani, R. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128405 · Cited by 6
Nag, S. N., Roy, A., & Sudhier, K. G. (2025) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-09-2024-0582 · Cited by 4
Metadata
- Authors
- Dadkhah, M., Oermann, M. H., Hegedüs, M., Raman, R., & Dávid, L. D.
- Affiliations
- Amrita School of Engineering , Amrita Vishwa Vidyapeetham , Amritapuri , Kerala , India
- School of Nursing , Duke University , Durham , NC , USA
- Tomori Pál College, Hungaryf Hungarian Auditors , Budapest , Hungary
- Amrita School of Business , Amrita Vishwa Vidyapeetham , Amritapuri , Kerala , India
- Faculty of Economics and Business , John von Neumann University , Kecskemet , Hungary
- Venue
- Diagnosis
- Publisher
- Walter de Gruyter GmbH
- Published
- 2023-08-17
- Volume
- 10
- Issue
- 4
- Pages
- 390-397
- ISSN
- 2194-802X
- Cited by
- 24
- References
- 5
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review