Differentiate ChatGPT-generated and Human-written Medical Texts
Open accessAbstract
Background: Large language models such as ChatGPT are capable of generating grammatically perfect and human-like text content, and a large number of ChatGPT-generated texts have appeared on the Internet. However, medical texts such as clinical notes and diagnoses require rigorous validation, and erroneous medical content generated by ChatGPT could potentially lead to disinformation that poses significant harm to healthcare and the general public. Objective: This research is among the first studies on responsible and ethical AIGC (Artificial Intelligence Generated Content) in medicine. We focus on analyzing the differences between medical texts written by human experts and generated by ChatGPT, and designing machine learning workflows to effectively detect and differentiate medical texts generated by ChatGPT. Methods: We first construct a suite of datasets containing medical texts written by human experts and generated by ChatGPT. In the next step, we analyze the linguistic features of these two types of content and uncover differences in vocabulary, part-of-speech, dependency, sentiment, perplexity, etc. Finally, we design and implement machine learning methods to detect medical text generated by ChatGPT. Results: Medical texts written by humans are more concrete, more diverse, and typically contain more useful information, while medical texts generated by ChatGPT pay more attention to fluency and logic, and usually express general terminologies rather than effective information specific to the context of the problem. A BERT-based model can effectively detect medical texts generated by ChatGPT, and the F1 exceeds 95%.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
LLM-generated papers exhibit fewer grammatical and other types of errors and demonstrate a broader variety of expression.
“In contrast, LLM-generated papers exhibit fewer grammatical and other types of errors and demonstrate a broader variety of expression (Yan et al. 2023; Liao et al. 2023a).”
From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Liao et al. 2023a
The Vocabulary and Sentence Analysis section says human-written medical texts have more diverse content and expression than ChatGPT-generated texts—the opposite of the claimed broader variety. The Abstract describes ChatGPT text as grammatically polished, supporting that part of the claim, but the paper does not establish that it has fewer other types of errors. No page numbers are available in our copy. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredMachine-generated text has a more complex syntactic structure and uses more normalization, whereas human essays tend to be more lexically complex.
“Machine-generated text has a more complex syntactic structure and uses more normalization, whereas human essays tend to be more lexically complex [81,83].”
From Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity (2024) · cites this paper as [83]
The Vocabulary and Sentence Analysis section (page not provided) reports a larger vocabulary in human-written medical texts and says ChatGPT tends to use common words, supporting the lexical-diversity contrast. The Dependency Parsing section describes ChatGPT text as more logical and fluent, but does not establish greater syntactic complexity. The study examined medical abstracts and radiology reports, not essays. (LLM, conf=0.84)
Experimental — accuracy not yet measuredRecent research has elucidated distinct disparities between LLM-generated text and human-written text, underscoring a tangible and discernible gap between the two.
“Recent research (Giorgi et al. 2023; Liao et al. 2023b) has elucidated distinct disparities between LLM-generated text and human-written text, underscoring a tangible and discernible gap between the two.”
From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Liao et al. 2023b
The Principal Results report differences between ChatGPT-generated and human-written medical texts and say those differences make the texts distinguishable. The Limitations restrict the study to English medical abstracts and radiology reports generated by ChatGPT; it does not establish the same gap for LLM-generated text generally. (LLM, conf=0.82)
Experimental — accuracy not yet measuredAI models were able to generate more high-quality argumentative essays than German high school students in an online forum.
“In an experiment, AI models were able to generate more high-quality argumentative essays than German high school students in an online forum [83].”
From Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity (2024) · cites this paper as [83]
The Background says ChatGPT can write essays for college students and produce text of surprising quality. Searches for German high school students, argumentative essays, and an online forum found no passage reporting the claimed experiment or comparison. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569 · see citing works
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · see citing works
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · see citing works
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · see citing works
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,171 · see citing works
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078 · see citing works
Alsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736 · see citing works
BioGPT: generative pre-trained transformer for biomedical text generation and mining
Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac409 · Cited by 1,150 · see citing works
Self-citationChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008 · see citing works
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855 · see citing works
Self-citationWords as Tools: Learning Academic Vocabulary as Language Acquisition
Nagy, W. E., & Townsend, D. (2012) · Reading Research Quarterly · doi:10.1002/rrq.011 · Cited by 833 · see citing works
ChatGPT and the future of medical writing
Biswas, S. (2023) · Radiology · doi:10.1148/radiol.223312 · Cited by 571 · see citing works
Automated de-identification of free-text medical records
Neamatullah, I., Douglass, M. M., Lehman, L.-W. H., Reisner, A., Villarroel, M., Long, W. J., Szolovits, P., Moody, G. B., Mark, R. G., & Clifford, G. D. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-32 · Cited by 413 · see citing works
Bickmore, T. W., Trinh, H., Olafsson, S., O'Leary, T. K., Asadi, R., Rickles, N. M., & Cruz, R. (2018) · Journal of Medical Internet Research · doi:10.2196/11510 · Cited by 308 · see citing works
Health, T. L. D. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00023-7 · Cited by 257 · see citing works
Homolak, J. (2023) · Croatian Medical Journal · doi:10.3325/cmj.2023.64.1 · Cited by 208 · see citing works
Wagner, W. (2010) · Language Resources and Evaluation · doi:10.1007/s10579-010-9124-x · Cited by 172 · see citing works
Evaluating large language models on a highly-specialized topic, radiation oncology physics
Holmes, J., Liu, Z., Zhang, L., Ding, Y., Sio, T. T. W., McGee, L. A., Ashman, J. B., Li, X., Liu, T., Shen, J., et al. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1219326 · Cited by 166 · see citing works
Self-citationSezgın, E., Sirrianni, J., & Linwood, S. L. (2022) · JMIR Medical Informatics · doi:10.2196/32875 · Cited by 129 · see citing works
When brain-inspired AI meets AGI
Zhao, L., Zhang, L., Wu, Z., Chen, Y., Dai, H., Yu, X., Liu, Z., Zhang, T., Hu, X., Jiang, X., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100005 · Cited by 96 · see citing works
Self-citationEvaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approaches
Schopf, T., Braun, D., & Matthes, F. (2022) · International Conference on Natural Language Processing and Information Retrieval (NLPIR) · doi:10.1145/3582768.3582795 · Cited by 76 · see citing works
ChatGPT and medical education: a double-edged sword
Khairatun Hisan, U., & Miftahul Amri, M. (2023) · Journal of Pedagogy and Education Science · doi:10.56741/jpes.v2i01.302 · Cited by 63 · see citing works
AgriBERT: Knowledge-Infused Agricultural Language Models for Matching Food and Nutrition
Rezayi, S., Liu, Z., Wu, Z., Dhakal, C., Ge, B., Zhen, C., Liu, T., & Li, S. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/715 · Cited by 55 · see citing works
Self-citationContext Matters: A Strategy to Pre-train Language Model for Science Education
Liu, Z., He, X., Liu, L., Liu, T., & Zhaı, X. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-36336-8_103 · Cited by 54 · see citing works
Self-citationLiu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45673-2_46 · Cited by 42 · see citing works
Self-citationSurviving ChatGPT in healthcare
Liu, Z., Zhang, L., Wu, Z., Yu, X., Cao, C., Dai, H., Liu, N., Liu, J., Liu, W., Li, Q., et al. (2024) · Frontiers in Radiology · doi:10.3389/fradi.2023.1224682 · Cited by 39 · see citing works
Self-citationClinicalRadioBERT: Knowledge-Infused Few Shot Learning for Clinical Notes Named Entity Recognition
Rezayi, S., Dai, H., Liu, Z., Wu, Z., Hebbar, A., Burns, A. H., Zhao, L., Zhu, D., Li, Q., Liu, W., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21014-3_28 · Cited by 31 · see citing works
Self-citationSurvey on natural language processing in medical image analysis.
Liu, Z., He, M., Jiang, Z., Wu, Z., Dai, H., Zhang, L., Luo, S., Han, T., Li, X., Jiang, X., et al. (2022) · PubMed Central · doi:10.11817/j.issn.1672-7347.2022.220376 · Cited by 23 · see citing works
Self-citationContext Matters: A Strategy to Pre-train Language Model for Science EducationPreprint
Liu, Z., He, X., Liu, L., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4339205 · Cited by 16 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 22
- Devlin J, Chang MW, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. 2019 Presented at: North American Chapter of the Association for Computational Linguistics: Human Language Technologies; June 2-7, 2019; Minneapolis p. 4171-4186
- Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:1-11
- Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst. 2020;33:1877-1901
- Ouyang L, Wu J, Jiang X, Almeida D, Wainwright CL, Mishkin P, et al. Training language models to follow instructions with human feedback. arXiv. Preprint posted online on March 4, 2022. [FREE Full text]
- Christiano PF, Leike J, Brown T, Martic M, Legg S, Amodei D. Deep reinforcement learning from human preferences. Adv Neural Inf Process Syst. 2017;30:1-9
- Schulman J, Wolski F, Dhariwal P, Radford A, Klimov O. Proximal policy optimization algorithms. arXiv. Preprint posted online on July 20, 2017. [FREE Full text]
- Guan Z, Wu Z, Liu Z, Wu D, Ren H, Li Q, et al. Cohortgpt: an enhanced gpt for participant recruitment in clinical study. arXiv. Preprint posted online on July 21, 2023. [FREE Full text]
- Dai H, Liu Z, Liao W, Huang X, Wu Z, Zhao L, et al. AugGPT: leveraging ChatGPT for text data augmentation. arXiv. Preprint posted online on February 25, 2023. [FREE Full text]
- Ma C, Wu Z, Wang J, Xu S, Wei Y, Liu Z, et al. ImpressionGPT: an iterative optimizing framework for radiology report summarization with ChatGPT. arXiv. Preprint posted online on April 17, 2023. [FREE Full text]
- Liu Z, Yu X, Zhang L, Wu Z, Cao C, Dai H, et al. Deid-GPT: zero-shot medical text de-identification by GPT-4. arXiv. Preprint posted online on March 20, 2023. [FREE Full text]
- Shi Y, Xu S, Liu Z, Liu T, Li X, Liu N. MedEdit: model editing for medical question answering with external knowledge bases. arXiv. Preprint posted online on September 27, 2023. [FREE Full text]
- Mitrović S, Andreoletti D, Ayoub O. ChatGPT or human? Detect and explain. Explaining decisions of machine learning model for detecting short ChatGPT-generated text. arXiv. Preprint posted online on January 30, 2023. [FREE Full text]
- Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al. RoBERTa: a robustly pptimized BERT pretraining approach. arXiv. Preprint posted online on July 26, 2019. [FREE Full text]
- Lan Z, Chen M, Goodman S, Gimpel K, Sharma P, Soricut R. ALBERT: A lite BERT for self-supervised learning of language representations. arXiv. Preprint posted online on Septemeber 26, 2019. [FREE Full text]
- Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. Semantic Scholar. 2019. URL: https://www.semanticscholar.org/paper/ Language-Models-are-Unsupervised-Multitask-Learners-Radford-Wu/9405cc0d6169988371b2755e573cc28650d14dfe [accessed 2023-10-18]
- Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, et al. Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res. 2020;21(1):1-67
- Liao W, Liu Z, Dai H, Wu Z, Zhang Y, Huang X, et al. Mask-guided BERT for few shot text classification. arXiv. Preprint posted online on February 21, 2023. [FREE Full text]
- Cai H, Liao W, Liu Z, Huang X, Zhang Y, Ding S, et al. Coarse-to-fine knowledge graph domain adaptation based on distantly-supervised iterative training. arXiv. Preprint posted online on November 5, 2022. [FREE Full text]
- Liu Z, Li Y, Shu P, Zhong A, Yang L, Ju C, et al. Radiology-Llama2: best-in-class large language model for radiology. arXiv. Preprint posted online on August 29, 2023. [FREE Full text] [doi: 10.1007/978-3-031-45673-2_46] · DOI
- Guo B, Zhang X, Wang Z, Jiang M, Nie J, Ding Y, et al. How close is chatgpt to human experts? Comparison corpus, evaluation, and detection. arXiv. Preprint posted online on January 18, 2023. [FREE Full text]
- Bird S, Klein E, Loper E. Natural Language Processing with Python -Analyzing Text with the Natural Language Toolkit. Sebastopol. O'Reilly Media; 2009.
- Carlini N, Tramer F, Wallace E, Jagielski M, Herbert-Voss A, Lee K, et al. Extracting training data from large language models. In: Proceedings of the 30th USENIX Security Symposium. 2021 Presented at: 30th USENIX Security Symposium; August 11-13, 2021; Vancouver
Cited by
Sorted by citations
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855 · see citing works
Self-citationLarge language models in healthcare and medical domain: A review
Nazi, Z. A., & Peng, W. (2024) · Informatics · doi:10.3390/informatics11030057 · Cited by 415 · see citing works
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335 · see citing works
Younis, H. A., Eisa, T. A. E., Nasser, M., Sahib, T. M., Noor, A. A., Alyasiri, O. M., Salisu, S., Hayder, I. M., & Younis, H. A. (2024) · Diagnostics · doi:10.3390/diagnostics14010109 · Cited by 242 · see citing works
Review of large vision models and visual prompt engineering
Wang, J., Liu, Z., Zhao, L., Wu, Z., Ma, C., Yu, S., Dai, H., Yang, Q., Liu, Y., Zhang, S., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100047 · Cited by 231 · see citing works
Self-citationAugGPT: Leveraging ChatGPT for Text Data Augmentation
Dai, H.-X., Liu, Z., Liao, W., Huang, X.-K., Cao, Y.-H., Wu, Z., Zhao, L., Xu, S.-C., Zeng, F., Liu, W., et al. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3536934 · Cited by 322 · see citing works
Self-citationA Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions
Wu, J., Yang, S., Zhan, R., Yuan, Y., Chao, L. S., & Wong, D. F. (2025) · Computational Linguistics · doi:10.1162/coli_a_00549 · Cited by 212 · see citing works
Oniani, D., Hilsman, J., Peng, Y., Poropatich, R. K., Pamplin, J. C., Legault, G. L., & Wang, Y. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00965-x · Cited by 143 · see citing works
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
Laskar, M. T. R., Bari, M. S., Rahman, M., Bhuiyan, M. A. H., Joty, S., & Huang, J. X. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.29 · Cited by 117 · see citing works
Contrasting Linguistic Patterns in Human and LLM-Generated News Text
Muñoz-Ortiz, A., Gómez-Rodríguez, C., & Vilares, D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10903-2 · Cited by 94 · see citing works
When brain-inspired AI meets AGI
Zhao, L., Zhang, L., Wu, Z., Chen, Y., Dai, H., Yu, X., Liu, Z., Zhang, T., Hu, X., Jiang, X., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100005 · Cited by 96 · see citing works
Self-citationPudasaini, S., Miralles-Pechuán, L., Lillis, D., & Llorens Salvador, M. (2025) · Journal of Academic Ethics · doi:10.1007/s10805-024-09576-x · Cited by 70 · see citing works
Impact of a Digital Scribe System on Clinical Documentation Time and Quality: Usability Study
van Buchem, M. M., Kant, I. M. J., King, L., Kazmaier, J., Steyerberg, E. W., & Bauer, M. P. (2024) · JMIR AI · doi:10.2196/60020 · Cited by 70 · see citing works
Understanding LLMs: A comprehensive overview from training to inference
Liu, Y., He, H., Han, T., Zhang, X., Liu, M., Tian, J., Zhang, Y., Wang, J., Gao, X., Zhong, T., et al. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129190 · Cited by 68 · see citing works
Self-citationZaitsu, W., & Jin, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288453 · Cited by 61 · see citing works
Radiology-GPT: A large language model for radiology
Liu, Z., Li, Y., Shu, P., Zhong, A., Jiang, H., Pan, Y., Yang, L., Ju, C., Wu, Z., Ma, C., et al. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100153 · Cited by 78 · see citing works
Self-citationLarge Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis
Yu, H., Fan, L., Li, L., Zhou, J., Ma, Z., Xian, L., Hua, W., He, S., Jin, M., Zhang, Y., et al. (2024) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-024-00171-8 · Cited by 69 · see citing works
Self-citationAnalysis of ChatGPT Responses to Ophthalmic Cases: Can ChatGPT Think like an Ophthalmologist?
Chen, J., Reddy, A. J., Al-Sharif, E. M., Shoji, M. K., Kalaw, F. G. P., Eslani, M., Lang, P. Z., Arya, M., Koretz, Z. A., Bolo, K. A., et al. (2024) · Ophthalmology Science · doi:10.1016/j.xops.2024.100600 · Cited by 44 · see citing works
Li, F., & Yang, Y. Y. (2024) · JMIR Formative Research · doi:10.2196/60024 · Cited by 59 · see citing works
Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45673-2_46 · Cited by 42 · see citing works
Self-citationRezayi, S., Liu, Z., Wu, Z., Dhakal, C., Ge, B., Dai, H., Mai, G., Liu, N., Zhen, C., Liu, T., et al. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3442542 · Cited by 42 · see citing works
Self-citationKim, S.-J. (2024) · Science Editing · doi:10.6087/kcse.343 · Cited by 42 · see citing works
Surviving ChatGPT in healthcare
Liu, Z., Zhang, L., Wu, Z., Yu, X., Cao, C., Dai, H., Liu, N., Liu, J., Liu, W., Li, Q., et al. (2024) · Frontiers in Radiology · doi:10.3389/fradi.2023.1224682 · Cited by 39 · see citing works
Self-citationA feasibility study for the application of AI-generated conversations in pragmatic analysis
Chen, X., Li, J., & Ye, Y. (2024) · Journal of Pragmatics · doi:10.1016/j.pragma.2024.01.003 · Cited by 37 · see citing works
Artificial general intelligence for radiation oncology
Liu, C., Liu, Z., Holmes, J., Zhang, L., Zhang, L., Ding, Y., Shu, P., Wu, Z., Dai, H., Li, Y., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100045 · Cited by 34 · see citing works
Self-citationBrainstorming Will Never Be the Same Again - A Human Group Supported by Artificial Intelligence
Lavrič, F., & Škraba, A. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5040065 · Cited by 33 · see citing works
Georgiou, G. P. (2025) · Information · doi:10.3390/info16110979 · Cited by 32 · see citing works
Hakam, H. T., Prill, R., Korte, L., Lovreković, B., Ostojić, M., Ramadanov, N., & Muehlensiepen, F. (2023) · JMIR Formative Research · doi:10.2196/52164 · Cited by 29 · see citing works
Practical Evaluation of ChatGPT Performance for Radiology Report Generation
Soleimani, M., Seyyedi, N., Ayyoubzadeh, S. M., Kalhori, S. R. N., & Keshavarz, H. (2024) · Academic Radiology · doi:10.1016/j.acra.2024.07.020 · Cited by 29 · see citing works
Fight Fire With Fire: How Much Can We Trust ChatGPT on Source Code-Related Tasks?
Yu, X., Liu, L., Hu, X., Keung, J., Liu, J., & Xia, X. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3492204 · Cited by 34 · see citing works
Doru, B., Maier, C., Busse, J. S., Lücke, T., Schönhoff, J., Enax‐Krumova, E., Hessler, S., Berger, M., & Tokic, M. C. (2025) · JMIR Medical Education · doi:10.2196/62779 · Cited by 29 · see citing works
Can we trust academic AI detective? Accuracy and limitations of AI-output detectors
Erol, G., Ergen, A., Gülşen Erol, B., Kaya Ergen, Ş., Bora, T. S., Çölgeçen, A. D., Araz, B., Şahin, C., Bostancı, G., Kılıç, İ., et al. (2025) · Acta Neurochirurgica · doi:10.1007/s00701-025-06622-4 · Cited by 28 · see citing works
Unveiling ChatGPT text using writing style
Berriche, L., & Larabi-Marie-Sainte, S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e32976 · Cited by 31 · see citing works
Hybrid Arabic handwritten character segmentation using CNN and graph theory algorithm
Berriche, L., Alqahtani, A., & Rekik, S. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101872 · Cited by 27 · see citing works
Wani, M. A., ELAffendi, M. A., & Shakil, K. A. (2024) · Computers · doi:10.3390/computers13100264 · Cited by 24 · see citing works
Bibliometric Overview of ChatGPT: New Perspectives in Social Sciences
Oliński, M., Krukowski, K., & Sieciński, K. (2024) · Publ. · doi:10.3390/publications12010009 · Cited by 26 · see citing works
A collaborative large language model for drug analysis
Zhou, H., Liu, F., Wu, J., Zhang, W., Huang, G., Clifton, L., Eyre, D. W., Luo, H., Liu, F., Branson, K., et al. (2025) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01471-z · Cited by 25 · see citing works
Arbel, Y., Gimmon, Y., & Shmueli, L. (2025) · Physical Therapy · doi:10.1093/ptj/pzaf010 · Cited by 21 · see citing works
Large language models for bioinformatics
Ruan, W., Lyu, Y., Zhang, J., Cai, J., Shu, P., Yang, G., Lu, Y., Gao, S., Wang, Y., Wang, P., et al. (2025) · Quantitative Biology · doi:10.1002/qub2.70014 · Cited by 35 · see citing works
Self-citationAD-AutoGPT: An autonomous GPT for Alzheimer’s disease infodemiology
Dai, H., Li, Y., Liu, Z., Zhao, L., Wu, Z., Song, S., Ye, S., Zhu, D., Li, X., Sheng, L., et al. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0004383 · Cited by 20 · see citing works
Self-citationPark, S. H., Han, K., & Lee, J. (2024) · La radiologia medica · doi:10.1007/s11547-024-01886-9 · Cited by 18 · see citing works
Mapping the individual, social and biospheric impacts of Foundation Models
Hernández, A. D., Krishna, S., Perini, A., Katell, M. A., Bennett, S., Borda, A., Hashem, Y., Hadjiloizou, S., Mahomed, S., Jayadeva, S., et al. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658939 · Cited by 20 · see citing works
Yang, S., Chen, S.-K., Hailin, Z. H. U., Lin, J., & Wang, X. (2024) · System · doi:10.1016/j.system.2024.103494 · Cited by 16 · see citing works
Wei, S., Hu, A., Liang, Y., Yang, J., Yu, L., Li, W., Yang, B., & Qiu, J. (2025) · Radiation Oncology · doi:10.1186/s13014-025-02660-5 · Cited by 18 · see citing works
Discriminating Human-authored from ChatGPT-Generated Code Via Discernable Feature Analysis
Li, K., Hong, S., Fu, C., Zhang, Y., & Liu, M. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew60843.2023.00059 · Cited by 23 · see citing works
Self-citationThe ChatGPT application on quality management: a comprehensive review
Atalan, A. (2025) · Journal of Management Analytics · doi:10.1080/23270012.2025.2484225 · Cited by 14 · see citing works
Ensemble learning approach for distinguishing human and computer-generated Arabic reviews
Alhayan, F., & Himdi, H. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2345 · Cited by 13 · see citing works
Appliances of Generative AI-Powered Language Tools in Academic Writing: A Scoping Review
Raitskaya, L., & Тихонова, Е. В. (2024) · Journal of language and Education · doi:10.17323/jle.2024.24181 · Cited by 19 · see citing works
Is This You, LLM? Recognizing AI-written Programs with Multilingual Code Stylometry
Gurioli, A., Gabbrielli, M., & Zacchiroli, S. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00044 · Cited by 12 · see citing works
Classifying human vs. AI text with machine learning and explainable transformer models
Masih, A., Afzal, B., Firdoos, S., Mahmood, J., Ali, A., Abdulnabi, M. S. H., & Balungu, D. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-27377-z · Cited by 16 · see citing works
Arshed, M. A., Gherghina, Ș., Dewi, C., Iqbal, A., & Mumtaz, S. (2024) · De Computis · doi:10.3390/computation12050101 · Cited by 13 · see citing works
Zero-shot detection of LLM-generated text via text reorder
Sun, J., & Lv, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129829 · Cited by 10 · see citing works
ChatGPT vs. Human Journalists: Analyzing News Summaries Through BERTScore and Moderation Standards
Kim, H.-S., Kang, J.-W., & Choi, S. (2025) · Electronics · doi:10.3390/electronics14112115 · Cited by 11 · see citing works
Pudasaini, S., Miralles-Pechuán, L., Lillis, D., & Salvador, M. L. (2024) · arXiv · doi:10.48550/arxiv.2407.13105 · Cited by 8 · see citing works
Litake, O., Park, B. H., Tully, J. L., & Gabriel, R. A. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae081 · Cited by 9 · see citing works
Kayabaşı, M., Köksaldı, S., & Engin, C. D. (2024) · Clinical and Experimental Optometry · doi:10.1080/08164622.2024.2419524 · Cited by 9 · see citing works
Phillips, V., Kiryakoza, F., Arefin, S., Choudhary, N., & GARIFULLIN, R. F. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00189-2 · Cited by 9 · see citing works
Sheikh, M. S., KASHANI, K. B., Gregoire, J. R., Thongprayoon, C., Miao, J., Craici, I. M., Cheungpasitporn, W., & Qureshi, F. (2025) · Digital Health · doi:10.1177/20552076251328807 · Cited by 9 · see citing works
Zhang, M. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1641212 · Cited by 13 · see citing works
Differentiating between GPT-generated and human-written feedback for radiology residents
Zhou, Z., Rizwan, A. P., Rogoza, N., Chung, A. D., & Kwan, B. Y. M. (2025) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2025.02.002 · Cited by 8 · see citing works
Wang, J., Yao, Z., Mitra, A., Osebe, S., Yang, Z., & Yu, H. Q. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.49 · Cited by 9 · see citing works
Battle of the authors: Comparing neurosurgery articles written by humans and AI
Akgün, M. Y., Savasci, M., Günerbüyük, C., Günara, S. O., Öktenoğlu, T., Özer, A. F., & Ateş, Ö. (2025) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2025.111152 · Cited by 7 · see citing works
Barrot, J. S., & Aranda, M. R. R. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09884-0 · Cited by 7 · see citing works
Carvalho, I., Loureiro, S. M. C., Ivanov, S. H., Björk, P., & Seyitoğlu, F. (2025) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-01-2025-0126 · Cited by 9 · see citing works
Dahlberg, A., Käenniemi, T., Winther-Jensen, T., Tapiola, O., Luisto, R., Puranen, T., Gordon, M., Sanmark, E., & Vartiainen, V. A. (2026) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2026.103421 · Cited by 12 · see citing works
Kim, N., Homer, M., & Jang, H. (2025) · American Journal of Speech-Language Pathology · doi:10.1044/2025_ajslp-24-00464 · Cited by 9 · see citing works
Chappidi, S., Belue, M. J., Harmon, S., Jagasia, S., Zhuge, Y., Taşçı, E., Turkbey, B., Singh, J., Camphausen, K., & Krauze, A. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000755 · Cited by 5 · see citing works
Jia, L., Liu, X., Chen, T. D., Wang, Y., Takahashi, K., & Wang, Y. (2026) · Information Technology and People · doi:10.1108/itp-06-2025-0773 · Cited by 5 · see citing works
Hosni, J. A. (2024) · Journal of English Language Teaching and Applied Linguistics · doi:10.32996/jeltal.2024.6.3.5 · Cited by 5 · see citing works
Matalon, J., Spurzem, A., Ahsan, S., White, E., Kothari, R., & Varma, M. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1477535 · Cited by 4 · see citing works
Zhong, T., Zhao, W., Zhang, Y., Pan, Y., Dong, P., Jiang, Z., Jiang, H., Zhou, Y., Kui, X., Shang, Y., et al. (2025) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2025.3597325 · Cited by 4 · see citing works
Self-citationXu, H., Xue, T., Liu, D., Zhang, F., Westin, C., Kikinis, R., O’Donnell, L. J., & Cai, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73471-7_8 · Cited by 4 · see citing works
Hong, Y., Pan, T., Zhu, S., Hu, M., Zhou, Z., & Xu, T. (2025) · Scientific Reports · doi:10.1038/s41598-025-01733-5 · Cited by 4 · see citing works
Ricieri, D. D. V., de Farias, A. M. G., Barreto, R. V. G., & de Souza, F. R. (2024) · Peer Review · doi:10.53660/prw-1986-3703 · Cited by 4 · see citing works
Pei, E., Zhao, H., Zhang, T., Jiang, D., He, L., & Chen, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.104063 · Cited by 3 · see citing works
Raya, J. T., Islam, N., & Maisha, M. T. (2024) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit64611.2024.11022427 · Cited by 3 · see citing works
Detecting authorship between generative AI models and humans: a Burrows’s Delta approach
Zhu, H., & Lei, L. (2025) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqaf048 · Cited by 3 · see citing works
Automatic Design Summary Generation with Generative AI
Ikoma, D., Aoki, E., Taniguchi, T., Suzuki, S., & Ohkuma, T. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651901 · Cited by 3 · see citing works
Investigating the Impact of Utilizing the ChatGPT for Arabic Sentiment Analysis
Al-Gaphari, G. H., Al-Hagree, S., & Al-Helali, B. M. (2024) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-59711-4_9 · Cited by 3 · see citing works
Human or Algorithm? The Visual Turing Test of AI-Generated Images
Wang, C. (2024) · Journal of Multimedia Information System · doi:10.33851/jmis.2024.11.3.201 · Cited by 2 · see citing works
Detection and Classification of AI-Generated Text
Gupta, S., & Gupta, D. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10724991 · Cited by 2 · see citing works
A Novel Approach for Distinguishing Human and AI-Generated Texts
Abdulhamed, A. A., Ranjan, P., & Xiong, S. (2026) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3793195 · Cited by 2 · see citing works
From chalkboards to chatbots: generative AI impact on education in emerging economies
Virmani, N., Sharma, D., Sahu, A., & Garza‐Reyes, J. A. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2632172 · Cited by 2 · see citing works
Text Origin Detection: Unmasking the Source – AI vs Human
Pandita, V., Mujawar, A. M., Norbu, T., Verma, V. C., & Patil, P. C. (2024) · International Conference for Emerging Technology (INCET) · doi:10.1109/incet61516.2024.10592990 · Cited by 2 · see citing works
Data Augmentation using Generative-AI
Gowda, S. R., C., P. H., Sunitha, R., M., S. K., H., S. S., & Rao, Y. R. (2024) · Journal of Innovative Image Processing · doi:10.36548/jiip.2024.3.005 · Cited by 1 · see citing works
Kumandaş, M. T., & Murat, N. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127042 · Cited by 1 · see citing works
Gondode, P. G., Bhoi, D., Kumar, S., Singh, R., Duggal, S., Shanker, D., & Kumar, S. (2025) · A&A Practice · doi:10.1213/xaa.0000000000002070 · Cited by 1 · see citing works
El‐Dakhs, D. A. S., Afzaal, M., & Siyanova‐Chanturia, A. (2025) · Corpus Pragmatics · doi:10.1007/s41701-025-00210-8 · Cited by 1 · see citing works
HQML-NLP: A hybrid quantum machine learning framework for scholarly AI-text detection
Hazim, L. R., & Ata, O. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.114634 · Cited by 1 · see citing works
Kong, L., & Wang, J. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-13048-8_13 · Cited by 1 · see citing works
Ton‐Nu, A. T., & Barrot, J. S. (2026) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2026.2642394 · Cited by 2 · see citing works
Meyer, T., Schlosser, T., Moniri, S., Kumar, A. S., Friedrich, M., & Kowerko, D. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114962 · Cited by 1 · see citing works
Epistemic Modality in Human and AI-Generated Academic Abstracts: A Corpus-Based Analysis
Mahmud, A., Hasan, W., & Khan, A. A. (2026) · Qlantic journal of social sciences. · doi:10.55737/qjss.vii-i.26494 · Cited by 1 · see citing works
Arshed, M. A., Gherghina, Ş. C., Dur-E-Zahra, & Manzoor, M. (2024) · Electronics · doi:10.3390/electronics13112222 · Cited by 1 · see citing works
Hamouda, N., Ibrahim, M. K., & Jabal, M. S. (2023) · medRxiv · doi:10.1101/2023.06.28.23291928 · Cited by 1 · see citing works
Xu, T., Hong, Y., Pan, T., Zhu, S., & Zhou, Z. (2024) · doi:10.2196/preprints.56740
Chow, J. C., Yeh, Y.-T., & Chou, W. (2024) · doi:10.2196/preprints.64556
Cheima, M., Altayyar, S., Vergonjeanne, M., Gellé, T., & Preux, P. (2025) · Journal of Epidemiology and Population Health · doi:10.1016/j.jeph.2025.202990
The Rephrased Reality: Analysing Sentiment Shifts in LLM-Rephrased Text
Richardson, F. L., Villavicencio, A., & de Menezes, R. P. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707717
- Authors
- Liao, W., Liu, Z., Dai, H., Xu, S., Wu, Z., Zhang, Y., Huang, X., Zhu, D., Cai, H., Liu, T., & Li, X.
- Affiliations
- South China University of Technology (CN)
- University of Georgia (US)
- The University of Texas at Arlington (US)
- Massachusetts General Hospital (US)
- Corresponding author
- Li, Xiang
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Volume
- 9
- Pages
- e48904-e48904
- ISSN
- 2369-3762 (ISSN-L)
- arXiv
- 2304.11567
- PMC
- PMC10784984
- OpenAlex
- W4390347092
- Cited by
- 119
- References
- 28
- Citations by year
- 2026: 26 · 2025: 36 · 2024: 42 · 2023: 15
- FWCI
- 11.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (U21A20520, 62172112)
- National Key Research and Development Program of China (2022YFE0112200)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- ChatGPT, large language models, AI-generated text detection, medical texts, clinical notes, disinformation, linguistic features, perplexity, BERT, responsible AI
- MeSH terms
- Disinformation, Algorithms, Artificial Intelligence, Health Facilities, Humans, Electric Power Supplies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
