CoChat
Sign Up
Cited by 205Artificial Intelligence in Healthcare and EducationArtificial Intelligence in EducationAcademic integrity and plagiarism

The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

Open access
Khlaif, Zuheir N, Mousa, Allam, Hattab, Muayad Kamal, Itmazi, Jamil, Hassan, Amjad A, Sanmugam, Mageswaran, Ayyoub, Abedalkarim·2023·JMIR Medical Education
DOI 10.2196/47049PMC PMC10636627

Published version of a preprint

Open this paper in CoChat — free accountOpen PDF

Abstract

Background: Artificial intelligence (AI) has many applications in various aspects of our daily life, including health, criminal, education, civil, business, and liability law. One aspect of AI that has gained significant attention is natural language processing (NLP), which refers to the ability of computers to understand and generate human language. Objective: This study aims to examine the potential for, and concerns of, using AI in scientific research. For this purpose, high-impact research articles were generated by analyzing the quality of reports generated by ChatGPT and assessing the application’s impact on the research framework, data analysis, and the literature review. The study also explored concerns around ownership and the integrity of research when using AI-generated text. Methods: A total of 4 articles were generated using ChatGPT, and thereafter evaluated by 23 reviewers. The researchers developed an evaluation form to assess the quality of the articles generated. Additionally, 50 abstracts were generated using ChatGPT and their quality was evaluated. The data were subjected to ANOVA and thematic analysis to analyze the qualitative data provided by the reviewers. Results: When using detailed prompts and providing the context of the study, ChatGPT would generate high-quality research that could be published in high-impact journals. However, ChatGPT had a minor impact on developing the research framework and data analysis. The primary area needing improvement was the development of the literature review. Moreover, reviewers expressed concerns around ownership and the integrity of the research when using AI-generated text. Nonetheless, ChatGPT has a strong potential to increase human productivity in research and can be used in academic writing. Conclusions: AI-generated text has the potential to improve the quality of high-impact research articles. The findings of this study suggest that decision makers and researchers should focus more on the methodology part of the research, which includes research design, developing research tools, and analyzing data in depth, to draw strong theoretical and practical implications, thereby establishing a revolution in scientific research in the era of AI. The practical implications of this study can be used in different fields such as medical education to deliver materials to develop the basic competencies for both medicine students and faculty members.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/47049

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When ChatGPT and other AI chatbots were challenged to authenticate their outputs with references, they generated multiple citations with detailed bibliographic data that seemed authentic, but most were fabricated, contained at least one falsified citation datum, or were completely erroneous when verified through medical literature resources.

    “Even when ChatGPT and other AI chatbots were challenged to authenticate their outputs with references [13,14], they generated multiple citations with detailed bibliographic data that seemed perfectly authentic, but most were actually fabricated, contained at least one falsified citation data, or were completely erroneous when verified through medical literature resources [13-16].”

    From Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study (2024) · cites this paper as [15]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 38

  1. [1]Hwang G Chien S Definition, roles, and potential research issues of the metaverse in education: An artificial intelligence perspective Computers and Education: Artificial Intelligence 2022 3 100082 10.1016/j.caeai.2022.100082 10.1016/j.caeai.2022.100082 · DOI · Paper page
  2. [2]Khurana D Koli A Khatter K Singh S Natural language processing: state of the art, current trends and challenges Multimed Tools Appl 2023 82 3 3713 3744 10.1007/s11042-022-13428-4 35855771 13428 35855771 PMC9281254 · DOI · Paper page
  3. [4]Henson RN Toga AW Analysis of Variance (ANOVA) Brain Mapping: An Encyclopedic Reference (Vol. 1) 2015 Amsterdam, The Netherlands Academic Press 477 481
  4. [5]Thurzo A Strunga M Urban R Surovková J Afrashtehfar K Impact of Artificial Intelligence on Dental Education: A Review and Guide for Curriculum Update Education Sciences 2023 01 31 13 2 150 10.3390/educsci13020150 10.3390/educsci13020150 · DOI
  5. [7]Shen Y Heacock L Elias J Hentel Keith D Reig Beatriu Shih George Moy Linda ChatGPT and Other Large Language Models Are Double-edged Swords Radiology 2023 04 307 2 e230163 10.1148/radiol.230163 10.1148/radiol.230163 36700838 36700838 · DOI · Paper page
  6. [8]Yenduri G Ramalingam M Chemmalar SG Supriya Y Srivastava G Maddikunta PKR Deepti RG Rutvij HJ Prabadevi B Weizheng W Vasilakos AV Gadekallu TR Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions arXiv Preprint posted online on May 21, 2023 10.48550/arXiv.2305.10435 · DOI
  7. [9]Brown T Mann B Ryder N Subbiah M Kaplan J Dhariwal P Neelakantan A Shyam P Sastry G Askell A Agarwal S Herbert-Voss A Krueger G Henighan T Child R Ramesh A Ziegler DM Wu J Winter C Hesse C Chen M Sigler E Litwin M Gray S Chess B Clark J Berner C McCandlish S Radford A Sutskever I Amodei D Language Models are Few-Shot Learners arXiv Preprint posted online on July 22, 2020
  8. [11]Liebrenz M Schleifer R Buadze A Bhugra D Smith A Generating scholarly content with ChatGPT: ethical challenges for medical publishing The Lancet Digital Health 2023 03 15 5 3 e105 e106 10.1016/s2589-7500(23)00019-5 10.1016/s2589-7500(23)00019-5 36754725 · DOI · Paper page
  9. [13]Topol EJ High-performance medicine: the convergence of human and artificial intelligence Nat Med 2019 01 7 25 1 44 56 10.1038/s41591-018-0300-7 30617339 10.1038/s41591-018-0300-7 30617339 · DOI · Paper page
  10. [14]Kung TH Cheatham M Medenilla A Sillos C De Leon L Elepaño Camille Madriaga M Aggabao R Diaz-Candido G Maningo J Tseng V Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models PLOS Digit Health 2023 02 2 2 e0000198 10.1371/journal.pdig.0000198 36812645 PDIG-D-22-00371 36812645 PMC9931230 · DOI · Paper page
  11. [15]Seth P Hueppchen N Miller SD Rudzicz F Ding J Parakh K Record JD Data Science as a Core Competency in Undergraduate Medical Education in the Age of Artificial Intelligence in Health Care JMIR Med Educ 2023 07 11 9 e46344 10.2196/46344 37432728 v9i1e46344 37432728 PMC10369309 · DOI · Paper page
  12. [16]Mirbabaie M Stieglitz S Frick NRJ Artificial intelligence in disease diagnostics: A critical review and classification on the current state of research guiding future direction Health Technol 2021 05 10 11 4 693 731 10.1007/s12553-021-00555-5 · DOI
  13. [17]R Niakan Kalhori S Bahaadinbeigy K Deldar K Gholamzadeh M Hajesmaeel-Gohari S Ayyoubzadeh SM Digital Health Solutions to Control the COVID-19 Pandemic in Countries With High Disease Prevalence: Literature Review J Med Internet Res 2021 03 10 23 3 e19473 10.2196/19473 33600344 v23i3e19473 33600344 PMC7951053 · DOI
  14. [19]Wang S Scells H Koopman B Zuccon G Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search? arXiv (Cornell University) arXiv Preprint posted online on February 9, 2023 10.1145/3539618.3591703 · DOI · Paper page
  15. [22]Gilat R Cole B How Will Artificial Intelligence Affect Scientific Writing, Reviewing and Editing? The Future is Here … Arthroscopy 2023 05 39 5 1119 1120 10.1016/j.arthro.2023.01.014 10.1016/j.arthro.2023.01.014 36774329 S0749-8063(23)00032-4 36774329 · DOI
  16. [23]Dowling M Lucey B ChatGPT for (Finance) research: The Bananarama Conjecture Finance Research Letters 2023 05 53 103662 10.1016/j.frl.2023.103662 10.1016/j.frl.2023.103662 · DOI
  17. [25]Hubanov O Hubanova T Kotliarevska H Vikhliaiev M Donenko V Lepekh Y International legal regulation of copyright and related rights protection in the digital environment EEA 2021 08 16 39 7 1 20 10.25115/eea.v39i7.5014 10.25115/eea.v39i7.5014 · DOI
  18. [26]Jhaveri M Cetin O Gañán C Moore T Eeten M Abuse Reporting and the Fight Against Cybercrime ACM Comput. Surv 2017 01 02 49 4 1 27 10.1145/3003147 10.1145/3003147 · DOI
  19. [27]Roy Sarkar K Assessing insider threats to information security using technical, behavioural and organisational measures Information Security Technical Report 2010 08 15 3 112 133 10.1016/j.istr.2010.11.002 10.1016/j.istr.2010.11.002 · DOI
  20. [28]Clough J Data Theft? Cybercrime and the Increasing Criminalization of Access to Data Crim Law Forum 2011 3 23 22 1-2 145 170 10.1007/s10609-011-9133-5 10.1007/s10609-011-9133-5 · DOI
  21. [29]Sabillon R Cano J Cavaller RV Serra RJ Cybercrime and cybercriminals: A comprehensive study International Journal of Computer Networks and Communications Security 2016 6 4 6 165 176 10.1109/icccf.2016.7740434 · DOI
  22. [30]Maimon D Louderback E Cyber-Dependent Crimes: An Interdisciplinary Review Annu. Rev. Criminol 2019 01 13 2 1 191 216 10.1146/annurev-criminol-032317-092057 10.1146/annurev-criminol-032317-092057 · DOI
  23. [31]Tammenlehto L Copyright Compensation in the Finnish Sanctioning System – A Remedy for Ungained Benefit or an Unjustified Punishment? IIC 2022 06 27 53 6 883 916 10.1007/s40319-022-01206-6 10.1007/s40319-022-01206-6 · DOI
  24. [32]Viano EC Cybercrime, Organized Crime, and Societal Responses: International Approaches 2016 12 10 Cham, Switzerland Springer Cham
  25. [33]Komljenovic J The future of value in digitalised higher education: why data privacy should not be our biggest concern High Educ (Dordr) 2022 83 1 119 135 10.1007/s10734-020-00639-7 33230347 639 33230347 PMC7675381 · DOI
  26. [35]Bokovnya A Khisamova Z Begishev I Latypova E Nechaeva E Computer crimes on the COVID-19 scene: analysis of social, legal, and criminal threats Cuest. Pol 2020 10 25 38 Especial 463 472 10.46398/cuestpol.38e.31 10.46398/cuestpol.38e.31 · DOI
  27. [36]Gürkaynak G Yılmaz İ Yeşilaltay B Bengi B Intellectual property law and practice in the blockchain realm Computer Law & Security Review 2018 34 4 847 862 10.1016/j.clsr.2018.05.027 · DOI
  28. [37]Holt D Challis D From policy to practice: One university's experience of implementing strategic change through wholly online teaching and learning AJET 2007 03 22 23 1 110 131 10.14742/ajet.1276 10.14742/ajet.1276 · DOI
  29. [38]Beugelsdijk S van Witteloostuijn A Meyer K A new approach to data access and research transparency (DART) J Int Bus Stud 2020 04 21 51 6 887 905 10.1057/s41267-020-00323-z 10.1057/s41267-020-00323-z · DOI
  30. [39]Selvadurai N The Proper Basis for Exercising Jurisdiction in Internet Disputes: Strengthening State Boundaries or Moving Towards Unification? Pittsburgh Journal of Technology Law and Policy 2013 05 30 13 2 1 26 10.5195/tlp.2013.124 · DOI
  31. [40]Fullana O Ruiz J Accounting information systems in the blockchain era IJIPM 2021 11 1 63 10.1504/ijipm.2021.113357 10.1504/ijipm.2021.113357 · DOI
  32. [41]Anjankar A Mohite P Waghmode A Patond S Ninave S A Critical Appraisal of Ethical issues in E-Learning Indian Journal of Forensic Medicine & Toxicology 2012 15 3 78 81 10.37506/ijfmt.v15i3.15283 10.37506/ijfmt.v15i3.15283 · DOI
  33. [44]Gao CA Howard FM Markov NS Dyer EC Ramesh S Luo Y Pearson AT Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers NPJ Digit Med 2023 04 26 6 1 75 10.1038/s41746-023-00819-6 10.1038/s41746-023-00819-6 37100871 10.1038/s41746-023-00819-6 37100871 PMC10133283 · DOI · Paper page
  34. [45]Braun V Clarke V Cooper H Camic PM Long DL Panter AT Rindskopf D Sher EJ Thematic analysis APA handbook of research methods in psychology, Vol. 2. Research designs: Quantitative, qualitative, neuropsychological, and biological 2012 Washington, DC American Psychological Association 57 71
  35. [47]Kung TH Cheatham M Medenilla A Sillos C De Leon L Elepaño Camille Madriaga M Aggabao R Diaz-Candido G Maningo J Tseng V Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models PLOS Digit Health 2023 02 9 2 2 e0000198 e0000210 10.1371/journal.pdig.0000198 36812645 PDIG-D-22-00371 36812645 PMC9931230 · DOI · Paper page
  36. [48]Paranjape K Schinkel M Nannan Panday R Car J Nanayakkara P Introducing Artificial Intelligence Training in Medical Education JMIR Med Educ 2019 12 03 5 2 e16048 e16060 10.2196/16048 31793895 v5i2e16048 31793895 PMC6918207 · DOI · Paper page
  37. [49]Liu S Wright Aileen P Patterson Barron L Wanderer Jonathan P Turer Robert W Nelson Scott D McCoy Allison B Sittig Dean F Wright Adam Using AI-generated suggestions from ChatGPT to optimize clinical decision support J Am Med Inform Assoc 2023 06 20 30 7 1237 1245 10.1093/jamia/ocad072 37087108 7136722 37087108 PMC10280357 · DOI · Paper page
  38. [50]Peng Y Rousseau JF Shortliffe EH Weng C AI-generated text may have a role in evidence-based medicine Nat Med 2023 07 23 29 7 1593 1594 10.1038/s41591-023-02366-9 37221382 10.1038/s41591-023-02366-9 37221382 PMC11193148 · DOI · Paper page

Cited by

Sorted by citations

Authors
Khlaif, Z. N., Mousa, A., Hattab, M. K., Itmazi, J., Hassan, A. A., Sanmugam, M., & Ayyoub, A.
Affiliations
  • An-Najah National University (PS)
  • Palestine Ahliya University (PS)
  • Universiti Sains Malaysia (MY)
Corresponding author
Khlaif, Zuheir N
ORCID
Venue
JMIR Medical Education
Publisher
JMIR Publications Inc.
Published
2023-09-14
Volume
9
Pages
e47049
ISSN
2369-3762 (ISSN-L)
DOI
10.2196/47049
PMC
PMC10636627
OpenAlex
W4385080756
Cited by
205
References
11
Citations by year
2026: 49 · 2025: 95 · 2024: 60 · 2023: 1
FWCI
8.07
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Greater South Information System
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Safety Research › Academic integrity and plagiarism
Keywords
ChatGPT, AI-generated text, scientific research, natural language processing, research integrity, research framework development, data analysis, academic writing, prompt quality, peer review concerns

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review