The opportunities and challenges of adopting ChatGPT in medical research
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Purpose: This study aims to investigate the opportunities and challenges of adopting ChatGPT in medical research. Methods: A qualitative approach with focus groups is adopted in this study. A total of 62 participants including academic researchers from different streams in medicine and eHealth, participated in this study. Results: A total of five themes with 16 sub-themes related to the opportunities; and a total of five themes with 12 sub-themes related to the challenges were identified. The major opportunities include improved data collection and analysis, improved communication and accessibility, and support for researchers in multiple streams of medical research. The major challenges identified were limitations of training data leading to bias, ethical issues, technical limitations, and limitations in data collection and analysis. Conclusion: Although ChatGPT can be used as a potential tool in medical research, there is a need for further evidence to generalize its impact on the different research activities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1×
“A study’s outcomes could be manipulated or researchers could be misled by using ChatGPT to create language that is nearly comparable to previously published research (17–20).”
BackgroundDwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854
ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · arXiv · doi:10.48550/arxiv.2303.15056 · Cited by 1,207
ChatGPT outperforms crowd workers for text-annotation tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305016120 · Cited by 1,197 · cited 1×
“However, there are studies that have analyzed the use of ChatGPT in data analysis, in analyzing the survey responses and social media data (38, 39), indicating a potential use of ChatGPT in data analysis.”
MethodGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022) · doi:10.1101/2022.12.23.521610 · Cited by 1,099
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
ChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008 · cited 1×
“It employs deep learning techniques to predict and generate text sequences, offering assistance, information, or engaging in conversation across various topics and domains, making it a versatile and powerful tool for natural language understanding and generation (10).”
BackgroundOpen AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning
Mhlanga, D. (2023) · Sustainable Development Goals Series · doi:10.1007/978-3-031-37776-1_17 · Cited by 718
AI in Medical Imaging Informatics: Current Challenges and Future Directions
Panayides, A. S., Amini, A., Filipovic, N. D., Sharma, A., Tsaftaris, S. A., Young, A., Foran, D., Do, N., Golemati, S., Kurc, T., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2991043 · Cited by 713
Haleem, A., Javaid, M., & Singh, R. P. (2022) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100089 · Cited by 694 · cited 1×
“More study is required to solve ChatGPT’s shortcomings, which include those caused by the calibre and variety of the data used for training (14–16).”
BackgroundA Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education
King, M. R., & chatGPT (2023) · Cellular and Molecular Bioengineering · doi:10.1007/s12195-022-00754-8 · Cited by 602
Johnson, D., Goodman, R., Patrinely, J., Stone, C., Zimmerman, E., Donald, R., Chang, S., Berkowitz, S., Finn, A., Jahangir, E., et al. (2023) · doi:10.21203/rs.3.rs-2566942/v1 · Cited by 598 · cited 1×
“Studies (11, 12) have shown that ChatGPT can provide accurate and relevant answers to a wide range of questions, outperforming previous models in terms of accuracy and efficiency.”
BackgroundGenerating scholarly content with ChatGPT: Ethical challenges for medical publishing
Liebrenz, M., Schleifer, R., Buadze, A., Bhugra, D., & Smith, A. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00019-5 · Cited by 594 · cited 4×
“Recent studies (18, 22–27) have identified both opportunities and challenges of applying ChatGPT in medical research.”
BackgroundInfluentialChatGPT and the future of medical writing
Biswas, S. (2023) · Radiology · doi:10.1148/radiol.223312 · Cited by 571
ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B. O., Ricke, J., et al. (2023) · European Radiology · doi:10.1007/s00330-023-10213-1 · Cited by 549 · cited 1×
“More study is required to solve ChatGPT’s shortcomings, which include those caused by the calibre and variety of the data used for training (14–16).”
BackgroundAI for life: Trends in artificial intelligence for biotechnology
Holzinger, A., Keiblinger, K., Holub, P., Zatloukal, K., & Müller, H. (2023) · New Biotechnology · doi:10.1016/j.nbt.2023.02.001 · Cited by 438
ChatGPT for healthcare services: An emerging stage for an innovative perspective
Javaid, M., Haleem, A., & Singh, R. P. (2023) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100105 · Cited by 429 · cited 1×
“Lack of regulatory compliances, issues with privacy and security were identified in recent studies (46– 48).”
BackgroundThe Future of AI in Medicine: A Perspective from a Chatbot
King, M. R. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-022-03121-w · Cited by 299
Analysing the Role of ChatGPT in Improving Student Productivity in Higher Education
Fauzi, F., Tuhuteru, L., Sampe, F., Ausat, A. M. A., & Hatta, H. R. (2023) · Journal on Education · doi:10.31004/joe.v5i4.2563 · Cited by 283
Samaan, J. S., Yeo, Y. H., Rajeev, N., Hawley, L., Abel, S., Ng, W. H., Srinivasan, N., Park, J., Burch, M., Watson, R., et al. (2023) · Obesity Surgery · doi:10.1007/s11695-023-06603-5 · Cited by 282
Putting ChatGPT’s Medical Advice to the (Turing) Test: Survey Study
Nov, O., Singh, N., & Mann, D. (2023) · JMIR Medical Education · doi:10.2196/46939 · Cited by 198
The opportunities and pitfalls of ChatGPT in clinical and translational medicine
Baumgartner, C. (2023) · Clinical and Translational Medicine · doi:10.1002/ctm2.1206 · Cited by 103
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B., Ricke, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.14882 · Cited by 97
Artificial Intelligence Discusses the Role of Artificial Intelligence in Translational Medicine
Mann, D. L. (2023) · JACC: Basic to Translational Science · doi:10.1016/j.jacbts.2023.01.001 · Cited by 93 · cited 2×
“As ChatGPT is now available for free, it is used by most of the researchers (41/62).”
Background(2023) · Iraqi Journal for Computer Science and Mathematics · doi:10.52866/20ijcsm.2023.01.01.0018 · Cited by 91
Does ChatGPT have semantic understanding? A problem with the statistics-of-occurrence strategy
Titus, L. M. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101174 · Cited by 82
Transforming Maritime Health with ChatGPT-Powered Healthcare Services for Mariners
Sharma, M., & Sharma, S. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03195-0 · Cited by 27
Cited by
Current trends and future implications in the utilization of ChatGPT in nursing: a rapid review
Kleib, M., Darko, E. M., Akingbade, O., Kennedy, M., Majekodunmi, P., Nickel, E., & Vogelsang, L. (2024) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2024.100252 · Cited by 40
“The evidence aligns with the study of Alsadhan et al. (2023), which identified training data leading to bias, ethical issues, technical limitations, and limitations in data collection and analysis as challenges to adopting ChatGPT in medical research.”
Embracing the future: Integrating ChatGPT into China’s nursing education system
Ni, Z., Peng, R., Zheng, X., & Xie, P. (2024) · International Journal of Nursing Sciences · doi:10.1016/j.ijnss.2024.03.006 · Cited by 35
“Because learning tool development and education development are inextricably linked, several studies have examined the potent data collection, text production, literature categorization, and self-correcting learning capabilities of ChatGPT 4.0 [8,9].”
BackgroundInfluentialVirtual Tutor, Digital Natives and AI: Analyzing the impact of ChatGPT on academia in Indonesia
Margono, H., Saud, M., & Falahat, M. (2024) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2024.101069 · Cited by 26
Yang, M., Long, J., He, Y., Meng, R., Ling, C., Long, Q., & Wen, J. (2026) · BMC Nursing · doi:10.1186/s12912-026-05132-7
Metadata
- Authors
- Alsadhan, A., Al-Anezi, F., Almohanna, A., Alnaim, N., Alzahrani, H., Shinawi, R., AboAlsamh, H., Bakhshwain, A., Alenazy, M., Arif, W., Alyousef, S., Alhamidi, S., Alghamdi, A., AlShrayfi, N., Rubaian, N. B., Alanzi, T., AlSahli, A., Alturki, R., & Herzallah, N.
- Venue
- Frontiers in Medicine
- Publisher
- Frontiers Media SA
- Published
- 2023-12-22
- Volume
- 10
- Pages
- 1259640-1259640
- ISSN
- 2296-858X (ISSN-L)
- OpenAlex
- W4390111556
- Cited by
- 31
- References
- 31
- FWCI
- 1.07
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.