Accelerating the integration of ChatGPT and other large‐scale AI models into biomedical research and healthcare
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Large‐scale artificial intelligence (AI) models such as ChatGPT have the potential to improve performance on many benchmarks and real‐world tasks. However, it is difficult to develop and maintain these models because of their complexity and resource requirements. As a result, they are still inaccessible to healthcare industries and clinicians. This situation might soon be changed because of advancements in graphics processing unit (GPU) programming and parallel computing. More importantly, leveraging existing large‐scale AIs such as GPT‐4 and Med‐PaLM and integrating them into multiagent models (e.g., Visual‐ChatGPT) will facilitate real‐world implementations. This review aims to raise awareness of the potential applications of these models in healthcare. We provide a general overview of several advanced large‐scale AI models, including language models, vision‐language models, graph learning models, language‐conditioned multiagent models, and multimodal embodied models. We discuss their potential medical applications in addition to the challenges and future directions. Importantly, we stress the need to align these models with human values and goals, such as using reinforcement learning from human feedback, to ensure that they provide accurate and personalized insights that support human decision‐making and improve healthcare outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Research works printed but not linked: 63
- Wang B, 2021, Pre‐trained language models in biomedical domain: a survey from multiscale perspective, arXiv, 2110
- 10.1016/j.jbi.2021.103982 · DOI · Paper page
- OpenAI. GPT‐4 Technical Report. March 20 2023.https://arxiv.org/abs/2303.08774
- Kazerouni A, 2022, Diffusion models for medical image analysis: a comprehensive survey, arXiv, 2211
- Doersch C, 2016, Tutorial on variational autoencoders, arXiv, 1606
- Vaswani A, 2017, Attention is all you need, Adv Neural Inf Process Syst, 30, 1
- O'Shea K, 2015, An introduction to convolutional neural networks, arXiv, 151511
- Mikolov T, 2013, Efficient estimation of word representations in vector space, arXiv, 1301
- Dosovitskiy A, 2020, An image is worth 16 × 16 words: transformers for image recognition at scale, arXiv, 2010
- Zhang Z, 2023, Multimodal chain‐of‐thought reasoning in language models, arXiv, 2302
- Wang X, 2022, Self‐consistency improves chain of thought reasoning in language models, arXiv, 2203
- Arora S, 2022, Ask me anything: a simple strategy for prompting language models, arXiv, 2210
- Anonymous. Verify‐and‐edit: A knowledge‐enhanced chain‐of‐thought framework. Accessed March 20 2023.https://openreview.net/pdf?id=fmacccZByR.
- Bai Y, 2022, Constitutional AI: harmlessness from AI feedback, arXiv, 2212
- 10.1093/bioadv/vbac023 · DOI · Paper page
- ZengG YangW JuZ et al. MedDialog: Large‐scale medical dialogue datasets. InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)(pp. 9241‐9250).2020. Online. Association for Computational Linguistics. · DOI · Paper page
- Liu W, 2022, MedDG: An Entity‐Centric Medical Consultation Dataset for Entity‐Aware Medical Dialogue Generation, 447
- 10.1093/bioinformatics/btab083 · DOI · Paper page
- 10.1038/s42256-022-00499-z · DOI · Paper page
- Madani A, 2020, Progen: language modeling for protein generation, arXiv, 2004
- ChithranandaS GrandG RamsundarB.Chemberta: large‐scale self‐supervised pretraining for molecular property prediction.arXiv.2020;2010:09885.
- WangS GuoY WangY SunH HuangJ.SMILES‐BERT: large scale unsupervised pre‐training for molecular property prediction.2019. pp. 429‐436. · DOI · Paper page
- 10.1109/JBHI.2022.3207502 · DOI · Paper page
- Eslami S, 2021, Does clip benefit visual question answering in the medical domain as much as it does in the general domain?, arXiv, 2112
- Zhang Y, 2022, Contrastive learning of medical visual representations from paired images and text, Proc Mach Learn Res, 182, 2
- 10.1097/SLA.0000000000002665 · DOI · Paper page
- 10.1038/s41598-022-15496-w · DOI
- 10.1016/j.artmed.2021.102032 · DOI
- Huang H, 2022, Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi‐View Ultrasound, 665
- MayyaV KarthikK SowmyaKS KaradkaK JeganathanJ.COVIDDX: AI‐based clinical decision support system for learning COVID‐19 disease representations from multimodal patient data. 14th International Conference on Health Informatics.2021. pp. 659‐666. · doi:10.5220/0010341906590666
- 10.1016/j.ophtha.2022.02.017 · DOI · Paper page
- Wang M, 2019, Deep graph library: a graph‐centric, highly‐performant package for graph neural networks, arXiv, 1909
- Gilmer J, 2017, Neural message passing for quantum chemistry, Proc Mach Learn Res, 70, 1263
- Qiu S, 2022, Optimizing Sparse Matrix Multiplications for Graph Neural Networks, 101
- MorrisC RitzertM FeyM et al.Weisfeiler and leman go neural: Higher‐order graph neural networks. In Proceedings of the Thirty‐Third AAAI Conference on Artificial Intelligence and Thirty‐First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence.2019. pp. 4602‐4609. · DOI · Paper page
- Xu K, 2021, Optimization of graph neural networks: implicit acceleration by skip connections and more depth, Proc Mach Learn Res, 139, 11592
- Alon U, 2020, On the bottleneck of graph neural networks and its practical implications, arXiv, 2006
- Yun S, 2019, Graph transformer networks, Adv Neural Inf Process Syst, 32, 1
- Rampášek L, 2022, Recipe for a general, powerful, scalable graph transformer, arXiv
- Chen D, 2022, Structure‐aware transformer for graph representation learning, Proc Mach Learn Res, 162, 3469
- Mialon G, 2021, Graphit: encoding graph structure in transformers, arXiv, 2106
- Gao Z, 2022, AlphaDesign: a graph protein design method and benchmark on AlphaFoldDB, arXiv, 2202
- 10.3390/biom12111709 · DOI
- 10.1021/acs.jmedchem.2c00991 · DOI · Paper page
- Chen X, 2022, DProQ: a gated‐graph transformer for protein complex structure assessment, bioRxiv
- 10.1186/s13321-023-00694-z · DOI
- Wang Y, 2022, MechRetro is a chemical‐mechanism‐driven graph learning framework for interpretable retrosynthesis prediction and pathway planning, arXiv, 2210
- 10.1093/bib/bbad079 · DOI
- 10.1109/MCAS.2006.1688199 · DOI · Paper page
- 10.1002/aisy.202000071 · DOI · Paper page
- 10.1177/1050651920958507 · DOI
- SeethalakshmiV AbivishnuS KumarSAI DeepthiyaC.Development of Health Monitoring Robot with Smart Medication for Elderly People “2022 8th International Conference on Advanced Computing and Communication Systems (ICACCS) ” Coimbatore India.2022. pp. 01‐05. · doi:10.1109/icaccs54159.2022.9785166
- SoleymaniA LiX TavakoliM.Deep neural skill assessment and transfer: application to robotic surgery training. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Prague Czech Republic.2021. pp. 8822‐8829. · DOI
- 10.1016/j.compmedimag.2009.07.007 · DOI
- Bian Z, 2021, Colossal‐AI: a unified deep learning system for large‐scale parallel training, arXiv, 2110
- 10.1007/978-1-4842-4470-8_2 · DOI
- Price W, 2019, Medical AI and contextual bias, Harv JL & Tech, 33, 65
- 10.1016/S2589-7500(20)30275-2 · DOI · Paper page
- 10.1056/NEJMp1703370 · DOI · Paper page
- 10.1197/jamia.M2562 · DOI · Paper page
- Naughton J., 2017, Giving Google our private NHS data is simply illegal, The Guardian, 9, 9
- 10.1038/s41467-020-19784-9 · DOI · Paper page
- Rajbhandari S, 2022, Deepspeed‐moe: advancing mixture‐of‐experts inference and training to power next‐generation ai scale, Int Conf Mach Learn, 18332
Cited by
Antimicrobial resistance: Impacts, challenges, and future prospects
Ahmed, S. K., Hussein, S., Qurbani, K., Ibrahim, R. H., Fareeq, A., Mahmood, K. A., & Mohamed, M. G. (2024) · Journal of Medicine, Surgery, and Public Health · doi:10.1016/j.glmedi.2024.100081 · Cited by 1,213
Zhou, H.-Y., Yu, Y., Wang, C., Zhang, S., Gao, Y., Pan, J., Shao, J., Lu, G., Zhang, K., & Li, W. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01045-x · Cited by 343
A systematic review of large language models and their implications in medical education
Lucas, H. C., Upperman, J. S., & Robinson, J. R. (2024) · Medical Education · doi:10.1111/medu.15402 · Cited by 287
A comprehensive survey of ChatGPT: Advancements, applications, prospects, and challenges
Nazir, A., & Wang, Z. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100022 · Cited by 245
Large Language Models in Healthcare and Medical Applications: A Review
Maity, S., & Saikia, M. J. (2025) · Bioengineering · doi:10.3390/bioengineering12060631 · Cited by 249
“The ability of LLMs to simulate patient encounters with diverse presentations and complexities offers valuable opportunities for students to develop clinical reasoning skills in a safe and controlled environment [12,30].”
Choudhury, A., & Chaudhry, Z. (2024) · Journal of Medical Internet Research · doi:10.2196/56764 · Cited by 159
Large Language Model‐Based Chatbots in Higher Education
Yigci, D., Eryilmaz, M., Yetisen, A. K., Tasoglu, S., & Ozcan, A. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202400429 · Cited by 113
Reddy, S. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101304 · Cited by 99
Alhur, A. (2024) · Cureus · doi:10.7759/cureus.57795 · Cited by 82
Wang, D., Liang, J., Ye, J., Li, J., Li, J., Zhang, Q., Hu, Q., Pan, C., Wang, D., Liu, Z., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/58041 · Cited by 76
Self-citation
Metadata
- Authors
- Wang, D., Feng, L., Ye, J., Zou, J., & Zheng, Y.
- Venue
- MedComm – Future Medicine
- Publisher
- Wiley
- Published
- 2023-05-17
- Volume
- 2
- Issue
- 2
- ISSN
- 2769-6456 (ISSN-L)
- OpenAlex
- W4377043947
- Cited by
- 120
- References
- 61
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- diamond
- Funders
- National Natural Science Foundation of China (82171034)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.