The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.
Large AI Models in Health Informatics: Applications, Challenges, and the Future
Open accessAbstract
Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once pretrained, large AI models demonstrate impressive performance in various downstream tasks. A prime example is ChatGPT, whose capability has compelled people's imagination about the far-reaching influence that large AI models can have and their potential to transform different domains of our lives. In health informatics, the advent of large AI models has brought new paradigms for the design of methodologies. The scale of multi-modal data in the biomedical and health domain has been ever-expanding especially since the community embraced the era of deep learning, which provides the ground to develop, validate, and advance large AI models for breakthroughs in health-related areas. This article presents a comprehensive review of large AI models, from background to their applications. We identify seven key sectors in which large AI models are applicable and might have substantial influence, including: 1) bioinformatics; 2) medical diagnosis; 3) medical imaging; 4) medical informatics; 5) medical education; 6) public health; and 7) medical robotics. We examine their challenges, followed by a critical discussion about potential future directions and pitfalls of large AI models in transforming the field of health informatics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Research works printed but not linked: 57
- wang, 0, SimVLM: Simple visual language model pretraining with weak supervision, Proc Int Conf Learn Representations
- 10.1109/CVPR52688.2022.01519 · DOI · Paper page
- huang, 0, GPipe: Efficient training of giant neural networks using pipeline parallelism, Proc Adv Neural Inf Process Syst, 32
- tan, 0, EfficientNetV2: Smaller models and faster training, Proc Int Conf Mach Learn, 10096
- 10.1109/CVPR52688.2022.01167 · DOI · Paper page
- dehghani, 0, Scaling vision transformers to 22 billion parameters, Proc Int Conf Mach Learn, 7480
- 10.1109/CVPR52688.2022.01170 · DOI · Paper page
- vaswani, 0, Attention is all you need, Proc Adv Neural Inf Process Syst
- 10.1001/jama.2016.17216 · DOI · Paper page
- lee, 2023, The AI Revolution in Medicine GPT-4 and Beyond
- 10.1038/s41746-023-00840-9 · DOI
- siddiqui, 0, Metadata archaeology: Unearthing data subsets by leveraging training dynamics, Proc Int Conf Learn Representations
- lecun, 2022, A path towards autonomous machine intelligence version 0.9.2,2022-06-27, Open Review, 62
- 10.1016/j.clsr.2017.08.007 · DOI · Paper page
- elhage, 2021, A mathematical framework for transformer circuits, Transformer Circuits Thread, 1
- chen, 0, Generative pretraining from pixels, Proc Int Conf Mach Learn, 1691
- 10.1109/ICCV.2017.97 · DOI · Paper page
- ridnik, 0, ImageNet-21 K pretraining for the masses, Proc Adv Neural Inf Process Syst
- reed, 2022, A generalist agent, Trans Mach Learn Res
- 10.1007/978-3-030-01216-8_12 · DOI · Paper page
- 10.3390/robotics11060127 · DOI
- 10.1109/CVPR52688.2022.01179 · DOI · Paper page
- 10.1007/978-3-031-43996-4_27 · DOI
- chen, 0, A simple framework for contrastive learning of visual representations, Proc Int Conf Mach Learn, 1597
- li, 2023, Multi-step jailbreaking privacy attacks on chatGPT, 10.18653/v1/2023.findings-emnlp.272 · DOI · Paper page
- li, 0, Data augmentation alone can improve adversarial training, Proc Int Conf Learn Representations
- 10.7759/cureus.40895 · DOI · Paper page
- 10.18653/v1/2022.emnlp-main.130 · DOI · Paper page
- 10.1038/s41594-021-00714-2 · DOI · Paper page
- 10.15302/J-QB-023-0327 · DOI
- 10.1093/nar/gkab1074 · DOI · Paper page
- 10.1093/nar/gkaa921 · DOI · Paper page
- 10.1109/TCYB.2023.3243999 · DOI
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 10.2196/19273 · DOI · Paper page
- wu, 2022, High-resolution de novo structure prediction from primary sequence, BioRxiv
- 10.1109/BHI56158.2022.9926927 · DOI
- elnaggar, 2023, Ankh: Optimized protein language model unlocks general-purpose modelling, BioRxiv
- lin, 2022, Pangu drug model: Learn a molecule like a human, BioRxiv
- chen, 2023, xTrimoPGLM: Unified 100b-scale pre-trained transformer for deciphering the language of protein, BioRxiv
- 10.3390/s22082861 · DOI
- 10.1109/LRA.2022.3188101 · DOI
- 10.1126/science.ade2574 · doi:10.1126/science.ade2574 · Paper page
- 10.1007/978-3-031-43996-4_10 · DOI
- 10.1016/S0140-6736(19)32497-3 · DOI · Paper page
- madani, 2020, Progen: Language modeling for protein generation, 10.1101/2020.03.07.982272 · DOI · Paper page
- 10.1016/j.tibs.2014.10.005 · DOI · Paper page
- 10.18653/v1/2022.emnlp-main.256 · DOI · Paper page
- 10.1107/S2059798317016709 · DOI
- 10.1038/nsb1101-923 · DOI
- 10.3390/diagnostics13111947 · DOI
- 10.18653/v1/2022.acl-long.551 · DOI · Paper page
- kanakarajan, 0, Bioelectra: Pretrained biomedical text encoder using discriminators, Proc 20th Workshop Biomed Lang Process, 143
- 10.18653/v1/2020.emnlp-main.379 · DOI
- yu, 2022, Scaling autoregressive models for content-rich text-to-image generation, Trans Mach Learn Res
- 10.1093/bioinformatics/btz682 · DOI · Paper page
- 10.1038/s41746-022-00742-2 · DOI · Paper page
Cited by
Medical SAM adapter: Adapting segment anything model for medical image segmentation
Wu, J., Wang, Z., Hong, M., Ji, W., Fu, H., Xu, Y., Xu, M., & Jin, Y. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103547 · Cited by 677
A systematic review of large language models and their implications in medical education
Lucas, H. C., Upperman, J. S., & Robinson, J. R. (2024) · Medical Education · doi:10.1111/medu.15402 · Cited by 287
Foundation models in robotics: Applications, challenges, and the future
Firoozi, R., Tucker, J., Tian, S., Majumdar, A., Sun, J., Liu, W., Zhu, Y., Song, S., Kapoor, A., Hausman, K., et al. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649241281508 · Cited by 238
Self-citationLarge Language Model‐Based Chatbots in Higher Education
Yigci, D., Eryilmaz, M., Yetisen, A. K., Tasoglu, S., & Ozcan, A. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202400429 · Cited by 113
Analyzing evaluation methods for large language models in the medical field: a scoping review
Lee, J., Park, S., Shin, J., & Cho, B. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02709-7 · Cited by 52
Metadata
- Authors
- Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B., Yuan, W., Wang, N., Xu, D., & Lo, B.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2023-12
- Volume
- 27
- Issue
- 12
- Pages
- 6074-6087
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W4386973901
- Cited by
- 233
- References
- 105
- FWCI
- 8.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Research Grants Council (RGC) of Hong Kong SAR (ECS24211020, GRF14203821, GRF14216222)
- Innovation and Technology Fund (ITF) of Hong Kong SAR (ITS/240/21)
- Science, Technology and Innovation Commission (STIC) of Shenzhen Municipality (SGDX20220530111005039)
- Bill & Melinda Gates Foundation (OPP1171395)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Large AI Models in Health Informatics: Applications, Challenges, and the Future. https://app.cochat.ai/papers/10.1109/jbhi.2023.3316750
- The paper
- Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B., Yuan, W., Wang, N., Xu, D., & Lo, B. (2023). Large AI Models in Health Informatics: Applications, Challenges, and the Future. IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/jbhi.2023.3316750
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.