Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 233

The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.

Large AI Models in Health Informatics: Applications, Challenges, and the Future

Open access
Qiu, Jianing, Li, Lin, Sun, Jiankai, Peng, Jiachuan, Shi, Peilun, Zhang, Ruiyang, Dong, Yinzhao, Lam, Kyle, Lo, Frank P.-W., Xiao, Bo, Yuan, Wu, Wang, Ningli, Xu, Dong, Lo, Benny·2023·IEEE Journal of Biomedical and Health Informatics

Abstract

Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once pretrained, large AI models demonstrate impressive performance in various downstream tasks. A prime example is ChatGPT, whose capability has compelled people's imagination about the far-reaching influence that large AI models can have and their potential to transform different domains of our lives. In health informatics, the advent of large AI models has brought new paradigms for the design of methodologies. The scale of multi-modal data in the biomedical and health domain has been ever-expanding especially since the community embraced the era of deep learning, which provides the ground to develop, validate, and advance large AI models for breakthroughs in health-related areas. This article presents a comprehensive review of large AI models, from background to their applications. We identify seven key sectors in which large AI models are applicable and might have substantial influence, including: 1) bioinformatics; 2) medical diagnosis; 3) medical imaging; 4) medical informatics; 5) medical education; 6) public health; and 7) medical robotics. We examine their challenges, followed by a critical discussion about potential future directions and pitfalls of large AI models in transforming the field of health informatics.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jbhi.2023.3316750

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 105 references

Research works printed but not linked: 57

  1. wang, 0, SimVLM: Simple visual language model pretraining with weak supervision, Proc Int Conf Learn Representations
  2. 10.1109/CVPR52688.2022.01519 · DOI · Paper page
  3. huang, 0, GPipe: Efficient training of giant neural networks using pipeline parallelism, Proc Adv Neural Inf Process Syst, 32
  4. tan, 0, EfficientNetV2: Smaller models and faster training, Proc Int Conf Mach Learn, 10096
  5. 10.1109/CVPR52688.2022.01167 · DOI · Paper page
  6. dehghani, 0, Scaling vision transformers to 22 billion parameters, Proc Int Conf Mach Learn, 7480
  7. 10.1109/CVPR52688.2022.01170 · DOI · Paper page
  8. vaswani, 0, Attention is all you need, Proc Adv Neural Inf Process Syst
  9. 10.1001/jama.2016.17216 · DOI · Paper page
  10. lee, 2023, The AI Revolution in Medicine GPT-4 and Beyond
  11. 10.1038/s41746-023-00840-9 · DOI
  12. siddiqui, 0, Metadata archaeology: Unearthing data subsets by leveraging training dynamics, Proc Int Conf Learn Representations
  13. lecun, 2022, A path towards autonomous machine intelligence version 0.9.2,2022-06-27, Open Review, 62
  14. 10.1016/j.clsr.2017.08.007 · DOI · Paper page
  15. elhage, 2021, A mathematical framework for transformer circuits, Transformer Circuits Thread, 1
  16. chen, 0, Generative pretraining from pixels, Proc Int Conf Mach Learn, 1691
  17. 10.1109/ICCV.2017.97 · DOI · Paper page
  18. ridnik, 0, ImageNet-21 K pretraining for the masses, Proc Adv Neural Inf Process Syst
  19. reed, 2022, A generalist agent, Trans Mach Learn Res
  20. 10.1007/978-3-030-01216-8_12 · DOI · Paper page
  21. 10.3390/robotics11060127 · DOI
  22. 10.1109/CVPR52688.2022.01179 · DOI · Paper page
  23. 10.1007/978-3-031-43996-4_27 · DOI
  24. chen, 0, A simple framework for contrastive learning of visual representations, Proc Int Conf Mach Learn, 1597
  25. li, 2023, Multi-step jailbreaking privacy attacks on chatGPT, 10.18653/v1/2023.findings-emnlp.272 · DOI · Paper page
  26. li, 0, Data augmentation alone can improve adversarial training, Proc Int Conf Learn Representations
  27. 10.7759/cureus.40895 · DOI · Paper page
  28. 10.18653/v1/2022.emnlp-main.130 · DOI · Paper page
  29. 10.1038/s41594-021-00714-2 · DOI · Paper page
  30. 10.15302/J-QB-023-0327 · DOI
  31. 10.1093/nar/gkab1074 · DOI · Paper page
  32. 10.1093/nar/gkaa921 · DOI · Paper page
  33. 10.1109/TCYB.2023.3243999 · DOI
  34. 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
  35. 10.2196/19273 · DOI · Paper page
  36. wu, 2022, High-resolution de novo structure prediction from primary sequence, BioRxiv
  37. 10.1109/BHI56158.2022.9926927 · DOI
  38. elnaggar, 2023, Ankh: Optimized protein language model unlocks general-purpose modelling, BioRxiv
  39. lin, 2022, Pangu drug model: Learn a molecule like a human, BioRxiv
  40. chen, 2023, xTrimoPGLM: Unified 100b-scale pre-trained transformer for deciphering the language of protein, BioRxiv
  41. 10.3390/s22082861 · DOI
  42. 10.1109/LRA.2022.3188101 · DOI
  43. 10.1126/science.ade2574 · doi:10.1126/science.ade2574 · Paper page
  44. 10.1007/978-3-031-43996-4_10 · DOI
  45. 10.1016/S0140-6736(19)32497-3 · DOI · Paper page
  46. madani, 2020, Progen: Language modeling for protein generation, 10.1101/2020.03.07.982272 · DOI · Paper page
  47. 10.1016/j.tibs.2014.10.005 · DOI · Paper page
  48. 10.18653/v1/2022.emnlp-main.256 · DOI · Paper page
  49. 10.1107/S2059798317016709 · DOI
  50. 10.1038/nsb1101-923 · DOI
  51. 10.3390/diagnostics13111947 · DOI
  52. 10.18653/v1/2022.acl-long.551 · DOI · Paper page
  53. kanakarajan, 0, Bioelectra: Pretrained biomedical text encoder using discriminators, Proc 20th Workshop Biomed Lang Process, 143
  54. 10.18653/v1/2020.emnlp-main.379 · DOI
  55. yu, 2022, Scaling autoregressive models for content-rich text-to-image generation, Trans Mach Learn Res
  56. 10.1093/bioinformatics/btz682 · DOI · Paper page
  57. 10.1038/s41746-022-00742-2 · DOI · Paper page

Cited by

See all 233

Metadata

Authors
Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B., Yuan, W., Wang, N., Xu, D., & Lo, B.
Venue
IEEE Journal of Biomedical and Health Informatics
Published
2023-12
Volume
27
Issue
12
Pages
6074-6087
ISSN
  • 2168-2194 (ISSN-L)
  • 2168-2208
OpenAlex
W4386973901
Cited by
233
References
105
FWCI
8.06
Type
journal article
Language
en
Open access
hybrid
Funders
  • Research Grants Council (RGC) of Hong Kong SAR (ECS24211020, GRF14203821, GRF14216222)
  • Innovation and Technology Fund (ITF) of Hong Kong SAR (ITS/240/21)
  • Science, Technology and Innovation Commission (STIC) of Shenzhen Municipality (SGDX20220530111005039)
  • Bill & Melinda Gates Foundation (OPP1171395)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Large AI Models in Health Informatics: Applications, Challenges, and the Future. https://app.cochat.ai/papers/10.1109/jbhi.2023.3316750
The paper
Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B., Yuan, W., Wang, N., Xu, D., & Lo, B. (2023). Large AI Models in Health Informatics: Applications, Challenges, and the Future. IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/jbhi.2023.3316750

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.