CoChat

Accelerating the integration of ChatGPT and other large‐scale AI models into biomedical research and healthcare

Open access
Wang, Ding‐Qiao, Feng, Long‐Yu, Ye, Jin‐Guo, Zou, Jin‐Gen, Zheng, Ying‐Feng · 2023 · MedComm – Future Medicine
Cited by 120

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.

Abstract

Large‐scale artificial intelligence (AI) models such as ChatGPT have the potential to improve performance on many benchmarks and real‐world tasks. However, it is difficult to develop and maintain these models because of their complexity and resource requirements. As a result, they are still inaccessible to healthcare industries and clinicians. This situation might soon be changed because of advancements in graphics processing unit (GPU) programming and parallel computing. More importantly, leveraging existing large‐scale AIs such as GPT‐4 and Med‐PaLM and integrating them into multiagent models (e.g., Visual‐ChatGPT) will facilitate real‐world implementations. This review aims to raise awareness of the potential applications of these models in healthcare. We provide a general overview of several advanced large‐scale AI models, including language models, vision‐language models, graph learning models, language‐conditioned multiagent models, and multimodal embodied models. We discuss their potential medical applications in addition to the challenges and future directions. Importantly, we stress the need to align these models with human values and goals, such as using reinforcement learning from human feedback, to ensure that they provide accurate and personalized insights that support human decision‐making and improve healthcare outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/mef2.43

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 63

  1. Wang B, 2021, Pre‐trained language models in biomedical domain: a survey from multiscale perspective, arXiv, 2110
  2. 10.1016/j.jbi.2021.103982 · DOI · Paper page
  3. OpenAI. GPT‐4 Technical Report. March 20 2023.https://arxiv.org/abs/2303.08774
  4. Kazerouni A, 2022, Diffusion models for medical image analysis: a comprehensive survey, arXiv, 2211
  5. Doersch C, 2016, Tutorial on variational autoencoders, arXiv, 1606
  6. Vaswani A, 2017, Attention is all you need, Adv Neural Inf Process Syst, 30, 1
  7. O'Shea K, 2015, An introduction to convolutional neural networks, arXiv, 151511
  8. Mikolov T, 2013, Efficient estimation of word representations in vector space, arXiv, 1301
  9. Dosovitskiy A, 2020, An image is worth 16 × 16 words: transformers for image recognition at scale, arXiv, 2010
  10. Zhang Z, 2023, Multimodal chain‐of‐thought reasoning in language models, arXiv, 2302
  11. Wang X, 2022, Self‐consistency improves chain of thought reasoning in language models, arXiv, 2203
  12. Arora S, 2022, Ask me anything: a simple strategy for prompting language models, arXiv, 2210
  13. Anonymous. Verify‐and‐edit: A knowledge‐enhanced chain‐of‐thought framework. Accessed March 20 2023.https://openreview.net/pdf?id=fmacccZByR.
  14. Bai Y, 2022, Constitutional AI: harmlessness from AI feedback, arXiv, 2212
  15. 10.1093/bioadv/vbac023 · DOI · Paper page
  16. ZengG YangW JuZ et al. MedDialog: Large‐scale medical dialogue datasets. InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)(pp. 9241‐9250).2020. Online. Association for Computational Linguistics. · DOI · Paper page
  17. Liu W, 2022, MedDG: An Entity‐Centric Medical Consultation Dataset for Entity‐Aware Medical Dialogue Generation, 447
  18. 10.1093/bioinformatics/btab083 · DOI · Paper page
  19. 10.1038/s42256-022-00499-z · DOI · Paper page
  20. Madani A, 2020, Progen: language modeling for protein generation, arXiv, 2004
  21. ChithranandaS GrandG RamsundarB.Chemberta: large‐scale self‐supervised pretraining for molecular property prediction.arXiv.2020;2010:09885.
  22. WangS GuoY WangY SunH HuangJ.SMILES‐BERT: large scale unsupervised pre‐training for molecular property prediction.2019. pp. 429‐436. · DOI · Paper page
  23. 10.1109/JBHI.2022.3207502 · DOI · Paper page
  24. Eslami S, 2021, Does clip benefit visual question answering in the medical domain as much as it does in the general domain?, arXiv, 2112
  25. Zhang Y, 2022, Contrastive learning of medical visual representations from paired images and text, Proc Mach Learn Res, 182, 2
  26. 10.1097/SLA.0000000000002665 · DOI · Paper page
  27. 10.1038/s41598-022-15496-w · DOI
  28. 10.1016/j.artmed.2021.102032 · DOI
  29. Huang H, 2022, Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi‐View Ultrasound, 665
  30. MayyaV KarthikK SowmyaKS KaradkaK JeganathanJ.COVIDDX: AI‐based clinical decision support system for learning COVID‐19 disease representations from multimodal patient data. 14th International Conference on Health Informatics.2021. pp. 659‐666. · doi:10.5220/0010341906590666
  31. 10.1016/j.ophtha.2022.02.017 · DOI · Paper page
  32. Wang M, 2019, Deep graph library: a graph‐centric, highly‐performant package for graph neural networks, arXiv, 1909
  33. Gilmer J, 2017, Neural message passing for quantum chemistry, Proc Mach Learn Res, 70, 1263
  34. Qiu S, 2022, Optimizing Sparse Matrix Multiplications for Graph Neural Networks, 101
  35. MorrisC RitzertM FeyM et al.Weisfeiler and leman go neural: Higher‐order graph neural networks. In Proceedings of the Thirty‐Third AAAI Conference on Artificial Intelligence and Thirty‐First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence.2019. pp. 4602‐4609. · DOI · Paper page
  36. Xu K, 2021, Optimization of graph neural networks: implicit acceleration by skip connections and more depth, Proc Mach Learn Res, 139, 11592
  37. Alon U, 2020, On the bottleneck of graph neural networks and its practical implications, arXiv, 2006
  38. Yun S, 2019, Graph transformer networks, Adv Neural Inf Process Syst, 32, 1
  39. Rampášek L, 2022, Recipe for a general, powerful, scalable graph transformer, arXiv
  40. Chen D, 2022, Structure‐aware transformer for graph representation learning, Proc Mach Learn Res, 162, 3469
  41. Mialon G, 2021, Graphit: encoding graph structure in transformers, arXiv, 2106
  42. Gao Z, 2022, AlphaDesign: a graph protein design method and benchmark on AlphaFoldDB, arXiv, 2202
  43. 10.3390/biom12111709 · DOI
  44. 10.1021/acs.jmedchem.2c00991 · DOI · Paper page
  45. Chen X, 2022, DProQ: a gated‐graph transformer for protein complex structure assessment, bioRxiv
  46. 10.1186/s13321-023-00694-z · DOI
  47. Wang Y, 2022, MechRetro is a chemical‐mechanism‐driven graph learning framework for interpretable retrosynthesis prediction and pathway planning, arXiv, 2210
  48. 10.1093/bib/bbad079 · DOI
  49. 10.1109/MCAS.2006.1688199 · DOI · Paper page
  50. 10.1002/aisy.202000071 · DOI · Paper page
  51. 10.1177/1050651920958507 · DOI
  52. SeethalakshmiV AbivishnuS KumarSAI DeepthiyaC.Development of Health Monitoring Robot with Smart Medication for Elderly People “2022 8th International Conference on Advanced Computing and Communication Systems (ICACCS) ” Coimbatore India.2022. pp. 01‐05. · doi:10.1109/icaccs54159.2022.9785166
  53. SoleymaniA LiX TavakoliM.Deep neural skill assessment and transfer: application to robotic surgery training. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Prague Czech Republic.2021. pp. 8822‐8829. · DOI
  54. 10.1016/j.compmedimag.2009.07.007 · DOI
  55. Bian Z, 2021, Colossal‐AI: a unified deep learning system for large‐scale parallel training, arXiv, 2110
  56. 10.1007/978-1-4842-4470-8_2 · DOI
  57. Price W, 2019, Medical AI and contextual bias, Harv JL & Tech, 33, 65
  58. 10.1016/S2589-7500(20)30275-2 · DOI · Paper page
  59. 10.1056/NEJMp1703370 · DOI · Paper page
  60. 10.1197/jamia.M2562 · DOI · Paper page
  61. Naughton J., 2017, Giving Google our private NHS data is simply illegal, The Guardian, 9, 9
  62. 10.1038/s41467-020-19784-9 · DOI · Paper page
  63. Rajbhandari S, 2022, Deepspeed‐moe: advancing mixture‐of‐experts inference and training to power next‐generation ai scale, Int Conf Mach Learn, 18332

Cited by

See all 120

Metadata

Authors
Wang, D., Feng, L., Ye, J., Zou, J., & Zheng, Y.
Venue
MedComm – Future Medicine
Publisher
Wiley
Published
2023-05-17
Volume
2
Issue
2
ISSN
2769-6456 (ISSN-L)
OpenAlex
W4377043947
Cited by
120
References
61
FWCI
4.15
Type
journal article
Language
en
Open access
diamond
Funders
National Natural Science Foundation of China (82171034)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.