CoChat

Transformers and large language models in healthcare: A review

Open access
Nerella, Subhash, Bandyopadhyay, Sabyasachi, Zhang, Jiaqing, Contreras, Miguel, Siegel, Scott, Bumin, Aysegul, Silva, Brandon, Sena, Jessica, Shickel, Benjamin, Bihorac, Azra, Khezeli, Kia, Rashidi, Parisa · 2024 · Artificial Intelligence in Medicine
Cited by 197

The DOI matches its Crossref record; 134 of the 134 references it cites were found in a registry or an index.

Abstract

With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of healthcare data, including clinical NLP, medical imaging, structured Electronic Health Records (EHR), social media, bio-physiological signals, biomolecular sequences. Furthermore, which have also include the articles that used the transformer architecture for generating surgical instructions and predicting adverse outcomes after surgeries under the umbrella of critical care. Under diverse settings, these models have been used for clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. Finally, we also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.artmed.2024.102900

Cites

134 of 134 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 134 references

Research works printed but not linked: 304

  1. Vaswani, 2017, Attention is all you need, Adv Neural Inf Proces Syst, 5998
  2. Xu, 2023, 45(10), 12113
  3. Parvaiz, 2023, Vision Transformers in medical computer vision—A contemplative retrospection, Eng Appl Artif Intell, 122, 10.1016/j.engappai.2023.106126 · DOI · Paper page
  4. T. Mikolov, W.-t. Yih, and G. Zweig, "Linguistic regularities in continuous space word representations," in Proceedings of the 2013 conference of the north american chapter of the association for computational linguistics: Human language technologies, 2013, pp. 746-751.
  5. J. Pennington, R. Socher, and C. D. Manning, "Glove: Global vectors for word representation," in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1532-1543. · DOI · Paper page
  6. Johnson, 2016, MIMIC-III, a freely accessible critical care database, Sci Data, 3, 1, 10.1038/sdata.2016.35 · DOI · Paper page
  7. Doğan, 2014, NCBI disease corpus: a resource for disease name recognition and concept normalization, J Biomed Inform, 47, 1, 10.1016/j.jbi.2013.12.006 · DOI · Paper page
  8. Uzuner, 2011, 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text, J Am Med Inform Assoc, 18, 552, 10.1136/amiajnl-2011-000203 · DOI · Paper page
  9. Li, 2016, BioCreative V CDR task corpus: a resource for chemical disease relation extraction, Database, 2016
  10. Krallinger, 2015, The CHEMDNER corpus of chemicals and drugs and its annotation principles, J Chem, 7, 1
  11. Smith, 2008, Overview of BioCreative II gene mention recognition, Genome Biol, 9, 1
  12. J.-D. Kim, T. Ohta, Y. Tsuruoka, Y. Tateisi, and N. Collier, "Introduction to the bio-entity recognition task at JNLPBA," in Proceedings of the international joint workshop on natural language processing in biomedicine and its applications, 2004: Citeseer, pp. 70-75. · DOI · Paper page
  13. Gerner, 2010, LINNAEUS: a species name identification system for biomedical literature, BMC Bioinform, 11, 1, 10.1186/1471-2105-11-85 · DOI · Paper page
  14. Bravo, 2015, Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research, BMC Bioinform, 16, 1, 10.1186/s12859-015-0472-9 · DOI · Paper page
  15. Van Mulligen, 2012, The EU-ADR corpus: annotated drugs, diseases, targets, and their relationships, J Biomed Inform, 45, 879, 10.1016/j.jbi.2012.04.004 · DOI
  16. Krallinger, 2017, Overview of the BioCreative VI chemical-protein interaction Track, Proceedings of the sixth BioCreative challenge evaluation workshop, 1, 141
  17. Sun, 2013, Evaluating temporal relations in clinical text: 2012 i2b2 challenge, J Am Med Inform Assoc, 20, 806, 10.1136/amiajnl-2013-001628 · DOI · Paper page
  18. Sun, 2013, Annotating temporal information in clinical narratives, J Biomed Inform, 46, S5, 10.1016/j.jbi.2013.07.004 · DOI
  19. A. Romanov and C. Shivade, "Lessons from natural language inference in the clinical domain," arXiv preprint arXiv:1808.06752, 2018. · DOI · Paper page
  20. Uzuner, 2007, Evaluating the state-of-the-art in automatic de-identification, J Am Med Inform Assoc, 14, 550, 10.1197/jamia.M2444 · DOI · Paper page
  21. Stubbs, 2015, Automated systems for the de-identification of longitudinal clinical narratives: Overview of 2014 i2b2/UTHealth shared task Track 1, J Biomed Inform, 58, S11, 10.1016/j.jbi.2015.06.007 · DOI · Paper page
  22. Stubbs, 2015, Annotating longitudinal clinical narratives for de-identification: The 2014 i2b2/UTHealth corpus, J Biomed Inform, 58, S20, 10.1016/j.jbi.2015.07.020 · DOI · Paper page
  23. S. Pradhan, N. Elhadad, W. W. Chapman, S. Manandhar, and G. Savova, "SemEval-2014 Task 7: Analysis of clinical text," in SemEval@ COLING, 2014, pp. 54-62. · DOI · Paper page
  24. N. Elhadad, S. Pradhan, S. Gorman, S. Manandhar, W. Chapman, and G. Savova, "SemEval-2015 task 14: Analysis of clinical text," in proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), 2015, pp. 303-310. · DOI
  25. S. Bethard, G. Savova, W.-T. Chen, L. Derczynski, J. Pustejovsky, and M. Verhagen, "Semeval-2016 task 12: Clinical tempeval," in Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), 2016, pp. 1052-1062. · DOI · Paper page
  26. Soğancıoğlu, 2017, BIOSSES: a semantic sentence similarity estimation system for the biomedical domain, Bioinformatics, 33, i49, 10.1093/bioinformatics/btx238 · DOI · Paper page
  27. Herrero-Zazo, 2013, The DDI corpus: An annotated corpus with pharmacological substances and drug–drug interactions, J Biomed Inform, 46, 914, 10.1016/j.jbi.2013.07.011 · DOI · Paper page
  28. Baker, 2016, Automatic semantic classification of scientific literature according to the hallmarks of cancer, Bioinformatics, 32, 432, 10.1093/bioinformatics/btv585 · DOI
  29. A. Nentidis, A. Krithara, K. Bougiatiotis, G. Paliouras, and I. Kakadiaris, "Results of the sixth edition of the BioASQ Challenge," Brussels, Belgium, November 2018: Association for Computational Linguistics, in Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering, pp. 1-10, doi:10.18653/v1/W18-5301. [Online]. Available: https://aclanthology.org/W18-5301[Online]. Available: doi:10.18653/v1/W18-5301. · DOI
  30. Yang, 2020, Clinical concept extraction using transformers, J Am Med Inform Assoc, 27, 1935, 10.1093/jamia/ocaa189 · DOI
  31. Stubbs, 2019, Cohort selection for clinical trials: n2c2 2018 shared task track 1, J Am Med Inform Assoc, 26, 1163, 10.1093/jamia/ocz163 · DOI
  32. Henry, 2020, 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records, J Am Med Inform Assoc, 27, 3, 10.1093/jamia/ocz166 · DOI · Paper page
  33. Mayer, 2020, "Transformer-based argument mining for healthcare applications," in ECAI, IOS Press, 2020, 2108
  34. K. Huang et al., "Clinical XLNet: Modeling sequential clinical notes and predicting prolonged mechanical ventilation," arXiv preprint arXiv:1912.11975, 2019. · DOI
  35. X. Yu, W. Hu, S. Lu, X. Sun, and Z. Yuan, "Biobert based named entity recognition in electronic medical record," in 2019 10th international conference on information technology in medicine and education (ITME), 2019: IEEE, pp. 49-52. · DOI
  36. Alimova, 2020, Multiple features for clinical relation extraction: A machine learning approach, J Biomed Inform, 103, 10.1016/j.jbi.2020.103382 · DOI
  37. Jagannatha, 2019, Overview of the first natural language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes (MADE 1.0), Drug Saf, 42, 99, 10.1007/s40264-018-0762-z · DOI · Paper page
  38. Ji, 2020, BERT-based ranking for biomedical entity normalization, AMIA Summits on Translational Science Proceedings, 2020, 269
  39. Pradhan, 2015, Evaluating the state of the art in disorder recognition and normalization of the clinical narrative, J Am Med Inform Assoc, 22, 143, 10.1136/amiajnl-2013-002544 · DOI · Paper page
  40. Yang, 2020, Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models, JMIR Med Inform, 8, 10.2196/19735 · DOI
  41. Wang, 2020, The 2019 n2c2/OHNLP track on clinical semantic textual similarity: overview, JMIR Med Inform, 8, 10.2196/23375 · DOI · Paper page
  42. S. Jiang, S. Zhao, K. Hou, Y. Liu, and L. Zhang, "A BERT-BiLSTM-CRF model for Chinese electronic medical records named entity recognition," in 2019 12th International Conference on Intelligent Computation Technology and Automation (ICICTA), 2019: IEEE, pp. 166-169. · DOI
  43. U. Naseem, K. Musial, P. Eklund, and M. Prasad, "Biomedical named-entity recognition by hierarchically fusing biobert representations and deep contextual-level word-embedding," in 2020 International joint conference on neural networks (IJCNN), 2020: IEEE, pp. 1-8. · DOI
  44. Z. Dai, X. Wang, P. Ni, Y. Li, G. Li, and X. Bai, "Named entity recognition using BERT BiLSTM CRF for Chinese electronic health records," in 2019 12th international congress on image and signal processing, biomedical engineering and informatics (cisp-bmei), 2019: IEEE, pp. 1-5. · DOI · Paper page
  45. Li, 2020, Chinese clinical named entity recognition with variant neural structures based on BERT methods, J Biomed Inform, 107, 10.1016/j.jbi.2020.103422 · DOI · Paper page
  46. Kim, 2020, Korean clinical entity recognition from diagnosis text using BERT, BMC Med Inform Decis Mak, 20, 1
  47. Catelli, 2020, Crosslingual named entity recognition for clinical de-identification applied to a COVID-19 Italian data set, Appl Soft Comput, 97, 10.1016/j.asoc.2020.106779 · DOI
  48. R. Vunikili, H. Supriya, V. G. Marica, and O. Farri, "Clinical NER using Spanish BERT Embeddings," in IberLEF@ SEPLN, 2020, pp. 505-511.
  49. Boudjellal, 2021, ABioNER: a BERT-based model for Arabic biomedical named-entity recognition, Complexity, 2021, 1, 10.1155/2021/6633213 · DOI
  50. G. Michalopoulos, Y. Wang, H. Kaka, H. Chen, and A. Wong, "Umlsbert: Clinical domain knowledge augmentation of contextual embeddings using the unified medical language system metathesaurus," arXiv preprint arXiv:2010.10391, 2020. · DOI · Paper page
  51. A. García-Pablos, N. Perez, and M. Cuadros, "Sensitive data detection and classification in Spanish clinical text: Experiments with BERT," arXiv preprint arXiv:2003.03106, 2020. · arXiv
  52. J. Mao and W. Liu, "Hadoken: a BERT-CRF Model for Medical Document Anonymization," in IberLEF@ SEPLN, 2019, pp. 720-726.
  53. M. Marimon et al., "Automatic De-identification of Medical Texts in Spanish: the MEDDOCAN Track, Corpus, Guidelines, Methods and Evaluation of Results," in IberLEF@ SEPLN, 2019, pp. 618-638.
  54. R. Leaman and Z. Lu, "TaggerOne: joint named entity recognition and normalization with semi-Markov Models," (in eng), Bioinformatics (Oxford, England), vol. 32, no. 18, pp. 2839-2846, 2016/09/15/ 2016, doi:https://doi.org/10.1093/bioinformatics/btw343. · DOI · Paper page
  55. H.-L. Trieu, A.-K. D. Nguyen, N. Nguyen, M. Miwa, H. Takamura, and S. Ananiadou, "Coreference resolution in full text articles with bert and syntax-based mention filtering," in Proceedings of The 5th Workshop on BioNLP Open Shared Tasks, 2019, pp. 196-205. · DOI
  56. Cohen, 2017, Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles, BMC Bioinform, 18, 1, 10.1186/s12859-017-1775-9 · DOI
  57. J. M. Steinkamp, W. Bala, A. Sharma, and J. J. Kantrowitz, "Task definition, annotated dataset, and supervised natural language processing models for symptom extraction from unstructured clinical notes," (in en), J Biomed Inform, vol. 102, p. 103354, 2020/02/01/ 2020, doi:https://doi.org/10.1016/j.jbi.2019.103354. · DOI
  58. O. Uzuner, I. Solti, F. Xia, and E. Cadag, "Community annotation experiment for ground truth generation for the i2b2 medication challenge," (in eng), J Am Med Inform Assoc JAMIA, vol. 17, no. 5, pp. 519-523, 2010 2010, doi:https://doi.org/10.1136/jamia.2010.004200. · DOI
  59. Lai, 2020, BERT-GT: cross-sentence n-ary relation extraction with BERT and Graph Transformer, Bioinformatics, 36, 5678, 10.1093/bioinformatics/btaa1087 · DOI
  60. N. Peng, H. Poon, C. Quirk, K. Toutanova, and W.-t. Yih, "Cross-sentence n-ary relation extraction with graph lstms," Trans Assoc Comput Linguist, vol. 5, pp. 101-115, 2017. · DOI · Paper page
  61. Wei, 2016, Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task, Database, 2016, 10.1093/database/baw032 · DOI · Paper page
  62. C. Lin, T. Miller, D. Dligach, S. Bethard, and G. Savova, "A BERT-based universal model for both within-and cross-sentence clinical temporal relation extraction," in Proceedings of the 2nd Clinical Natural Language Processing Workshop, 2019, pp. 65-71. · DOI
  63. Styler, 2014, Temporal annotation in the clinical domain, Trans Assoc Comput Linguist, 2, 143, 10.1162/tacl_a_00172 · DOI · Paper page
  64. Y. He, Z. Zhu, Y. Zhang, Q. Chen, and J. Caverlee, "Infusing disease knowledge into BERT for health question answering, medical inference and disease name recognition," arXiv preprint arXiv:2010.03746, 2020. · DOI
  65. Shen, 2014, Entity linking with a knowledge base: Issues, techniques, and solutions, IEEE Trans Knowl Data Eng, 27, 443, 10.1109/TKDE.2014.2327028 · DOI · Paper page
  66. Li, 2019, Fine-tuning bidirectional encoder representations from transformers (BERT)–based models on large-scale electronic health record notes: an empirical study, JMIR Med Inform, 7, 10.2196/14830 · DOI · Paper page
  67. Xiong, 2020, Distributed representation and one-hot representation fusion with gated network for clinical semantic textual similarity, BMC Med Inform Decis Mak, 20, 1
  68. Wang, 2018, Overview of the BioCreative/OHNLP challenge 2018 task 2: clinical semantic textual similarity, Proceedings of the BioCreative/OHNLP Challenge, vol, 2018
  69. Z. Zhang, J. Liu, and N. Razavian, "BERT-XML: Large scale automated ICD coding using BERT pretraining," arXiv preprint arXiv:2006.03685, 2020. · DOI
  70. R. You, Z. Zhang, Z. Wang, S. Dai, H. Mamitsuka, and S. Zhu, "Attentionxml: Label tree-based attention-aware deep model for high-performance extreme multi-label text classification," Advances in Neural Information Processing Systems, vol. 32, 2019.
  71. Cao, 2019, Learning imbalanced datasets with label-distribution-aware margin loss, Adv Neural Inf Proces Syst, 32
  72. Wang, 2020, A study of entity-linking methods for normalizing Chinese diagnosis and procedure terms to ICD codes, J Biomed Inform, 105, 10.1016/j.jbi.2020.103418 · DOI
  73. G. López-García, J. M. Jerez, and F. J. Veredas, "ICB-UMA at CANTEMIST 2020: Automatic ICD-O Coding in Spanish with BERT," in IberLEF@ SEPLN, 2020, pp. 468-476.
  74. G. López-Garcıa et al., "ICB-UMA at CLEF e-health 2020 task 1: Automatic ICD-10 coding in Spanish with BERT," in Proc. Work. Notes CLEF, Conf. Labs Eval. Forum, CEUR Workshop, 2020, pp. 1-15.
  75. S. Remmer, A. Lamproudis, and H. Dalianis, "Multi-label diagnosis classification of Swedish discharge summaries–ICD-10 code assignment using KB-BERT," in International Conference Recent Advances in Natural Language Processing (RANLP'21), online, September 1-3, 2021, 2021: INCOMA Ltd., pp. 1158-1166. · DOI
  76. K. Suvirat, D. Tanasanchonnakul, K. Horsiritham, C. Kongkamol, T. Ingviya, and S. Chaichulee, "Automated Diagnosis Code Assignment of Thai Free-text Clinical Notes," in 2022 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), 2022: IEEE, pp. 1-6. · DOI
  77. S. Silvestri, F. Gargiulo, M. Ciampi, and G. De Pietro, "Exploit multilingual language model at scale for ICD-10 clinical text classification," in 2020 IEEE Symposium on Computers and Communications (ISCC), 2020: IEEE, pp. 1-7. · DOI
  78. A. Bérard, Z. M. Kim, V. Nikoulina, E. L. Park, and M. Gallé, "A multilingual neural machine translation model for biomedical data," arXiv preprint arXiv:2008.02878, 2020. · DOI
  79. H. Liu, Y. Liang, L. Wang, X. Feng, and R. Guan, "BioNMT: A Biomedical neural machine translation system," INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, vol. 15, no. 6, 2020. · doi:10.15837/ijccc.2020.6.3988
  80. X. Wang, Z. Tu, and S. Shi, "Tencent ai lab machine translation systems for the WMT21 biomedical translation task," in Proceedings of the Sixth Conference on Machine Translation, 2021, pp. 874-878.
  81. S. Subramanian, O. Hrinchuk, V. Adams, and O. Kuchaiev, "NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21," arXiv preprint arXiv:2111.08634, 2021. · arXiv
  82. Choi, 2020, Learning the graphical structure of electronic health records with graph convolutional transformer, Proc AAAI Conference on artificial intelligence, 34, 606, 10.1609/aaai.v34i01.5400 · DOI · Paper page
  83. J. Shang, T. Ma, C. Xiao, and J. Sun, "Pre-training of graph augmented transformers for medication recommendation," arXiv preprint arXiv:1906.00346, 2019. · DOI · Paper page
  84. X. Peng, G. Long, T. Shen, S. Wang, and J. Jiang, "Sequential diagnosis prediction with transformer and ontological representation," in 2021 IEEE International Conference on Data Mining (ICDM), 2021: IEEE, pp. 489-498. · DOI
  85. S. Darabi, M. Kachuee, S. Fazeli, and M. Sarrafzadeh, "TAPER: Time-Aware Patient EHR Representation," IEEE J Biomed Health Inform, vol. 24, no. 11, pp. 3268-3275, Nov 2020, doi:https://doi.org/10.1109/JBHI.2020.2984931. · DOI
  86. X. Luo et al., "Applying interpretable deep learning models to identify chronic cough patients using EHR data," Comput Methods Prog Biomed, vol. 210, p. 106395, Oct 2021, doi:https://doi.org/10.1016/j.cmpb.2021.106395. · DOI
  87. Y. Meng, W. Speier, M. K. Ong, and C. W. Arnold, "Bidirectional Representation Learning From Transformers Using Multimodal Electronic Health Record Data to Predict Depression," IEEE J Biomed Health Inform, vol. 25, no. 8, pp. 3121-3129, Aug 2021, doi:https://doi.org/10.1109/JBHI.2021.3063721. · DOI · Paper page
  88. X. Zhang et al., "Learning robust patient representations from multi-modal electronic health records: a supervised deep learning approach," in Proceedings of the 2021 SIAM International Conference on Data Mining (SDM), 2021: SIAM, pp. 585-593. · DOI
  89. S. Rao et al., "An Explainable Transformer-Based Deep Learning Model for the Prediction of Incident Heart Failure," IEEE J Biomed Health Inform, vol. 26, no. 7, pp. 3362-3372, Jul 2022, doi:https://doi.org/10.1109/JBHI.2022.3148820. · DOI
  90. S. Rao et al., "Targeted-BEHRT: Deep Learning for Observational Causal Inference on Longitudinal Electronic Health Records," IEEE Trans Neural Netw Learn Syst, vol. PP, Jun 23 2022, doi:10.1109/TNNLS.2022.3183864. · DOI
  91. Y. Li et al., "Hi-BEHRT: Hierarchical Transformer-Based Model for Accurate Prediction of Clinical Events Using Multimodal Longitudinal Electronic Health Records," IEEE J Biomed Health Inform, vol. 27, no. 2, pp. 1106-1117, Feb 2023, doi:https://doi.org/10.1109/JBHI.2022.3224727. · DOI · Paper page
  92. J. Luo, M. Ye, C. Xiao, and F. Ma, "Hitanet: Hierarchical time-aware attention networks for risk prediction on electronic health records," in Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp. 647-656. · DOI · Paper page
  93. H. Ren, J. Wang, W. X. Zhao, and N. Wu, "Rapt: Pre-training of time-aware transformer for learning robust healthcare representation," in Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 2021, pp. 3503-3511. · DOI
  94. J. M. J. Valanarasu, P. Oza, I. Hacihaliloglu, and V. M. Patel, "Medical transformer: Gated axial-attention for medical image segmentation," arXiv preprint arXiv:2102.10662, 2021. · DOI · Paper page
  95. Sirinukunwattana, 2017, Gland segmentation in colon histology images: The glas challenge contest, Med Image Anal, 35, 489, 10.1016/j.media.2016.08.008 · DOI · Paper page
  96. Kumar, 2019, A multi-organ nucleus segmentation challenge, IEEE Trans Med Imaging, 39, 1380, 10.1109/TMI.2019.2947628 · DOI · Paper page
  97. Kumar, 2017, A dataset and a technique for generalized nuclear segmentation for computational pathology, IEEE Trans Med Imaging, 36, 1550, 10.1109/TMI.2017.2677499 · DOI · Paper page
  98. Y. Chang, H. Menghan, Z. Guangtao, and Z. Xiao-Ping, "TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation," arXiv preprint arXiv:2107.05188, 2021. · arXiv
  99. A. L. Simpson et al., "A large annotated medical image dataset for the development and evaluation of segmentation algorithms," arXiv preprint arXiv:1902.09063, 2019. · arXiv
  100. Y. Zhang, H. Liu, and Q. Hu, "Transfuse: Fusing transformers and cnns for medical image segmentation," arXiv preprint arXiv:2102.08005, 2021. · DOI · Paper page
  101. Tajbakhsh, 2015, Automated polyp detection in colonoscopy videos using shape and context information, IEEE Trans Med Imaging, 35, 630, 10.1109/TMI.2015.2487997 · DOI · Paper page
  102. Vázquez, 2017, A benchmark for endoluminal scene segmentation of colonoscopy images, J Healthc Engi vol, 2017
  103. Silva, 2014, Toward embedded detection of polyps in wce images for early diagnosis of colorectal cancer, Int J Comput Assist Radiol Surg, 9, 283, 10.1007/s11548-013-0926-3 · DOI · Paper page
  104. H. Cao et al., "Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation," arXiv preprint arXiv:2105.05537, 2021. · arXiv
  105. X. Huang, Z. Deng, D. Li, and X. Yuan, "MISSFormer: An effective medical image segmentation Transformer," arXiv preprint arXiv:2109.07162, 2021. · arXiv
  106. Z. Zhang, B. Sun, and W. Zhang, "Pyramid Medical Transformer for Medical Image Segmentation," arXiv preprint arXiv:2104.14702, 2021. · arXiv
  107. Andrearczyk, 2020, Overview of the HECKTOR challenge at MICCAI 2020: automatic head and neck tumor segmentation in PET/CT, 1
  108. N. Codella et al., "Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic)," arXiv preprint arXiv:1902.03368, 2019. · arXiv
  109. A. Lin, B. Chen, J. Xu, Z. Zhang, and G. Lu, "DS-TransUNet: Dual swin Transformer U-Net for medical image segmentation," arXiv preprint arXiv:2106.06716, 2021. · DOI · Paper page
  110. S. Li, X. Sui, X. Luo, X. Xu, Y. Liu, and R. S. M. Goh, "Medical Image Segmentation using Squeeze-and-Expansion Transformers," arXiv preprint arXiv:2105.09511, 2021. · DOI · Paper page
  111. Orlando, 2020, Refuge challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs, Med Image Anal, 59, 10.1016/j.media.2019.101570 · DOI · Paper page
  112. Sivaswamy, 2015, A comprehensive retinal image dataset for the assessment of glaucoma from the optic nerve head analysis, JSM Biomedical Imaging Data Papers, 2, 1004
  113. F. Fumero, S. Alayón, J. L. Sanchez, J. Sigut, and M. Gonzalez-Hernandez, "RIM-ONE: An open retinal image database for optic nerve evaluation," in 2011 24th international symposium on computer-based medical systems (CBMS), 2011: IEEE, pp. 1-6. · DOI · Paper page
  114. B. Yun, Y. Wang, J. Chen, H. Wang, W. Shen, and Q. Li, "Spectr: Spectral transformer for hyperspectral pathology image segmentation," arXiv preprint arXiv:2103.03604, 2021. · arXiv
  115. Zhang, 2019, A multidimensional choledoch database and benchmarks for cholangiocarcinoma diagnosis, IEEE Access, 7, 149414, 10.1109/ACCESS.2019.2947470 · DOI
  116. G. Xu, X. Wu, X. Zhang, and X. He, "LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation," arXiv preprint arXiv:2107.08623, 2021. · DOI
  117. B. Chen, Y. Liu, Z. Zhang, G. Lu, and D. Zhang, "TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation," arXiv preprint arXiv:2107.05274, 2021. · arXiv
  118. Shiraishi, 2000, Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules, Am J Roentgenol, 174, 71, 10.2214/ajr.174.1.1740071 · DOI · Paper page
  119. Y.-B. Tang, Y.-X. Tang, J. Xiao, and R. M. Summers, "Xlsor: A robust and accurate lung segmentor on chest x-rays using criss-cross attention and customized radiorealistic abnormalities generation," in International Conference on Medical Imaging with Deep Learning, 2019: PMLR, pp. 457-467.
  120. X. Yan, H. Tang, S. Sun, H. Ma, D. Kong, and X. Xie, "AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation," arXiv preprint arXiv:2110.10403, 2021. · DOI · Paper page
  121. Chen, 2021, A deep learning-based auto-segmentation system for organs-at-risk on whole-body computed tomography images for radiation therapy, Radiother Oncol, 160, 175, 10.1016/j.radonc.2021.04.019 · DOI · Paper page
  122. R. Trullo, C. Petitjean, S. Ruan, B. Dubray, D. Nie, and D. Shen, "Segmentation of organs at risk in thoracic CT images using a sharpmask architecture and conditional random fields," in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), 2017: IEEE, pp. 1003-1006. · DOI
  123. D. Guo and D. Terzopoulos, "A Transformer-Based Network for Anisotropic 3D Medical Image Segmentation," in 2020 25th International Conference on Pattern Recognition (ICPR), 2021: IEEE, pp. 8857-8861. · DOI
  124. Sun, 2021, HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation, J Healthc re Eng vol, 2021
  125. Wang, 2019, Benchmark on automatic six-month-old infant brain segmentation algorithms: the iSeg-2017 challenge, IEEE Trans Med Imaging, 38, 2219, 10.1109/TMI.2019.2901712 · DOI · Paper page
  126. Y. Tang et al., "Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis," in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022/06// 2022, New Orleans, LA, USA: IEEE, pp. 20698-20708, doi:10.1109/CVPR52688.2022.02007. [Online]. Available: https://ieeexplore.ieee.org/document/9879123/. · DOI · Paper page
  127. H. Zhang et al., "TiM-Net: Transformer in M-Net for Retinal Vessel Segmentation," (in en), Journal of Healthcare Engineering, vol. 2022, p. e9016401, 2022/07/11/ 2022, doi:https://doi.org/10.1155/2022/9016401. · DOI
  128. A. D. Hoover, V. Kouznetsova, and M. Goldbaum, "Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response," IEEE Trans Med Imaging, vol. 19, no. 3, pp. 203-210, 2000/03// 2000, doi:https://doi.org/10.1109/42.845178. · DOI · Paper page
  129. C. G. Owen et al., "Measuring Retinal Vessel Tortuosity in 10-Year-Old Children: Validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) Program," Invest Ophthalmol Vis Sci, vol. 50, no. 5, pp. 2004-2010, 2009/05/01/ 2009, doi:https://doi.org/10.1167/iovs.08-3018. · DOI · Paper page
  130. L. Wang, L. Yu, J. Zhu, H. Tang, F. Gou, and J. Wu, "Auxiliary Segmentation Method of Osteosarcoma in MRI Images Based on Denoising and Local Enhancement," (in en), Healthcare, vol. 10, no. 8, p. 1468, 2022/08// 2022, doi:https://doi.org/10.3390/healthcare10081468. · DOI
  131. X. Shen, L. Wang, Y. Zhao, R. Liu, W. Qian, and H. Ma, "Dilated transformer: residual axial attention for breast ultrasound image segmentation," (in en), Quantitative Imaging in Medicine and Surgery, vol. 12, no. 9, pp. 4512-4528, 2022/09// 2022, doi:10.21037/qims-22-33. · DOI
  132. Y. Zhang et al., "BUSIS: A Benchmark for Breast Ultrasound Image Segmentation," Healthcare, vol. 10, no. 4, p. 729, 2022/04/14/ 2022, doi:https://doi.org/10.3390/healthcare10040729. · DOI
  133. N. T. Duc, N. T. Oanh, N. T. Thuy, T. M. Triet, and V. S. Dinh, "ColonFormer: An Efficient Transformer Based Method for Colon Polyp Segmentation," IEEE Access, vol. 10, pp. 80575-80586, 2022 2022, doi:https://doi.org/10.1109/ACCESS.2022.3195241. · DOI · Paper page
  134. Q. Jia and H. Shu, "BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation," arXiv preprint arXiv:2109.12271, 2021. · DOI
  135. Kim, 2021, Hyoid bone tracking in a videofluoroscopic swallowing study using a deep-learning-based segmentation network, Diagnostics, 11, 1147, 10.3390/diagnostics11071147 · DOI
  136. Zhang, 2021, Weaving attention U-net: A novel hybrid CNN and attention-based method for organs-at-risk segmentation in head and neck CT images, Med Phys, 48, 7052, 10.1002/mp.15287 · DOI
  137. G. M. Correia, V. Niculae, and A. F. Martins, "Adaptively sparse transformers," arXiv preprint arXiv:1909.00015, 2019. · DOI · Paper page
  138. H.-Y. Zhou, J. Guo, Y. Zhang, L. Yu, L. Wang, and Y. Yu, "nnFormer: Interleaved Transformer for Volumetric Segmentation," arXiv preprint arXiv:2109.03201, 2021. · arXiv
  139. R. Mehta and J. Sivaswamy, "M-net: A Convolutional Neural Network for deep brain structure segmentation," in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), 2017/04// 2017, pp. 437-440, doi:10.1109/ISBI.2017.7950555. [Online]. Available: files/505/7950555.html. · DOI · Paper page
  140. A. Luthra, H. Sulakhe, T. Mittal, A. Iyer, and S. Yadav, "Eformer: Edge Enhancement based Transformer for Medical Image Denoising," arXiv preprint arXiv:2109.08044, 2021. · arXiv
  141. Xie, 2021, SegFormer: Simple and efficient design for semantic segmentation with transformers, Adv Neural Inf Proces Syst, 34, 12077
  142. J. Chen, Y. He, E. C. Frey, Y. Li, and Y. Du, "ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration," arXiv preprint arXiv:2104.06468, 2021. · DOI · Paper page
  143. D. S. Marcus, T. H. Wang, J. Parker, J. G. Csernansky, J. C. Morris, and R. L. Buckner, "Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults," (in eng), J Cogn Neurosci, vol. 19, no. 9, pp. 1498-1507, 2007/09// 2007, doi:https://doi.org/10.1162/jocn.2007.19.9.1498. · DOI · Paper page
  144. D. W. Shattuck et al., "Construction of a 3D probabilistic atlas of human cortical structures," (in eng), NeuroImage, vol. 39, no. 3, pp. 1064-1080, 2008/02/01/ 2008, doi:https://doi.org/10.1016/j.neuroimage.2007.09.031. · DOI · Paper page
  145. G. v. Tulder, Y. Tong, and E. Marchiori, "Multi-view analysis of unregistered medical images using cross-view transformers," in International Conference on Medical Image Computing and Computer-Assisted Intervention, 2021: Springer, pp. 104-113. · DOI
  146. Irvin, 2019, Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison, Proc AAAI Conference on artificial intelligence, 33, 590, 10.1609/aaai.v33i01.3301590 · DOI · Paper page
  147. J. Chen, Y. Du, Y. He, W. P. Segars, Y. Li, and E. C. Frey, "TransMorph: Transformer for unsupervised medical image registration," arXiv preprint arXiv:2111.10480, 2021. · DOI · Paper page
  148. Y. Zhu and S. Lu, "Swin-VoxelMorph: A Symmetric Unsupervised Learning Model for Deformable Medical Image Registration Using Swin Transformer," L. Wang, Q. Dou, P. T. Fletcher, S. Speidel, and S. Li, Eds., 2022 2022, Cham: Springer Nature Switzerland, in Lecture Notes in Computer Science, pp. 78-87, doi:10.1007/978-3-031-16446-0_8. · DOI
  149. K. Marek et al., "The Parkinson Progression Marker Initiative (PPMI)," (in en), Prog Neurobiol, vol. 95, no. 4, pp. 629-635, 2011/12/01/ 2011, doi:https://doi.org/10.1016/j.pneurobio.2011.09.005. · DOI · Paper page
  150. O. Pelka, S. Koitka, J. Rückert, F. Nensa, and C. M. Friedrich, "Radiology Objects in COntext (ROCO): a multimodal image dataset," in Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis: Springer, 2018, pp. 180-189. · DOI · Paper page
  151. X. Wang, Y. Peng, L. Lu, Z. Lu, and R. M. Summers, "Tienet: Text-image embedding network for common thorax disease classification and reporting in chest x-rays," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 9049-9058. · DOI · Paper page
  152. P. Rajpurkar et al., "Mura: Large dataset for abnormality detection in musculoskeletal radiographs," arXiv preprint arXiv:1712.06957, 2017. · arXiv
  153. E. Pahwa, D. Mehta, S. Kapadia, D. Jain, and A. Luthra, "MedSkip: Medical Report Generation Using Skip Connections and Integrated Attention," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021 2021, pp. 3409-3415. [Online]. Available: https://openaccess.thecvf.com/content/ICCV2021W/CVAMD/html/Pahwa_MedSkip_Medical_Report_Generation_Using_Skip_Connections_and_Integrated_Attention_ICCVW_2021_paper.html. · DOI
  154. B. Jing, P. Xie, and E. Xing, "On the Automatic Generation of Medical Imaging Reports," 2018 2018, pp. 2577-2586, doi:10.18653/v1/P18-1240. [Online]. Available: http://arxiv.org/abs/1711.08195[Online]. Available: files/340/1711.html. · DOI · Paper page
  155. M. Li et al., "FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark," in Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021/10/31/ 2021. [Online]. Available: https://openreview.net/forum?id=FgYTwJbjbf[Online]. Available: files/343/forum.html.
  156. F. Ren and Y. Zhou, "CGMVQA: A New Classification and Generative Model for Medical Visual Question Answering," (in en), IEEE Access, vol. 8, pp. 50626-50636, 2020 2020, doi:https://doi.org/10.1109/ACCESS.2020.2980024. · DOI
  157. U. Naseem, M. Khushi, and J. Kim, "Vision-Language Transformer for Interpretable Pathology Visual Question Answering," IEEE Journal of Biomedical and Health Informatics, pp. 1-1, 2022 2022, doi:10.1109/JBHI.2022.3163751. · DOI
  158. O. Dalmaz, M. Yurt, and T. Çukur, "ResViT: Residual vision transformers for multi-modal medical image synthesis," arXiv preprint arXiv:2106.16031, 2021. · DOI · Paper page
  159. Goodfellow, 2020, Generative adversarial networks, Commun ACM, 63, 139, 10.1145/3422622 · DOI · Paper page
  160. H. Wu et al., "Cvt: Introducing convolutions to vision transformers," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 22-31. · DOI · Paper page
  161. Alipour, 2012, Diabetic retinopathy grading by digital curvelet transform, Comput Math Methods Med, 2012
  162. S. Yan, C. Wang, W. Chen, and J. Lyu, "Swin transformer-based GAN for multi-modal medical image translation," Frontiers in Oncology, vol. 12, 2022. · DOI
  163. Hu, 2021, Data-Enabled Intelligence in Complex Industrial Systems Cross-Model Transformer Method for Medical Image Synthesis, Complexity, 2021, 10.1155/2021/5624909 · DOI
  164. J. Liu, S. Pasumarthi, B. Duffy, E. Gong, G. Zaharchuk, and K. Datta, "One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation," arXiv preprint arXiv:2204.13738, 2022. · DOI
  165. X. Zhang et al., "Ptnet: A high-resolution infant MRI synthesizer based on transformer," arXiv preprint arXiv:2105.13993, 2021. · arXiv
  166. Makropoulos, 2018, The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction, Neuroimage, 173, 88, 10.1016/j.neuroimage.2018.01.054 · DOI · Paper page
  167. Zhang, 2022, PTNet3D: A 3D High-Resolution Longitudinal Infant Brain MRI Synthesizer Based on Transformers, IEEE Trans Med Imaging, 41, 2925, 10.1109/TMI.2022.3174827 · DOI
  168. Howell, 2019, The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development, NeuroImage, 185, 891, 10.1016/j.neuroimage.2018.03.049 · DOI · Paper page
  169. McCollough, 2017, Low-dose CT for the detection and classification of metastatic liver lesions: results of the 2016 low dose CT grand challenge, Med Phys, 44, e339, 10.1002/mp.12345 · DOI · Paper page
  170. Z. Wang, X. Cun, J. Bao, W. Zhou, J. Liu, and H. Li, "Uformer: A general u-shaped transformer for image restoration," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17683-17693. · DOI · Paper page
  171. D. Wang, F. Fan, Z. Wu, R. Liu, F. Wang, and H. Yu, "CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising," arXiv preprint arXiv:2202.13517, 2022. · DOI · Paper page
  172. C. Wang, K. Shang, H. Zhang, Q. Li, Y. Hui, and S. K. Zhou, "Dudotrans: Dual-domain transformer provides more attention for sinogram restoration in sparse-view ct reconstruction," arXiv preprint arXiv:2111.10790, 2021. · DOI
  173. L. Yang and D. Zhang, "Low-Dose CT Denoising via Sinogram Inner-Structure Transformer," arXiv preprint arXiv:2204.03163, 2022. · arXiv
  174. Jiayi Pan, Heye Zhang, Weifei Wu, Zhifan Gao, Weiwen Wu, Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction, Patterns, Volume 3, Issue 6, 2022. · DOI
  175. Y. Korkmaz, S. U. H. Dar, M. Yurt, M. Özbey and T. Çukur, "Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers," in IEEE Transactions on Medical Imaging, vol. 41, no. 7, pp. 1747-1763, July 2022. · DOI · Paper page
  176. D. Ulyanov, A. Vedaldi, and V. Lempitsky, "Deep image prior," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 9446-9454. · DOI · Paper page
  177. Knoll, 2020, fastMRI: A publicly available raw k-space and DICOM dataset of knee images for accelerated MR image reconstruction using machine learning, Radiol Artif intel, 2
  178. Feng, 2023, Multimodal Transformer for Accelerated MR Imaging," in, IEEE Transactions on Medical Imaging, 42, 2804, 10.1109/TMI.2022.3180228 · DOI · Paper page
  179. C. Fang, D. Zhang, L. Wang, Y. Zhang, L. Cheng, and J. Han, "Cross-Modality High-Frequency Transformer for MR Image Super-Resolution," arXiv preprint arXiv:2203.15314, 2022. · DOI
  180. P. Guo, Y. Mei, J. Zhou, S. Jiang, and V. M. Patel, "Reconformer: Accelerated mri reconstruction using recurrent transformer," arXiv preprint arXiv:2201.09376, 2022. · arXiv
  181. G. Li et al., "Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 20636-20645. · DOI
  182. M. Ekanayake, K. Pawar, M. Harandi, G. Egan, and Z. Chen, "Multi-head Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction," arXiv preprint arXiv:2207.08412, 2022. · arXiv
  183. Z. Zhao, T. Zhang, W. Xie, Y. Wang, and Y. Zhang, "K-Space Transformer for Fast MRIReconstruction with Implicit Representation," arXiv preprint arXiv:2206.06947, 2022. · arXiv
  184. K. Larsen, A. Pal, and Y. Rathi, "A Deep Learning Approach Using Masked Image Modeling for Reconstruction of Undersampled K-spaces," arXiv preprint arXiv:2208.11472, 2022. · arXiv
  185. Hu, 2022, TRANS-Net: Transformer-Enhanced Residual-Error AlterNative Suppression Network for MRI Reconstruction, IEEE Trans Instrum Meas, 71, 1
  186. Z. Fabian and M. Soltanolkotabi, "HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction," arXiv preprint arXiv:2203.08213, 2022. · DOI
  187. J. Huang, Y. Wu, H. Wu, and G. Yang, "Fast MRI Reconstruction: How Powerful Transformers Are?," arXiv preprint arXiv:2201.09400, 2022. · DOI
  188. C. Yan, G. Shi, and Z. Wu, "SMIR: A Transformer-Based Model for MRI super-resolution reconstruction," in 2021 IEEE International Conference on Medical Imaging Physics and Engineering (ICMIPE), 2021: IEEE, pp. 1-6. · DOI
  189. B. Zhou et al., "Dsformer: A dual-domain self-supervised transformer for accelerated multi-contrast mri reconstruction," arXiv preprint arXiv:2201.10776, 2022. · DOI
  190. Y. Fu et al., "A resource-efficient deep learning framework for low-dose brain PET image reconstruction and analysis," in 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), 2022: IEEE, pp. 1-5. · DOI
  191. S.-I. Jang et al., "Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoising," arXiv preprint arXiv:2209.03300, 2022. · arXiv
  192. Yang, 2021, A multi-omics-based serial deep learning approach to predict clinical outcomes of single-agent anti-PD-1/PD-L1 immunotherapy in advanced stage non-small-cell lung cancer, Am J Transl Res, 13, 743
  193. D. Ho, I. B. H. Tan, and M. Motani, "Predictive models for colorectal cancer recurrence using multi-modal healthcare data," in Proceedings of the Conference on Health, Inference, and Learning, 2021, pp. 204-213. · DOI
  194. S. Li et al., "Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting," Advances in Neural Information Processing Systems, vol. 32, 2019.
  195. E. Bacry, S. Gaïffas, A. Kabeshova, and Y. Yu, "ZiMM: a deep learning model for long term adverse events with non-clinical claims data," arXiv preprint arXiv:1911.05346, 2019. · arXiv
  196. Kabeshova, 2020, ZiMM: a deep learning model for long term and blurry relapses with non-clinical claims data, J Biomed Inform, 110, 10.1016/j.jbi.2020.103531 · DOI
  197. E. Rojas-Muñoz, K. Couperus, and J. Wachs, "Daisi: Database for ai surgical instruction," arXiv preprint arXiv:2004.02809, 2020. · arXiv
  198. C.-Y. Lin, "Rouge: A package for automatic evaluation of summaries," in Text summarization branches out, 2004, pp. 74-81.
  199. S. Banerjee and A. Lavie, "METEOR: An automatic metric for MT evaluation with improved correlation with human judgments," in Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, 2005, pp. 65-72.
  200. R. Vedantam, C. Lawrence Zitnick, and D. Parikh, "Cider: Consensus-based image description evaluation," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 4566-4575. · DOI · Paper page

200 of 304 shown

Cited by

See all 197

Metadata

Authors
Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., Khezeli, K., & Rashidi, P.
Venue
Artificial Intelligence in Medicine
Publisher
Elsevier BV
Published
2024-08
Volume
154
Pages
102900
ISSN
0933-3657 (ISSN-L)
OpenAlex
W4399367209
Cited by
197
References
134
FWCI
15.79
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
  • NIBIB
  • NINDS (1R01NS120924)
  • National Institutes of Health
  • National Science Foundation (1750192)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Transformers and large language models in healthcare: A review. https://app.cochat.ai/papers/10.1016/j.artmed.2024.102900
The paper
Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., Khezeli, K., & Rashidi, P. (2024). Transformers and large language models in healthcare: A review. Artificial Intelligence in Medicine. https://doi.org/10.1016/j.artmed.2024.102900

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.