Transformers and large language models in healthcare: A review
Open accessThe DOI matches its Crossref record; 134 of the 134 references it cites were found in a registry or an index.
Abstract
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of healthcare data, including clinical NLP, medical imaging, structured Electronic Health Records (EHR), social media, bio-physiological signals, biomolecular sequences. Furthermore, which have also include the articles that used the transformer architecture for generating surgical instructions and predicting adverse outcomes after surgeries under the umbrella of critical care. Under diverse settings, these models have been used for clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. Finally, we also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Research works printed but not linked: 304
- Vaswani, 2017, Attention is all you need, Adv Neural Inf Proces Syst, 5998
- Xu, 2023, 45(10), 12113
- Parvaiz, 2023, Vision Transformers in medical computer vision—A contemplative retrospection, Eng Appl Artif Intell, 122, 10.1016/j.engappai.2023.106126 · DOI · Paper page
- T. Mikolov, W.-t. Yih, and G. Zweig, "Linguistic regularities in continuous space word representations," in Proceedings of the 2013 conference of the north american chapter of the association for computational linguistics: Human language technologies, 2013, pp. 746-751.
- J. Pennington, R. Socher, and C. D. Manning, "Glove: Global vectors for word representation," in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1532-1543. · DOI · Paper page
- Johnson, 2016, MIMIC-III, a freely accessible critical care database, Sci Data, 3, 1, 10.1038/sdata.2016.35 · DOI · Paper page
- Doğan, 2014, NCBI disease corpus: a resource for disease name recognition and concept normalization, J Biomed Inform, 47, 1, 10.1016/j.jbi.2013.12.006 · DOI · Paper page
- Uzuner, 2011, 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text, J Am Med Inform Assoc, 18, 552, 10.1136/amiajnl-2011-000203 · DOI · Paper page
- Li, 2016, BioCreative V CDR task corpus: a resource for chemical disease relation extraction, Database, 2016
- Krallinger, 2015, The CHEMDNER corpus of chemicals and drugs and its annotation principles, J Chem, 7, 1
- Smith, 2008, Overview of BioCreative II gene mention recognition, Genome Biol, 9, 1
- J.-D. Kim, T. Ohta, Y. Tsuruoka, Y. Tateisi, and N. Collier, "Introduction to the bio-entity recognition task at JNLPBA," in Proceedings of the international joint workshop on natural language processing in biomedicine and its applications, 2004: Citeseer, pp. 70-75. · DOI · Paper page
- Gerner, 2010, LINNAEUS: a species name identification system for biomedical literature, BMC Bioinform, 11, 1, 10.1186/1471-2105-11-85 · DOI · Paper page
- Bravo, 2015, Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research, BMC Bioinform, 16, 1, 10.1186/s12859-015-0472-9 · DOI · Paper page
- Van Mulligen, 2012, The EU-ADR corpus: annotated drugs, diseases, targets, and their relationships, J Biomed Inform, 45, 879, 10.1016/j.jbi.2012.04.004 · DOI
- Krallinger, 2017, Overview of the BioCreative VI chemical-protein interaction Track, Proceedings of the sixth BioCreative challenge evaluation workshop, 1, 141
- Sun, 2013, Evaluating temporal relations in clinical text: 2012 i2b2 challenge, J Am Med Inform Assoc, 20, 806, 10.1136/amiajnl-2013-001628 · DOI · Paper page
- Sun, 2013, Annotating temporal information in clinical narratives, J Biomed Inform, 46, S5, 10.1016/j.jbi.2013.07.004 · DOI
- A. Romanov and C. Shivade, "Lessons from natural language inference in the clinical domain," arXiv preprint arXiv:1808.06752, 2018. · DOI · Paper page
- Uzuner, 2007, Evaluating the state-of-the-art in automatic de-identification, J Am Med Inform Assoc, 14, 550, 10.1197/jamia.M2444 · DOI · Paper page
- Stubbs, 2015, Automated systems for the de-identification of longitudinal clinical narratives: Overview of 2014 i2b2/UTHealth shared task Track 1, J Biomed Inform, 58, S11, 10.1016/j.jbi.2015.06.007 · DOI · Paper page
- Stubbs, 2015, Annotating longitudinal clinical narratives for de-identification: The 2014 i2b2/UTHealth corpus, J Biomed Inform, 58, S20, 10.1016/j.jbi.2015.07.020 · DOI · Paper page
- S. Pradhan, N. Elhadad, W. W. Chapman, S. Manandhar, and G. Savova, "SemEval-2014 Task 7: Analysis of clinical text," in SemEval@ COLING, 2014, pp. 54-62. · DOI · Paper page
- N. Elhadad, S. Pradhan, S. Gorman, S. Manandhar, W. Chapman, and G. Savova, "SemEval-2015 task 14: Analysis of clinical text," in proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), 2015, pp. 303-310. · DOI
- S. Bethard, G. Savova, W.-T. Chen, L. Derczynski, J. Pustejovsky, and M. Verhagen, "Semeval-2016 task 12: Clinical tempeval," in Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), 2016, pp. 1052-1062. · DOI · Paper page
- Soğancıoğlu, 2017, BIOSSES: a semantic sentence similarity estimation system for the biomedical domain, Bioinformatics, 33, i49, 10.1093/bioinformatics/btx238 · DOI · Paper page
- Herrero-Zazo, 2013, The DDI corpus: An annotated corpus with pharmacological substances and drug–drug interactions, J Biomed Inform, 46, 914, 10.1016/j.jbi.2013.07.011 · DOI · Paper page
- Baker, 2016, Automatic semantic classification of scientific literature according to the hallmarks of cancer, Bioinformatics, 32, 432, 10.1093/bioinformatics/btv585 · DOI
- A. Nentidis, A. Krithara, K. Bougiatiotis, G. Paliouras, and I. Kakadiaris, "Results of the sixth edition of the BioASQ Challenge," Brussels, Belgium, November 2018: Association for Computational Linguistics, in Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering, pp. 1-10, doi:10.18653/v1/W18-5301. [Online]. Available: https://aclanthology.org/W18-5301[Online]. Available: doi:10.18653/v1/W18-5301. · DOI
- Yang, 2020, Clinical concept extraction using transformers, J Am Med Inform Assoc, 27, 1935, 10.1093/jamia/ocaa189 · DOI
- Stubbs, 2019, Cohort selection for clinical trials: n2c2 2018 shared task track 1, J Am Med Inform Assoc, 26, 1163, 10.1093/jamia/ocz163 · DOI
- Henry, 2020, 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records, J Am Med Inform Assoc, 27, 3, 10.1093/jamia/ocz166 · DOI · Paper page
- Mayer, 2020, "Transformer-based argument mining for healthcare applications," in ECAI, IOS Press, 2020, 2108
- K. Huang et al., "Clinical XLNet: Modeling sequential clinical notes and predicting prolonged mechanical ventilation," arXiv preprint arXiv:1912.11975, 2019. · DOI
- X. Yu, W. Hu, S. Lu, X. Sun, and Z. Yuan, "Biobert based named entity recognition in electronic medical record," in 2019 10th international conference on information technology in medicine and education (ITME), 2019: IEEE, pp. 49-52. · DOI
- Alimova, 2020, Multiple features for clinical relation extraction: A machine learning approach, J Biomed Inform, 103, 10.1016/j.jbi.2020.103382 · DOI
- Jagannatha, 2019, Overview of the first natural language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes (MADE 1.0), Drug Saf, 42, 99, 10.1007/s40264-018-0762-z · DOI · Paper page
- Ji, 2020, BERT-based ranking for biomedical entity normalization, AMIA Summits on Translational Science Proceedings, 2020, 269
- Pradhan, 2015, Evaluating the state of the art in disorder recognition and normalization of the clinical narrative, J Am Med Inform Assoc, 22, 143, 10.1136/amiajnl-2013-002544 · DOI · Paper page
- Yang, 2020, Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models, JMIR Med Inform, 8, 10.2196/19735 · DOI
- Wang, 2020, The 2019 n2c2/OHNLP track on clinical semantic textual similarity: overview, JMIR Med Inform, 8, 10.2196/23375 · DOI · Paper page
- S. Jiang, S. Zhao, K. Hou, Y. Liu, and L. Zhang, "A BERT-BiLSTM-CRF model for Chinese electronic medical records named entity recognition," in 2019 12th International Conference on Intelligent Computation Technology and Automation (ICICTA), 2019: IEEE, pp. 166-169. · DOI
- U. Naseem, K. Musial, P. Eklund, and M. Prasad, "Biomedical named-entity recognition by hierarchically fusing biobert representations and deep contextual-level word-embedding," in 2020 International joint conference on neural networks (IJCNN), 2020: IEEE, pp. 1-8. · DOI
- Z. Dai, X. Wang, P. Ni, Y. Li, G. Li, and X. Bai, "Named entity recognition using BERT BiLSTM CRF for Chinese electronic health records," in 2019 12th international congress on image and signal processing, biomedical engineering and informatics (cisp-bmei), 2019: IEEE, pp. 1-5. · DOI · Paper page
- Li, 2020, Chinese clinical named entity recognition with variant neural structures based on BERT methods, J Biomed Inform, 107, 10.1016/j.jbi.2020.103422 · DOI · Paper page
- Kim, 2020, Korean clinical entity recognition from diagnosis text using BERT, BMC Med Inform Decis Mak, 20, 1
- Catelli, 2020, Crosslingual named entity recognition for clinical de-identification applied to a COVID-19 Italian data set, Appl Soft Comput, 97, 10.1016/j.asoc.2020.106779 · DOI
- R. Vunikili, H. Supriya, V. G. Marica, and O. Farri, "Clinical NER using Spanish BERT Embeddings," in IberLEF@ SEPLN, 2020, pp. 505-511.
- Boudjellal, 2021, ABioNER: a BERT-based model for Arabic biomedical named-entity recognition, Complexity, 2021, 1, 10.1155/2021/6633213 · DOI
- G. Michalopoulos, Y. Wang, H. Kaka, H. Chen, and A. Wong, "Umlsbert: Clinical domain knowledge augmentation of contextual embeddings using the unified medical language system metathesaurus," arXiv preprint arXiv:2010.10391, 2020. · DOI · Paper page
- A. García-Pablos, N. Perez, and M. Cuadros, "Sensitive data detection and classification in Spanish clinical text: Experiments with BERT," arXiv preprint arXiv:2003.03106, 2020. · arXiv
- J. Mao and W. Liu, "Hadoken: a BERT-CRF Model for Medical Document Anonymization," in IberLEF@ SEPLN, 2019, pp. 720-726.
- M. Marimon et al., "Automatic De-identification of Medical Texts in Spanish: the MEDDOCAN Track, Corpus, Guidelines, Methods and Evaluation of Results," in IberLEF@ SEPLN, 2019, pp. 618-638.
- R. Leaman and Z. Lu, "TaggerOne: joint named entity recognition and normalization with semi-Markov Models," (in eng), Bioinformatics (Oxford, England), vol. 32, no. 18, pp. 2839-2846, 2016/09/15/ 2016, doi:https://doi.org/10.1093/bioinformatics/btw343. · DOI · Paper page
- H.-L. Trieu, A.-K. D. Nguyen, N. Nguyen, M. Miwa, H. Takamura, and S. Ananiadou, "Coreference resolution in full text articles with bert and syntax-based mention filtering," in Proceedings of The 5th Workshop on BioNLP Open Shared Tasks, 2019, pp. 196-205. · DOI
- Cohen, 2017, Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles, BMC Bioinform, 18, 1, 10.1186/s12859-017-1775-9 · DOI
- J. M. Steinkamp, W. Bala, A. Sharma, and J. J. Kantrowitz, "Task definition, annotated dataset, and supervised natural language processing models for symptom extraction from unstructured clinical notes," (in en), J Biomed Inform, vol. 102, p. 103354, 2020/02/01/ 2020, doi:https://doi.org/10.1016/j.jbi.2019.103354. · DOI
- O. Uzuner, I. Solti, F. Xia, and E. Cadag, "Community annotation experiment for ground truth generation for the i2b2 medication challenge," (in eng), J Am Med Inform Assoc JAMIA, vol. 17, no. 5, pp. 519-523, 2010 2010, doi:https://doi.org/10.1136/jamia.2010.004200. · DOI
- Lai, 2020, BERT-GT: cross-sentence n-ary relation extraction with BERT and Graph Transformer, Bioinformatics, 36, 5678, 10.1093/bioinformatics/btaa1087 · DOI
- N. Peng, H. Poon, C. Quirk, K. Toutanova, and W.-t. Yih, "Cross-sentence n-ary relation extraction with graph lstms," Trans Assoc Comput Linguist, vol. 5, pp. 101-115, 2017. · DOI · Paper page
- Wei, 2016, Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task, Database, 2016, 10.1093/database/baw032 · DOI · Paper page
- C. Lin, T. Miller, D. Dligach, S. Bethard, and G. Savova, "A BERT-based universal model for both within-and cross-sentence clinical temporal relation extraction," in Proceedings of the 2nd Clinical Natural Language Processing Workshop, 2019, pp. 65-71. · DOI
- Styler, 2014, Temporal annotation in the clinical domain, Trans Assoc Comput Linguist, 2, 143, 10.1162/tacl_a_00172 · DOI · Paper page
- Y. He, Z. Zhu, Y. Zhang, Q. Chen, and J. Caverlee, "Infusing disease knowledge into BERT for health question answering, medical inference and disease name recognition," arXiv preprint arXiv:2010.03746, 2020. · DOI
- Shen, 2014, Entity linking with a knowledge base: Issues, techniques, and solutions, IEEE Trans Knowl Data Eng, 27, 443, 10.1109/TKDE.2014.2327028 · DOI · Paper page
- Li, 2019, Fine-tuning bidirectional encoder representations from transformers (BERT)–based models on large-scale electronic health record notes: an empirical study, JMIR Med Inform, 7, 10.2196/14830 · DOI · Paper page
- Xiong, 2020, Distributed representation and one-hot representation fusion with gated network for clinical semantic textual similarity, BMC Med Inform Decis Mak, 20, 1
- Wang, 2018, Overview of the BioCreative/OHNLP challenge 2018 task 2: clinical semantic textual similarity, Proceedings of the BioCreative/OHNLP Challenge, vol, 2018
- Z. Zhang, J. Liu, and N. Razavian, "BERT-XML: Large scale automated ICD coding using BERT pretraining," arXiv preprint arXiv:2006.03685, 2020. · DOI
- R. You, Z. Zhang, Z. Wang, S. Dai, H. Mamitsuka, and S. Zhu, "Attentionxml: Label tree-based attention-aware deep model for high-performance extreme multi-label text classification," Advances in Neural Information Processing Systems, vol. 32, 2019.
- Cao, 2019, Learning imbalanced datasets with label-distribution-aware margin loss, Adv Neural Inf Proces Syst, 32
- Wang, 2020, A study of entity-linking methods for normalizing Chinese diagnosis and procedure terms to ICD codes, J Biomed Inform, 105, 10.1016/j.jbi.2020.103418 · DOI
- G. López-García, J. M. Jerez, and F. J. Veredas, "ICB-UMA at CANTEMIST 2020: Automatic ICD-O Coding in Spanish with BERT," in IberLEF@ SEPLN, 2020, pp. 468-476.
- G. López-Garcıa et al., "ICB-UMA at CLEF e-health 2020 task 1: Automatic ICD-10 coding in Spanish with BERT," in Proc. Work. Notes CLEF, Conf. Labs Eval. Forum, CEUR Workshop, 2020, pp. 1-15.
- S. Remmer, A. Lamproudis, and H. Dalianis, "Multi-label diagnosis classification of Swedish discharge summaries–ICD-10 code assignment using KB-BERT," in International Conference Recent Advances in Natural Language Processing (RANLP'21), online, September 1-3, 2021, 2021: INCOMA Ltd., pp. 1158-1166. · DOI
- K. Suvirat, D. Tanasanchonnakul, K. Horsiritham, C. Kongkamol, T. Ingviya, and S. Chaichulee, "Automated Diagnosis Code Assignment of Thai Free-text Clinical Notes," in 2022 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), 2022: IEEE, pp. 1-6. · DOI
- S. Silvestri, F. Gargiulo, M. Ciampi, and G. De Pietro, "Exploit multilingual language model at scale for ICD-10 clinical text classification," in 2020 IEEE Symposium on Computers and Communications (ISCC), 2020: IEEE, pp. 1-7. · DOI
- A. Bérard, Z. M. Kim, V. Nikoulina, E. L. Park, and M. Gallé, "A multilingual neural machine translation model for biomedical data," arXiv preprint arXiv:2008.02878, 2020. · DOI
- H. Liu, Y. Liang, L. Wang, X. Feng, and R. Guan, "BioNMT: A Biomedical neural machine translation system," INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, vol. 15, no. 6, 2020. · doi:10.15837/ijccc.2020.6.3988
- X. Wang, Z. Tu, and S. Shi, "Tencent ai lab machine translation systems for the WMT21 biomedical translation task," in Proceedings of the Sixth Conference on Machine Translation, 2021, pp. 874-878.
- S. Subramanian, O. Hrinchuk, V. Adams, and O. Kuchaiev, "NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21," arXiv preprint arXiv:2111.08634, 2021. · arXiv
- Choi, 2020, Learning the graphical structure of electronic health records with graph convolutional transformer, Proc AAAI Conference on artificial intelligence, 34, 606, 10.1609/aaai.v34i01.5400 · DOI · Paper page
- J. Shang, T. Ma, C. Xiao, and J. Sun, "Pre-training of graph augmented transformers for medication recommendation," arXiv preprint arXiv:1906.00346, 2019. · DOI · Paper page
- X. Peng, G. Long, T. Shen, S. Wang, and J. Jiang, "Sequential diagnosis prediction with transformer and ontological representation," in 2021 IEEE International Conference on Data Mining (ICDM), 2021: IEEE, pp. 489-498. · DOI
- S. Darabi, M. Kachuee, S. Fazeli, and M. Sarrafzadeh, "TAPER: Time-Aware Patient EHR Representation," IEEE J Biomed Health Inform, vol. 24, no. 11, pp. 3268-3275, Nov 2020, doi:https://doi.org/10.1109/JBHI.2020.2984931. · DOI
- X. Luo et al., "Applying interpretable deep learning models to identify chronic cough patients using EHR data," Comput Methods Prog Biomed, vol. 210, p. 106395, Oct 2021, doi:https://doi.org/10.1016/j.cmpb.2021.106395. · DOI
- Y. Meng, W. Speier, M. K. Ong, and C. W. Arnold, "Bidirectional Representation Learning From Transformers Using Multimodal Electronic Health Record Data to Predict Depression," IEEE J Biomed Health Inform, vol. 25, no. 8, pp. 3121-3129, Aug 2021, doi:https://doi.org/10.1109/JBHI.2021.3063721. · DOI · Paper page
- X. Zhang et al., "Learning robust patient representations from multi-modal electronic health records: a supervised deep learning approach," in Proceedings of the 2021 SIAM International Conference on Data Mining (SDM), 2021: SIAM, pp. 585-593. · DOI
- S. Rao et al., "An Explainable Transformer-Based Deep Learning Model for the Prediction of Incident Heart Failure," IEEE J Biomed Health Inform, vol. 26, no. 7, pp. 3362-3372, Jul 2022, doi:https://doi.org/10.1109/JBHI.2022.3148820. · DOI
- S. Rao et al., "Targeted-BEHRT: Deep Learning for Observational Causal Inference on Longitudinal Electronic Health Records," IEEE Trans Neural Netw Learn Syst, vol. PP, Jun 23 2022, doi:10.1109/TNNLS.2022.3183864. · DOI
- Y. Li et al., "Hi-BEHRT: Hierarchical Transformer-Based Model for Accurate Prediction of Clinical Events Using Multimodal Longitudinal Electronic Health Records," IEEE J Biomed Health Inform, vol. 27, no. 2, pp. 1106-1117, Feb 2023, doi:https://doi.org/10.1109/JBHI.2022.3224727. · DOI · Paper page
- J. Luo, M. Ye, C. Xiao, and F. Ma, "Hitanet: Hierarchical time-aware attention networks for risk prediction on electronic health records," in Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp. 647-656. · DOI · Paper page
- H. Ren, J. Wang, W. X. Zhao, and N. Wu, "Rapt: Pre-training of time-aware transformer for learning robust healthcare representation," in Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 2021, pp. 3503-3511. · DOI
- J. M. J. Valanarasu, P. Oza, I. Hacihaliloglu, and V. M. Patel, "Medical transformer: Gated axial-attention for medical image segmentation," arXiv preprint arXiv:2102.10662, 2021. · DOI · Paper page
- Sirinukunwattana, 2017, Gland segmentation in colon histology images: The glas challenge contest, Med Image Anal, 35, 489, 10.1016/j.media.2016.08.008 · DOI · Paper page
- Kumar, 2019, A multi-organ nucleus segmentation challenge, IEEE Trans Med Imaging, 39, 1380, 10.1109/TMI.2019.2947628 · DOI · Paper page
- Kumar, 2017, A dataset and a technique for generalized nuclear segmentation for computational pathology, IEEE Trans Med Imaging, 36, 1550, 10.1109/TMI.2017.2677499 · DOI · Paper page
- Y. Chang, H. Menghan, Z. Guangtao, and Z. Xiao-Ping, "TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation," arXiv preprint arXiv:2107.05188, 2021. · arXiv
- A. L. Simpson et al., "A large annotated medical image dataset for the development and evaluation of segmentation algorithms," arXiv preprint arXiv:1902.09063, 2019. · arXiv
- Y. Zhang, H. Liu, and Q. Hu, "Transfuse: Fusing transformers and cnns for medical image segmentation," arXiv preprint arXiv:2102.08005, 2021. · DOI · Paper page
- Tajbakhsh, 2015, Automated polyp detection in colonoscopy videos using shape and context information, IEEE Trans Med Imaging, 35, 630, 10.1109/TMI.2015.2487997 · DOI · Paper page
- Vázquez, 2017, A benchmark for endoluminal scene segmentation of colonoscopy images, J Healthc Engi vol, 2017
- Silva, 2014, Toward embedded detection of polyps in wce images for early diagnosis of colorectal cancer, Int J Comput Assist Radiol Surg, 9, 283, 10.1007/s11548-013-0926-3 · DOI · Paper page
- H. Cao et al., "Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation," arXiv preprint arXiv:2105.05537, 2021. · arXiv
- X. Huang, Z. Deng, D. Li, and X. Yuan, "MISSFormer: An effective medical image segmentation Transformer," arXiv preprint arXiv:2109.07162, 2021. · arXiv
- Z. Zhang, B. Sun, and W. Zhang, "Pyramid Medical Transformer for Medical Image Segmentation," arXiv preprint arXiv:2104.14702, 2021. · arXiv
- Andrearczyk, 2020, Overview of the HECKTOR challenge at MICCAI 2020: automatic head and neck tumor segmentation in PET/CT, 1
- N. Codella et al., "Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic)," arXiv preprint arXiv:1902.03368, 2019. · arXiv
- A. Lin, B. Chen, J. Xu, Z. Zhang, and G. Lu, "DS-TransUNet: Dual swin Transformer U-Net for medical image segmentation," arXiv preprint arXiv:2106.06716, 2021. · DOI · Paper page
- S. Li, X. Sui, X. Luo, X. Xu, Y. Liu, and R. S. M. Goh, "Medical Image Segmentation using Squeeze-and-Expansion Transformers," arXiv preprint arXiv:2105.09511, 2021. · DOI · Paper page
- Orlando, 2020, Refuge challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs, Med Image Anal, 59, 10.1016/j.media.2019.101570 · DOI · Paper page
- Sivaswamy, 2015, A comprehensive retinal image dataset for the assessment of glaucoma from the optic nerve head analysis, JSM Biomedical Imaging Data Papers, 2, 1004
- F. Fumero, S. Alayón, J. L. Sanchez, J. Sigut, and M. Gonzalez-Hernandez, "RIM-ONE: An open retinal image database for optic nerve evaluation," in 2011 24th international symposium on computer-based medical systems (CBMS), 2011: IEEE, pp. 1-6. · DOI · Paper page
- B. Yun, Y. Wang, J. Chen, H. Wang, W. Shen, and Q. Li, "Spectr: Spectral transformer for hyperspectral pathology image segmentation," arXiv preprint arXiv:2103.03604, 2021. · arXiv
- Zhang, 2019, A multidimensional choledoch database and benchmarks for cholangiocarcinoma diagnosis, IEEE Access, 7, 149414, 10.1109/ACCESS.2019.2947470 · DOI
- G. Xu, X. Wu, X. Zhang, and X. He, "LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation," arXiv preprint arXiv:2107.08623, 2021. · DOI
- B. Chen, Y. Liu, Z. Zhang, G. Lu, and D. Zhang, "TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation," arXiv preprint arXiv:2107.05274, 2021. · arXiv
- Shiraishi, 2000, Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules, Am J Roentgenol, 174, 71, 10.2214/ajr.174.1.1740071 · DOI · Paper page
- Y.-B. Tang, Y.-X. Tang, J. Xiao, and R. M. Summers, "Xlsor: A robust and accurate lung segmentor on chest x-rays using criss-cross attention and customized radiorealistic abnormalities generation," in International Conference on Medical Imaging with Deep Learning, 2019: PMLR, pp. 457-467.
- X. Yan, H. Tang, S. Sun, H. Ma, D. Kong, and X. Xie, "AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation," arXiv preprint arXiv:2110.10403, 2021. · DOI · Paper page
- Chen, 2021, A deep learning-based auto-segmentation system for organs-at-risk on whole-body computed tomography images for radiation therapy, Radiother Oncol, 160, 175, 10.1016/j.radonc.2021.04.019 · DOI · Paper page
- R. Trullo, C. Petitjean, S. Ruan, B. Dubray, D. Nie, and D. Shen, "Segmentation of organs at risk in thoracic CT images using a sharpmask architecture and conditional random fields," in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), 2017: IEEE, pp. 1003-1006. · DOI
- D. Guo and D. Terzopoulos, "A Transformer-Based Network for Anisotropic 3D Medical Image Segmentation," in 2020 25th International Conference on Pattern Recognition (ICPR), 2021: IEEE, pp. 8857-8861. · DOI
- Sun, 2021, HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation, J Healthc re Eng vol, 2021
- Wang, 2019, Benchmark on automatic six-month-old infant brain segmentation algorithms: the iSeg-2017 challenge, IEEE Trans Med Imaging, 38, 2219, 10.1109/TMI.2019.2901712 · DOI · Paper page
- Y. Tang et al., "Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis," in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022/06// 2022, New Orleans, LA, USA: IEEE, pp. 20698-20708, doi:10.1109/CVPR52688.2022.02007. [Online]. Available: https://ieeexplore.ieee.org/document/9879123/. · DOI · Paper page
- H. Zhang et al., "TiM-Net: Transformer in M-Net for Retinal Vessel Segmentation," (in en), Journal of Healthcare Engineering, vol. 2022, p. e9016401, 2022/07/11/ 2022, doi:https://doi.org/10.1155/2022/9016401. · DOI
- A. D. Hoover, V. Kouznetsova, and M. Goldbaum, "Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response," IEEE Trans Med Imaging, vol. 19, no. 3, pp. 203-210, 2000/03// 2000, doi:https://doi.org/10.1109/42.845178. · DOI · Paper page
- C. G. Owen et al., "Measuring Retinal Vessel Tortuosity in 10-Year-Old Children: Validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) Program," Invest Ophthalmol Vis Sci, vol. 50, no. 5, pp. 2004-2010, 2009/05/01/ 2009, doi:https://doi.org/10.1167/iovs.08-3018. · DOI · Paper page
- L. Wang, L. Yu, J. Zhu, H. Tang, F. Gou, and J. Wu, "Auxiliary Segmentation Method of Osteosarcoma in MRI Images Based on Denoising and Local Enhancement," (in en), Healthcare, vol. 10, no. 8, p. 1468, 2022/08// 2022, doi:https://doi.org/10.3390/healthcare10081468. · DOI
- X. Shen, L. Wang, Y. Zhao, R. Liu, W. Qian, and H. Ma, "Dilated transformer: residual axial attention for breast ultrasound image segmentation," (in en), Quantitative Imaging in Medicine and Surgery, vol. 12, no. 9, pp. 4512-4528, 2022/09// 2022, doi:10.21037/qims-22-33. · DOI
- Y. Zhang et al., "BUSIS: A Benchmark for Breast Ultrasound Image Segmentation," Healthcare, vol. 10, no. 4, p. 729, 2022/04/14/ 2022, doi:https://doi.org/10.3390/healthcare10040729. · DOI
- N. T. Duc, N. T. Oanh, N. T. Thuy, T. M. Triet, and V. S. Dinh, "ColonFormer: An Efficient Transformer Based Method for Colon Polyp Segmentation," IEEE Access, vol. 10, pp. 80575-80586, 2022 2022, doi:https://doi.org/10.1109/ACCESS.2022.3195241. · DOI · Paper page
- Q. Jia and H. Shu, "BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation," arXiv preprint arXiv:2109.12271, 2021. · DOI
- Kim, 2021, Hyoid bone tracking in a videofluoroscopic swallowing study using a deep-learning-based segmentation network, Diagnostics, 11, 1147, 10.3390/diagnostics11071147 · DOI
- Zhang, 2021, Weaving attention U-net: A novel hybrid CNN and attention-based method for organs-at-risk segmentation in head and neck CT images, Med Phys, 48, 7052, 10.1002/mp.15287 · DOI
- G. M. Correia, V. Niculae, and A. F. Martins, "Adaptively sparse transformers," arXiv preprint arXiv:1909.00015, 2019. · DOI · Paper page
- H.-Y. Zhou, J. Guo, Y. Zhang, L. Yu, L. Wang, and Y. Yu, "nnFormer: Interleaved Transformer for Volumetric Segmentation," arXiv preprint arXiv:2109.03201, 2021. · arXiv
- R. Mehta and J. Sivaswamy, "M-net: A Convolutional Neural Network for deep brain structure segmentation," in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), 2017/04// 2017, pp. 437-440, doi:10.1109/ISBI.2017.7950555. [Online]. Available: files/505/7950555.html. · DOI · Paper page
- A. Luthra, H. Sulakhe, T. Mittal, A. Iyer, and S. Yadav, "Eformer: Edge Enhancement based Transformer for Medical Image Denoising," arXiv preprint arXiv:2109.08044, 2021. · arXiv
- Xie, 2021, SegFormer: Simple and efficient design for semantic segmentation with transformers, Adv Neural Inf Proces Syst, 34, 12077
- J. Chen, Y. He, E. C. Frey, Y. Li, and Y. Du, "ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration," arXiv preprint arXiv:2104.06468, 2021. · DOI · Paper page
- D. S. Marcus, T. H. Wang, J. Parker, J. G. Csernansky, J. C. Morris, and R. L. Buckner, "Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults," (in eng), J Cogn Neurosci, vol. 19, no. 9, pp. 1498-1507, 2007/09// 2007, doi:https://doi.org/10.1162/jocn.2007.19.9.1498. · DOI · Paper page
- D. W. Shattuck et al., "Construction of a 3D probabilistic atlas of human cortical structures," (in eng), NeuroImage, vol. 39, no. 3, pp. 1064-1080, 2008/02/01/ 2008, doi:https://doi.org/10.1016/j.neuroimage.2007.09.031. · DOI · Paper page
- G. v. Tulder, Y. Tong, and E. Marchiori, "Multi-view analysis of unregistered medical images using cross-view transformers," in International Conference on Medical Image Computing and Computer-Assisted Intervention, 2021: Springer, pp. 104-113. · DOI
- Irvin, 2019, Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison, Proc AAAI Conference on artificial intelligence, 33, 590, 10.1609/aaai.v33i01.3301590 · DOI · Paper page
- J. Chen, Y. Du, Y. He, W. P. Segars, Y. Li, and E. C. Frey, "TransMorph: Transformer for unsupervised medical image registration," arXiv preprint arXiv:2111.10480, 2021. · DOI · Paper page
- Y. Zhu and S. Lu, "Swin-VoxelMorph: A Symmetric Unsupervised Learning Model for Deformable Medical Image Registration Using Swin Transformer," L. Wang, Q. Dou, P. T. Fletcher, S. Speidel, and S. Li, Eds., 2022 2022, Cham: Springer Nature Switzerland, in Lecture Notes in Computer Science, pp. 78-87, doi:10.1007/978-3-031-16446-0_8. · DOI
- K. Marek et al., "The Parkinson Progression Marker Initiative (PPMI)," (in en), Prog Neurobiol, vol. 95, no. 4, pp. 629-635, 2011/12/01/ 2011, doi:https://doi.org/10.1016/j.pneurobio.2011.09.005. · DOI · Paper page
- O. Pelka, S. Koitka, J. Rückert, F. Nensa, and C. M. Friedrich, "Radiology Objects in COntext (ROCO): a multimodal image dataset," in Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis: Springer, 2018, pp. 180-189. · DOI · Paper page
- X. Wang, Y. Peng, L. Lu, Z. Lu, and R. M. Summers, "Tienet: Text-image embedding network for common thorax disease classification and reporting in chest x-rays," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 9049-9058. · DOI · Paper page
- P. Rajpurkar et al., "Mura: Large dataset for abnormality detection in musculoskeletal radiographs," arXiv preprint arXiv:1712.06957, 2017. · arXiv
- E. Pahwa, D. Mehta, S. Kapadia, D. Jain, and A. Luthra, "MedSkip: Medical Report Generation Using Skip Connections and Integrated Attention," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021 2021, pp. 3409-3415. [Online]. Available: https://openaccess.thecvf.com/content/ICCV2021W/CVAMD/html/Pahwa_MedSkip_Medical_Report_Generation_Using_Skip_Connections_and_Integrated_Attention_ICCVW_2021_paper.html. · DOI
- B. Jing, P. Xie, and E. Xing, "On the Automatic Generation of Medical Imaging Reports," 2018 2018, pp. 2577-2586, doi:10.18653/v1/P18-1240. [Online]. Available: http://arxiv.org/abs/1711.08195[Online]. Available: files/340/1711.html. · DOI · Paper page
- M. Li et al., "FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark," in Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021/10/31/ 2021. [Online]. Available: https://openreview.net/forum?id=FgYTwJbjbf[Online]. Available: files/343/forum.html.
- F. Ren and Y. Zhou, "CGMVQA: A New Classification and Generative Model for Medical Visual Question Answering," (in en), IEEE Access, vol. 8, pp. 50626-50636, 2020 2020, doi:https://doi.org/10.1109/ACCESS.2020.2980024. · DOI
- U. Naseem, M. Khushi, and J. Kim, "Vision-Language Transformer for Interpretable Pathology Visual Question Answering," IEEE Journal of Biomedical and Health Informatics, pp. 1-1, 2022 2022, doi:10.1109/JBHI.2022.3163751. · DOI
- O. Dalmaz, M. Yurt, and T. Çukur, "ResViT: Residual vision transformers for multi-modal medical image synthesis," arXiv preprint arXiv:2106.16031, 2021. · DOI · Paper page
- Goodfellow, 2020, Generative adversarial networks, Commun ACM, 63, 139, 10.1145/3422622 · DOI · Paper page
- H. Wu et al., "Cvt: Introducing convolutions to vision transformers," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 22-31. · DOI · Paper page
- Alipour, 2012, Diabetic retinopathy grading by digital curvelet transform, Comput Math Methods Med, 2012
- S. Yan, C. Wang, W. Chen, and J. Lyu, "Swin transformer-based GAN for multi-modal medical image translation," Frontiers in Oncology, vol. 12, 2022. · DOI
- Hu, 2021, Data-Enabled Intelligence in Complex Industrial Systems Cross-Model Transformer Method for Medical Image Synthesis, Complexity, 2021, 10.1155/2021/5624909 · DOI
- J. Liu, S. Pasumarthi, B. Duffy, E. Gong, G. Zaharchuk, and K. Datta, "One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation," arXiv preprint arXiv:2204.13738, 2022. · DOI
- X. Zhang et al., "Ptnet: A high-resolution infant MRI synthesizer based on transformer," arXiv preprint arXiv:2105.13993, 2021. · arXiv
- Makropoulos, 2018, The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction, Neuroimage, 173, 88, 10.1016/j.neuroimage.2018.01.054 · DOI · Paper page
- Zhang, 2022, PTNet3D: A 3D High-Resolution Longitudinal Infant Brain MRI Synthesizer Based on Transformers, IEEE Trans Med Imaging, 41, 2925, 10.1109/TMI.2022.3174827 · DOI
- Howell, 2019, The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development, NeuroImage, 185, 891, 10.1016/j.neuroimage.2018.03.049 · DOI · Paper page
- McCollough, 2017, Low-dose CT for the detection and classification of metastatic liver lesions: results of the 2016 low dose CT grand challenge, Med Phys, 44, e339, 10.1002/mp.12345 · DOI · Paper page
- Z. Wang, X. Cun, J. Bao, W. Zhou, J. Liu, and H. Li, "Uformer: A general u-shaped transformer for image restoration," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17683-17693. · DOI · Paper page
- D. Wang, F. Fan, Z. Wu, R. Liu, F. Wang, and H. Yu, "CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising," arXiv preprint arXiv:2202.13517, 2022. · DOI · Paper page
- C. Wang, K. Shang, H. Zhang, Q. Li, Y. Hui, and S. K. Zhou, "Dudotrans: Dual-domain transformer provides more attention for sinogram restoration in sparse-view ct reconstruction," arXiv preprint arXiv:2111.10790, 2021. · DOI
- L. Yang and D. Zhang, "Low-Dose CT Denoising via Sinogram Inner-Structure Transformer," arXiv preprint arXiv:2204.03163, 2022. · arXiv
- Jiayi Pan, Heye Zhang, Weifei Wu, Zhifan Gao, Weiwen Wu, Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction, Patterns, Volume 3, Issue 6, 2022. · DOI
- Y. Korkmaz, S. U. H. Dar, M. Yurt, M. Özbey and T. Çukur, "Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers," in IEEE Transactions on Medical Imaging, vol. 41, no. 7, pp. 1747-1763, July 2022. · DOI · Paper page
- D. Ulyanov, A. Vedaldi, and V. Lempitsky, "Deep image prior," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 9446-9454. · DOI · Paper page
- Knoll, 2020, fastMRI: A publicly available raw k-space and DICOM dataset of knee images for accelerated MR image reconstruction using machine learning, Radiol Artif intel, 2
- Feng, 2023, Multimodal Transformer for Accelerated MR Imaging," in, IEEE Transactions on Medical Imaging, 42, 2804, 10.1109/TMI.2022.3180228 · DOI · Paper page
- C. Fang, D. Zhang, L. Wang, Y. Zhang, L. Cheng, and J. Han, "Cross-Modality High-Frequency Transformer for MR Image Super-Resolution," arXiv preprint arXiv:2203.15314, 2022. · DOI
- P. Guo, Y. Mei, J. Zhou, S. Jiang, and V. M. Patel, "Reconformer: Accelerated mri reconstruction using recurrent transformer," arXiv preprint arXiv:2201.09376, 2022. · arXiv
- G. Li et al., "Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 20636-20645. · DOI
- M. Ekanayake, K. Pawar, M. Harandi, G. Egan, and Z. Chen, "Multi-head Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction," arXiv preprint arXiv:2207.08412, 2022. · arXiv
- Z. Zhao, T. Zhang, W. Xie, Y. Wang, and Y. Zhang, "K-Space Transformer for Fast MRIReconstruction with Implicit Representation," arXiv preprint arXiv:2206.06947, 2022. · arXiv
- K. Larsen, A. Pal, and Y. Rathi, "A Deep Learning Approach Using Masked Image Modeling for Reconstruction of Undersampled K-spaces," arXiv preprint arXiv:2208.11472, 2022. · arXiv
- Hu, 2022, TRANS-Net: Transformer-Enhanced Residual-Error AlterNative Suppression Network for MRI Reconstruction, IEEE Trans Instrum Meas, 71, 1
- Z. Fabian and M. Soltanolkotabi, "HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction," arXiv preprint arXiv:2203.08213, 2022. · DOI
- J. Huang, Y. Wu, H. Wu, and G. Yang, "Fast MRI Reconstruction: How Powerful Transformers Are?," arXiv preprint arXiv:2201.09400, 2022. · DOI
- C. Yan, G. Shi, and Z. Wu, "SMIR: A Transformer-Based Model for MRI super-resolution reconstruction," in 2021 IEEE International Conference on Medical Imaging Physics and Engineering (ICMIPE), 2021: IEEE, pp. 1-6. · DOI
- B. Zhou et al., "Dsformer: A dual-domain self-supervised transformer for accelerated multi-contrast mri reconstruction," arXiv preprint arXiv:2201.10776, 2022. · DOI
- Y. Fu et al., "A resource-efficient deep learning framework for low-dose brain PET image reconstruction and analysis," in 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), 2022: IEEE, pp. 1-5. · DOI
- S.-I. Jang et al., "Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoising," arXiv preprint arXiv:2209.03300, 2022. · arXiv
- Yang, 2021, A multi-omics-based serial deep learning approach to predict clinical outcomes of single-agent anti-PD-1/PD-L1 immunotherapy in advanced stage non-small-cell lung cancer, Am J Transl Res, 13, 743
- D. Ho, I. B. H. Tan, and M. Motani, "Predictive models for colorectal cancer recurrence using multi-modal healthcare data," in Proceedings of the Conference on Health, Inference, and Learning, 2021, pp. 204-213. · DOI
- S. Li et al., "Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting," Advances in Neural Information Processing Systems, vol. 32, 2019.
- E. Bacry, S. Gaïffas, A. Kabeshova, and Y. Yu, "ZiMM: a deep learning model for long term adverse events with non-clinical claims data," arXiv preprint arXiv:1911.05346, 2019. · arXiv
- Kabeshova, 2020, ZiMM: a deep learning model for long term and blurry relapses with non-clinical claims data, J Biomed Inform, 110, 10.1016/j.jbi.2020.103531 · DOI
- E. Rojas-Muñoz, K. Couperus, and J. Wachs, "Daisi: Database for ai surgical instruction," arXiv preprint arXiv:2004.02809, 2020. · arXiv
- C.-Y. Lin, "Rouge: A package for automatic evaluation of summaries," in Text summarization branches out, 2004, pp. 74-81.
- S. Banerjee and A. Lavie, "METEOR: An automatic metric for MT evaluation with improved correlation with human judgments," in Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, 2005, pp. 65-72.
- R. Vedantam, C. Lawrence Zitnick, and D. Parikh, "Cider: Consensus-based image description evaluation," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 4566-4575. · DOI · Paper page
200 of 304 shown
Cited by
He, K., Mao, R., Lin, Q., Ruan, Y., Lan, X., Feng, M., & Cambria, E. (2024) · doi:10.2139/ssrn.4809363 · Cited by 69
AI-assisted tumor board decision-making in pancreatic oncology
Mergen, M., Busch, F., Schwarberg, B., Koldeweihe, P., Jungwirth, D., Sydlik, J., Maurer, H. C., Makowski, M. R., Spitzl, D., & Gassert, F. T. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03444-x · Cited by 3
Anbukkarasi, S., Hemalatha, S., Balakrishnan, A., Varadhaganapathy, S., & Easwaramoorthy, S. V. (2026) · Scientific reports · doi:10.1038/s41598-026-47146-w · Cited by 1
“Models that are built on a large scale and are meant for the healthcare sector, in addition, can be seen as the future of multimodal architecture which can be used to provide diagnostic support, risk prediction, and decision assistance in different clinical domains 3 .”
Metadata
- Authors
- Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., Khezeli, K., & Rashidi, P.
- Venue
- Artificial Intelligence in Medicine
- Publisher
- Elsevier BV
- Published
- 2024-08
- Volume
- 154
- Pages
- 102900
- ISSN
- 0933-3657 (ISSN-L)
- OpenAlex
- W4399367209
- Cited by
- 197
- References
- 134
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Funders
- NIBIB
- NINDS (1R01NS120924)
- National Institutes of Health
- National Science Foundation (1750192)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Transformers and large language models in healthcare: A review. https://app.cochat.ai/papers/10.1016/j.artmed.2024.102900
- The paper
- Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., Khezeli, K., & Rashidi, P. (2024). Transformers and large language models in healthcare: A review. Artificial Intelligence in Medicine. https://doi.org/10.1016/j.artmed.2024.102900
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.