Pre-training in Medical Data: A Survey
Open accessAbstract
Medical data refers to health-related information associated with regular patient care or as part of a clinical trial program. There are many categories of such data, such as clinical imaging data, bio-signal data, electronic health records (EHR), and multi-modality medical data. With the development of deep neural networks in the last decade, the emerging pre-training paradigm has become dominant in that it has significantly improved machine learning methods′ performance in a data-limited scenario. In recent years, studies of pre-training in the medical domain have achieved significant progress. To summarize these technology advancements, this work provides a comprehensive survey of recent advances for pre-training on several major types of medical data. In this survey, we summarize a large number of related publications and the existing benchmarking in the medical domain. Especially, the survey briefly describes how some pre-training methods are applied to or developed for medical data. From a data-driven perspective, we examine the extensive use of pre-training in many medical scenarios. Moreover, based on the summary of recent pre-training studies, we identify several challenges in this field to provide insights for future studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Pretrained models followed by fine-tuning on target clinical data enable efficient adaptation to specialized clinical tasks even with limited data from the specific patient cohort.
“This approach enables efficient adaptation to specialized clinical tasks, even with limited data from the specific patient cohort [77].”
From Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review (2026) · cites this paper as [77]
The paper’s opening passage (section and page not provided) says pre-training improves performance in data-limited scenarios and is used across medical settings. It does not establish the more specific claim that fine-tuning enables efficient adaptation with limited data from a particular patient cohort. (LLM, conf=0.79)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · see citing works
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · see citing works
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809 · see citing works
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · see citing works
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347 · see citing works
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891 · see citing works
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · see citing works
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857 · see citing works
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669 · see citing works
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · see citing works
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759 · see citing works
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691 · see citing works
Jaderberg, M., Simonyan, K., Zisserman, A., & Kavukcuoglu, K. (2015) · arXiv · doi:10.48550/arxiv.1506.02025 · Cited by 5,137 · see citing works
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093 · see citing works
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.010 · Cited by 4,842 · see citing works
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · see citing works
The impact of the MIT-BIH Arrhythmia Database
Moody, G. B., & Mark, R. G. (2001) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.932724 · Cited by 4,834 · see citing works
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616 · see citing works
Mutational landscape and significance across 12 major cancer types
Kandoth, C., McLellan, M. D., Vandin, F., Ye, K., Niu, B., Lu, C., Xie, M., Zhang, Q., McMichael, J. F., Wyczalkowski, M. A., et al. (2013) · Nature · doi:10.1038/nature12634 · Cited by 4,419 · see citing works
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · see citing works
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796 · see citing works
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725 · see citing works
The future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 3,119 · cited 3× · see citing works
“Compared to other state-of-the-art (SOTA) methods on VQA tasks on medical images, MMBERT achieves superior performance and provides attention maps to improve model interpretability.”
BCI2000: A General-Purpose Brain-Computer Interface (BCI) System
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., & Wolpaw, J. R. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827072 · Cited by 3,022 · see citing works
Armato, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2011) · Medical Physics · doi:10.1118/1.3528204 · Cited by 2,887 · see citing works
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639 · see citing works
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629 · see citing works
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620 · see citing works
Improved Baselines with Momentum Contrastive LearningPreprint
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 2,579 · see citing works
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C., & Heng, P. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,530 · see citing works
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., & Joulin, A. (2020) · arXiv · doi:10.48550/arxiv.2006.09882 · Cited by 2,499 · see citing works
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,477 · see citing works
Dataset of breast ultrasound images
Al-Dhabyani, W., Gomaa, M., Khaled, H., & Fahmy, A. (2020) · Data in Brief · doi:10.1016/j.dib.2019.104863 · Cited by 2,405 · see citing works
Apostolopoulos, I. D., & Mpesiana, T. A. (2020) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-020-00865-4 · Cited by 2,338 · see citing works
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · see citing works
LXMERT: Learning Cross-Modality Encoder Representations from Transformers
Tan, H., & Bansal, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1514 · Cited by 2,319 · see citing works
CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep LearningPreprint
Rajpurkar, P., Irvin, J., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D. Y., Bagul, A., Langlotz, C. P., Shpanskaya, K. S., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05225 · Cited by 2,283 · see citing works
UNITER: UNiversal Image-TExt Representation Learning
Chen, Y.-C., Li, L., Yu, L., El Kholy, A., Ahmed, F., Gan, Z., Cheng, Y., & Liu, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58577-8_7 · Cited by 2,055 · see citing works
Pollard, T. J., Johnson, A. E. W., Raffa, J. D., Celi, L. A., Mark, R. G., & Badawi, O. (2018) · Scientific Data · doi:10.1038/sdata.2018.178 · Cited by 1,993 · see citing works
Torrey, L. A., & SHAVLIK, J. W. (2010) · IGI Global eBooks · doi:10.4018/978-1-60566-766-9.ch011 · Cited by 1,887 · see citing works
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · see citing works
Greenspan, H. K., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,704 · see citing works
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664 · see citing works
An Empirical Study of Training Self-Supervised Vision Transformers
Chen, X., Xie, S., & He, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00950 · Cited by 1,648 · see citing works
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,610 · see citing works
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J. P., & Lim, C. C. T. (2017) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,521 · see citing works
Big Self-Supervised Models are Strong Semi-Supervised LearnersPreprint
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10029 · Cited by 1,480 · see citing works
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435 · see citing works
Medical image analysis using convolutional neural networks: a review
Anwar, S. M., Majid, M., Qayyum, A., Awais, M., Alnowami, M., & Khan, M. K. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1088-1 · Cited by 1,431 · see citing works
Setio, A. A. A., Traverso, A., de Bel, T., Berens, M. S. N., van den Bogaard, C., Cerello, P., Chen, H., Dou, Q., Fantacci, M. E., Geurts, B. H. J., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.06.015 · Cited by 1,408 · see citing works
DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG
Supratak, A., Dong, H., Wu, C., & Guo, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2721116 · Cited by 1,376 · see citing works
Brain tumor classification using deep CNN features via transfer learning
Deepak, S., & Ameer, P. M. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103345 · Cited by 1,370 · see citing works
PTB-XL, a large publicly available electrocardiography dataset
Wagner, P., Strodthoff, N., Bousseljot, R.-D., Kreiseler, D., Lunze, F. I., Samek, W., & Schaeffter, T. (2020) · Scientific Data · doi:10.1038/s41597-020-0495-6 · Cited by 1,357 · see citing works
The Sleep Heart Health Study: Design, Rationale, and Methods
(1997) · Sleep · doi:10.1093/sleep/20.12.1077 · Cited by 1,331 · see citing works
The National Lung Screening Trial: Overview and Study Design
National Lung Screening Trial Research Team (2010) · Radiology · doi:10.1148/radiol.10091808 · Cited by 1,280 · see citing works
Rethinking ImageNet Pre-Training
He, K., Girshick, R., & Dollár, P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00502 · Cited by 1,164 · see citing works
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135 · see citing works
Predicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084 · see citing works
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014 · see citing works
Pre-trained models: Past, present and future
Han, X., Zhang, Z., Ding, N., Gu, Y., Liu, X., Huo, Y., Qiu, J., Yao, Y., Zhang, A., Zhang, L., et al. (2021) · AI Open · doi:10.1016/j.aiopen.2021.08.002 · Cited by 994 · see citing works
Deep learning in cancer diagnosis, prognosis and treatment selection
Tran, K. A., Kondrashova, O., Bradley, A., Williams, E. D., Pearson, J. V., & Waddell, N. (2021) · Genome Medicine · doi:10.1186/s13073-021-00968-x · Cited by 932 · see citing works
The National Sleep Research Resource: towards a sleep data commons
Zhang, G., Cui, L., Mueller, R., Tao, S., Kim, M. J., Rueschman, M., Mariani, S., Mobley, D. R., & Redline, S. S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy064 · Cited by 923 · see citing works
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
Hou, L., Samaras, D., Kurç, T., Gao, Y., Davis, J., & Saltz, J. H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.266 · Cited by 902 · see citing works
Multi-grade brain tumor classification using deep CNN with extensive data augmentation
Sajjad, M., Khan, S., Muhammad, K., Wu, W., Ullah, A., & Baik, S. W. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2018.12.003 · Cited by 895 · see citing works
Rasmy, L., Xiang, Y., Xie, Z., Tao, C., & Zhi, D. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00455-y · Cited by 886 · see citing works
Brain tumor classification for MR images using transfer learning and fine-tuning
Swati, Z. N. K., Zhao, Q., Kabir, M., Ali, F., Ali, Z., Ahmad, S., & Lu, J. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.05.001 · Cited by 867 · see citing works
Transfusion: Understanding Transfer Learning for Medical ImagingPreprint
Raghu, M., Zhang, C., Kleinberg, J. M., & Samy Bengio, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07208 · Cited by 845 · see citing works
Clifford, G. D., Liu, C., Moody, B., Lehman, L.-W. H., Silva, I., Li, Q., Johnson, A. E. W., & Mark, R. G. (2017) · Computing in cardiology · doi:10.22489/cinc.2017.065-469 · Cited by 841 · see citing works
CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation
Kavur, A. E., Gezer, N. S., BARIŞ, M. M., Aslan, S., Conze, P.-H., Groza, V., Pham, D. D., Chatterjee, S., Ernst, P., Özkan, S., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101950 · Cited by 828 · see citing works
DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation
Roth, H. R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E. B., & Summers, R. M. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9_68 · Cited by 784 · see citing works
Sparse Feature Learning for Deep Belief Networks
Ranzato, M., Boureau, Y.-L., & LeCun, Y. (2007) · neural information processing systems · Cited by 752 · see citing works
AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 740 · see citing works
Big Self-Supervised Models Advance Medical Image Classification
Azizi, S., Mustafa, B., Ryan, F., Beaver, Z., Freyberg, J., Deaton, J., Loh, A., Karthikesalingam, A., Kornblith, S., Chen, T., et al. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00346 · Cited by 685 · see citing works
Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model
Han, Z., Wei, B., Zheng, Y., Yin, Y., Li, K., & Li, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-04075-z · Cited by 682 · see citing works
Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet
Bousseljot, R.-D., Kreiseler, D., & Schnabel, A. (2009) · Biomedizinische Technik/Biomedical Engineering · doi:10.1515/bmte.1995.40.s1.317 · Cited by 647 · see citing works
Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging
Xu, Y., Hosny, A., Zeleznik, R., Parmar, C., Coroller, T. P., Franco, I. “., Mak, R. H., & Aerts, H. J. W. L. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-2495 · Cited by 635 · see citing works
Liu, F., Liu, C., Zhao, L., Zhang, X., Xiao-ling, W., Xu, X., Liu, Y., Ma, C., Wei, S., He, Z., et al. (2018) · Journal of Medical Imaging and Health Informatics · doi:10.1166/jmihi.2018.2442 · Cited by 623 · see citing works
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning
Chen, R. J., Chen, C., Li, Y., Chen, T. Y., Trister, A. D., Krishnan, R. G., & Mahmood, F. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01567 · Cited by 621 · see citing works
BEHRT: Transformer for Electronic Health Records
Li, Y., Rao, S., Solares, J. R. A., Hassaine, A., Ramakrishnan, R., Canoy, D., Zhu, Y., Rahimi, K., & Salimi-Khorshidi, G. (2020) · Scientific Reports · doi:10.1038/s41598-020-62922-y · Cited by 595 · see citing works
Multi-Scale Self-Guided Attention for Medical Image Segmentation
Sinha, A., & Dolz, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2986926 · Cited by 583 · see citing works
Self-supervised learning for medical image analysis using image context restoration
Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101539 · Cited by 575 · see citing works
Pernas, F. J. D., Martínez‐Zarzuela, M., Antón‐Rodríguez, M., & González‐Ortega, D. (2021) · Healthcare · doi:10.3390/healthcare9020153 · Cited by 563 · see citing works
Remote Heart Rate Measurement from Face Videos under Realistic Situations
Li, X.-B., Chen, J., Zhao, G.-Y., & Pietikainen, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.543 · Cited by 547 · see citing works
Probability of error of some adaptive pattern-recognition machines
Scudder, H. J. (1965) · IEEE Transactions on Information Theory · doi:10.1109/tit.1965.1053799 · Cited by 542 · see citing works
ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors
Subramanian, R., Wache, J., Abadi, M. K., Vieriu, R. L., WINKLER, S. S., & Sebe, N. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2625250 · Cited by 536 · see citing works
The temple university hospital EEG data corpus
Obeid, I., & Picone, J. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00196 · Cited by 528 · see citing works
Yao, J., Zhu, X., Jonnagaddala, J., Hawkins, N., & Huang, J. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101789 · Cited by 522 · see citing works
Learning to Learn: Introduction and Overview
Thrun, S., & Pratt, L. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_1 · Cited by 521 · see citing works
A Deep Learning Model Based on Concatenation Approach for the Diagnosis of Brain Tumor
Noreen, N., Palaniappan, S., Qayyum, A., Ahmad, I., Imran, M. A., & Shoaib, M. (2020) · IEEE Access · doi:10.1109/access.2020.2978629 · Cited by 504 · see citing works
DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
Wang, G., Zuluaga, M. A., Li, W., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2840695 · Cited by 502 · see citing works
Rotation Equivariant CNNs for Digital Pathology
Veeling, B. S., Linmans, J., Winkens, J., Cohen, T., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_24 · Cited by 476 · see citing works
Bhandary, A., Prabhu, G. A., Rajinikanth, V., Thanaraj, K. P., Satapathy, S. C., Robbins, D. E., Shasky, C., Zhang, Y., Tavares, J. M. R. S., & Raja, N. S. M. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.013 · Cited by 462 · see citing works
TADDEI, A., Distante, G., Emdin, M., Pisani, P., Moody, G. B., Zeelenberg, C., & Marchesi, C. (1992) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a060332 · Cited by 439 · see citing works
A convolutional neural network for sleep stage scoring from raw single-channel EEG
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., & Payen, J. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.12.001 · Cited by 425 · see citing works
A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines
Lu, N., Li, T., Ren, X., & Miao, H. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2601240 · Cited by 419 · see citing works
Recognition of emotions using multimodal physiological signals and an ensemble deep learning model
Yin, Z., Zhao, M., Wang, Y., Yang, J., & Zhang, J. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.12.005 · Cited by 416 · see citing works
Skin lesion classification using ensembles of multi-resolution EfficientNets with meta data
Gessert, N., Nielsen, M., Shaikh, M., Werner, R., & Schlaefer, A. (2020) · MethodsX · doi:10.1016/j.mex.2020.100864 · Cited by 399 · see citing works
Self-Supervised ECG Representation Learning for Emotion Recognition
Sarkar, P., & Etemad, A. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3014842 · Cited by 388 · see citing works
Raghu, S., Sriraam, N., Temel, Y., Rao, S. V., & Kubben, P. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.01.017 · Cited by 387 · see citing works
Brain tumor classification in MRI image using convolutional neural network
Khan, H. A., Wu, J., Mushtaq, M. U., & Mushtaq, M. U. (2020) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2020328 · Cited by 386 · see citing works
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal TransformersPreprint
Huang, Z., Zeng, Z., Liu, B., Fu, D., & Fu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00849 · Cited by 344 · see citing works
Digital medicine and the curse of dimensionality
Berisha, V., Krantsevich, C., Hahn, P. R., Hahn, S., Dasarathy, G., Turaga, P., & Liss, J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00521-5 · Cited by 344 · see citing works
MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition
Song, T., Zheng, W., Cheng, L., Zong, Y., Zhang, X., & Cui, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2891579 · Cited by 339 · see citing works
Detecting formal thought disorder by deep contextualized word representations
Sarzyńska‐Wawer, J., Wawer, A., Pawlak, A., Szymanowska, J., Stefaniak, I., Jarkiewicz, M., & Okruszek, Ł. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114135 · Cited by 336 · see citing works
Moon, W. K., Lee, Y., Ke, H.-H., Lee, S. H., Huang, C., & Chang, R. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105361 · Cited by 322 · see citing works
Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection
Wang, Z., Yin, Y., Shi, J., Fang, W., Li, H., & Wang, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_31 · Cited by 318 · see citing works
Pre-training of Graph Augmented Transformers for Medication Recommendation
Shang, J., Ma, T., Xiao, C., & Sun, J. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/825 · Cited by 311 · see citing works
Byra, M., Styczyński, G., Szmigielski, C. A., Kalinowski, P., Michałowski, Ł., Paluszkiewicz, R., Ziarkiewicz‐Wróblewska, B., Zieniewicz, K., Sobieraj, P., & Nowicki, A. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1843-2 · Cited by 302 · see citing works
Multiscale Energy and Eigenspace Approach to Detection and Localization of Myocardial Infarction
Sharma, L. N., Tripathy, R. K., & Dandapat, S. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2405134 · Cited by 298 · see citing works
Santamaria-Granados, L., Munoz-Organero, M., Ramirez-Gonzalez, G., Abdulhay, E., & Arunkumar, N. (2019) · IEEE Access · doi:10.1109/access.2018.2883213 · Cited by 289 · see citing works
WSISA: Making Survival Prediction from Whole Slide Histopathological Images
Zhu, X.-L., Yao, J., Zhu, F.-Y., & Huang, J.-Z. (2017) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2017.725 · Cited by 286 · see citing works
Rethinking the Value of Labels for Improving Class-Imbalanced LearningPreprint
Yang, Y., & Xu, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07529 · Cited by 282 · see citing works
Christ, P. F., Ettlinger, F., Grün, F., Elshaer, M. E. A., Lipková, J., Schlecht, S. J., Ahmaddy, F., Tatavarty, S., Bickel, M., Bilic, P., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05970 · Cited by 278 · see citing works
Cheng, J. (2015) · Figshare · doi:10.6084/m9.figshare.1512427 · Cited by 262 · see citing works
Self-Supervised Contrastive Pre-Training for Time Series Via Time-Frequency Consistency
Zhang, X., Zhao, Z., Tsiligkaridis, T., & Žitnik, M. (2022) · neural information processing systems · doi:10.52202/068431-0288 · Cited by 261 · see citing works
Deep convolutional neural network for survival analysis with pathological images
Zhu, X., Yao, J., & Huang, J. (2016) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822579 · Cited by 258 · see citing works
Self-supervised learning methods and applications in medical imaging analysis: a survey
Shurrab, S., & Duwairi, R. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1045 · Cited by 258 · see citing works
Unsupervised Pre-Training of Image Features on Non-Curated Data
Caron, M., Bojanowski, P., Mairal, J., & Joulin, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00305 · Cited by 258 · see citing works
Uncovering the structure of clinical EEG signals with self-supervised learning
Banville, H. J., Chehab, O., Hyvärinen, A., Engemann, D. A., & Gramfort, A. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abca18 · Cited by 255 · see citing works
Çimtay, Y., & Ekmekcioǧlu, E. (2020) · Sensors · doi:10.3390/s20072034 · Cited by 254 · see citing works
Treder, M., Lauermann, J. L., & Eter, N. (2017) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-017-3850-3 · Cited by 243 · see citing works
Transfer learning for ECG classification
Weimann, K., & Conrad, T. (2021) · Scientific Reports · doi:10.1038/s41598-021-84374-8 · Cited by 230 · see citing works
Moon, J. H., Lee, H., Shin, W., Kim, Y., & Choi, E. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3207502 · Cited by 221 · see citing works
Amin, S. U., Alsulaiman, M., Muhammad, G., Bencherif, M. A., & Hossain, M. S. (2019) · IEEE Access · doi:10.1109/access.2019.2895688 · Cited by 209 · see citing works
Convolutional neural networks based efficient approach for classification of lung diseases
Demir, F., Şengür, A., & Bajaj, V. (2019) · Health Information Science and Systems · doi:10.1007/s13755-019-0091-3 · Cited by 208 · see citing works
Nogay, H. S., & Adeli, H. (2020) · European Neurology · doi:10.1159/000512985 · Cited by 203 · see citing works
Self-supervised representation learning from 12-lead ECG data
Mehari, T., & Strodthoff, N. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105114 · Cited by 198 · see citing works
Chen, T., Huang, C.-H., Shih, E. S. C., Hu, Y., & Hwang, M. (2019) · iScience · doi:10.1016/j.isci.2020.100886 · Cited by 196 · see citing works
Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction
Bai, W., Chen, C., Tarroni, G., Duan, J., Guitton, F., Petersen, S. E., Guo, Y., Matthews, P. M., & Rueckert, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_60 · Cited by 189 · see citing works
Transfer Learning in Breast Cancer Diagnoses via Ultrasound Imaging
Ayana, G., Dese, K., & Choe, S. (2021) · Cancers · doi:10.3390/cancers13040738 · Cited by 178 · see citing works
MMBERT: Multimodal BERT Pretraining for Improved Medical VQA
Khare, Y., Bagal, V., Mathew, M., Devi, A., Priyakumar, U. D., & Jawahar, C. V. (2021) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434063 · Cited by 176 · see citing works
Andreotti, F., Carr, O., Pimentel, M. A. F., Mahdi, A., & Vos, M. D. (2017) · Computing in cardiology · doi:10.22489/cinc.2017.360-239 · Cited by 171 · see citing works
Pham, T. D. (2020) · Scientific Reports · doi:10.1038/s41598-020-74164-z · Cited by 156 · see citing works
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
Phan, H., Chén, O. Y., Koch, P., Lu, Z., McLoughlin, I. V., Mertins, A., & Vos, M. D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2020.3020381 · Cited by 153 · see citing works
Armato, S. G., III, McLennan, G., Bidaut, L., McNitt-Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2015) · The Cancer Imaging Archive · doi:10.7937/k9/tcia.2015.lo9ql9sx · Cited by 150 · see citing works
An ensemble of deep neural networks for kidney ultrasound image classification
Sudharson, S., & Kokil, P. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105709 · Cited by 147 · see citing works
(2020) · Cited by 147 · see citing works
Meng, Y., Speier, W. F., Ong, M. K., & Arnold, C. W. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3063721 · Cited by 137 · see citing works
Lung cancer histology classification from CT images based on radiomics and deep learning models
Marentakis, P., Karaiskos, P., Kouloulias, V., Kelekis, N., Argentos, S., Oikonomopoulos, N., & Loukas, C. (2021) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-020-02302-w · Cited by 137 · see citing works
Emotion Analysis for Personality Inference from EEG Signals
Zhao, G., Ge, Y., Shen, B., Wei, X., & Wang, H. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2786207 · Cited by 132 · see citing works
Deep Learning Computed Tomography
Würfl, T., Ghesu, F. C., Christlein, V., & Maier, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_50 · Cited by 131 · see citing works
Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Series
Tipirneni, S., & Reddy, C. K. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3516367 · Cited by 130 · see citing works
A Novel Multistage Transfer Learning for Ultrasound Breast Cancer Image Classification
Ayana, G., Park, J., Jeong, J.-W., & Choe, S. (2022) · Diagnostics · doi:10.3390/diagnostics12010135 · Cited by 129 · see citing works
Open access database of raw ultrasonic signals acquired from malignant and benign breast lesions
Piotrzkowska‐Wróblewska, H., Dobruch‐Sobczak, K., Byra, M., & Nowicki, A. (2017) · Medical Physics · doi:10.1002/mp.12538 · Cited by 125 · see citing works
Abdominal multi-organ segmentation with cascaded convolutional and adversarial deep networks
Conze, P.-H., Kavur, A. E., Gall, É. C.-L., Gezer, N. S., Meur, Y. L., Selver, M. A., & Rousseau, F. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102109 · Cited by 124 · see citing works
Convolutional Neural Networks for Electrocardiogram Classification
Rahhal, M. M. A., Bazi, Y., Zuair, M., Othman, E. M. A., & Benjdira, B. (2018) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-018-0389-7 · Cited by 123 · see citing works
How Useful Is Self-Supervised Pretraining for Visual Tasks?
Newell, A., & Deng, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00737 · Cited by 122 · see citing works
Kutlu, H., & Avcı, E. (2019) · Sensors · doi:10.3390/s19091992 · Cited by 120 · see citing works
Exploiting pretrained CNN models for the development of an EEG-based robust BCI framework
Sadiq, M. T., Aziz, M. Z., Almogren, A., Yousaf, A., Siuly, S., & Rehman, A. U. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105242 · Cited by 120 · see citing works
Self-Loop Uncertainty: A Novel Pseudo-Label for Semi-supervised Medical Image Segmentation
Li, Y., Chen, J., Xie, X., Ma, K., & Zheng, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_60 · Cited by 114 · see citing works
What Makes Transfer Learning Work for Medical Images: Feature Reuse & Other Factors
Matsoukas, C., Haslum, J. F., Sorkhei, M., Söderberg, M. P., & Smith, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00901 · Cited by 113 · see citing works
Wang, S., Dong, L.-Y., Wang, X., & Wang, X. (2020) · Open Medicine · doi:10.1515/med-2020-0028 · Cited by 111 · see citing works
Breast Cancer Classification in Ultrasound Images using Transfer Learning
Hijab, A., Rushdi, M. A., Gomaa, M. M. M., & Eldeib, A. (2019) · International Conference on Advances in Biomedical Engineering (ICABME) · doi:10.1109/icabme47164.2019.8940291 · Cited by 110 · see citing works
Meng, Y., Speier, W. F., Ong, M. K., & Arnold, C. W. (2021) · eScholarship (California Digital Library) · Cited by 109 · see citing works
Gómez‐Flores, W., & Pereira, W. C. D. A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104036 · Cited by 105 · see citing works
Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?
Lehman, E., Jain, S., Pichotta, K., Goldberg, Y., & Wallace, B. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.73 · Cited by 103 · see citing works
Deep Correlational Learning for Survival Prediction from Multi-modality Data
Yao, J., Zhu, X., Zhu, F., & Huang, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66185-8_46 · Cited by 102 · see citing works
Clinical-BERT: Vision-Language Pre-training for Radiograph Diagnosis and Reports Generation
Yan, B., & Pei, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20204 · Cited by 94 · see citing works
Cheplygina, V., de Bruijne, M., & Pluim, J. P. W. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.03.009 · Cited by 93 · see citing works
Self-supervised Contrastive Learning for EEG-based Sleep Staging
Jiang, X., Zhao, J., Du, B., & Yuan, Z. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533305 · Cited by 92 · see citing works
CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and PatientsPreprint
Kiyasseh, D., Zhu, T., & Clifton, D. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13249 · Cited by 91 · see citing works
Quantitative EEG and Neurofeedback in Children and Adolescents
Simkin, D. R., Thatcher, R. W., & Lubar, J. F. (2014) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2014.03.001 · Cited by 88 · see citing works
BERT-XML: Large Scale Automated ICD Coding Using BERT Pretraining
Zhang, Z., Liu, J., & Razavian, N. (2020) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2020.clinicalnlp-1.3 · Cited by 87 · see citing works
Deep Recurrent Neural Networks for ECG Signal DenoisingPreprint
Antczak, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11551 · Cited by 86 · see citing works
Self-supervised Learning is More Robust to Dataset Imbalance
Liu, H., HaoChen, J. Z., Gaidon, A., & Ma, T. (2021) · arXiv · doi:10.48550/arxiv.2110.05025 · Cited by 84 · see citing works
van Kessel, R., Wong, B. L. H., Rubinić, I., O’Nuallain, E., & Czabanowska, K. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000013 · Cited by 84 · see citing works
Fine-tuning convolutional deep features for MRI based brain tumor classification
Ahmed, K. B., Hall, L., Goldgof, D. B., Liu, R., & Gatenby, R. A. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2253982 · Cited by 81 · see citing works
Li, Y., Wang, H., & Luo, Y. (2020) · 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313289 · Cited by 81 · see citing works
Transfer learning for non-image data in clinical research: A scoping review
Ebbehøj, A. L., Thunbo, M. Ø., Andersen, O. E., Glindtvad, M. V., & Hulmán, Á. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000014 · Cited by 78 · see citing works
Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure AnalysisPreprint
Tang, S., Dunnmon, J., Saab, K. K., Zhang, X., Huang, Q., Dubost, F., Rubin, D. L., & Lee‐Messer, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08336 · Cited by 76 · see citing works
Paul, R., Hawkins, S. H., Hall, L., Goldgof, D. B., & Gillies, R. J. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844626 · Cited by 75 · see citing works
Subject-Aware Contrastive Learning for Biosignals
Cheng, J. Y., Goh, H., Dogrusoz, K., Tuzel, O., & Azemi, E. (2020) · arXiv · doi:10.48550/arxiv.2007.04871 · Cited by 74 · see citing works
Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration
van Aken, B., Papaioannou, J.-M., Mayrdorfer, M., Budde, K., Gers, F. A., & Loeser, A. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.75 · Cited by 69 · see citing works
Reddy, D. S., Bharath, R., & Rajalakshmi, P. (2018) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2018.8531118 · Cited by 68 · see citing works
Brain Tumor Segmentation and Survival Prediction
Agravat, R. R., & Raval, M. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46640-4_32 · Cited by 66 · see citing works
Unsupervised Pre-training Across Image Domains Improves Lung Tissue Classification
Schlegl, T., Ofner, J., & Langs, G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13972-2_8 · Cited by 65 · see citing works
DeepEnroll: Patient-Trial Matching with Deep Embedding and Entailment Prediction
Zhang, X., Xiao, C., Glass, L. M., & Sun, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380181 · Cited by 65 · see citing works
Shi, H., Wang, H., Qin, C., Zhao, L., & Liu, C. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105219 · Cited by 62 · see citing works
Knowledge-Enhanced Attributed Multi-Task Learning for Medicine Recommendation
Zhang, Y., Wu, X., Fang, Q., Qian, S., & Xu, C. (2022) · ACM Transactions on Information Systems · doi:10.1145/3527662 · Cited by 62 · see citing works
“BioVid Emo DB”: A multimodal database for emotion analyses validated by subjective ratings
Zhang, L., Walter, S., Ma, X., Werner, P., Al-Hamadi, A. K., Traue, H. C., & Gruss, S. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849931 · Cited by 60 · see citing works
Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation
Li, M., Cai, W., Verspoor, K., Pan, S., Liang, X., & Chang, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02000 · Cited by 60 · see citing works
Distanced LSTM: Time-Distanced Gates in Long Short-Term Memory Models for Lung Cancer Detection
Gao, R., Huo, Y., Bao, S., Tang, Y., Antic, S., Epstein, E. S., Balar, A., Deppen, S., Paulson, A. B., Sandler, K. L., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32692-0_36 · Cited by 55 · see citing works
Self-Supervised Graph Learning With Hyperbolic Embedding for Temporal Health Event Prediction
Lu, C. H., Reddy, C. K. A., & Ning, Y. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3109881 · Cited by 54 · see citing works
Transfer Learning for Survival Analysis via Efficient L2,1-Norm Regularized Cox Regression
Li, Y., Wang, L., Wang, J., Ye, J., & Reddy, C. K. A. (2016) · Proceedings · doi:10.1109/icdm.2016.0034 · Cited by 54 · see citing works
Bagherzadeh, S., Maghooli, K., Shalbaf, A., & Maghsoudi, A. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103544 · Cited by 51 · see citing works
Chen, H., Lundberg, S., Erion, G., Kim, J. H., & Lee, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00536-y · Cited by 48 · see citing works
A novel ECG-based real-time detection method of negative emotions in wearable applications
Cheng, Z., Shu, L., Xie, J., & Chen, C. L. P. (2017) · International Conference on Security, Pattern Analysis, and Cybernetics (SPAC) · doi:10.1109/spac.2017.8304293 · Cited by 48 · see citing works
PPGnet: Deep Network for Device Independent Heart Rate Estimation from Photoplethysmogram
Shyam, A., Ravichandran, V., Preejith, S. P., Joseph, J., & Sivaprakasam, M. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8856989 · Cited by 47 · see citing works
ECG assessment based on neural networks with pretraining
Ribas, V. J., Wojdel, A., Romero, E. E., Ramos, P. M., & Brugada, J. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.08.013 · Cited by 44 · see citing works
Effectiveness of Transfer Learning for Deep Learning-Based Electrocardiogram Analysis
Jang, J.-H., Kim, T. Y., & Yoon, D. (2021) · Healthcare Informatics Research · doi:10.4258/hir.2021.27.1.19 · Cited by 44 · see citing works
Sarkar, P., Lobmaier, S. M., Fabre, B. R., González, D., Mueller, A., Frasch, M. G., Antonelli, M. C., & Etemad, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-03376-8 · Cited by 43 · see citing works
Flagged first, then by citations
Research works printed but not linked: 12
- [28][28] V. Jain, E. Learned-Miller. Online domain adaptation of a pre-trained cascade of classifiers. In Proceedings of IEEE Computer Vision and Pattern Recognition, Colorado Springs, USA, pp. 577–584, 2011. DOI: 10.1109/CV-PR.2011.5995317. · DOI
- [47][47] P. Bilic, P. F. Christ, E. Vorontsov, G. Chlebus, H. Chen, Q. Dou, C. W. Fu, X. Han, P. A. Heng, J. Hesser, S. Kadoury, T. K. Konopczynski, M. Le, C. M. Li, X. M. Li, J. Lipková, J. S. Lowengrub, H. Meine, J. H. Moltz, C. Pal, M. Piraud, X. J. Qi, J. Qi, M. Rempfler, K. Roth, A. Schenk, A. Sekuboyina, P. Zhou, C. Hülsemeyer, M. Beetz, F. Ettlinger, F. Grün, G. Kaissis, F. Lohöfer, R. Braren, J. Holch, F. Hofmann, W. H. Sommer, V. Heinemann, C. Jacobs, G. E. H. Mamani, B. van Ginneken, G. Chartrand, A. Tang, M. Drozdzal, A. Ben-Cohen, E. Klang, M. M. Amitai, E. Konen, H. Greenspan, J. Moreau, A. Hostettler, L. Soler, R. Vivanti, A. Szeskin, N. Lev-Cohain, J. Sosna, L. Joskowicz, B. H. Menze. The liver tumor segmentation benchmark (LiTS). [Online], Available: https://arxiv.org/abs/1901.04056, 2019. · arXiv
- [98][98] K. M. He, X. Y. Zhang, S. Q. Ren, J. Sun. Deep residual learning for image recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Vegas, USA, pp. 770–778, 2016. DOI: 10.1109/CV-PR.2016.90. · DOI
- [108][108] Health Information Science and Systems 2020 8 1 10.1007/s13755-019-0089-x PMC6898694 31867102 · DOI
- [121][121] He K M Chen X L Xie S N Li Y H Dollár P Girshick R Masked autoencoders are scalable vision learners 2022 New Orleans, USA IEEE 15979 15988
- [129][129] Journal of Medical Systems 2018 42 11
- [204][204] Journal of Neural Engineering 2021 18 4
- [209][209] N. Wagh, J. H. Wei, S. Rawal, B. M. Berry, L. Barnard, B. Brinkmann, G. Worrell, D. Jones, Y. Varatharajah. Domain-guided self-supervision of EEG data improves downstream classification performance and generalizability. In Proceedings of Machine Learning for Health, pp. 130–142, 2021.
- [218][218] ACM Transactions on Knowledge Discovery from Data 2022 1 1
- [222][222] K. Hur, J. Lee, J. Oh, W. Price, Y. Kim, E. Choi. Unifying heterogeneous electronic health records systems via text-based code embedding. In Proceedings of Conference on Health, Inference, and Learning, pp.183–203, 2022.
- [224][224] Journal of Medical Internet Research 2021 23 1
- [236][236] L. H. Li, M. Yatskar, D. Yin, C. J. Hsieh, K. W. Chang. VisualBERT: A simple and performant baseline or vision and language. [Online], Available: https://arxiv.org/abs/1908.03557, 2019. · arXiv
Cited by
Sorted by citations
Waqas, A., Bui, M. M., Glassy, E. F., Naqa, I. E., Borkowski, P., Borkowski, A., & Rasool, G. (2023) · Laboratory Investigation · doi:10.1016/j.labinv.2023.100255 · Cited by 149 · see citing works
Foundation Model for Advancing Healthcare: Challenges, Opportunities and Future Directions
He, Y., Huang, F., Jiang, X., Nie, Y., Wang, M., Wang, J., & Chen, H. (2024) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2024.3496744 · Cited by 130 · see citing works
A systematic review of intermediate fusion in multimodal deep learning for biomedical applications
Guarrasi, V., Aksu, F., Caruso, C. M., Di Feola, F., Rofena, A., Ruffini, F., & Soda, P. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105509 · Cited by 95 · see citing works
Revisiting Computer-Aided Tuberculosis Diagnosis
Liu, Y., Wu, Y.-H., Zhang, S., Liu, L., Wu, M., & Cheng, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330825 · Cited by 46 · see citing works
Guo, R., Wei, J., Sun, L., Yu, B., Chang, G., Liu, D., Zhang, S., Yao, Z., Xu, M., & Bu, L. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108709 · Cited by 50 · see citing works
Self-citationLessons learned from RadiologyNET foundation models for transfer learning in medical radiology
Napravnik, M., Hržić, F., Urschler, M., Miletić, D., & Štajduhar, I. (2025) · Scientific Reports · doi:10.1038/s41598-025-05009-w · Cited by 15 · see citing works
Zakaria, T. M., Langi, A. Z. R., Nazaruddin, M. S., & Anshori, I. (2025) · IEEE Access · doi:10.1109/access.2025.3582805 · Cited by 16 · see citing works
Generative artificial intelligence in diabetes healthcare
Vehi, J., Mujahid, O., Beneyto, A., & Contreras, I. (2025) · iScience · doi:10.1016/j.isci.2025.113051 · Cited by 12 · see citing works
A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical ApplicationsPreprint
Guarrasi, V., Aksu, F., Caruso, C. M., Feola, F. D., Rofena, A., Ruffini, F., & Soda, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4952813 · Cited by 12 · see citing works
Hierarchical Pretraining on Multimodal Electronic Health Records
Wang, X., Luo, J., Wang, J., Yin, Z., Cui, S., Zhong, Y., Wang, Y., & Ma, F. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.171 · Cited by 13 · see citing works
Complementary to Multiple Labels: A Correlation-Aware Correction Approach
Gao, Y. D., Xu, M., & Zhang, M.-L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3416384 · Cited by 8 · see citing works
Self-citationIrregularity-Informed Time Series Analysis: Adaptive Modelling of Spatial and Temporal Dynamics
Zheng, L. N., Li, Z., Dong, C. G., Zhang, W. E., Yue, L., Xu, M., Maennel, O., & Chen, W. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679716 · Cited by 8 · see citing works
Self-citationSWAP: Exploiting Second-Ranked Logits for Adversarial Attacks on Time Series
Dong, C. G., Zheng, L. N., Chen, W., Zhang, W. E., & Yue, L. (2023) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg59574.2023.00020 · Cited by 8 · see citing works
Self-citationZheng, L. N., Dong, C. G., Zhang, W. E., Chen, X., Yue, L., & Chen, W. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679719 · Cited by 6 · see citing works
Self-citationFeature extraction and deep learning
Mahyar, A., Motamednia, H., Cheraaqee, P., & Mansouri, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-332818-3.00019-8 · Cited by 6 · see citing works
Buser, M. A. D., Simons, D. C., Fitski, M., Wijnen, M. H. W. A., Littooij, A. S., ter Brugge, A. H., Vos, I. N., Janse, M. H. A., de Boer, M., ter Maat, L. S., et al. (2025) · Bioengineering · doi:10.3390/bioengineering12111157 · Cited by 3 · see citing works
Foundation models for brain imaging: A systematic review
Ghamizi, S., Kanli, G., Deng, Y., Palissot, V., Perquin, M., & Keunen, O. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121877 · Cited by 5 · see citing works
Neural Reconstruction through Scattering Media with Forward and Backward Losses
Wang, Y., Shen, S., Xia, S., Li, R., Peng, X., Yu, Y., Li, S., & Jingyi Yu, A. (2023) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccp56744.2023.10233796 · Cited by 3 · see citing works
Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review
Yang, M., Shi, N., Chen, H., Po, E. Y. P., Ng, P. Y., Lai, P. C. K., Wu, Y.-C., & Fong, D. Y. T. (2026) · Health Data Science · doi:10.34133/hds.0356 · Cited by 3 · see citing works
“This approach enables efficient adaptation to specialized clinical tasks, even with limited data from the specific patient cohort [ 77 ].”
Data-Efficient Sleep Staging with Synthetic Time Series Pretraining
Grieger, N., Mehrkanoon, S., & Bialonski, S. (2025) · Algorithms · doi:10.3390/a18090580 · Cited by 2 · see citing works
Cardiac Dynamic Characteristics Classification on Cine MRI Using Semi-supervised Imaging Approach
Ahmad, F., Xiong, J., Wu, J., Xia, J., & Xia, Z. (2025) · Machine Intelligence Research · doi:10.1007/s11633-024-1534-0 · Cited by 2 · see citing works
Answer Semantics-enhanced Medical Visual Question Answering
Liang, Y., Yang, E., Guo, G., Cai, W., Jiang, L., Zhao, J., & Wang, X. (2025) · Machine Intelligence Research · doi:10.1007/s11633-025-1564-2 · Cited by 2 · see citing works
BucketAugment: Reinforced Domain Generalisation in Abdominal CT Segmentation
Hresko, D. J., & Drotár, P. (2024) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2024.3397623 · Cited by 2 · see citing works
A Progressive Sampling Method for Dual-Node Imbalanced Learning with Restricted Data Access
Qiu, Y., Chen, W., & Xu, M. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00060 · Cited by 2 · see citing works
Self-citationTransforming Raw CKD Data into a Fixed Dataset: Evaluating Preprocessing Methods
Subashini., N. J., Pushparaj., E., & Venkatesh, K. (2025) · International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE) · doi:10.1109/rmkmate64874.2025.11042790 · Cited by 1 · see citing works
Monteleone, M., & Postiglione, A. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia241455
AI strategies for drug discovery and bioactivity prediction: opportunities and challenges
Azad, A. K. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-34059-8.00013-0
Medical data foundations: Key concepts and definitions for clinicians and researchers
Boubaker, O. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27638-5.00003-1
Wang, L., Zhou, Y., Zhou, S., & Qiao, L. (2026) · World Conference on Computing and Communication Technologies (WCCCT) · doi:10.1109/wccct69960.2026.11549832
Cross-variability decoding for motor imagery EEG signals: a comprehensive review
Wang, L., Zhou, Y., Wang, P., Ma, X., & Zhou, S. (2026) · Frontiers in Neuroscience · doi:10.3389/fnins.2026.1899645
- Authors
- Qiu, Y., Lin, F., Chen, W., & Xu, M.
- Affiliations
- The University of Queensland (AU)
- The University of Adelaide (AU)
- Corresponding author
- Chen, Weitong
- Venue
- Machine Intelligence Research
- Published
- 2023-02-21
- Volume
- 20
- Issue
- 2
- Pages
- 147-179
- ISSN
- 1476-8186 (ISSN-L)
- 2731-538X
- 2731-5398
- PMC
- PMC9942039
- OpenAlex
- W4321437302
- Cited by
- 30
- References
- 235
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 8 · 2023: 6
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Machine Intelligence Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- Funders
- University of Adelaide
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- pre-training, health data, deep neural network, electronic health records, multimodal medical data, benchmarking, transfer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review