Multistage transfer learning for medical images
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Deep learning is revolutionizing various domains and significantly impacting medical image analysis. Despite notable progress, numerous challenges remain, necessitating the refinement of deep learning algorithms for optimal performance in medical image analysis. This paper explores the growing demand for precise and robust medical image analysis by focusing on an advanced deep learning technique, multistage transfer learning. Over the past decade, multistage transfer learning has emerged as a pivotal strategy, particularly in overcoming challenges associated with limited medical data and model generalization. However, the absence of well-compiled literature capturing this development remains a notable gap in the field. This exhaustive investigation endeavors to address this gap by providing a foundational understanding of how multistage transfer learning approaches confront the unique challenges posed by insufficient medical image datasets. The paper offers a detailed analysis of various multistage transfer learning types, architectures, methodologies, and strategies deployed in medical image analysis. Additionally, it delves into intrinsic challenges within this framework, providing a comprehensive overview of the current state while outlining potential directions for advancing methodologies in future research. This paper underscores the transformative potential of multistage transfer learning in medical image analysis, providing valuable guidance to researchers and healthcare professionals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 2×
“The integration of multistage transfer learning into medical image analysis has resulted in a paradigm shift and several noteworthy improvements (Shorten and Khoshgoftaar 2019).”
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678 · cited 3×
“Transfer learning encompasses a diverse type of method designed to leverage knowledge gained from one domain or task to enhance performance in a different but related domain or task (Zhuang et al. 2021).”
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545 · cited 1×
“CNNs have proven highly effective in tasks such as image recognition, object detection, and image classification due to their ability to capture local patterns and hierarchical representations in data (Zhao et al. 2019).”
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273
Convolutional neural networks: an overview and application in radiology
Yamashita, R., Nishio, M., Do, R. K. G., & Togashi, K. (2018) · Insights into Imaging · doi:10.1007/s13244-018-0639-9 · Cited by 4,682 · cited 2×
“Within the hidden layers of a CNN, one or more layers are dedicated to performing convolutions (Yamashita et al. 2018).”
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“This is particularly advantageous for medical imaging tasks where resource constraints are common (Sze et al. 2017).”
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
Revolutionizing healthcare: the role of artificial intelligence in clinical practice
Alowais, S. A., Alghamdi, S. S., Alsuhebany, N., Alqahtani, T., Alshaya, A. I., Almohareb, S. N., Aldairem, A., Alrashed, M., Bin Saleh, K., Badreldin, H. A., et al. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04698-z · Cited by 3,146 · cited 1×
“As the healthcare industry has experienced an unprecedented surge in the demand for precise and efficient deep learning-based diagnostic tools, the shortcomings imposed by these challenges have prompted researchers to explore innovative approaches (Alowais et al. 2023; El-Bouzaidi and Abdoun 2023).”
Explainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922 · cited 1×
“These high-level representations serve as a bridge between the source and target tasks, encapsulating the model’s understanding of the most pertinent information (Linardatos et al. 2020).”
Research works printed but not linked: 114
- Al-Stouhi S, Reddy CK (2016) Transfer learning for class imbalance problems with inadequate data. Knowl Inf Syst 48:201–228. https://doi.org/10.1007/s10115-015-0870-3 · DOI
- Alammar Z, Alzubaidi L, Zhang J et al (2023) Deep transfer learning with enhanced feature fusion for detection of abnormalities in X-ray images. Cancers (Basel) 15:4007. https://doi.org/10.3390/cancers15154007 · DOI
- Ali NF, Atef M (2022) LSTM multi-stage transfer learning for blood pressure estimation using photoplethysmography. Electronics 11:3749. https://doi.org/10.3390/electronics11223749 · DOI
- Ali MU, Kallu KD, Masood H et al (2023) A CNN-based chest infection diagnostic model: a multistage multiclass isolated and developed transfer learning framework. Int J Intell Syst 2023. https://doi.org/10.1155/2023/6850772 · DOI
- Alsubaie MG, Luo S, Shaukat K (2024) Alzheimer’s disease detection using deep learning on neuroimaging: a systematic review. Mach Learn Knowl Extr 6:464–505. https://doi.org/10.3390/make6010024 · DOI
- Alzubaidi L, Zhang J, Humaidi AJ et al (2021a) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Springer International Publishing, Cham
- Alzubaidi L, Bai J, Al-Sabaawi A et al (2023) A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications. J Big Data 10:46. https://doi.org/10.1186/s40537-023-00727-2 · DOI · Paper page
- Asakawa T, Shinoda H, Togawa T et al (2023) Real and generated image classification using multi-stage transfer learning. CEUR Workshop Proc 3497:1396–1402
- Aswiga RV, Aishwarya R, Shanthi AP (2021) Multistage transfer learning technique for classifying rare medical datasets. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-021-02989-1 · doi:10.1007/s12652-021-02989-1
- Ayana G, Choe S (2022) BUViTNet: breast ultrasound detection via vision transformers. Diagnostics 12:2654. https://doi.org/10.3390/diagnostics12112654 · DOI
- Ayana G, Dese K, Choe S (2021) Transfer learning in breast cancer diagnoses via ultrasound imaging. Cancers (Basel) 13:738. https://doi.org/10.3390/cancers13040738 · DOI · Paper page
- Ayana G, Park J, Choe S (2022a) Patchless multi-stage transfer learning for improved mammographic breast mass classification. Cancers (Basel) 14:1280. https://doi.org/10.3390/cancers14051280 · DOI
- Ayana G, Park J, Jeong J-W, Choe S (2022b) A novel multistage transfer learning for ultrasound breast cancer image classification. Diagnostics 12:135. https://doi.org/10.3390/diagnostics12010135 · DOI
- Ayana G, Dese K, Dereje Y et al (2023) Vision-transformer-based transfer learning for mammogram classification. Diagnostics 13:178. https://doi.org/10.3390/diagnostics13020178 · DOI
- Bao R, Sun Y, Gao Y et al (2023) A survey of heterogeneous transfer learning. J Big Data 14:1–20
- Basha SHS, Vinakota SK, Pulabaigari V et al (2021) AutoTune: automatically tuning convolutional neural networks for improved transfer learning. Neural Netw 133:112–122. https://doi.org/10.1016/j.neunet.2020.10.009 · DOI
- Chan H-P, Samala RK, Hadjiiski LM, Zhou C (2020) Deep learning in medical image analysis. pp 3–21 · DOI · Paper page
- Chato L, Regentova E (2023) Survey of transfer learning approaches in the machine learning of digital health sensing data. J Pers Med 13:1703. https://doi.org/10.3390/jpm13121703 · DOI
- Cho W, Park J, Kim T (2023) Complementary domain adaptation and generalization for unsupervised continual domain shift learning. Proc IEEE Int Conf Comput Vis. https://doi.org/10.1109/ICCV51070.2023.01051 · DOI
- Christodoulidis S, Anthimopoulos M, Ebner L et al (2017) Multisource transfer learning with convolutional neural networks for lung pattern analysis. IEEE J Biomed Heal Inf 21:76–84. https://doi.org/10.1109/JBHI.2016.2636929 · DOI · Paper page
- Chugh G, Kumar S, Singh N (2023) MSTLA: multi-stage transfer learning approach for breast carcinoma diagnosis. 2023 Int Conf Adv Comput Comput Technol InCACCT. pp 509–514. https://doi.org/10.1109/InCACCT57535.2023.10141697 · DOI
- Desai D (2023) Deep transfer learning for multiple sclerosis detection and classi cation using pre-trained model. pp 0–22 · doi:10.21203/rs.3.rs-3393656/v1
- Dinsdale NK, Bluemke E, Sundaresan V et al (2022) Challenges for machine learning in clinical translation of big data imaging studies. Neuron 110:3866–3881. https://doi.org/10.1016/j.neuron.2022.09.012 · DOI
- Duchi JC, Bartlett PL, Wainwright MJ (2011) Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res 12:2121–2159. https://doi.org/10.1109/CDC.2012.6426698 · DOI · Paper page
- El-Bouzaidi YEI, Abdoun O (2023) Advances in artificial intelligence for accurate and timely diagnosis of COVID-19: a comprehensive review of medical imaging analysis. Sci Afr 22:e01961. https://doi.org/10.1016/j.sciaf.2023.e01961 · DOI
- Elahi M, Afolaranmi SO, Martinez Lastra JL, Perez Garcia JA (2023) A comprehensive literature review of the applications of AI techniques through the lifecycle of industrial equipment. Discov Artif Intell 3:43. https://doi.org/10.1007/s44163-023-00089-x · DOI · Paper page
- Fernando T, Gammulle H, Denman S et al (2022) Deep learning for medical anomaly detection a survey. ACM Comput Surv 54:1–28. https://doi.org/10.1145/3464423 · DOI · Paper page
- Gao L, Zhang L, Liu C, Wu S (2020) Handling imbalanced medical image data: a deep-learning-based one-class classification approach. Artif Intell Med 108:101935. https://doi.org/10.1016/j.artmed.2020.101935 · DOI · Paper page
- Ghazal M, Abbas T, Munir S et al (2022) Alzheimer disease detection empowered with transfer learning. Comput Mater Contin 70:5005–5019. https://doi.org/10.32604/cmc.2022.020866 · DOI
- Gladston A, Venkatesan V, Haripriya K, Mounika M (2022) Multistage transfer learning for stage detection of diabetic retinopathy. Int J Ambient Comput Intell 13:1–24. https://doi.org/10.4018/IJACI.304725 · doi:10.4018/ijaci.304725
- Gull S, Akbar S, Naqi SM (2023) A deep learning approach for multi-stage classification of brain tumor through magnetic resonance images. Int J Imaging Syst Technol 33:1745–1766. https://doi.org/10.1002/ima.22897 · DOI
- Guo Y, Shi H, Kumar A et al (2019) Spottune: transfer learning through adaptive fine-tuning. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. https://doi.org/10.1109/CVPR.2019.00494 · DOI · Paper page
- Hadgi S, Li L, Ovsjanikov M (2024) To supervise or not to supervise: understanding and addressing the key challenges of 3D transfer learning · DOI
- Han X, Zhang Z, Ding N et al (2021) Pre-trained models: past, present and future. AI Open 2:225–250. https://doi.org/10.1016/j.aiopen.2021.08.002 · DOI · Paper page
- Hardt M, Recht B, Singer Y (2016) Train faster, generalize better: stability of stochastic gradient descent. 33rd Int Conf Mach Learn ICML 2016 3:1868–1877
- Hassanzadeh H, Nguyen A, Karimi S, Chu K (2018) Transferability of artificial neural networks for clinical document classification across hospitals: a case study on abnormality detection from radiology reports. J Biomed Inf 85:68–79. https://doi.org/10.1016/j.jbi.2018.07.017 · DOI
- He L, Li H, Wang J et al (2020) A multi-task, multi-stage deep transfer learning model for early prediction of neurodevelopment in very preterm infants. Sci Rep 10:15072. https://doi.org/10.1038/s41598-020-71914-x · DOI
- Hernández Santa Cruz JF (2021) An ensemble approach for multi-stage transfer learning models for COVID-19 detection from chest CT scans. Intell Med 5:100027. https://doi.org/10.1016/j.ibmed.2021.100027 · DOI
- Hosna A, Merry E, Gyalmo J et al (2022) Transfer learning: a friendly introduction. J Big Data 9:102. https://doi.org/10.1186/s40537-022-00652-w · DOI · Paper page
- Iman M, Arabnia HR, Rasheed K (2023) A review of deep transfer learning and recent advancements. Technologies. https://doi.org/10.3390/technologies11020040 · DOI · Paper page
- Jaganathan D, Balasubramaniam S, Sureshkumar V, Dhanasekaran S (2024) Revolutionizing breast cancer diagnosis: a concatenated precision through transfer learning in histopathological data analysis. Diagnostics 14:422. https://doi.org/10.3390/diagnostics14040422 · DOI
- Jia Z, Chen J, Xu X et al (2023) The importance of resource awareness in artificial intelligence for healthcare. Nat Mach Intell 5:687–698. https://doi.org/10.1038/s42256-023-00670-0 · DOI · Paper page
- Khalifa N, Loey M, Taha M, Mohamed H (2019) Deep transfer learning models for medical diabetic retinopathy detection. Acta Inf Med 27:327. https://doi.org/10.5455/aim.2019.27.327-332 · DOI
- Kim HE, Cosa-Linan A, Santhanam N et al (2022) Transfer learning for medical image classification: a literature review. BMC Med Imaging 22:1–13. https://doi.org/10.1186/s12880-022-00793-7 · DOI · Paper page
- Kondaveeti HK, Edupuganti P (2020) Skin cancer classification using transfer learning. In: 2020 IEEE International Conference on Advent Trends in Multidisciplinary Research and Innovation (ICATMRI). IEEE, pp 1–4 · DOI
- Kora P, Ooi CP, Faust O et al (2022) Transfer learning techniques for medical image analysis: a review. Biocybern Biomed Eng 42:79–107. https://doi.org/10.1016/j.bbe.2021.11.004 · DOI · Paper page
- Labach A, Salehinejad H, Valaee S (2019) Survey of dropout methods for deep neural networks. arXiv
- Lai T (2024) Interpretable medical imagery diagnosis with self-attentive transformers: a review of explainable AI for health care. BioMedInformatics 4:113–126. https://doi.org/10.3390/biomedinformatics4010008 · DOI
- Lee T, Singh VP, Cho KH (2021) Updating weights. pp 63–78 · doi:10.1007/978-3-030-64777-3_6
- Li Q, Li S, Li R et al (2022a) Low-dose computed tomography image reconstruction via a multistage convolutional neural network with autoencoder perceptual loss network. Quant Imaging Med Surg 12:1929–1957. https://doi.org/10.21037/qims-21-465 · DOI
- Li M, Jiang Y, Zhang Y, Zhu H (2023) Medical image analysis using deep learning algorithms. Front Public Heal. https://doi.org/10.3389/fpubh.2023.1273253. 11: · DOI · Paper page
- Liu Y, Cui W, Ha Q et al (2021) Knowledge transfer between brain lesion segmentation tasks with increased model capacity. Comput Med Imaging Graph 88:101842. https://doi.org/10.1016/j.compmedimag.2020.101842 · DOI
- Lizancos Vidal P, de Moura J, Novo J, Ortega M (2021) Multi-stage transfer learning for lung segmentation using portable X-ray devices for patients with COVID-19. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2021.114677 · DOI
- Lu J, Behbood V, Hao P et al (2015) Transfer learning using computational intelligence: a survey. Knowl-Based Syst 80:14–23. https://doi.org/10.1016/j.knosys.2015.01.010 · DOI · Paper page
- Maaliw RR, Alon AS, Lagman AC et al (2022) A multistage transfer learning approach for acute lymphoblastic leukemia classification. 2022 IEEE 13th Annu Ubiquitous Comput Electron Mob Commun Conf UEMCON 2022. 488–495. https://doi.org/10.1109/UEMCON54665.2022.9965679 · DOI
- Mall PK, Singh PK, Srivastav S et al (2023) A comprehensive review of deep neural networks for medical image processing: recent developments and future opportunities. Healthc Anal 4:100216. https://doi.org/10.1016/j.health.2023.100216 · DOI · Paper page
- Malte A, Ratadiya P (2019) Evolution of transfer learning in natural language processing. Comput Lang. https://doi.org/10.48550/arXiv.1910.07370 · DOI
- Marathe A, Anirudh R, Jain N et al (2017) Performance modeling under resource constraints using deep transfer learning. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. ACM, New York, NY, USA, pp 1–12 · DOI
- Marcinkevičs R, Vogt JE (2020) Interpretability and explainability: a machine learning Zoo Mini-tour. Mach Learn. https://doi.org/10.48550/arXiv.2012.01805 · DOI
- Mathivanan SK, Sonaimuthu S, Murugesan S et al (2024) Employing deep learning and transfer learning for accurate brain tumor detection. Sci Rep 14:7232. https://doi.org/10.1038/s41598-024-57970-7 · DOI · Paper page
- Meng J, Tan Z, Yu Y et al (2022) TL-med: a two-stage transfer learning recognition model for medical images of COVID-19. Biocybern Biomed Eng 42:842–855. https://doi.org/10.1016/j.bbe.2022.04.005 · DOI
- Mudeng V, Choe S (2022a) Deep neural network incorporating domain and resolution transformations model for histopathological image classification. Comput Electr Eng 104:108468. https://doi.org/10.1016/j.compeleceng.2022.108468 · DOI
- Mudeng V, Farid MN, Ayana G, Choe S (2023) Domain and histopathology adaptations—based classification for malignancy grading system. Am J Pathol 193:2080–2098. https://doi.org/10.1016/j.ajpath.2023.07.007 · DOI
- Najjar R (2023) Redefining radiology: a review of artificial intelligence integration in medical imaging. Diagnostics 13:2760. https://doi.org/10.3390/diagnostics13172760 · DOI · Paper page
- Nejjar I, Geissmann F, Zhao M et al (2024) Domain adaptation via alignment of operation profile for remaining useful lifetime prediction. Reliab Eng Syst Saf 242:109718. https://doi.org/10.1016/j.ress.2023.109718 · DOI
- Nie L, Li B, Du Y et al (2024) Deep learning strategies with CReToNeXt-YOLOv5 for advanced pig face emotion detection. Sci Rep 14:1679. https://doi.org/10.1038/s41598-024-51755-8 · DOI
- Nwankpa C, Ijomah W, Gachagan A, Marshall S (2018) Activation functions: comparison of trends in practice and research for deep learning. Mach Learn. https://doi.org/10.48550/arXiv.1811.03378 · arXiv · doi:10.48550/arxiv.1811.03378 · Paper page
- Otović E, Njirjak M, Jozinović D et al (2022) Intra-domain and cross-domain transfer learning for time series data—how transferable are the features? Knowledge-Based Syst 239:107976. https://doi.org/10.1016/j.knosys.2021.107976 · DOI
- Paiano M, Martina S, Giannelli C, Caruso F (2024) Transfer learning with generative models for object detection on limited datasets. Computer Vis Pattern Recognit. https://doi.org/10.48550/arXiv.2402.06784 · arXiv · doi:10.48550/arxiv.2402.06784
- Panjapornpon C, Bardeeniz S, Hussain MA, Chomchai P (2023) Explainable deep transfer learning for energy efficiency prediction based on uncertainty detection and identification. Energy AI 12:100224. https://doi.org/10.1016/j.egyai.2022.100224 · DOI
- Peng P, Liang L, Luo H, et al G et al (2021) Rethinking transfer learning for medical image classification. Image Video Process 1:1–14
- Poudel K, Dhakal M, Bhandari P et al (2023) Exploring transfer learning in medical image segmentation using vision-language models. Computer Vis Pattern Recognit. https://doi.org/10.48550/arXiv.2308.07706 · DOI
- Raghu M, Unterthiner T, Kornblith S et al (2021) Do vision transformers see like convolutional neural networks? Computer Vis Pattern Recognit. https://doi.org/10.48550/arXiv.2108.08810 · DOI · Paper page
- Ravikumar A, Sriraman H, Saleena B, Prakash B (2023) Selecting the optimal transfer learning model for precise breast cancer diagnosis utilizing pre-trained deep learning models and histopathology images. Health Technol (Berl) 13:721–745. https://doi.org/10.1007/s12553-023-00772-0 · DOI
- Rimer M, Martinez T (2006) Classification-based objective functions. Mach Learn 63:183–205. https://doi.org/10.1007/s10994-006-6266-6 · DOI
- Russakovsky O, Deng J, Su H et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252. https://doi.org/10.1007/s11263-015-0816-y · DOI · Paper page
- Safayenikoo P, Akturk I (2021) Weight update skipping: reducing training time for artificial neural networks. IEEE J Emerg Sel Top Circuits Syst 11:563–574. https://doi.org/10.1109/JETCAS.2021.3127907 · DOI
- Salehi AW, Khan S, Gupta G et al (2023) A study of CNN and transfer learning in medical imaging: advantages, challenges, future scope. Sustainability 15:5930. https://doi.org/10.3390/su15075930 · DOI · Paper page
- Samala RK, Chan H-P, Hadjiiski LM et al (2017) Multi-task transfer learning deep convolutional neural network: application to computer-aided diagnosis of breast cancer on mammograms. Phys Med Biol 62:8894–8908. https://doi.org/10.1088/1361-6560/aa93d4 · DOI · Paper page
- Samala RK, Chan H-P, Hadjiiski L et al (2019a) Breast cancer diagnosis in digital breast tomosynthesis: effects of training sample size on multi-stage transfer learning using deep neural nets. IEEE Trans Med Imaging 38:686–696. https://doi.org/10.1109/TMI.2018.2870343 · DOI · Paper page
- Shi L, Wang B, Zhang J (2023) A multi-stage transfer learning framework for diabetic retinopathy grading on small data. IEEE Int Conf Commun.https://doi.org/10.1109/ICC45041.2023.10279479 · DOI
- Shurrab S, Duwairi R (2022) Self-supervised learning methods and applications in medical imaging analysis: a survey. PeerJ Comput Sci 8:1–37. https://doi.org/10.7717/PEERJ-CS.1045 · DOI · Paper page
- Simaiya S, Kaur R, Sandhu JK et al (2022) A novel multistage ensemble approach for prediction and classification of diabetes. Front Physiol. https://doi.org/10.3389/fphys.2022.1085240 · DOI
- Souid A, Alsubaie N, Soufiene BO et al (2023) Improving diagnosis accuracy with an intelligent image retrieval system for lung pathologies detection: a features extractor approach. Sci Rep 13:16619. https://doi.org/10.1038/s41598-023-42366-w · DOI
- Stergiou C, Siganos D (1996) Neural networks | The back-propagation algorithm. Surprise 96:1–9
- Sun Y, Gao Y, Bao R et al (2024) Online transfer learning for RSV case detection · DOI
- Szandała T (2021) Review and comparison of commonly used activation functions for deep neural networks. Stud Comput Intell 903:203–224. https://doi.org/10.1007/978-981-15-5495-7_11 · DOI · Paper page
- Taye MM (2023) Theoretical understanding of convolutional neural network: concepts, architectures, applications, future directions. Computation 11:52. https://doi.org/10.3390/computation11030052 · DOI · Paper page
- Valle Salgado EI, Yan H, Hong Y et al (2023) Model-based transfer learning for automatic optical inspection based on domain discrepancy. In: Dai Q, Shimura T, Zheng Z et al (eds) Optoelectronic imaging and multimedia technology IX. SPIE, Bellingham, p 42 · DOI
- Vania M, Lee D (2021) Intervertebral disc instance segmentation using a multistage optimization mask-RCNN (MOM-RCNN). J Comput Des Eng 8:1023–1036. https://doi.org/10.1093/jcde/qwab030 · DOI
- Velpula VK, Sharma LD (2023) Multi-stage glaucoma classification using pre-trained convolutional neural networks and voting-based classifier fusion. Front Physiol 14:1–17. https://doi.org/10.3389/fphys.2023.1175881 · DOI
- Verma G, Raskar S, Emani M, Chapman B (2024) Cross-feature transfer learning for efficient tensor program generation. Appl Sci 14:513. https://doi.org/10.3390/app14020513 · DOI
- Vidal PL, de Moura J, Novo J, Ortega M (2021) Multi-stage transfer learning for lung segmentation using portable X-ray devices for patients with COVID-19. Expert Syst Appl 173:114677. https://doi.org/10.1016/j.eswa.2021.114677 · DOI
- Wang P, Zhang X, Hao Y (2019a) A method combining CNN and ELM for feature extraction and classification of SAR image. J Sens 2019:1–8. https://doi.org/10.1155/2019/6134610 · DOI
- Wang T, Huan J, Zhu M (2019b) Instance-based deep transfer learning. Proc—2019 IEEE Winter Conf Appl Comput Vision, WACV. pp 367–375. https://doi.org/10.1109/WACV.2019.00045 · DOI
- Wang S, Cao G, Wang Y et al (2021) Review and prospect: artificial intelligence in advanced medical imaging. Front Radiol. https://doi.org/10.3389/fradi.2021.781868 · DOI
- Weiss K, Khoshgoftaar TM, Wang D (2016) A survey of transfer learning. J Big Data 3:9. https://doi.org/10.1186/s40537-016-0043-6 · DOI · Paper page
- Xie X, Niu J, Liu X et al (2021) A survey on incorporating domain knowledge into deep learning for medical image analysis. Med Image Anal 69:101985. https://doi.org/10.1016/j.media.2021.101985 · DOI · Paper page
- Xu Q, Xie W, Liao B et al (2023) Interpretability of clinical decision support systems based on artificial intelligence from technological and medical perspective: a systematic review. J Healthc Eng 2023:1–13. https://doi.org/10.1155/2023/9919269 · DOI · Paper page
- Yao Y, Ge D, Yu J, Xie M (2022) Model-based deep transfer learning method to fault detection and diagnosis in nuclear power plants. Front Energy Res. https://doi.org/10.3389/fenrg.2022.823395 · DOI
- Yeo D, Bae J-R, Kim N-S et al (2018) Sequential knowledge transfer in teacher-student framework using densely distilled flow-based information. In: 2018 25th IEEE International Conference on Image Processing (ICIP). IEEE, pp 674–678 · DOI
- Yi S, Zhou L, Ma L, Shao D (2023) MTRA-CNN: a multi-scale transfer learning Framework for Glaucoma classification in retinal fundus images. IEEE Access 11:142689–142701. https://doi.org/10.1109/ACCESS.2023.3342910 · DOI
- You C, Cong W, Vannier MW et al (2020) CT Super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE). IEEE Trans Med Imaging 39:188–203. https://doi.org/10.1109/TMI.2019.2922960 · DOI · Paper page
- You C, Xiang J, Su K et al (2022b) Incremental learning meets transfer learning: application to multi-site prostate MRI segmentation. pp 3–16 · DOI
- Yu X, Wang J, Hong Q-Q et al (2022) Transfer learning for medical images analyses: a survey. Neurocomputing 489:230–254. https://doi.org/10.1016/j.neucom.2021.08.159 · DOI · Paper page
- Yuan G, Li Y, Li S et al (2022) Layer freezing & data sieving: missing pieces of a generic framework for sparse training. Adv Neural Inf Process Syst 35
- Zawish M, Davy S, Abraham L (2024) Complexity-driven model compression for resource-constrained deep learning on edge. IEEE Trans Artif Intell. https://doi.org/10.1109/TAI.2024.3353157 · DOI
- Zhang T, Gao P, Dong H et al (2022) Consecutive pre-training: a knowledge transfer learning strategy with relevant unlabeled data for remote sensing domain. Remote Sens 14:1–20. https://doi.org/10.3390/rs14225675 · DOI
- Zhang S, Qian Z, Huang K et al (2023) Robust generative adversarial network. Mach Learn 112:5135–5161. https://doi.org/10.1007/s10994-023-06367-0 · DOI
- Zhao J, Shetty S, Pan JW (2017) Feature-based transfer learning for network security. In: MILCOM 2017–2017 IEEE Military Communications Conference (MILCOM). IEEE, pp 17–22 · DOI
- Zhao Z, Alzubaidi L, Zhang J et al (2024) A comparison review of transfer learning and self-supervised learning: definitions, applications, advantages and limitations. Expert Syst Appl 242:122807. https://doi.org/10.1016/j.eswa.2023.122807 · DOI · Paper page
- Zheng H, Shen L, Tang A et al (2023) Learn from model beyond fine-tuning: a survey. Artif Intell 14:1–20
- Zhou J, Zheng L-Y, Wang Y, Gogu C (2020) A multistage deep transfer learning method for machinery fault diagnostics across diverse working conditions and devices. IEEE Access 8:80879–80898. https://doi.org/10.1109/ACCESS.2020.2990739 · DOI
- Zoetmulder R, Gavves E, Caan M, Marquering H (2022) Domain- and task-specific transfer learning for medical segmentation tasks. Comput Methods Programs Biomed 214:106539. https://doi.org/10.1016/j.cmpb.2021.106539 · DOI
Cited by
Shobayo, O., & Saatchi, R. (2025) · Diagnostics · doi:10.3390/diagnostics15091072 · Cited by 53
“…the relationships between patches using the K , V , Q (keys, values, and queries) matrices, which are computed as: where Z ( l − 1 ) is the positional patch embedding for each patch and W K , W V , and W Q are the learnable weight projection matrices, which have the same size as embedding space.”
Park, S.-Y., Ayana, G., Wako, B. D., Jeong, K. C., Yoon, S.-D., & Choe, S.-W. (2025) · Diagnostics · doi:10.3390/diagnostics15030260 · Cited by 18
Self-citationXu, Z., Choi, Y., Yi, C., Park, C., Park, J., Park, H., & Song, S. (2026) · Aerospace · doi:10.3390/aerospace13030222
Metadata
- Authors
- Ayana, G., Dese, K., Abagaro, A. M., Jeong, K. C., Yoon, S.-D., & Choe, S.-W.
- Venue
- Artificial Intelligence Review
- Published
- 2024-08-06
- Volume
- 57
- Issue
- 9
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W4401372704
- Cited by
- 57
- References
- 20
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- National Research Foundation of Korea (RS-2023-00240521)
- Korea Ministry of SMEs and Startups (S3310765)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multistage transfer learning for medical images. https://app.cochat.ai/papers/10.1007/s10462-024-10855-7
- The paper
- Ayana, G., Dese, K., Abagaro, A. M., Jeong, K. C., Yoon, S.-D., & Choe, S.-W. (2024). Multistage transfer learning for medical images. Artificial Intelligence Review. https://doi.org/10.1007/s10462-024-10855-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.