The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
A Review of Deep Transfer Learning and Recent Advancements
Open accessAbstract
Deep learning has been the answer to many machine learning problems during the past two decades. However, it comes with two significant constraints: dependency on extensive labeled data and training costs. Transfer learning in deep learning, known as Deep Transfer Learning (DTL), attempts to reduce such reliance and costs by reusing obtained knowledge from a source data/task in training on a target data/task. Most applied DTL techniques are network/model-based approaches. These methods reduce the dependency of deep learning models on extensive training data and drastically decrease training costs. Moreover, the training cost reduction makes DTL viable on edge devices with limited resources. Like any new advancement, DTL methods have their own limitations, and a successful transfer depends on specific adjustments and strategies for different scenarios. This paper reviews the concept, definition, and taxonomy of deep transfer learning and well-known methods. It investigates the DTL approaches by reviewing applied DTL techniques in the past five years and a couple of experimental analyses of DTLs to discover the best practice for using DTL in different scenarios. Moreover, the limitations of DTLs (catastrophic forgetting dilemma and overly biased pre-trained models) are discussed, along with possible solutions and research trends.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
Brain tumor classification using deep CNN features via transfer learning
Deepak, S., & Ameer, P. M. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103345 · Cited by 1,321
A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis
Wen, L., Gao, L., & Li, X. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2754287 · Cited by 1,095
Deep Transfer Learning for Image‐Based Structural Damage Recognition
Gao, Y., & Mosalam, K. M. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12363 · Cited by 766
Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning
Jaiswal, A., Gianchandani, N., Singh, D., Kumar, V., & Kaur, M. (2021) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2020.1788642 · Cited by 613
A Digital-Twin-Assisted Fault Diagnosis Using Deep Transfer Learning
Xu, Y., Sun, Y., Liu, X., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2018.2890566 · Cited by 509
Application of deep transfer learning for automated brain abnormality classification using MR images
Talo, M., Baloglu, U. B., Yıldırım, Ö., & Rajendra Acharya, U. (2019) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.12.007 · Cited by 507
Unsupervised Cross-Dataset Transfer Learning for Person Re-identification
Peng, P., Xiang, T., Wang, Y., Pontil, M., Gong, S., Huang, T., & Tian, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.146 · Cited by 416
Automated Deep Transfer Learning-Based Approach for Detection of COVID-19 Infection in Chest X-rays
Narayan Das, N., Kumar, N., Kaur, M., Kumar, V., & Singh, D. (2022) · IRBM · doi:10.1016/j.irbm.2020.07.001 · Cited by 351
Jha, D., Choudhary, K., Tavazza, F., Liao, W.-K., Choudhary, A., Campbell, C., & Agrawal, A. (2019) · Nature Communications · doi:10.1038/s41467-019-13297-w · Cited by 339
Facial Emotion Recognition Using Transfer Learning in the Deep CNN
Akhand, M. A. H., Roy, S., Siddique, N., Kamal, M. A. S., & Shimamura, T. (2021) · Electronics · doi:10.3390/electronics10091036 · Cited by 333
Celik, Y., Talo, M., Yildirim, O., Karabatak, M., & Acharya, U. R. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.03.011 · Cited by 318
Learning to Discover Novel Visual Categories via Deep Transfer Clustering
Han, K., Vedaldi, A., & Zisserman, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00849 · Cited by 303
Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning
Li, X., Zhang, W., Ding, Q., & Li, X. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2927590 · Cited by 298
An adaptive deep transfer learning method for bearing fault diagnosis
Wu, Z., Jiang, H., Zhao, K., & Li, X. (2020) · Measurement · doi:10.1016/j.measurement.2019.107227 · Cited by 291
Loey, M., Manogaran, G., & Khalifa, N. E. M. (2025) · Neural Computing and Applications · doi:10.1007/s00521-020-05437-x · Cited by 286
Video-based emotion recognition in the wild using deep transfer learning and score fusion
Kaya, H., Gürpınar, F., & Salah, A. A. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.01.012 · Cited by 235 · cited 1×
“[32] 2017 Video-based emotion recognition in the wild using deep transfer learning and score fusion video (audio & visual) yes Finetuning yes VGG-Face Human science / psychology”
MethodWhat is being transferred in transfer learning?
Neyshabur, B., Sedghi, H., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.11687 · Cited by 183
Gu, Y., Ge, Z., Bonnington, C. P., & Zhou, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2942429 · Cited by 176
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
Phan, H., Chén, O. Y., Koch, P., Lu, Z., McLoughlin, I. V., Mertins, A., & Vos, M. D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2020.3020381 · Cited by 162
Sudhakar, & Kumar, S. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.029 · Cited by 139
Deep Transfer Learning for Modality Classification of Medical Images
Yu, Y., Lin, H., Meng, J., Wei, X., Guo, H., & Zhao, Z. (2017) · Information · doi:10.3390/info8030091 · Cited by 138
Comparison of Deep Transfer Learning Strategies for Digital Pathology
Mormont, R., Geurts, P., & Marée, R. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00303 · Cited by 134
Deep Transfer Learning for Signal Detection in Ambient Backscatter Communications
Liu, C., Wei, Z., Ng, D. W. K., Yuan, J., & Liang, Y. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3034895 · Cited by 132
Progressive Neural Networks for Transfer Learning in Emotion Recognition
Gideon, J., Khorram, S., Aldeneh, Z., Dimitriadis, D., & Provost, E. M. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1637 · Cited by 129
Online detection for bearing incipient fault based on deep transfer learning
Mao, W., Ding, L., Tian, S. I. P., & Liang, X. (2019) · Measurement · doi:10.1016/j.measurement.2019.107278 · Cited by 126
Deep Transfer Learning for Multiple Class Novelty Detection
Perera, P., & Patel, V. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01181 · Cited by 105
Automatic ICD-9 coding via deep transfer learning
Zeng, M., Li, M., Fei, Z., Yu, Y., Pan, Y. F., & Wang, J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.081 · Cited by 103
Deep transfer learning for military object recognition under small training set condition
Yang, Z. Q., Yu, W., Liang, P., Guo, H., Xia, L., Zhang, F., Ma, Y., & Ma, J. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3468-3 · Cited by 99
Factors of Influence for Transfer Learning Across Diverse Appearance Domains and Task Types
Mensink, T., Uijlings, J., Kuznetsova, A., Gygli, M., & Ferrari, V. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3129870 · Cited by 97
Folding Membrane Proteins by Deep Transfer Learning
Wang, S., Li, Z., Yu, Y., & Xu, J. (2017) · Cell Systems · doi:10.1016/j.cels.2017.09.001 · Cited by 82
Deep Transfer Learning for Art Classification Problems
Sabatelli, M., Kestemont, M., Daelemans, W. M. P., & Geurts, P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11012-3_48 · Cited by 71
Empirical Study and Improvement on Deep Transfer Learning for Human Activity Recognition
Ding, R., Li, X., Nie, L., Li, J., Si, X., Chu, D., Liu, G., & Zhan, D. (2018) · Sensors · doi:10.3390/s19010057 · Cited by 64
Wan, L., Liu, R., Sun, L., Nie, H., & Wang, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.09.007 · Cited by 63
Voghoei, S., Tonekaboni, N. H., Wallace, J. G., & Arabnia, H. R. (2018) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci46756.2018.00177 · Cited by 45
Self-citationMulticlassification of Endoscopic Colonoscopy Images Based on Deep Transfer Learning
Wang, Y., Feng, Z., Song, L., Liu, X., & Liu, S. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/2485934 · Cited by 42
Deep transfer learning-based visual classification of pressure injuries stages
Ay, B., Taşar, B., Utlu, Z., Ay, K., & Galip Aydin, B. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07274-6 · Cited by 35
Deep Transfer Learning for WiFi Localization
Li, P., Cui, H. F., Khan, A., Raza, U. A., Piechocki, R. J., Doufexi, A., & Farnham, T. (2021) · IEEE Radar Conference (RadarConf) · doi:10.1109/radarconf2147009.2021.9455237 · Cited by 31
Joshi, D., Mishra, V., Srivastav, H., & Goel, D. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10521-x · Cited by 25
Iman, M., Arabnia, H. R., & Branchinst, R. M. (2021) · Transactions on computational science and computational intelligence · doi:10.1007/978-3-030-70296-0_6 · Cited by 20
Self-citationClassification of analyzable metaphase images using transfer learning and fine tuning
Albayrak, A. (2021) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-021-02474-z · Cited by 14
(2019) · doi:10.1287/orms.2016.05.10 · Cited by 10
EXPANSE, A Continual Deep Learning System; Research Proposal
Iman, M., Rasheed, K., & Arabnia, H. R. (2021) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci54926.2021.00103 · Cited by 8
Self-citationAn Evaluation of Progressive Neural Networksfor Transfer Learning in Natural Language Processing
Moeed, A., Hagerer, G., Dugar, S., Gupta, S., Ghosh, M., Danner, H., Mitevski, O., Nawroth, A., & Groh, G. (2020) · Cited by 5
Cited by
Zhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., & Gu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122807 · Cited by 410
Deep learning for water quality
Zhi, W., Appling, A. P., Golden, H. E., Podgorski, J., & Li, L. (2024) · Nature Water · doi:10.1038/s44221-024-00202-z · Cited by 364
AAontology: An Ontology of Amino Acid Scales for Interpretable Machine Learning
Breimann, S., Kamp, F., Steiner, H., & Frishman, D. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168717 · Cited by 15
Vishwanath, M., Cao, S., Dutt, N., Rahmani, A. M., Lim, M. M., & Cao, H. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107948 · Cited by 3
Metadata
- Authors
- Iman, M., Arabnia, H. R., & Rasheed, K.
- Venue
- Technologies
- Publisher
- MDPI AG
- Published
- 2023-03-14
- Volume
- 11
- Issue
- 2
- Pages
- 40
- ISSN
- 2227-7080 (ISSN-L)
- OpenAlex
- W4324142429
- Cited by
- 680
- References
- 47
- FWCI
- 58.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.