The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
A Review of Deep Transfer Learning and Recent Advancements
Open accessAbstract
Deep learning has been the answer to many machine learning problems during the past two decades. However, it comes with two significant constraints: dependency on extensive labeled data and training costs. Transfer learning in deep learning, known as Deep Transfer Learning (DTL), attempts to reduce such reliance and costs by reusing obtained knowledge from a source data/task in training on a target data/task. Most applied DTL techniques are network/model-based approaches. These methods reduce the dependency of deep learning models on extensive training data and drastically decrease training costs. Moreover, the training cost reduction makes DTL viable on edge devices with limited resources. Like any new advancement, DTL methods have their own limitations, and a successful transfer depends on specific adjustments and strategies for different scenarios. This paper reviews the concept, definition, and taxonomy of deep transfer learning and well-known methods. It investigates the DTL approaches by reviewing applied DTL techniques in the past five years and a couple of experimental analyses of DTLs to discover the best practice for using DTL in different scenarios. Moreover, the limitations of DTLs (catastrophic forgetting dilemma and overly biased pre-trained models) are discussed, along with possible solutions and research trends.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
Brain tumor classification using deep CNN features via transfer learning
Deepak, S., & Ameer, P. M. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103345 · Cited by 1,321
A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis
Wen, L., Gao, L., & Li, X. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2754287 · Cited by 1,095
Deep Transfer Learning for Image‐Based Structural Damage Recognition
Gao, Y., & Mosalam, K. M. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12363 · Cited by 766
Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning
Jaiswal, A., Gianchandani, N., Singh, D., Kumar, V., & Kaur, M. (2021) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2020.1788642 · Cited by 613
A Digital-Twin-Assisted Fault Diagnosis Using Deep Transfer Learning
Xu, Y., Sun, Y., Liu, X., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2018.2890566 · Cited by 509
Application of deep transfer learning for automated brain abnormality classification using MR images
Talo, M., Baloglu, U. B., Yıldırım, Ö., & Rajendra Acharya, U. (2019) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.12.007 · Cited by 507
Cited by
Zhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., & Gu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122807 · Cited by 410
Deep learning for water quality
Zhi, W., Appling, A. P., Golden, H. E., Podgorski, J., & Li, L. (2024) · Nature Water · doi:10.1038/s44221-024-00202-z · Cited by 364
AAontology: An Ontology of Amino Acid Scales for Interpretable Machine Learning
Breimann, S., Kamp, F., Steiner, H., & Frishman, D. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168717 · Cited by 15
Vishwanath, M., Cao, S., Dutt, N., Rahmani, A. M., Lim, M. M., & Cao, H. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107948 · Cited by 3
Metadata
- Authors
- Iman, M., Arabnia, H. R., & Rasheed, K.
- Venue
- Technologies
- Publisher
- MDPI AG
- Published
- 2023-03-14
- Volume
- 11
- Issue
- 2
- Pages
- 40
- ISSN
- 2227-7080 (ISSN-L)
- OpenAlex
- W4324142429
- Cited by
- 680
- References
- 47
- FWCI
- 58.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Review of Deep Transfer Learning and Recent Advancements. https://app.cochat.ai/papers/10.3390/technologies11020040
- The paper
- Iman, M., Arabnia, H. R., & Rasheed, K. (2023). A Review of Deep Transfer Learning and Recent Advancements. Technologies. https://doi.org/10.3390/technologies11020040
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.