A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 1,101–1,200 of 1,257
Adversarial Multiple-Target Domain Adaptation for Fault Classification
Ragab, M., Chen, Z., Wu, M., Li, H., Kwoh, C.-K., Yan, R., & Li, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3009341 · Cited by 90
“The DA involves a domain D and task T [29], where the domain D consists of two components: a feature space X and marginal distribution P(x), where D = X , P(x), x ∈ X , where x is the data sample.”
BackgroundThrift, W. J., & Ragan, R. (2019) · Analytical Chemistry · doi:10.1021/acs.analchem.9b03599 · Cited by 89
A Survey of Transfer and Multitask Learning in Bioinformatics
Xu, Q., & Yang, Q. (2011) · Journal of Computing Science and Engineering · doi:10.5626/jcse.2011.5.3.257 · Cited by 89
Self-citationKotei, E., & Thirunavukarasu, R. (2023) · Information · doi:10.3390/info14030187 · Cited by 89
“Transfer learning [12] is one technique used to address this drawback.”
MethodAdvancing medical imaging informatics by deep learning-based domain adaptation
Choudhary, A., Tong, L., Zhu, Y., & Wang, M. D. (2020) · Yearbook of Medical Informatics · doi:10.1055/s-0040-1702009 · Cited by 84
“Transfer learning (TL) [7] is a technique that applies knowledge learned from one”
BackgroundSubpopulation Data Poisoning Attacks
Jagielski, M., Severi, G., Pousette Harger, N., & Oprea, A. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3485368 · Cited by 86
Using Convolutional Neural Networks to Automate Aircraft Maintenance Visual Inspection
Dogru, A., Bouarfa, S., Arizar, R., & Aydogan, R. (2020) · doi:10.20944/preprints202011.0527.v1 · Cited by 86
“In order to reduce the computational time to train the MASK R-CNN, we have applied transfer learning [26] with a warm restart (shown in Figure 2) and taken the initial weights from [27].”
MethodFederated Learning for Resource-Constrained IoT Devices: Panoramas and State of the Art
Imteaj, A., Mamun Ahmed, K., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2023) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-031-11748-0_2 · Cited by 86
Latent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85
“To tackle the distribution discrepancies among different persons, transfer learning and domain adaptation methods are proposed in the literature (Pan and Yang 2010).”
MethodSelf-citationMcInnes, G., Sharo, A. G., Koleske, M. L., Brown, J. E. H., Norstad, M., Adhikari, A. N., Wang, S., Brenner, S. E., Halpern, J., Koenig, B. A., et al. (2021) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2021.03.003 · Cited by 86
“The resulting model may perform very well on Y because the ‘‘lessons’’ learned in modeling X transfer well to Y. 84–89 There are several flavors of transfer learning that have been applied to applications in genetics and proteomics.”
MethodProactive Content Caching by Exploiting Transfer Learning for Mobile Edge Computing
Hou, T., Feng, G., Qin, S., & Jiang, W. (2017) · GLOBECOM 2017 - 2017 IEEE Global Communications Conference · doi:10.1109/glocom.2017.8254636 · Cited by 85
Zhou, Y., Pei, Y., Li, Z., Fang, L., Zhao, Y., & Yi, W. (2020) · Measurement · doi:10.1016/j.measurement.2020.107801 · Cited by 84
“However, the transfer learning proposed by Pan and Yang [49] provides a powerful solu-tion for training a DCNN with a limited dataset.”
BackgroundA novel database of children's spontaneous facial expressions (LIRIS-CSE)
Khan, R. A., Crenn, A., Meyer, A., & Bouakaz, S. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.02.004 · Cited by 82
Edge Intelligence: The Convergence of Humans, Things, and AI
Rausch, T., & Dustdar, S. (2019) · 2019 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e.2019.00022 · Cited by 82
“C2E - Training data is centralized - Inferencing data may be sensitive - Inferencing may need to happen in near-real time - Large number of model deployments - Models run on specialized hardware - Model compression [41] - Latency/accuracy tradeoff [42] - Distributed inferencing [43] - Transfer learning [44] - Surveill…”
MethodHuman Activity Recognition Based on Dynamic Active Learning
Bi, H., Perello-Nieto, M., Santos-Rodriguez, R., & Flach, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3013403 · Cited by 81
“Transfer learning is another machine learning branch with the main objective of learning new tasks with a limited number of labels, by exploiting a large labelled set on a related task [46].”
BackgroundPersonalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning
Fu, Z., He, X., Wang, E., Huo, J., Huang, J., & Wu, D. (2021) · Sensors · doi:10.3390/s21030885 · Cited by 79
“Therefore, domain adaptation can also be divided into supervised domain adaptation and unsupervised domain adaptation according to whether the target domain has labeled data [46].”
BackgroundSu, L., Xu, Y., & Dong, Z. (2024) · Energy Conversion and Economics · doi:10.1049/enc2.12125 · Cited by 86
“For battery pack SOH estimation with limited early life data and SOH labels, inductive transfer learning can be used, whereas transduction transfer learning can be applied when noisy SOH labels or no SOH labels exist [103].”
In Search of Lost Domain Generalization
Gulrajani, I., & Lopez-Paz, D. (2020) · arXiv · doi:10.48550/arxiv.2007.01434 · Cited by 440
“In the latter, unlabeled data from the test domain is available during training (Pan and Yang, 2009; Patel et al., 2015; Wilson and Cook, 2018).”
BackgroundKaur, A., Singh, Y., Neeru, N., Kaur, L., & Singh, A. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09649-9 · Cited by 79
DAO to HANOI via DeSci: AI Paradigm Shifts from AlphaGo to ChatGPT
Miao, Q., Zheng, W., Lv, Y., Huang, M., Ding, W., & Wang, F.-Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123561 · Cited by 78
“A series of surveys, like [35, 36] and [18], have well summarized the definition, taxonomy and development of Transfer Learning.”
BackgroundImproved survival analysis by learning shared genomic information from pan-cancer data
Kim, S., Kim, K., Choe, J., Lee, I., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa462 · Cited by 77
An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registry
Jiang, W., Synovic, N., Hyatt, M., Schorlemmer, T. R., Sethi, R., Lu, Y.-H., Thiruvathukal, G. K., & Davis, J. C. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00206 · Cited by 76
“Through transfer learning, DNNs can be pre-trained on large datasets and fine-tuned to solve specialized tasks, leveraging a PTM’s knowledge of one task to better teach it a similar task [33, 37].”
BackgroundWu, D., Lawhern, V. J., Hairston, W. D., & Lance, B. J. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2544108 · Cited by 74
“Definition 2: (Task) [23], [27] Given a domain D , a task T is composed of a label space Y and a prediction function f ( x ) , i.e., T = {Y , f ( x ) } .”
BackgroundInfluentialComputational Screening of New Perovskite Materials Using Transfer Learning and Deep Learning
Li, X., Dan, Y., Dong, R., Cao, Z., Niu, C., Song, Y., Li, S., & Hu, J. (2019) · Applied Sciences · doi:10.3390/app9245510 · Cited by 74
“We tried to retrieve these 5239 samples from the Material Project (MP) database and obtained 1148 sample data with Crystallographic Information File (CIF) files.”
MethodMiller, J., Taori, R., Raghunathan, A., Sagawa, S., Koh, P. W., Shankar, V., Liang, P., Carmon, Y., & Schmidt, L. (2021) · arXiv · doi:10.48550/arxiv.2107.04649 · Cited by 74
A study of deep neural networks for human activity recognition
Sansano, E., Montoliu, R., & Belmonte Fernández, Ó. (2020) · Computational Intelligence · doi:10.1111/coin.12318 · Cited by 73
A review of recent advances and strategies in transfer learning
Gholizade, M., Soltanizadeh, H., Rahmanimanesh, M., & Sana, S. S. (2025) · International Journal of System Assurance Engineering and Management · doi:10.1007/s13198-024-02684-2 · Cited by 92
“We also explore prior categorizations, such as those proposed in Pan and Yang Oct. (2010), which break down transfer learning into feature-based(Pan et al. 2010; Fer-nando et al. 2013), instance-based(Yao and Doretto 2010; Chattopadhyay et al. 2012; Chen et al. 2019), relational-based,(Zuo et al.…”
Towards Low-Cost Pavement Condition Health Monitoring and Analysis Using Deep Learning
Roberts, R., Giancontieri, G., Inzerillo, L., & Di Mino, G. (2020) · Applied Sciences · doi:10.3390/app10010319 · Cited by 71
“It is an approach wherein knowledge developed in one task is transferred and used to improve the learning of different target tasks using a pre-trained model as a baseline [19].”
Ma, G., Wang, Z., Liu, W., Fang, J., Zhang, Y., Ding, H., & Yuan, Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123531 · Cited by 70
“In fact, the SOH of LIBs is highly dependent on the operating conditions and ambient temperatures, which results in various degradation modes of LIBs [11], [12].”
BackgroundLyu, H., Lu, H., Mou, L., Li, W., Wright, J., Li, X., Li, X., Zhu, X., Wang, J., Yu, L., et al. (2018) · Remote Sensing · doi:10.3390/rs10030471 · Cited by 70
“According to [30,38], transfer learning can be defined as follows.”
BackgroundAI system engineering key challenges and lessons learned
Fischer, L., Ehrlinger, L., Geist, V., Ramler, R., Sobiezky, F., Zellinger, W., Brunner, D., Kumar, M., & Moser, B. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make3010004 · Cited by 71
“However, at a second look, it becomes intuitive that the minimization of stronger distance measures are more prone to the effect of negative transfer [115], that is, the adaptation of source-specific information not present in the target domain.”
BackgroundSupport and Invertibility in Domain-Invariant Representations
Johansson, F. D., Sontag, D., & Ranganath, R. (2019) · arXiv · doi:10.48550/arxiv.1903.03448 · Cited by 70
“Domain adaptation has been studied primarily under Assumption 2 (covariate shift) (Pan et al. , 2010), which is the setting also of this work.”
BackgroundCao, H., Liu, S., Zhao, R., & Xiong, X. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720919698 · Cited by 70
Preuss, K., Thach, N., Liang, X., Baine, M., Chen, J., Zhang, C., Du, H., Yu, H., Lin, C., Hollingsworth, M. A., et al. (2022) · Cancers · doi:10.3390/cancers14071654 · Cited by 69
“Another method is transfer learning, where standard architectures designed based on natural images with pretrained weights, such as ImageNet, are fine-tuned with specific medical images [12,13].”
MethodDeep generative Bayesian optimization for sensor placement in structural health monitoring
Sajedi, S., & Liang, X. (2022) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12799 · Cited by 68
Fiber tractography using machine learning
Neher, P. F., Côté, M.-A., Houde, J.-C., Descoteaux, M., & Maier-Hein, K. H. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.028 · Cited by 68
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
“The other solution is to use transfer learning (Pan and Yang, 2010).”
BackgroundMobileDA: Toward Edge-Domain Adaptation
Yang, J., Zou, H., Cao, S., Chen, Z., & Xie, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2976762 · Cited by 67
Izadi, M. J., Hassani, P., Raeesi, M., & Ahmadi, P. (2024) · Energy · doi:10.1016/j.energy.2024.130602 · Cited by 67
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks
Dinh, T., Zeng, Y., Zhang, R., Lin, Z., Gira, M., Rajput, S., Sohn, J.-Y., Papailiopoulos, D., & Lee, K. (2022) · arXiv · doi:10.48550/arxiv.2206.06565 · Cited by 67
“A domain-and-modality agnostic model that can be adapted to solve tasks across different modalities and domains has become a desidera-tum [14], motivating great efforts in transfer learning [15] and multi-modal learning [16].”
BackgroundNon-invasive wearable seizure detection using long–short-term memory networks with transfer learning
Nasseri, M., Pal Attia, T., Joseph, B., Gregg, N. M., Nurse, E. S., Viana, P. F., Schulze-Bonhage, A., Dümpelmann, M., Worrell, G., Freestone, D. R., et al. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abef8a · Cited by 66
Yeo, M., Tahayori, B., Kok, H. K., Maingard, J., Kutaiba, N., Russell, J., Thijs, V., Jhamb, A., Chandra, R. V., Brooks, M., et al. (2021) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2020-017099 · Cited by 65
Li, Z. (., Fang, X., & Sheng, O. R. L. (2018) · ACM Transactions on Management Information Systems · doi:10.1145/3131782 · Cited by 65
Tong, Z., Li, W., Zhang, B., & Zhang, M. (2018) · Shock and Vibration · doi:10.1155/2018/6714520 · Cited by 64
“DA can be considered as particular setting of transfer learning [17,18] which aims to leverage the knowledge learnt from a training domain to use in a different but related test domain by reducing distribution differences [18,19].”
BackgroundChe, Y., Deng, Z., Tang, X., Lin, X., Nie, X., & Hu, X. (2022) · Chinese Journal of Mechanical Engineering · doi:10.1186/s10033-021-00668-y · Cited by 64
Learning to denoise astronomical images with U-nets
Vojtekova, A., Lieu, M., Valtchanov, I., Altieri, B., Old, L., Chen, Q., & Hroch, F. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3567 · Cited by 63
Image-Based Feature Representation for Insider Threat Classification
Gayathri, R. G., Sajjanhar, A., & Xiang, Y. (2020) · Applied Sciences · doi:10.3390/app10144945 · Cited by 63
“from 0-255. The images are reshaped to a size of 32x32 for training. Each user’s daily log pattern is represented as the grayscale images. C. Transfer Learning for Anomaly Detection Transfer learning [31] is a research direction in machine learning that focuses on retaining knowledge obtained during one problem solvin…”
BackgroundMethodAn Intelligent Transient Stability Assessment Framework with Continual Learning Ability
Li, X., Yang, Z., Guo, P., & Cheng, J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3064052 · Cited by 62
Lin, S.-C., Yang, J.-H., Nogueira, R., Tsai, M.-F., Wang, C.-J., & Lin, J. (2020) · arXiv · doi:10.48550/arxiv.2005.02230 · Cited by 62
“In this work, though, we practically apply and formally analyze a query-expansion-based method as well as a transfer learning method [23, 36] under a full conversational IR pipeline.”
MethodZhang, Y., Lobo-Mueller, E. M., Karanicolas, P., Gallinger, S., Haider, M. A., & Khalvati, F. (2021) · Scientific Reports · doi:10.1038/s41598-021-80998-y · Cited by 62
Li, F., Xia, Y., Wang, F., Zhang, D., Li, X., & He, F. (2020) · Applied Sciences · doi:10.3390/app10051804 · Cited by 64
“In the field of machine learning, transfer learning is defined as the ability to use the knowledge learned in a previous task or domain in a new task or domain [12].”
BackgroundBayesian multi-task learning for decoding multi-subject neuroimaging data
Marquand, A. F., Brammer, M., Williams, S. C. R., & Doyle, O. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.02.008 · Cited by 59
“Multi-task learning has attracted substantial interest over recent years and a large volume of work exists within the machine learning literature (reviewed in Pan and Yang (2010)).”
BackgroundInfluentialNiazi, S. K. (2025) · Pharmaceuticals · doi:10.3390/ph18091271 · Cited by 61
“However, the limitations of transfer learning must be acknowledged, particularly the risk of negative transfer when applied to highly specific tasks or narrow therapeutic areas where the source and target domains differ substantially [74].”
Caroppo, A., Leone, A., & Siciliano, P. (2020) · Journal of Computer Science and Technology · doi:10.1007/s11390-020-9665-4 · Cited by 60
“Therefore, in order to save ourselves from this overhead, in the present work the concept of “transfer learning” was adopted ([31]).”
BackgroundKamran, F., Tang, S., Otles, E., McEvoy, D. S., Saleh, S. N., Gong, J., Li, B. Y., Dutta, S., Liu, X., Medford, R. J., et al. (2022) · BMJ · doi:10.1136/bmj-2021-068576 · Cited by 60
“57 58 Moreover, the clinician-informed data driven approach to feature selection and a rigorous approach to internal validation contributed to the strong generalization performance of the model.”
Lamaakal, I., Maleh, Y., El Makkaoui, K., Ouahbi, I., Pławiak, P., Alfarraj, O., Almousa, M., & Abd El-Latif, A. A. (2025) · Sensors · doi:10.3390/s25051318 · Cited by 60
“Other approaches include federated learning [166], which allows models to be trained across decentralized datasets without sharing data, and transfer learning [167], where pre-trained models are fine-tuned on smaller, domain-specific datasets to save resources.”
Ghosh, A., Urry, C. M., Wang, Z., Schawinski, K., Turp, D., & Powell, M. C. (2020) · The Astrophysical Journal · doi:10.3847/1538-4357/ab8a47 · Cited by 58
GENA-LM: A Family of Open-Source Foundational DNA Language Models for Long Sequences
Fishman, V., Kuratov, Y., Shmelev, A., Petrov, M., Penzar, D., Shepelin, D., Chekanov, N., Kardymon, O., & Burtsev, M. (2023) · doi:10.1101/2023.06.12.544594 · Cited by 137
“Transfer learning, especially through pre-training, has been widely adopted in natural language processing for its capacity to enhance computational efficiency and performance in scenarios with limited target data [9–14].”
Olmos, R., Tabik, S., Lamas, A., Pérez-Hernández, F., & Herrera, F. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.015 · Cited by 57
Ros‐NET: A deep convolutional neural network for automatic identification of rosacea lesions
Binol, H., Plotner, A., Sopkovich, J., Kaffenberger, B., Niazi, M. K. K., & Gurcan, M. N. (2020) · Skin Research and Technology · doi:10.1111/srt.12817 · Cited by 56
“We present a generalizable identification framework by applying transfer learning 7-9 on a deep-learning network that is pre-trained over 1 million images.”
BackgroundMethodDomain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
“While transfer learning and domain adaptation [10, 36, 39, 54] are popular to perform cross-domain learning, they can not be used in our problem since they require the availability of the test domain.”
BackgroundMethodZheng, Y., Guo, H., Zhang, L., Wu, J., Li, Q., & Lv, F. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.01097 · Cited by 55
“Transfer learning is an alternative method for the problem of lack of data ( 36).”
MethodFoukalas, F., & Tziouvaras, A. (2021) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2020.3026837 · Cited by 54
“Our model also utilizes a learning setting similar to multitask learning, as stated in [20], as the source task contains labeled data, and, thus, no self-learning procedure takes place.”
MethodYuan, W., Hang, K., Kragic, D., Wang, M. Y., & Stork, J. A. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.06.007 · Cited by 54
Transfer Learning Strategies for Deep Learning-based PHM Algorithms
Yang, F., Zhang, W., Tao, L., & Ma, J. (2020) · Applied Sciences · doi:10.3390/app10072361 · Cited by 53
“It is undoubtedly expensive to collect enough fault data available for training to reconstruct the fault diagnosis classifier, and it is difficult to directly train a satisfactory fault diagnosis classifier for the collection of a small amount of data [9].”
BackgroundA deep learning framework for hybrid heterogeneous transfer learning
Zhou, J. T., Pan, S. J., & Tsang, I. W. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2019.06.001 · Cited by 53
Self-citationMiloshevich, G., Cozian, B., Abry, P., Borgnat, P., & Bouchet, F. (2023) · Physical Review Fluids · doi:10.1103/physrevfluids.8.040501 · Cited by 53
Toward Secure Data Fusion in Industrial IoT Using Transfer Learning
Lin, H., Hu, J., Wang, X., Alhamid, M. F., & Piran, M. J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3038780 · Cited by 53
Generalizable Multi-Site Training and Testing Of Deep Neural Networks Using Image Normalization
Onofrey, J. A., Casetti-Dinescu, D. I., Lauritzen, A. D., Sarkar, S., Venkataraman, R., Fan, R. E., Sonn, G. A., Sprenkle, P. C., Staib, L. H., & Papademetris, X. (2019) · 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) · doi:10.1109/isbi.2019.8759295 · Cited by 52
Industrial Transfer Learning: Boosting Machine Learning in Production
Tercan, H., Guajardo, A., & Meisen, T. (2019) · 2019 IEEE 17th International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin41052.2019.8972099 · Cited by 50
“Transfer learning addresses this problem by utilizing the experiences gained from a source task to improve the learning for a new related task [4].”
BackgroundMethodGe, Q., Ruan, F., Qiao, B., Zhang, Q., Zuo, X., & Dang, L. (2021) · Electronics · doi:10.3390/electronics10151823 · Cited by 50
“The reason why model-based transfer learning works well is the generality of the low-and mid-level features of the image data.”
BackgroundTransfer learning for cross-language text categorization through active correspondences construction
Zhou, J., Pan, S., Tsang, I., & Ho, S.-S. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10211 · Cited by 50
“Different from homogeneous transfer learning, which aims to transfer knowledge across domains that are of homogeneous features (Pan and Yang 2010; Daumé III 2007), heterogeneous transfer learning (HTL) is proposed for heterogeneous domains with non-overlapping features.”
BackgroundSelf-citationKaur, R., Ginige, J. A., & Obst, O. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118997 · Cited by 48
Bi-weighting domain adaptation for cross-language text classification
(2011) · International Joint Conference on Artificial Intelligence · doi:10.5591/978-1-57735-516-8/ijcai11-258 · Cited by 47
Deep learning in ultrasound elastography imaging: A review
Li, H., Bhatt, M., Qu, Z., Zhang, S., Hartel, M. C., Khademhosseini, A., & Cloutier, G. (2022) · Medical Physics · doi:10.1002/mp.15856 · Cited by 47
A pre-training and self-training approach for biomedical named entity recognition
Gao, S., Kotevska, O., Sorokine, A., & Christian, J. B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246310 · Cited by 46
“In transfer learning, a model that is trained on one task is then retrained on and applied to a different related task; knowledge gained when training on the first task may boost performance on the second task, especially when labeled training data is scarce for the second task [27].”
BackgroundDeep decision tree transfer boosting
Jiang, S., Mao, H., Ding, Z., & Fu, Y. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2901273 · Cited by 46
“Transfer learning algorithms target at extracting the knowledge from one or more source domains and applying the knowledge to a target domain [1], [8]–[10].”
BackgroundMethodInfluentialMitchell, J. R., Szepietowski, P., Howard, R., Reisman, P., Jones, J. D., Lewis, P., Fridley, B. L., & Rollison, D. E. (2022) · Journal of Medical Internet Research · doi:10.2196/27210 · Cited by 45
“This has significant advantages in terms of reduced effort; in addition, it allows these systems to be quickly retuned for data sets from other institutions or different applications through transfer learning [69].”
BackgroundElSherief, M., Saha, K., Gupta, P., Mishra, S., Seybolt, J., Xie, J., O’Toole, M., Burd-Sharps, S., & De Choudhury, M. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00993-6 · Cited by 43
“These are essentially n-gram based binary support vector machine (SVM) models trained using transfer learning methodologies (Pan and Yang, 2009)—transfer learning is a method where a model developed for a task is reused as the starting point for a model on a second task.”
MethodTransfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Yurtsever, E., Liu, Y., Lambert, J., Miyajima, C., Takeuchi, E., Takeda, K., & Hansen, J. H. L. (2019) · 2019 IEEE Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc.2019.8917362 · Cited by 40
“Inductive transfer learning refers to the case where the source and target tasks are different, whereas in transductive transfer learning, the domain changes while the task remains the same [25].”
BackgroundWang, Z., Li, H.-X., & Chen, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927320 · Cited by 39
“Transfer RL [17], [18] can circumvent the necessity for repeatedly retraining the learning system by transferring the experience gained in a set of source tasks to help the learning performance in a related but different task.”
BackgroundJabbour, S., Fouhey, D., Kazerooni, E., Wiens, J., & Sjoding, M. W. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac030 · Cited by 39
The PAU Survey: Photometric redshifts using transfer learning from simulations
Eriksen, M., Alarcon, A., Cabayol, L., Carretero, J., Casas, R., Castander, F. J., De Vicente, J., Fernandez, E., Garcia-Bellido, J., Gaztanaga, E., et al. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa2265 · Cited by 39
“Transfer learning is a common way of dealing with limited training sets (Pan & Yang 2010).”
BackgroundInfluentialArtificial intelligence for early detection of diabetes mellitus complications via retinal imaging
Sobhi, N., Sadeghi-Bazargani, Y., Mirzaei, M., Abdollahi, M., Jafarizadeh, A., Pedrammehr, S., Alizadehsani, R., Tan, R.-S., Islam, S. M. S., & Acharya, U. R. (2025) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-025-01596-7 · Cited by 39
Distributed deep learning across multisite datasets for generalized CT hemorrhage segmentation
Remedios, S. W., Roy, S., Bermudez, C., Patel, M. B., Butman, J. A., Landman, B. A., & Pham, D. L. (2020) · Medical Physics · doi:10.1002/mp.13880 · Cited by 37
“Transfer learning is the process by which some neural model is trained on a different, but related task before being trained for the target task 42,27 .”
BackgroundLow dimensional subject representation based transfer learning in eeg decoding
Jeng, P.-Y., Wei, C.-S., Jung, T.-P., & Wang, L.-C. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3025865 · Cited by 35
Performance Enhancement of P300 Detection by Multiscale-CNN
Wang, H., Pei, Z., Xu, L., Xu, T., Bezerianos, A., Sun, Y., & Li, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3067943 · Cited by 35
“Using subject-specific data sets, we can transfer the individual information to the universal MS-CNN model by transfer learning techniques [49].”
BackgroundMethodHung, J. C., & Chang, J.-W. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107491 · Cited by 35
Liu, T., Liu, J., Li, D., & Tan, S. (2025) · Nature Communications · doi:10.1038/s41467-025-60093-w · Cited by 35
Tian, H., Chen, S.-C., & Shyu, M.-L. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10023-6 · Cited by 34
“As the input datasets are different, the feature strength is not always stable (Pan and Yang 2010; Tian et al. 2018).”
BackgroundZhuang, D., & Ibrahim, A. K. (2021) · Applied Sciences · doi:10.3390/app11177772 · Cited by 33
Transfer Learning Techniques for the Lithium-Ion Battery State of Charge Estimation
Eleftheriadis, P., Giazitzis, S., Leva, S., & Ogliari, E. (2024) · IEEE Access · doi:10.1109/access.2023.3337215 · Cited by 31
“In recent times, the concept of TL [22] has arisen as a novel learning framework aimed at addressing this intricate challenge [23].”
BackgroundRock Segmentation in the Navigation Vision of the Planetary Rovers
Kuang, B., Wisniewski, M., Rana, Z. A., & Zhao, Y. (2021) · Mathematics · doi:10.3390/math9233048 · Cited by 31
Machine Learning with Confidential Computing: A Systematization of Knowledge
Mo, F., Tarkhani, Z., & Haddadi, H. (2022) · arXiv · doi:10.48550/arxiv.2208.10134 · Cited by 31
An unsupervised domain adaptation brain CT segmentation method across image modalities and diseases
Dong, D., Fu, G., Li, J., Pei, Y., & Chen, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118016 · Cited by 30
Azizi, S., Mousavi, P., Yan, P., Tahmasebi, A., Kwak, J. T., Xu, S., Turkbey, B., Choyke, P., Pinto, P., Wood, B., et al. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-017-1573-x · Cited by 30
Pre-training in Medical Data: A Survey
Qiu, Y., Lin, F., Chen, W., & Xu, M. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1382-8 · Cited by 30
“Transfer learning[26] is a sub-field of machine”
ProkBERT family: genomic language models for microbiome applications
Ligeti, B., Szepesi-Nagy, I., Bodnár, B., Ligeti-Nagy, N., & Juhász, J. (2024) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1331233 · Cited by 30
“The first step involves segmenting raw sequences into chunks, usually ranging from 0.1–1kb in size, to optimize the model’s learning capability (Pan and Yang, 2009).”
BackgroundMethodInfluentialUncertainty Quantification in Deep Learning for Safer Neuroimage Enhancement
Tanno, R., Worrall, D., Kaden, E., Ghosh, A., Grussu, F., Bizzi, A., Sotiropoulos, S. N., Criminisi, A., & Alexander, D. C. (2019) · arXiv · doi:10.48550/arxiv.1907.13418 · Cited by 30
“Third, another important application is transfer learning [119] where uncertainty information could be used to leverage knowledge from different but related domains or tasks.”
Background
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.