A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 501–600 of 1,257
Constructing knowledge graphs and their biomedical applications
Nicholson, D. N., & Greene, C. S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.05.017 · Cited by 299
Review and prospect of data-driven techniques for load forecasting in integrated energy systems
Zhu, J., Dong, H., Zheng, W., Li, S., Huang, Y., & Xi, L. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119269 · Cited by 298
Mukhamediev, R. I., Popova, Y., Kuchin, Y., Zaitseva, E., Kalimoldayev, A., Symagulov, A., Levashenko, V., Abdoldina, F., Gopejenko, V., Yakunin, K., et al. (2022) · Mathematics · doi:10.3390/math10152552 · Cited by 292
A hybrid intelligent system for medical data classification
Seera, M., & Lim, C. P. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.09.022 · Cited by 299
Transfer Independently Together: A Generalized Framework for Domain Adaptation
Li, J., Lu, K., Huang, Z., Zhu, L., & Shen, H. T. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2820174 · Cited by 299
“It aims to leverage the label information in the source domain, so that the task in the target domain can be solved by knowledge transfer [8].”
BackgroundMethodInfluentialThree-dimensional convolutional neural network (3D-CNN) for heterogeneous material homogenization
Rao, C., & Liu, Y. (2020) · Computational Materials Science · doi:10.1016/j.commatsci.2020.109850 · Cited by 297
Learning to Diversify for Single Domain Generalization
Wang, Z., Luo, Y., Qiu, R., Huang, Z., & Baktashmotlagh, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00087 · Cited by 284
Generalized Transfer Subspace Learning Through Low-Rank Constraint
Shao, M., Kit, D., & Fu, Y. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0696-6 · Cited by 298
“…this equation as well as other constraints, e.g., low-rank, sparsity is satisfied, the algorithm will stop and the resultant P will be the projection for better representation used by transfer learning 1.1 Related Work An excellent survey of transfer learning can be found in (Pan and Yang 2010).”
BackgroundInfluentialUAV Relay in VANETs Against Smart Jamming With Reinforcement Learning
Xiao, L., Lu, X., Xu, D., Tang, Y., Wang, L., & Zhuang, W. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2789466 · Cited by 297
Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning
Li, X., Zhang, W., Ding, Q., & Li, X. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2927590 · Cited by 298
“While the data spaces are identical for different domains, the label spaces are different, which is also denoted as inductive transfer learning in the literature [27].”
BackgroundBilBOWA: Fast Bilingual Distributed Representations without Word Alignments
Gouws, S., Bengio, Y., & Corrado, G. S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.2455 · Cited by 285
“Although several techniques exist that can learn to map hand-crafted features from one domain to another [4, 6, 17], it is in general non-trivial to come up with good features which generalize well across tasks, and even harder across different languages.”
BackgroundFlare-productive active regions
Toriumi, S., & Wang, H. (2019) · Living Reviews in Solar Physics · doi:10.1007/s41116-019-0019-7 · Cited by 291
A Survey of Multilingual Neural Machine Translation
Dabre, R., Chu, C., & Kunchukuttan, A. (2021) · ACM Computing Surveys · doi:10.1145/3406095 · Cited by 294
“Transfer learning (Pan and Yang, 2010) has been widely explored to address low-resource translation, where knowledge learned from a high-resource language pair is used to improve the NMT performance on a low-resource pair.”
BackgroundPinto, G., Wang, Z., Roy, A., Hong, T., & Capozzoli, A. (2022) · Advances in Applied Energy · doi:10.1016/j.adapen.2022.100084 · Cited by 295
Multisource Transfer Learning With Convolutional Neural Networks for Lung Pattern Analysis
Christodoulidis, S., Anthimopoulos, M., Ebner, L., Christe, A., & Mougiakakou, S. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636929 · Cited by 296
“Formal definitions and a survey on transfer learning can be found in [31].”
BackgroundDeep Cybersecurity: A Comprehensive Overview from Neural Network and Deep Learning Perspective
Sarker, I. H. (2021) · doi:10.20944/preprints202102.0340.v1 · Cited by 295
Magesh, P. R., Myloth, R. D., & Tom, R. J. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104041 · Cited by 295
Self-supervised learning: A succinct review
Rani, V., Nabi, S. T., Kumar, M., Mittal, A., & Kumar, K. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09884-2 · Cited by 295
“1 3 will be able to learn guitar more quickly by applying prior knowledge to a new domain [16].”
BackgroundLearning to Learn: Model Regression Networks for Easy Small Sample Learning
Wang, Y.-X., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_37 · Cited by 282
Remarks on multi-output Gaussian process regression
Liu, H., Cai, J., & Ong, Y.-S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.12.034 · Cited by 294
Deep Cybersecurity: A Comprehensive Overview from Neural Network and Deep Learning Perspective
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00535-6 · Cited by 289
Deep learning with domain adaptation for accelerated projection‐reconstruction MR
Han, Y., Yoo, J., Kim, H. H., Shin, H. J., Sung, K., & Ye, J. C. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27106 · Cited by 294
“29,30 Given a pre-trained network from CT, the actual MR training only requires very few radial MR datasets, which significantly reduces the training time and expands the applicability of deep learning for MR imaging.”
BackgroundMethodGros, C., De Leener, B., Badji, A., Maranzano, J., Eden, D., Dupont, S. M., Talbott, J., Zhuoquiong, R., Liu, Y., Granberg, T., et al. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.081 · Cited by 289
HYDRA: Massively Compositional Model for Cross-Project Defect Prediction
Xia, X., Lo, D., Pan, S. J., Nagappan, N., & Wang, X. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2543218 · Cited by 293
Self-citationLearning to Transfer Examples for Partial Domain Adaptation
Cao, Z., You, K., Long, M., Wang, J., & Yang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00310 · Cited by 273
“Domain Adaptation Domain adaptation, a special scenario of transfer learning [29], bridges domains of different distributions to mitigate the burden of annotating target data for machine learning [28, 9, 44, 41], computer vision [32, 12, 16] and natural language processing [7].”
BackgroundSelf-citationArtificial Intelligence in Lung Cancer Pathology Image Analysis
Wang, S., Yang, D. M., Rong, R., Zhan, X., Fujimoto, J., Liu, H., Minna, J., Wistuba, I. I., Xie, Y., & Xiao, G. (2019) · Cancers · doi:10.3390/cancers11111673 · Cited by 291
“Although the concept of “transfer learning”, which refers to borrowing knowledge from one dataset to another [65], has been raised and widely implemented, it is not straightforward to incorporate prior knowledge into deep learning models.”
BackgroundMethodLearning to Segment Every Thing
Hu, R., Dollar, P., He, K., Darrell, T., & Girshick, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00445 · Cited by 281
Domain Adaptation for EEG Emotion Recognition Based on Latent Representation Similarity
Li, J., Qiu, S., Du, C., Wang, Y., & He, H. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2949306 · Cited by 291
“Let P ( X ) be the marginal probability distribution of X , then D = { X , P ( X ) } is a domain [15].”
BackgroundAn adaptive deep transfer learning method for bearing fault diagnosis
Wu, Z., Jiang, H., Zhao, K., & Li, X. (2020) · Measurement · doi:10.1016/j.measurement.2019.107227 · Cited by 291
Wolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290
“Another intriguing possibility for accommodating comorbidities is multi-label classification (Zhang and Zhou, 2014), or multi-task learning (Pan and Yang, 2010) where each data sample has multiple labels associated to it.”
Link Prediction and Recommendation across Heterogeneous Social Networks
Dong, Y., Tang, J., Wu, S., Tian, J., Chawla, N. V., Rao, J., & Cao, H. (2012) · 2012 IEEE 12th International Conference on Data Mining · doi:10.1109/icdm.2012.140 · Cited by 280
“Two main issues in transfer learning are “what to transfer” and “when to transfer” [28].”
BackgroundZeng, X., Chen, H., Luo, Y., & Ye, W. (2019) · IEEE Access · doi:10.1109/access.2019.2903171 · Cited by 288
“Transfer learning method is a widely used training method of neural network [17] which has been mentioned in Section II.”
MethodIntelligent waste management system using deep learning with IoT
Rahman, M. W., Islam, R., Hasan, A., Bithi, N. I., Hasan, M. M., & Rahman, M. M. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.08.016 · Cited by 286
Artificial intelligence in diabetes management: Advancements, opportunities, and challenges
Guan, Z., Li, H., Liu, R., Cai, C., Liu, Y., Li, J., Wang, X., Huang, S., Wu, L., Liu, D., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101213 · Cited by 412
“30 In summary, ML methods enable the development of AI applications that facilitate the discovery of previously unrecognized patterns in the data without the need to specify decision rules for each specific task or to account for complex interactions among input features.”
MethodQiao, K., Yu, K., Qu, B., Liang, J., Song, H., & Yue, C. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3145582 · Cited by 273
Deep Clustering: A Comprehensive Survey
Ren, Y., Pu, J., Yang, Z., Xu, J., Li, G., Pu, X., Yu, P. S., & He, L. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3403155 · Cited by 276
Multi-representation adaptation network for cross-domain image classification
Zhu, Y., Zhuang, F., Wang, J., Chen, J., Shi, Z., Wu, W., & He, Q. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.07.010 · Cited by 286
Reminder of the First Paper on Transfer Learning in Neural Networks, 1976
Bozinovski, S. (2020) · Informatica · doi:10.31449/inf.v44i3.2828 · Cited by 286
“Often previous learning is referred to as source and the next learning as target (Pratt 1993, Pan and Yang 2010, Weiss et al. 2016).”
BackgroundInfluentialFederated Learning for Open Banking
Long, G., Tan, Y., Jiang, J., & Zhang, C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_17 · Cited by 244
Learn from Others and Be Yourself in Heterogeneous Federated Learning
Huang, W., Ye, M., & Du, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00990 · Cited by 280
“A myriad of methods [43,46,73,77] incorporate extra proximal terms to handle the data in label distribution skew (prior probability shift) [30], neglecting the fact that there exists domain shift (same label, different features) [60, 64, 66].”
Convolutional neural networks for image classification
Jmour, N., Zayen, S., & Abdelkrim, A. (2018) · 2018 International Conference on Advanced Systems and Electric Technologies (IC_ASET) · doi:10.1109/aset.2018.8379889 · Cited by 275
A multi-class skin Cancer classification using deep convolutional neural networks
Chaturvedi, S. S., Tembhurne, J. V., & Diwan, T. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09388-2 · Cited by 283
“These models are fine-tuned further on HAM10000 dataset [72] using Transfer Learning [56] to learn domain specific features of skin cancers.”
MethodA Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
Hedderich, M. A., Lange, L., Adel, H., Strötgen, J., & Klakow, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.201 · Cited by 260
Detection and classification of soybean pests using deep learning with UAV images
Tetila, E. C., Machado, B. B., Astolfi, G., Belete, N. A. D. S., Amorim, W. P., Roel, A. R., & Pistori, H. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105836 · Cited by 283
A survey on the role of Internet of Things for adopting and promoting Agriculture 4.0
Raj, M., Gupta, S., Chamola, V., Elhence, A., Garg, T., Atiquzzaman, M., & Niyato, D. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103107 · Cited by 283
Mattey, R., & Ghosh, S. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114474 · Cited by 278
A Comprehensive Survey on Test-Time Adaptation Under Distribution Shifts
Liang, J., He, R., & Tan, T. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02181-w · Cited by 271
Transfer learning and deep convolutional neural networks for safety guardrail detection in 2D images
Kolar, Z., Chen, H., & Luo, X. (2018) · Automation in Construction · doi:10.1016/j.autcon.2018.01.003 · Cited by 279
A Review of Deep Learning in Multiscale Agricultural Sensing
Wang, D., Cao, W., Zhang, F., Li, Z., Xu, S., & Wu, X. (2022) · Remote Sensing · doi:10.3390/rs14030559 · Cited by 275
Monkeypox Virus Detection Using Pre-trained Deep Learning-based Approaches
Sitaula, C., & Shahi, T. B. (2022) · Journal of Medical Systems · doi:10.1007/s10916-022-01868-2 · Cited by 282
Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set
Liu, S., Song, Z., Wang, M., Xu, C., Lu, H., & Yan, S. (2012) · Proceedings of the 20th ACM international conference on Multimedia · doi:10.1145/2393347.2396471 · Cited by 283
DOME: recommendations for supervised machine learning validation in biology
Walsh, I., Fishman, D., Garcia-Gasulla, D., Titma, T., Pollastri, G., ELIXIR Machine Learning Focus Group, Capriotti, E., Casadio, R., Capella-Gutierrez, S., Cirillo, D., et al. (2021) · Nature Methods · doi:10.1038/s41592-021-01205-4 · Cited by 282
Nam, J., Pan, S. J., & Kim, S. (2014) · Cited by 282
Self-citationTransfer Learning with Dynamic Distribution Adaptation
Wang, J., Chen, Y., Feng, W., Yu, H., Huang, M., & Yang, Q. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3360309 · Cited by 177
“Transfer learning is able to reduce the distribution divergence [46] such that the models on the target domain can be learned.”
BackgroundSelf-citationYang, B., Lei, Y., Jia, F., Li, N., & Du, Z. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2953010 · Cited by 282
“Transfer learning is a promising tool to solve this problem, which aims to reuse the knowledge learned from one or more tasks (the source domain) to other related but different tasks (the target domain) [6].”
BackgroundRecycling waste classification using optimized convolutional neural network
Mao, W.-L., Chen, W.-C., Wang, C.-T., & Lin, Y.-H. (2021) · Resources, Conservation and Recycling · doi:10.1016/j.resconrec.2020.105132 · Cited by 278
Transferring GANs: Generating Images from Limited Data
Wang, Y., Wu, C., Herranz, L., van de Weijer, J., Gonzalez-Garcia, A., & Raducanu, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_14 · Cited by 274
An AIoT Based Smart Agricultural System for Pests Detection
Chen, C.-J., Huang, Y.-Y., Li, Y.-S., Chang, C.-Y., & Huang, Y.-M. (2020) · IEEE Access · doi:10.1109/access.2020.3024891 · Cited by 280
“The most representative model is the R-CNN [12] and the Faster R-CNN [11], [13].”
MethodAMMU: A survey of transformer-based biomedical pretrained language models
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103982 · Cited by 278
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
Arivazhagan, N., Bapna, A., Firat, O., Lepikhin, D., Johnson, M., Krikun, M., Chen, M. X., Cao, Y., Foster, G., Cherry, C., et al. (2019) · arXiv · doi:10.48550/arxiv.1907.05019 · Cited by 279
“…closely related to multitask learning include zero or few-shot learning (Lake et al., 2011; Romera-Paredes and Torr, 2015; Vinyals et al., 2016; Pan and Yang, 2010), meta-learning and life-long learning (Thrun and Mitchell, 1995; Silver et al., 2013; Chen and Liu, 2016; Parisi et al., 2018;…”
BackgroundDomain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation
Li, S., Song, S., Huang, G., Ding, Z., & Wu, C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839528 · Cited by 277
“Domain adaptation concerns with the problem of how to accurately adapt classifiers or regression models from a labeled source domain to a different but related unlabeled target domain [1], [7].”
BackgroundMeta-learning for few-shot bearing fault diagnosis under complex working conditions
Li, C., Li, S., Zhang, A., He, Q., Liao, Z., & Hu, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.099 · Cited by 274
Navigating the pitfalls of applying machine learning in genomics
Whalen, S., Schreiber, J., Noble, W. S., & Pollard, K. S. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-021-00434-9 · Cited by 271
Heterogeneous Defect Prediction
Nam, J., Fu, W., Kim, S., Menzies, T., & Tan, L. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2720603 · Cited by 277
Stratified Transfer Learning for Cross-domain Activity Recognition
Wang, J., Chen, Y., Hu, L., Peng, X., & Yu, P. S. (2018) · 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2018.8444572 · Cited by 253
Ma, J., Cheng, J. C. P., Lin, C., Tan, Y., & Zhang, J. (2019) · Atmospheric Environment · doi:10.1016/j.atmosenv.2019.116885 · Cited by 273
Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey
Jiang, S., Kang, P., Song, X., Lo, B., & Shull, P. (2022) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2021.3078190 · Cited by 270
Zhu, R., Qiu, T., Wang, J., Sui, S., Hao, C., Liu, T., Li, Y., Feng, M., Zhang, A., Qiu, C.-W., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-23087-y · Cited by 273
Yao, S., Guan, R., Huang, X., Li, Z., Sha, X., Yue, Y., Lim, E. G., Seo, H., Man, K. L., Zhu, X., et al. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3307157 · Cited by 265
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
Illuminating the dark spaces of healthcare with ambient intelligence
Haque, A., Milstein, A., & Fei-Fei, L. (2020) · Nature · doi:10.1038/s41586-020-2669-y · Cited by 274
“Instead of training a model designed for all distributions, one alternative is to take an existing model and fine-tune it on the new distribution 141 —also known as transfer learning 142 .”
BackgroundA novel gas turbine fault diagnosis method based on transfer learning with CNN
Zhong, S.-S., Fu, S., & Lin, L. (2019) · Measurement · doi:10.1016/j.measurement.2019.01.022 · Cited by 273
Locality Preserving Joint Transfer for Domain Adaptation
Li, J., Jing, M., Lu, K., Zhu, L., & Shen, H. T. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2924174 · Cited by 274
A Survey on Fusion-Based Indoor Positioning
Guo, X., Ansari, N., Hu, F., Shao, Y., Elikplim, N. R., & Li, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2951036 · Cited by 269
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Silva, F. L. D., & Costa, A. H. R. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11396 · Cited by 273
Summarizing Source Code with Transferred API Knowledge
Hu, X., Li, G., Xia, X., Lo, D., Lu, S., & Jin, Z. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/314 · Cited by 263
DDTCDR: Deep Dual Transfer Cross Domain Recommendation
Li, P., & Tuzhilin, A. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371793 · Cited by 269
Automatic handgun detection alarm in videos using deep learning
Olmos, R., Tabik, S., & Herrera, F. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.05.012 · Cited by 270
An enhanced CNN-enabled learning method for promoting ship detection in maritime surveillance system
Liu, R. W., Yuan, W., Chen, X., & Lu, Y. (2021) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.109435 · Cited by 269
A comprehensive review of model compression techniques in machine learning
Dantas, P. V., Sabino da Silva, W., Cordeiro, L. C., & Carvalho, C. B. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05747-w · Cited by 261
“This comparison should clarify the unique attributes and trade-offs of each model compression technique, offering a more refined understanding of their individual and comparative impacts [51–55].”
Olivares, K. G., Challu, C., Marcjasz, G., Weron, R., & Dubrawski, A. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.03.001 · Cited by 262
Automated fiber placement: A review of history, current technologies, and future paths forward
Brasington, A., Sacco, C., Halbritter, J., Wehbe, R., & Harik, R. (2021) · Composites Part C: Open Access · doi:10.1016/j.jcomc.2021.100182 · Cited by 264
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
Self-citationArtificial intelligence in drug design
Zhong, F., Xing, J., Li, X., Liu, X., Fu, Z., Xiong, Z., Lu, D., Wu, X., Zhao, J., Tan, X., et al. (2018) · Science China Life Sciences · doi:10.1007/s11427-018-9342-2 · Cited by 259
Gómez-Valverde, J. J., Antón, A., Fatti, G., Liefers, B., Herranz, A., Santos, A., Sánchez, C. I., & Ledesma-Carbayo, M. J. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.000892 · Cited by 265
“It is generally defined as the capability of the system to utilize the knowledge learned in one domain of interest, to another that shares some common characteristics [28].”
BackgroundPruning by explaining: A novel criterion for deep neural network pruning
Yeom, S.-K., Seegerer, P., Lapuschkin, S., Binder, A., Wiedemann, S., Müller, K.-R., & Samek, W. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107899 · Cited by 263
Machine learning for streaming data: state of the art, challenges, and opportunities
Gomes, H. M., Read, J., Bifet, A., Barddal, J. P., & Gama, J. (2019) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3373464.3373470 · Cited by 267
“Finally, transfer learning is a somewhat popular method to alleviate the problem of few labeled instances [94], and it has not been widely adopted for the streaming setting yet.”
Survey on Unmanned Aerial Vehicle Networks: A Cyber Physical System Perspective
Wang, H., Zhao, H., Zhang, J., Ma, D., Li, J., & Wei, J. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2962207 · Cited by 264
Google Earth Engine and Artificial Intelligence (AI): A Comprehensive Review
Yang, L., Driscol, J., Sarigai, S., Wu, Q., Chen, H., & Lippitt, C. D. (2022) · Remote Sensing · doi:10.3390/rs14143253 · Cited by 264
Chen, J., Huang, R., Chen, Z., Mao, W., & Li, W. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110239 · Cited by 267
A New Deep Transfer Learning Method for Bearing Fault Diagnosis Under Different Working Conditions
Zhu, J., Chen, N., & Shen, C. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2936932 · Cited by 266
“According to [13], TL approaches can be generally classified into four classes: instance-based TL, parameter-based TL, relation-based TL and feature-based TL. Instance-based TL reweights the source data through information contained in the target data.”
BackgroundDong, Y., Li, Y., Zheng, H., Wang, R., & Xu, M. (2022) · ISA Transactions · doi:10.1016/j.isatra.2021.03.042 · Cited by 264
MDFEND: Multi-domain Fake News Detection
Nan, Q., Cao, J., Zhu, Y., Wang, Y., & Li, J. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482139 · Cited by 248
“However, the data distributions vary from domain to domain, called domain shift [28, 46].”
BackgroundAutomatic detection of COVID-19 infection using chest X-ray images through transfer learning
Ohata, E. F., Bezerra, G. M., Chagas, J. V. S. D., Lira Neto, A. V., Albuquerque, A. B., Albuquerque, V. H. C. D., & Reboucas Filho, P. P. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003393 · Cited by 265
Feng, Y., Chen, J., Xie, J., Zhang, T., Lv, H., & Pan, T. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107646 · Cited by 262
ActiveClean: interactive data cleaning for statistical modeling
Krishnan, S., Wang, J., Wu, E., Franklin, M. J., & Goldberg, K. (2016) · Proceedings of the VLDB Endowment · doi:10.14778/2994509.2994514 · Cited by 264
“Transfer Learning and Bias Mitigation: ActiveClean has a strong link to a field called Transfer Learning and Domain Adaptation [27].”
BackgroundOffline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles
Wang, H., Jin, Y., Sun, C., & Doherty, J. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2834881 · Cited by 262
“Thus, transfer learning [50] can be extended to SAEAs to alleviate the issue of data paucity [51].”
BackgroundA brief review on multi-task learning
Thung, K.-H., & Wee, C.-Y. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6463-x · Cited by 263
Jabed, M. A., & Azmi Murad, M. A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e40836 · Cited by 250
“Fine-tuning pre-trained models on agricultural datasets can significantly improve model performance, especially in cases where labeled data is scarce [115].”
Gao, Y., Ruan, Y., Fang, C., & Yin, S. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110156 · Cited by 263
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.