A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 201–300 of 1,257
Adaptation Regularization: A General Framework for Transfer Learning
Long, M., Wang, J., Ding, G., Pan, S. J., & Yu, P. S. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.111 · Cited by 606
Self-citationMachine learning and AI in marketing–Connecting computing power to human insights
Ma, L., & Sun, B. (2020) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2020.04.005 · Cited by 602
Deep feature based rice leaf disease identification using support vector machine
Sethy, P. K., Barpanda, N. K., Rath, A. K., & Behera, S. K. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105527 · Cited by 598
Deep neural networks for the evaluation and design of photonic devices
Jiang, J., Chen, M., & Fan, J. A. (2020) · Nature Reviews Materials · doi:10.1038/s41578-020-00260-1 · Cited by 551
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · arXiv · doi:10.48550/arxiv.1902.04885 · Cited by 600
“e two institutions have a small intersection. On the other hand, due to the different businesses, only a small portion of the feature space from both parties overlaps. In this case, transfer learning [50] techniques can be applied to provide solutions for the entire sample and feature space under a federation (Figure2…”
BackgroundSelf-citationA Review on Fairness in Machine Learning
Pessach, D., & Shmueli, E. (2023) · ACM Computing Surveys · doi:10.1145/3494672 · Cited by 598
“They additionally combine a transfer learning technique with their procedure to learn from out-of-group samples (to read more about transfer learning, see the work of Pan and Yang [161]).”
MethodDeep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and Guidelines
Choi, K., Yi, J., Park, C., & Yoon, S. (2021) · IEEE Access · doi:10.1109/access.2021.3107975 · Cited by 588
“This is a central issue, because it can derail the performance of models learned from historical data [22].”
BackgroundKang, J., Ullah, Z., & Gwak, J. (2021) · Sensors · doi:10.3390/s21062222 · Cited by 589
Unsupervised Machine Learning for Networking: Techniques, Applications and Research Challenges
Usama, M., Qadir, J., Raza, A., Arif, H., Yau, K.-L. A., Elkhatib, Y., Hussain, A., & Al-Fuqaha, A. (2019) · IEEE Access · doi:10.1109/access.2019.2916648 · Cited by 575
Han, T., Liu, C., Yang, W., & Jiang, D. (2020) · ISA Transactions · doi:10.1016/j.isatra.2019.08.012 · Cited by 578
“Several comprehensive surveys were made to review the present development of transfer learning [29]-[30].”
BackgroundDemystifying Parallel and Distributed Deep Learning: An In-depth Concurrency Analysis
Ben-Nun, T., & Hoefler, T. (2020) · ACM Computing Surveys · doi:10.1145/3320060 · Cited by 577
“the result. The choice of initial weights can originate from random values, informed decisions (e.g., Xavier initialization[79]), or from pre-trained weights in a methodology called Transfer Learning[191]. In deep learning, recent works state that the optimization space is riddled with saddle points[143], and assume t…”
A Survey on Session-based Recommender Systems
Wang, S., Cao, L., Wang, Y., Sheng, Q. Z., Orgun, M. A., & Lian, D. (2022) · ACM Computing Surveys · doi:10.1145/3465401 · Cited by 570
“An intuitive instance of the framework could utilize transfer learning [23, 74] that transfers knowledge from source domains to help with the tasks in the target one.”
BackgroundDeep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study
Hosny, A., Parmar, C., Coroller, T. P., Grossmann, P., Zeleznik, R., Kumar, A., Bussink, J., Gillies, R. J., Mak, R. H., & Aerts, H. J. W. L. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002711 · Cited by 579
“Other efforts use pretrained networks on images from other domains, an approach known as transfer learning [29], as a workaround when sample size is perceived to be insufficient.”
BackgroundBeto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Wu, S., & Dredze, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1077 · Cited by 558
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges
Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3230975 · Cited by 567
Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2022) · ISA Transactions · doi:10.1016/j.isatra.2021.02.042 · Cited by 571
Transfer learning: a friendly introduction
Hosna, A., Merry, E., Gyalmo, J., Alom, Z., Aung, Z., & Azim, M. A. (2022) · Journal of Big Data · doi:10.1186/s40537-022-00652-w · Cited by 561
“The idea of TL is driven by the fact that humans can effectively relate previously acquired skills in solving contemporary challenges quicker and more accurately [3].”
BackgroundInfluentialToward more realistic drug-target interaction predictions
Pahikkala, T., Airola, A., Pietila, S., Shakyawar, S., Szwajda, A., Tang, J., & Aittokallio, T. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbu010 · Cited by 559
Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation
Wang, H., Zhang, F., Zhao, M., Li, W., Xie, X., & Guo, M. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313411 · Cited by 535
Muhammad, K., Ahmad, J., & Baik, S. W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.04.083 · Cited by 558
Convolutional Neural Networks Based Fire Detection in Surveillance Videos
Muhammad, K., Ahmad, J., Mehmood, I., Rho, S., & Baik, S. W. (2018) · IEEE Access · doi:10.1109/access.2018.2812835 · Cited by 556
Privacy and Robustness in Federated Learning: Attacks and Defenses
Lyu, L., Yu, H., Ma, X., Chen, C., Sun, L., Zhao, J., Yang, Q., & Yu, P. S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3216981 · Cited by 548
“Nowadays, FTL is attracting increasing attention in industries such as finance, medicine and healthcare.”
BackgroundSelf-citationDomain Transfer Multiple Kernel Learning
Duan, L., Tsang, I. W., & Xu, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.114 · Cited by 548
Bridging Theory and Algorithm for Domain Adaptation
Zhang, Y., Liu, T., Long, M., & Jordan, M. I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05801 · Cited by 289
A critique of pure learning and what artificial neural networks can learn from animal brains
Zador, A. M. (2019) · Nature Communications · doi:10.1038/s41467-019-11786-6 · Cited by 536
“…ANNs, “ transfer learning, ” in which connections pre-trained in the solution to one task are transferred to accelerate learning on a related task 42,43 For example, a network trained to classify objects such as ele-phants and giraffes might be used as a starting point for a network that…”
MethodA review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Plant identification using deep neural networks via optimization of transfer learning parameters
Mehdipour Ghazi, M., Yanikoglu, B., & Aptoula, E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.018 · Cited by 540
Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications
Muhammad, K., Ahmad, J., Lv, Z., Bellavista, P., Yang, P., & Baik, S. W. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2018.2830099 · Cited by 537
“the strategy of transfer learning [39] whereby we initialized the weights from a pretrained AlexNet model with a low”
Shen, S., Sadoughi, M., Li, M., Wang, Z., & Hu, C. (2020) · Applied Energy · doi:10.1016/j.apenergy.2019.114296 · Cited by 537
Huynh, B. Q., Li, H., & Giger, M. L. (2016) · Journal of Medical Imaging · doi:10.1117/1.jmi.3.3.034501 · Cited by 539
Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain Adaptation
Xu, R., Li, G., Yang, J., & Lin, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00151 · Cited by 508
“Domain adaptation [30, 33, 41] generalizes the learner across different domains by mitigating the domain shift problem.”
BackgroundDeep Multimodal Representation Learning: A Survey
Guo, W., Wang, J., & Wang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2916887 · Cited by 535
“A popular solution to address this problem is transfer learning, transferring general knowledge from the source domain with a large-scale dataset to target domain with insufficient data [168].”
BackgroundUnsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
Chen, Z., & Liu, B. (2018) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01581-6 · Cited by 466
A Survey of Zero-Shot Learning: Settings, Methods, and Applications
Wang, W., Zheng, V. W., Yu, H., & Miao, C. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3293318 · Cited by 528
“In transfer learning, knowledge contained in the source domain and source task is transferred to the target domain for learning the model in the target task [114, 115].”
BackgroundInfluentialTransfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913914 · Cited by 569
“This idea has been widely used in TL [24], [31], [40].”
BackgroundMethodDemocratising deep learning for microscopy with ZeroCostDL4Mic
von Chamier, L., Laine, R. F., Jukkala, J., Spahn, C., Krentzel, D., Nehme, E., Lerche, M., Hernández-Pérez, S., Mattila, P. K., Karinou, E., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-22518-0 · Cited by 521
“In addition, we included the option to perform transfer learning 33 in all the ZeroCostDL4Mic notebooks.”
MethodDeep Transfer Learning for Bearing Fault Diagnosis: A Systematic Review Since 2016
Chen, X., Yang, R., Xue, Y., Huang, M., Ferrero, R., & Wang, Z. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3244237 · Cited by 516
“To maintain consistency with other surveys, the definitions and notations of transfer learning are provided here with references to two surveys in [48] and [55].”
BackgroundChen, H., Jiang, B., Ding, S. X., & Huang, B. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3029946 · Cited by 521
Demystifying Neural Style Transfer
Li, Y., Wang, N., Liu, J., & Hou, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/310 · Cited by 514
“Domain Adaptation Domain adaptation belongs to the area of transfer learning [19].”
BackgroundA review of the use of convolutional neural networks in agriculture
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · The Journal of Agricultural Science · doi:10.1017/s0021859618000436 · Cited by 514
“Incontrast to ANN, whose training requirements in terms of time are impractical in some large-scale problems, CNN can learn complex problems particularly fast because of weight sharing and more complex models used, which allow massive parallelization The Journal of Agricultural Science (Pan and Yang, 2010).”
BackgroundMethodInfluentialTransductive Multi-View Zero-Shot Learning
Fu, Y., Hospedales, T. M., Xiang, T., & Gong, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408354 · Cited by 514
A Survey on Deep Neural Network Pruning: Taxonomy, Comparison, Analysis, and Recommendations
Cheng, H., Zhang, M., & Shi, J. Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3447085 · Cited by 497
A Digital-Twin-Assisted Fault Diagnosis Using Deep Transfer Learning
Xu, Y., Sun, Y., Liu, X., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2018.2890566 · Cited by 509
“It extracts knowledge from one or more source domains for using in a related, but different target domain [29], [30].”
BackgroundModel Adaptation: Unsupervised Domain Adaptation Without Source Data
Li, R., Jiao, Q., Cao, W., Wong, H.-S., & Wu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00966 · Cited by 487
Multimodal Classification of Remote Sensing Images: A Review and Future Directions
Gomez-Chova, L., Tuia, D., Moser, G., & Camps-Valls, G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2449668 · Cited by 508
“The general problem depicted here is also known as domain adaptation [61].”
BackgroundToward a Science of Computational Ethology
Anderson, D. J., & Perona, P. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.005 · Cited by 508
Nam, J., Pan, S. J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606584 · Cited by 449
“Zimmermann et al. [12] evaluated cross-project defect prediction performance based on data from 12 projects (622 combinations).”
BackgroundSelf-citationCurriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
Zhang, Y., David, P., & Gong, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.223 · Cited by 494
SpotTune: Transfer Learning Through Adaptive Fine-Tuning
Guo, Y., Shi, H., Kumar, A., Grauman, K., Rosing, T., & Feris, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00494 · Cited by 506
“There is a long history of transfer learning and domain adaptation methods in computer vision [8, 35].”
BackgroundMachine Learning Methods for Small Data Challenges in Molecular Science
Dou, B., Zhu, Z., Merkurjev, E., Ke, L., Chen, L., Jiang, J., Zhu, Y., Liu, J., Zhang, B., & Wei, G.-W. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00189 · Cited by 499
Partial Transfer Learning with Selective Adversarial Networks
Cao, Z., Long, M., Wang, J., & Jordan, M. I. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00288 · Cited by 480
WiFi CSI Based Passive Human Activity Recognition Using Attention Based BLSTM
Chen, Z., Zhang, L., Jiang, C., Cao, Z., & Cui, W. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2878233 · Cited by 497
Characterizing and Avoiding Negative Transfer
Wang, Z., Dai, Z., Póczos, B., & Carbonell, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01155 · Cited by 463
Boosting for transfer learning with multiple sources
Yao, Y., & Doretto, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539857 · Cited by 464
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“Before taking a closer look at the factors that cause distribution discrepancy in sensory data, we briefly introduce transfer learning [102].”
BackgroundUndoing the Damage of Dataset Bias
Khosla, A., Zhou, T., Malisiewicz, T., Efros, A. A., & Torralba, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_12 · Cited by 480
Partial Adversarial Domain Adaptation
Cao, Z., Ma, L., Long, M., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_9 · Cited by 461
Li, S., Zhao, X., & Zhou, G. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12433 · Cited by 490
“When training the FCN, a strategy of model-based transfer learning (Gao & Mosalam, 2018; Pan & Yang, 2010), rather than training the model from scratch, is adopted to accelerate and optimize the learning efficiency of the model.”
MethodDeepPurpose: a deep learning library for drug–target interaction prediction
Huang, K., Fu, T., Glass, L. M., Zitnik, M., Xiao, C., & Sun, J. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa1005 · Cited by 484
Artificial Intelligence in Society
OECD (2019) · doi:10.1787/eedfee77-en · Cited by 487
Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification
Yang, J., Zhao, Y.-Q., & Chan, J. C.-W. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2698503 · Cited by 484
“features, and the target task is expected to be improved [36].”
BackgroundHyper-Parameter Optimization: A Review of Algorithms and Applications
Yu, T., & Zhu, H. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05689 · Cited by 437
“Transfer learning uses knowledge from previous learning tasks to improve the learning or save resources on a target task (Pan and Yang, 2009).”
BackgroundImportance Weighted Adversarial Nets for Partial Domain Adaptation
Zhang, J., Ding, Z., Li, W., & Ogunbona, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00851 · Cited by 455
Progressive Feature Alignment for Unsupervised Domain Adaptation
Chen, C., Xie, W., Huang, W., Rong, Y., Ding, X., Huang, Y., Xu, T., & Huang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00072 · Cited by 481
“In UDA, we are given a source domain Ds = {(xi , y s i )} ns i=1 (x s i ∈ Xs, y s i ∈ Ys) of ns labeled samples and given a target domain Dt = {x t j} nt j=1 (xj t ∈ Xt) of nt unlabeled samples [28].”
BackgroundPTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2022) · AI Open · doi:10.1016/j.aiopen.2022.11.003 · Cited by 467
Sun, F.-Y., Hoffmann, J., Verma, V., & Tang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01000 · Cited by 1,032
Multi-Layer domain adaptation method for rolling bearing fault diagnosis
Li, X., Zhang, W., Ding, Q., & Sun, J.-Q. (2019) · Signal Processing · doi:10.1016/j.sigpro.2018.12.005 · Cited by 477
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11259 · Cited by 478
Transfer learning for cross-company software defect prediction
Ma, Y., Luo, G., Zeng, X., & Chen, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.007 · Cited by 475
A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks
Klaine, P. V., Imran, M. A., Onireti, O., & Souza, R. D. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2727878 · Cited by 472
“For further reading on TL, please refer to [245].”
BackgroundLabeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
“• learning from small training sets [68, 35], • transfer learning–that is, sharing parameters from certain classes or distributions to other classes or distributions that may have less training data available [76], and • semi-supervised learning, in which some training examples have no associated labels (e.”
BackgroundA review on transfer learning in EEG signal analysis
Wan, Z., Yang, R., Huang, M., Zeng, N., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.09.017 · Cited by 468
Jayaram, V., Alamgir, M., Altun, Y., Scholkopf, B., & Grosse-Wentrup, M. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2501545 · Cited by 468
“Previous Work Transfer learning describes the procedure of using data recorded in one task to boost performance in another, related task (for a more exhaustive review of the machine learning literature, see [11]).”
MethodMultiobjective Multifactorial Optimization in Evolutionary Multitasking
Gupta, A., Ong, Y.-S., Feng, L., & Tan, K. C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2554622 · Cited by 462
“Else, there exists a possibility that the transfer turns out to be impeding (or negative) [40]–[42].”
Background(2017) · neural information processing systems
Transfer Learning from Deep Features for Remote Sensing and Poverty Mapping
Xie, M., Jean, N., Burke, M., Lobell, D., & Ermon, S. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9906 · Cited by 455
Beyond Sharing Weights for Deep Domain Adaptation
Rozantsev, A., Salzmann, M., & Fua, P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2814042 · Cited by 462
Gong, B., Grauman, K. L., & Sha, F. (2013) · International Conference on Machine Learning · Cited by 556
Machine learning: applications of artificial intelligence to imaging and diagnosis
Nichols, J. A., Herbert Chan, H. W., & Baker, M. A. B. (2019) · Biophysical Reviews · doi:10.1007/s12551-018-0449-9 · Cited by 455
Grant-Free Non-Orthogonal Multiple Access for IoT: A Survey
Shahab, M. B., Abbas, R., Shirvanimoghaddam, M., & Johnson, S. J. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2996032 · Cited by 453
Artificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
Transfer Learning with Dynamic Adversarial Adaptation Network
Yu, C., Wang, J., Chen, Y., & Huang, M. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00088 · Cited by 400
“Unsupervised domain adaptation is a specific area of transfer learning [3], which is to learn a discriminative model in the presence of the domain shift between domains.”
BackgroundComparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification
Baltruschat, I. M., Nickisch, H., Grass, M., Knopp, T., & Saalbach, A. (2019) · Scientific Reports · doi:10.1038/s41598-019-42294-8 · Cited by 455
Methodologies for Cross-Domain Data Fusion: An Overview
Zheng, Y. (2015) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2015.2465959 · Cited by 454
“Yang et al. [72] initiate a setting called “heterogeneous transfer learning” to handle this category of situation.”
BackgroundInfluentialDeep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis
Khelifi, L., & Mignotte, M. (2020) · IEEE Access · doi:10.1109/access.2020.3008036 · Cited by 441
“Transfer learning is defined as the capability of extracting knowledge from one or more source tasks and applying it to a novel or target task [97].”
BackgroundA survey on anomaly detection for technical systems using LSTM networks
Lindemann, B., Maschler, B., Sahlab, N., & Weyrich, M. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103498 · Cited by 445
Deep Cocktail Network: Multi-source Unsupervised Domain Adaptation with Category Shift
Xu, R., Chen, Z., Zuo, W., Yan, J., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00417 · Cited by 415
Transfer learning for activity recognition: a survey
Cook, D., Feuz, K. D., & Krishnan, N. C. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0665-3 · Cited by 447
“In this paper, we specify a definition of transfer learning that is similar to that presented by Pan and Yang [50], but we allow for transfer learning which uses multiple source domains. and a target task T t which corresponds to D t , transfer learning helps improve the learning of the target predictive function f t…”
BackgroundMethodInfluentialFan, C., Chen, M., Wang, X., Wang, J., & Huang, B. (2021) · Frontiers in Energy Research · doi:10.3389/fenrg.2021.652801 · Cited by 445
Learning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248065 · Cited by 443
Liu, H., Ong, Y.-S., & Cai, J. (2018) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-017-1739-8 · Cited by 444
AI-powered banana diseases and pest detection
Selvaraj, M. G., Vergara, A., Ruiz, H., Safari, N., Elayabalan, S., Ocimati, W., & Blomme, G. (2019) · Plant Methods · doi:10.1186/s13007-019-0475-z · Cited by 444
Silver, D., Singh, S., Precup, D., & Sutton, R. S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103535 · Cited by 445
“Generalisation is often defined as the ability to transfer the solution to one problem into the solution to another problem [37,58,61].”
BackgroundMinimum Class Confusion for Versatile Domain Adaptation
Jin, Y., Wang, X., Long, M., & Wang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_28 · Cited by 393
“This challenge gives rise to Domain Adaptation (DA) [34,28], an important technology that aims to transfer knowledge from a labeled source domain to an unlabeled target domain in the presence of dataset shift.”
BackgroundAnalysis of transfer learning for deep neural network based plant classification models
Kaya, A., Keceli, A. S., Catal, C., Yalic, H. Y., Temucin, H., & Tekinerdogan, B. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.01.041 · Cited by 440
Deep learning for cardiovascular medicine: a practical primer
Krittanawong, C., Johnson, K. W., Rosenson, R. S., Wang, Z., Aydar, M., Baber, U., Min, J. K., Tang, W. H. W., Halperin, J. L., & Narayan, S. M. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehz056 · Cited by 435
“24 ).”
Unsupervised Person Re-Identification by Soft Multilabel Learning
Yu, H.-X., Zheng, W.-S., Wu, A., Guo, X., Gong, S., & Lai, J.-H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00225 · Cited by 421
Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II
Bali, K. K., Ong, Y.-S., Gupta, A., & Tan, P. S. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2906927 · Cited by 437
A Review of Graph Neural Networks and Their Applications in Power Systems
Liao, W., Bak-Jensen, B., Radhakrishna Pillai, J., Wang, Y., & Wang, Y. (2022) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2021.000058 · Cited by 426
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.