A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 401–500 of 1,257
Ghaffarian, S. M., & Shahriari, H. R. (2018) · ACM Computing Surveys · doi:10.1145/3092566 · Cited by 353
Domain-Symmetric Networks for Adversarial Domain Adaptation
Zhang, Y., Tang, H., Jia, K., & Tan, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00517 · Cited by 332
Plant diseases recognition on images using convolutional neural networks: A systematic review
Abade, A., Ferreira, P. A., & de Barros Vidal, F. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106125 · Cited by 342
Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery
Scott, G. J., England, M. R., Starms, W. A., Marcum, R. A., & Davis, C. H. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2657778 · Cited by 353
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 353
Deep learning for affective computing: Text-based emotion recognition in decision support
Kratzwald, B., Ilić, S., Kraus, M., Feuerriegel, S., & Prendinger, H. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.09.002 · Cited by 352
Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks
Kwon, O.-Y., Lee, M.-H., Guan, C., & Lee, S.-W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2946869 · Cited by 347
TFX: A TensorFlow-Based Production-Scale Machine Learning Platform
Baylor, D., Breck, E., Cheng, H.-T., Fiedel, N., Foo, C. Y., Haque, Z., Haykal, S., Ispir, M., Jain, V., Koc, L., et al. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098021 · Cited by 350
“Warm-starting is inspired by transfer learning [18].”
Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning
Hashmi, M. F., Katiyar, S., Keskar, A. G., Bokde, N. D., & Geem, Z. W. (2020) · Diagnostics · doi:10.3390/diagnostics10060417 · Cited by 347
“Pan and Yang [53] used domain, task, and marginal probabilities to propose a framework for better understanding the transfer learning.”
MethodArtificial Intelligence and Machine Learning Technology Driven Modern Drug Discovery and Development
Sarkar, C., Das, B., Rawat, V. S., Wahlang, J. B., Nongpiur, A., Tiewsoh, I., Lyngdoh, N. M., Das, D., Bidarolli, M., & Sony, H. T. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24032026 · Cited by 347
“A recommendation of AI study is to mimic this capacity by a transfer learning approach [208].”
Feature Transfer Learning for Face Recognition With Under-Represented Data
Yin, X., Yu, X., Sohn, K., Liu, X., & Chandraker, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00585 · Cited by 346
Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network
Chen, Z., Gryllias, K., & Li, W. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2917233 · Cited by 342
“provides a useful scheme to reduce the need to re-collect training data of enough size [26].”
BackgroundDeep neural network battery charging curve prediction using 30 points collected in 10 min
Tian, J., Xiong, R., Shen, W., Lu, J., & Yang, X.-G. (2021) · Joule · doi:10.1016/j.joule.2021.05.012 · Cited by 340
Tripathy, K. P., & Mishra, A. K. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130458 · Cited by 336
Multi-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346
“owledge transfer se−ings (such as features, instances, weights) from existing labeled data of some related task or domain. For a detailed review of transfer learning, we refer an interested reader to [53]. 2.4 Semi-supervised Learning Semi-supervised learning provides a compelling framework for leveraging unlabeled da…”
BackgroundInfluentialDou, Q., Ouyang, C., Chen, C., Chen, H., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/96 · Cited by 326
An Overview of Cross-Media Retrieval: Concepts, Methodologies, Benchmarks, and Challenges
Peng, Y., Huang, X., & Zhao, Y. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2705068 · Cited by 341
Radimagenet: an open Radiologic deep learning research Dataset for effective transfer learning
Mei, X., Liu, Z., Robson, P. M., Marinelli, B., Huang, M., Doshi, A., Jacobi, A., Cao, C., Link, K. E., Yang, T., et al. (2022) · Radiology Artificial Intelligence · doi:10.1148/ryai.210315 · Cited by 341
“In cases of limited sample size, transfer learning (9) is a commonly used deep learning approach whereby a model designed for one problem can be reused to initiate a different but related task in deep learning.”
Backgroundde Groof, A. J., Struyvenberg, M. R., van der Putten, J., van der Sommen, F., Fockens, K. N., Curvers, W. L., Zinger, S., Pouw, R. E., Coron, E., Baldaque-Silva, F., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2019.11.030 · Cited by 340
Jha, D., Choudhary, K., Tavazza, F., Liao, W.-K., Choudhary, A., Campbell, C., & Agrawal, A. (2019) · Nature Communications · doi:10.1038/s41467-019-13297-w · Cited by 339
Distributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
“In comparison, the concept of single weight transfer is very similar to that of transfer learning, which is derived from that idea that a model can solve new problems faster by using knowledge learned from solving previous problems in other domains.(23,24) In practice, this involves training a model on one institution…”
MethodNo More Discrimination: Cross City Adaptation of Road Scene Segmenters
Chen, Y.-H., Chen, W.-Y., Chen, Y.-T., Tsai, B.-C., Wang, Y.-C. F., & Sun, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.220 · Cited by 331
Joint Distribution Optimal Transportation for Domain AdaptationPreprint
Courty, N., Flamary, R., Habrard, A., & Rakotomamonjy, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08848 · Cited by 409
Maximum Density Divergence for Domain Adaptation
Li, J., Chen, E., Ding, Z., Zhu, L., Lu, K., & Shen, H. T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2991050 · Cited by 335
“A typical domain adaptation setting consists of a welllabeled source domain and an unlabeled target domain [2], [9], [10].”
BackgroundTransfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation
Ghafoorian, M., Mehrtash, A., Kapur, T., Karssemeijer, N., Marchiori, E., Pesteie, M., Guttmann, C. R. G., de Leeuw, F.-E., Tempany, C. M., van Ginneken, B., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_59 · Cited by 253
Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
Li, J., Zhang, Z., & He, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9533-x · Cited by 337
Zhou, Z., Sodha, V., Pang, J., Gotway, M. B., & Liang, J. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101840 · Cited by 328
“With the splendid success of deep neural networks, transfer learning (Pan and Yang, 2010; Weiss et al., 2016; Yosinski et al., 2014) has become integral to many applications, especially medical imaging (Greenspan et al.”
Generative Adversarial Networks in Time Series: A Systematic Literature Review
Brophy, E., Wang, Z., She, Q., & Ward, T. (2023) · ACM Computing Surveys · doi:10.1145/3559540 · Cited by 337
Discriminative Transfer Subspace Learning via Low-Rank and Sparse Representation
Xu, Y., Fang, X., Wu, J., Li, X., & Zhang, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2510498 · Cited by 336
Seismic fault detection with convolutional neural network
Xiong, W., Ji, X., Ma, Y., Wang, Y., AlBinHassan, N. M., Ali, M. N., & Luo, Y. (2018) · GEOPHYSICS · doi:10.1190/geo2017-0666.1 · Cited by 333
Shang, C., & You, F. (2019) · Engineering · doi:10.1016/j.eng.2019.01.019 · Cited by 332
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Fault Location in Power Distribution Systems via Deep Graph Convolutional Networks
Chen, K., Hu, J., Zhang, Y., Yu, Z., & He, J. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2951964 · Cited by 328
“With the help of transfer learning [39], the model can transfer the knowledge learned from simulated data to locate faults using actual measurements from the system.”
Gomez Villa, A., Salazar, A., & Vargas, F. (2017) · Ecological Informatics · doi:10.1016/j.ecoinf.2017.07.004 · Cited by 332
“Its expected that the previously knowledge helps to improve the learning of the new classication problem. Black box feature extractor and ne-tune- process involve a concept called transfer learning [14]. 4 Experimental Framework In this section both, the datasets used and the experiments carried out in this work, are…”
MethodDomain Adaptation From Multiple Sources: A Domain-Dependent Regularization Approach
Duan, L., Xu, D., & Tsang, I. W. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2178556 · Cited by 332
A convex formulation for learning task relationships in multi-task learning
Zhang, Y., & Yeung, D. (2010) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 388
Mao, W., He, J., & Zuo, M. J. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2917735 · Cited by 330
“The main goal of transfer learning is to improve the predictive performance on target data by means of auxiliary data [33].”
BackgroundA survey on data‐efficient algorithms in big data era
Adadi, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00419-9 · Cited by 331
Shrestha, Y. R., Krishna, V., & von Krogh, G. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.09.068 · Cited by 331
Separate to Adapt: Open Set Domain Adaptation via Progressive Separation
Liu, H., Cao, Z., Long, M., Wang, J., & Yang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00304 · Cited by 303
Self-citationData Augmentation in Classification and Segmentation: A Survey and New Strategies
Alomar, K., Aysel, H. I., & Cai, X. (2023) · Journal of Imaging · doi:10.3390/jimaging9020046 · Cited by 319
A systematic review and analysis of deep learning-based underwater object detection
Xu, S., Zhang, M., Song, W., Mei, H., He, Q., & Liotta, A. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.056 · Cited by 319
Shi, Z., Yao, W., Li, Z., Zeng, L., Zhao, Y., Zhang, R., Tang, Y., & Wen, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115733 · Cited by 327
Deep Learning-Based Intelligent Fault Diagnosis Methods Toward Rotating Machinery
Tang, S., Yuan, S., & Zhu, Y. (2020) · IEEE Access · doi:10.1109/access.2019.2963092 · Cited by 323
Fine-tuned Language Models for Text Classification.Preprint
Howard, J., & Ruder, S. (2018) · arXiv (Cornell University) · Cited by 357
A Survey of Transfer Learning for Convolutional Neural Networks
Ribani, R., & Marengoni, M. (2019) · 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images Tutorials (SIBGRAPI-T) · doi:10.1109/sibgrapi-t.2019.00010 · Cited by 303
Infrared machine vision and infrared thermography with deep learning: A review
He, Y., Deng, B., Wang, H., Cheng, L., Zhou, K., Cai, S., & Ciampa, F. (2021) · Infrared Physics & Technology · doi:10.1016/j.infrared.2021.103754 · Cited by 319
A literature review of Artificial Intelligence applications in railway systems
Tang, R., De Donato, L., Bes̆inović, N., Flammini, F., Goverde, R. M. P., Lin, Z., Liu, R., Tang, T., Vittorini, V., & Wang, Z. (2022) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103679 · Cited by 324
Deep learning of subsurface flow via theory-guided neural network
Wang, N., Zhang, D., Chang, H., & Li, H. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.124700 · Cited by 322
“In this subsection, the concept of ‘transfer learning’ is introduced to deal with the ‘boundary condition changing’ situation in a more efficient manner (Pan & Yang, 2009).”
BackgroundDomain Adaptation for Visual Applications: A Comprehensive Survey
Csurka, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05374 · Cited by 246
Lymph node metastasis prediction of papillary thyroid carcinoma based on transfer learning radiomics
Yu, J., Deng, Y., Liu, T., Zhou, J., Jia, X., Xiao, T., Zhou, S., Li, J., Guo, Y., Wang, Y., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18497-3 · Cited by 323
Ma, G., Xu, S., Jiang, B., Cheng, C., Yang, X., Shen, Y., Yang, T., Huang, Y., Ding, H., & Yuan, Y. (2022) · Energy & Environmental Science · doi:10.1039/d2ee01676a · Cited by 309
A survey of multi-source domain adaptation
Sun, S., Shi, H., & Wu, Y. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.12.003 · Cited by 322
Rahaman, M. M., Li, C., Yao, Y., Kulwa, F., Wu, X., Li, X., & Wang, Q. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104649 · Cited by 320
Transfer learning for time series classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621990 · Cited by 319
“Before getting into the details of the recent applications for transfer learning, we give a formal definition of the latter [14].”
BackgroundMethodInfluentialEvolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research
Tan, K. C., Feng, L., & Jiang, M. (2021) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2020.3039066 · Cited by 315
“In machine learning, the idea of taking advantage of useful traits across problem domains towards enhanced learning performance has received significant interest under the term of transfer learning (TL) in recent years [9], [10].”
BackgroundInfluentialA Systematic Literature Review and Meta-Analysis on Cross Project Defect Prediction
Hosseini, S., Turhan, B., & Gunarathna, D. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2770124 · Cited by 317
Oh, K., Chung, Y.-C., Kim, K. W., Kim, W.-S., & Oh, I.-S. (2019) · Scientific Reports · doi:10.1038/s41598-019-54548-6 · Cited by 317
Zhu, J., Chen, N., & Shen, C. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.106602 · Cited by 318
Designing deep learning studies in cancer diagnostics
Kleppe, A., Skrede, O.-J., De Raedt, S., Liestøl, K., Kerr, D. J., & Danielsen, H. E. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-020-00327-9 · Cited by 316
Med3D: Transfer Learning for 3D Medical Image Analysis
Chen, S., Ma, K., & Zheng, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.00625 · Cited by 317
Glioma Grading on Conventional MR Images: A Deep Learning Study With Transfer Learning
Yang, Y., Yan, L.-F., Zhang, X., Han, Y., Nan, H.-Y., Hu, Y.-C., Hu, B., Yan, S.-L., Zhang, J., Cheng, D.-L., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00804 · Cited by 316
“It is an effective method to transfer the feature knowledge learned from a large-scale database to a specific medical task (Pan and Yang, 2010; Yosinski et al., 2014).”
MethodSupervised Representation Learning: Transfer Learning with Deep Autoencoders
Zhuang, F., Cheng, X., Luo, P., Pan, S. J., & He, Q. (2016) · Cited by 434
Self-citationDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“Before taking a closer look at the factors that cause distribution discrepancy in sensory data, we briefly introduce transfer learning [102].”
BackgroundKarri, S. P. K., Chakraborty, D., & Chatterjee, J. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.000579 · Cited by 313
Decision support from financial disclosures with deep neural networks and transfer learning
Kraus, M., & Feuerriegel, S. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.10.001 · Cited by 312
“Transfer learning performs representation learning on a different, but related, dataset and then applies the gained knowledge to the actual training phase [44].”
BackgroundMulti-scale deep intra-class transfer learning for bearing fault diagnosis
Wang, X., Shen, C., Xia, M., Wang, D., Zhu, J., & Zhu, Z. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2020.107050 · Cited by 313
“Traditional deep learning methods work e ff ectively in the situation where the training and test datasets obey the same distribution [21].”
BackgroundMachine learning for metabolic engineering: A review
Lawson, C. E., Martí, J. M., Radivojevic, T., Jonnalagadda, S. V. R., Gentz, R., Hillson, N. J., Peisert, S., Kim, J., Simmons, B. A., Petzold, C. J., et al. (2021) · Metabolic Engineering · doi:10.1016/j.ymben.2020.10.005 · Cited by 313
A survey of deep meta-learning
Huisman, M., van Rijn, J. N., & Plaat, A. (2021) · Data Archiving and Networked Services (DANS) · doi:10.1007/s10462-021-10004-4#rightslink · Cited by 316
A review of data-driven fault detection and diagnostics for building HVAC systems
Chen, Z., O’Neill, Z., Wen, J., Pradhan, O., Yang, T., Lu, X., Lin, G., Miyata, S., Lee, S., Shen, C., et al. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121030 · Cited by 311
Conditional Generative Adversarial Network for Structured Domain Adaptation
Hong, W., Wang, Z., Yang, M., & Yuan, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00145 · Cited by 309
Waldner, F., & Diakogiannis, F. I. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111741 · Cited by 310
Neural Machine Translation for Low-resource Languages: A Survey
Ranathunga, S., Lee, E.-S. A., Prifti Skenduli, M., Shekhar, R., Alam, M., & Kaur, R. (2023) · ACM Computing Surveys · doi:10.1145/3567592 · Cited by 313
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
“Several related reviews on transfer learning and domain adaptation can be referred to as [4], [6], [7], [8], [9], [10], [11], [12], [13].”
BackgroundSupervised Learning of Semantics-Preserving Hash via Deep Convolutional Neural Networks
Yang, H.-F., Lin, K., & Chen, C.-S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2666812 · Cited by 314
Automated identification and grading system of diabetic retinopathy using deep neural networks
Zhang, W., Zhong, J., Yang, S., Gao, Z., Hu, J., Chen, Y., & Yi, Z. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.03.016 · Cited by 311
Learning to Discover Novel Visual Categories via Deep Transfer Clustering
Han, K., Vedaldi, A., & Zisserman, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00849 · Cited by 303
Cross-Domain Few-Shot Classification via Learned Feature-Wise TransformationPreprint
Tseng, H.-Y., Lee, H.-Y., Huang, J., & Yang, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08735 · Cited by 548
Deep Belief Networks Based Voice Activity Detection
Zhang, X.-L., & Wu, J. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2012.2229986 · Cited by 313
Deep neural networks with transfer learning in millet crop images
Coulibaly, S., Kamsu-Foguem, B., Kamissoko, D., & Traore, D. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.02.003 · Cited by 311
“Transfer learning is de fi ned as the ability of a system to recognize and apply knowledge and skills learned in previous tasks to novel tasks and new domains [16] which share some commonalities (as showed in Fig.”
BackgroundAlexopoulos, K., Nikolakis, N., & Chryssolouris, G. (2020) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2020.1747642 · Cited by 309
“Transfer Learning is ‘ the ability of a system to recognize and apply knowledge and skills learned in previous tasks to novel tasks ’ (Pan and Yang 2009).”
BackgroundA survey on incorporating domain knowledge into deep learning for medical image analysis
Xie, X., Niu, J., Liu, X., Chen, Z., Tang, S., & Yu, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101985 · Cited by 311
Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images
Bah, M. D., Hafiane, A., & Canals, R. (2018) · Remote Sensing · doi:10.3390/rs10111690 · Cited by 306
Combining Graph-Based Learning With Automated Data Collection for Code Vulnerability Detection
Wang, H., Ye, G., Tang, Z., Tan, S. H., Huang, S., Fang, D., Feng, Y., Bian, L., & Wang, Z. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3044773 · Cited by 308
Stable feature selection for biomarker discovery
He, Z., & Yu, W. (2010) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2010.07.002 · Cited by 309
Generalizing to Unseen Domains: A Survey on Domain Generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., & Qin, T. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/628 · Cited by 308
A Systematic Review on Data Scarcity Problem in Deep Learning: Solution and Applications
Bansal, M. A., Sharma, D. R., & Kathuria, D. M. (2022) · ACM Computing Surveys · doi:10.1145/3502287 · Cited by 306
“If the target domain has limited data, then we can either transfer 208:11 knowledge from the related source domain [S. J. Pan and Yang 2010] or can generate synthetic data [Lei et al. 2019] via augmentation techniques.”
BackgroundMethodZhang, Y., Li, W., Zhang, M., Qu, Y., Tao, R., & Qi, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3109872 · Cited by 304
Billion-scale semi-supervised learning for image classification
Yalniz, I. Z., Jégou, H., Chen, K., Paluri, M., & Mahajan, D. (2019) · arXiv · doi:10.48550/arxiv.1905.00546 · Cited by 299
Transferable Attention for Domain Adaptation
Wang, X., Li, L., Ye, W., Long, M., & Wang, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015345 · Cited by 287
Few-shot transfer learning for intelligent fault diagnosis of machine
Wu, J., Zhao, Z., Sun, C., Yan, R., & Chen, X. (2020) · Measurement · doi:10.1016/j.measurement.2020.108202 · Cited by 302
Deep Learning Based Analysis of Histopathological Images of Breast Cancer
Xie, J., Liu, R., Luttrell, J., & Zhang, C. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00080 · Cited by 302
Domain Adversarial Transfer Network for Cross-Domain Fault Diagnosis of Rotary Machinery
Chen, Z., He, G., Li, J., Liao, Y., Gryllias, K., & Li, W. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2995441 · Cited by 300
Skin Lesion Segmentation in Dermoscopic Images with Combination of YOLO and GrabCut Algorithm
Ünver, H. M., & Ayan, E. (2019) · Diagnostics · doi:10.3390/diagnostics9030072 · Cited by 302
Rahaman, M. M., Li, C., Yao, Y., Kulwa, F., Rahman, M. A., Wang, Q., Qi, S., Kong, F., Zhu, X., & Zhao, X. (2020) · Journal of X-Ray Science and Technology: Clinical Applications of Diagnosis and Therapeutics · doi:10.3233/xst-200715 · Cited by 302
AI Models for Green Communications Towards 6G
Mao, B., Tang, F., Kawamoto, Y., & Kato, N. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3130901 · Cited by 300
“2) Transfer Learning: Transfer learning is a machine learning method which aims to utilize the constructed knowledge system while solving a problem to the different but related problem [105].”
BackgroundMethodInfluentialTechnological revolutions in smart farming: Current trends, challenges & future directions
Sharma, V., Tripathi, A. K., & Mittal, H. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107217 · Cited by 297
Computer vision framework for crack detection of civil infrastructure—A review
Ai, D., Jiang, G., Lam, S.-K., He, P., & Li, C. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105478 · Cited by 297
Multi-Scale Metric Learning for Few-Shot Learning
Jiang, W., Huang, K., Geng, J., & Deng, X. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2995754 · Cited by 298
A GAN-based image synthesis method for skin lesion classification
Qin, Z., Liu, Z., Zhu, P., & Xue, Y. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105568 · Cited by 296
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.