A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 901–1,000 of 1,257
Qin, H., Zhang, D., Tang, Y., & Wang, Y. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103830 · Cited by 190
Emerging Trends in Machine Learning: A Polymer Perspective
Martin, T. B., & Audus, D. J. (2023) · ACS Polymers Au · doi:10.1021/acspolymersau.2c00053 · Cited by 187
Deep learning of transferable representation for scalable domain adaptation
Long, M., Wang, J., Cao, Y., Sun, J., & Yu, P. S. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2554549 · Cited by 191
“F”
BackgroundMeta-path based multi-network collective link prediction
Zhang, J., Yu, P. S., & Zhou, Z.-H. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623645 · Cited by 187
“Meanwhile, as proposed in [15, 23], di ↵ erent online social networks constructed to provide different services usually have distinct characteristics.”
BackgroundA survey on real-time event detection from the Twitter data stream
Hasan, M., Orgun, M. A., & Schwitter, R. (2018) · Journal of Information Science · doi:10.1177/0165551517698564 · Cited by 190
“…used in supervised clustering can be handled by semi-supervised learning [109], where a small set of labelled data can be coupled with a large unlabelled data set to build a classifier, or by transfer learning [110], where useful information can be extracted from different, but related, domains.”
BackgroundThangaraj, R., Anandamurugan, S., & Kaliappan, V. K. (2021) · Journal of Plant Diseases and Protection · doi:10.1007/s41348-020-00403-0 · Cited by 188
Deep learning for COVID-19 detection based on CT images
Zhao, W., Jiang, W., & Qiu, X. (2021) · Scientific Reports · doi:10.1038/s41598-021-93832-2 · Cited by 191
Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition With Multimodal Training
Abavisani, M., Joze, H. R. V., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00126 · Cited by 190
“Transfer Learning: In transfer learning, first, an agent is independently trained on a source task, then another agent uses the knowledge of the source agent by repurposing the learned features or transferring them to improve its learning on a target task [32, 43].”
BackgroundSemantic segmentation of water bodies in very high-resolution satellite and aerial images
Wieland, M., Martinis, S., Kiefl, R., & Gstaiger, V. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113452 · Cited by 190
Biswas, M., Kuppili, V., Edla, D. R., Suri, H. S., Saba, L., Marinhoe, R. T., Sanches, J. M., & Suri, J. S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2017.12.016 · Cited by 190
Transfer learning to localise a continental soil vis-NIR calibration model
Padarian, J., Minasny, B., & McBratney, A. B. (2019) · Geoderma · doi:10.1016/j.geoderma.2019.01.009 · Cited by 183
Kuwahara, T., Hara, K., Mizuno, N., Okuno, N., Matsumoto, S., Obata, M., Kurita, Y., Koda, H., Toriyama, K., Onishi, S., et al. (2019) · Clinical and Translational Gastroenterology · doi:10.14309/ctg.0000000000000045 · Cited by 190
A Survey of Textual Emotion Recognition and Its Challenges
Deng, J., & Ren, F. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3053275 · Cited by 186
Data‐Driven Materials Innovation and Applications
Wang, Z., Sun, Z., Yin, H., Liu, X., Wang, J., Zhao, H., Pang, C. H., Wu, T., Li, S., Yin, Z., et al. (2022) · Advanced Materials · doi:10.1002/adma.202104113 · Cited by 187
Deep learning for small and big data in psychiatry
Koppe, G., Meyer-Lindenberg, A., & Durstewitz, D. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0767-z · Cited by 189
A deep learning framework for identifying children with ADHD using an EEG-based brain network
Chen, H., Song, Y., & Li, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.058 · Cited by 189
Transfer learning for biomedical named entity recognition with neural networks
Giorgi, J. M., & Bader, G. D. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty449 · Cited by 188
A Survey of Sentiment Analysis Based on Transfer Learning
Liu, R., Shi, Y., Ji, C., & Jia, M. (2019) · IEEE Access · doi:10.1109/access.2019.2925059 · Cited by 189
“[41] conducted a detailed survey about the related methods and applications of transfer learning, divided the transfer learning methods into two categories: homogeneous and heterogeneous, and discussed the negative transfer problem.”
BackgroundStreet-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set
Liu, S., Song, Z., Liu, G., Xu, C., Lu, H., & Yan, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248071 · Cited by 176
Lee, K.-S., Jung, S.-K., Ryu, J.-J., Shin, S.-W., & Choi, J. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020392 · Cited by 187
“When the target dataset is significantly smaller than the base dataset, transfer learning is considered a powerful technique for training deep CNNs without overfitting [28,29].”
MethodA Survey on Active Deep Learning: From Model Driven to Data Driven
Liu, P., Wang, L., Ranjan, R., He, G., & Zhao, L. (2022) · ACM Computing Surveys · doi:10.1145/3510414 · Cited by 184
“Transfer Learning: Transfer Learning [123, 124] is another interesting paradigm to tackle the problem of insufficient samples.”
BackgroundNamed Entity Recognition and Classification in Historical Documents: A Survey
Ehrmann, M., Hamdi, A., Pontes, E. L., Romanello, M., & Doucet, A. (2024) · ACM Computing Surveys · doi:10.1145/3604931 · Cited by 181
Giray, G. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111031 · Cited by 187
Demir, B., Bovolo, F., & Bruzzone, L. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2195727 · Cited by 187
“DA (also known as partially supervised/unsupervised learning) methods define strategies that use the information available on the source domain to classify the target domain for which no prior information is available, assuming that the two domains may have different (but related) distributions [9]–[11].”
BackgroundSparse Transfer Manifold Embedding for Hyperspectral Target Detection
Zhang, L., Zhang, L., Tao, D., & Huang, X. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2246837 · Cited by 187
Domain Adaptation with Regularized Optimal Transport
Courty, N., Flamary, R., & Tuia, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-44848-9_18 · Cited by 175
“Many works study the generalization capabilities of a classifier allowing to transfer knowledge from a labeled source domain to an unlabeled target domain: this situation is referred to as transductive transfer learning [1].”
BackgroundGraphonomy: Universal Human Parsing via Graph Transfer Learning
Gong, K., Gao, Y., Liang, X., Shen, X., Wang, M., & Lin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00763 · Cited by 182
“Our approach is also related to transfer learning [32], which bridges different domains or tasks to mitigate the burden of manual labeling.”
BackgroundXu, L., Chen, N., Chen, Z., Zhang, C., & Yu, H. (2021) · Earth-Science Reviews · doi:10.1016/j.earscirev.2021.103828 · Cited by 185
Learning Categories From Few Examples With Multi Model Knowledge Transfer
Tommasi, T., Orabona, F., & Caputo, B. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.197 · Cited by 185
Easy Transfer Learning By Exploiting Intra-Domain Structures
Wang, J., Chen, Y., Yu, H., Huang, M., & Yang, Q. (2019) · 2019 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00211 · Cited by 168
Self-citationCollaborative Unsupervised Domain Adaptation for Medical Image Diagnosis
Zhang, Y., Wei, Y., Wu, Q., Zhao, P., Niu, S., Huang, J., & Tan, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3006377 · Cited by 185
“Hence, there is a strong motivation to develop Unsupervised Domain Adaptation (UDA) [14], [15] to improve diagnostic accuracy with limited annotated medical images.”
BackgroundHe, X., Chen, Y., & Ghamisi, P. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2951445 · Cited by 184
Convolutional neural networks for breast cancer detection in mammography: A survey
Abdelrahman, L., Al Ghamdi, M., Collado-Mesa, F., & Abdel-Mottaleb, M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104248 · Cited by 186
“Through pretraining, CNNs can transfer learned high-level features from one domain to another [64].”
Zero Touch Management: A Survey of Network Automation Solutions for 5G and 6G Networks
Coronado, E., Behravesh, R., Subramanya, T., Fernandez-Fernandez, A., Siddiqui, M. S., Costa-Perez, X., & Riggio, R. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3212586 · Cited by 183
“Several comprehensive surveys exist concerning different AI techniques on a wide range of applications, i.e., Supervised Learning (SL) [18], Unsupervised Learning (UL) [19], (Deep) Reinforcement Learning (RL) [20], Deep Learning (DL) [21] and Transfer Learning (TL) [22].”
BackgroundA hierarchical deep domain adaptation approach for fault diagnosis of power plant thermal system
Wang, X., He, H., & Li, L. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2899118 · Cited by 185
Transfer Learning on Heterogenous Feature Spaces via Spectral Transformation
Shi, X., Liu, Q., Fan, W., Yu, P. S., & Zhu, R. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.65 · Cited by 180
“, [4]), etc, are proposed to handle the case where data distributions are different but mainly in the same feature space.”
BackgroundDuplex Generative Adversarial Network for Unsupervised Domain Adaptation
Hu, L., Kan, M., Shan, S., & Chen, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00162 · Cited by 182
Active learning for regression using greedy sampling
Wu, D., Lin, C.-T., & Huang, J. (2019) · Information Sciences · doi:10.1016/j.ins.2018.09.060 · Cited by 183
Domain Adaptation With Neural Embedding Matching
Wang, Z., Du, B., & Guo, Y. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2935608 · Cited by 184
An introduction to deep learning in medical physics: advantages, potential, and challenges
Shen, C., Nguyen, D., Zhou, Z., Jiang, S. B., Dong, B., & Jia, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab6f51 · Cited by 185
Continuous Authentication Through Finger Gesture Interaction for Smart Homes Using WiFi
Kong, H., Lu, L., Yu, J., Chen, Y., & Tang, F. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2994955 · Cited by 184
Kalfarisi, R., Wu, Z. Y., & Soh, K. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000890 · Cited by 184
Deep learning for digital holography: a review
Zeng, T., Zhu, Y., & Lam, E. Y. (2021) · Optics Express · doi:10.1364/oe.443367 · Cited by 170
Machine Learning for the Detection and Identification of Internet of Things Devices: A Survey
Liu, Y., Wang, J., Li, J., Niu, S., & Song, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3099028 · Cited by 179
Linearized domain adaptation in evolutionary multitasking
Bali, K. K., Gupta, A., Feng, L., Ong, Y. S., & Siew, T. P. (2017) · 2017 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969454 · Cited by 168
“Domain adaptation is a fundamental aspect of machine learning [11, 12] and has been quite prevalent in the context of multi-task learning [8–10].”
BackgroundMachine learning in tolerancing for additive manufacturing
Zhu, Z., Anwer, N., Huang, Q., & Mathieu, L. (2018) · CIRP Annals · doi:10.1016/j.cirp.2018.04.119 · Cited by 184
Dynamic hand gesture recognition based on short-term sampling neural networks
Zhang, W., Wang, J., & Lan, F. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003465 · Cited by 183
“The STSNN architecture, like TSNs, uses a single ConvNet component to capture both short-term spatial information and temporal information from color and optical flow, respectively.”
BackgroundMethodInfluentialMulti-Fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling
Liu, D., & Wang, Y. (2019) · Journal of Mechanical Design · doi:10.1115/1.4044400 · Cited by 182
“Transfer learning [3] is an approach to reduce the required amount of training data ,byreusingthesourcedata (instancetransfer)[4,5],previouslytrainedfeaturesorbasisfunctions(featurerepresentationtransfer)[6,7],orpreviouslytrainedparame-ters(parametertransfer)[8,9].”
BackgroundTVT: Transferable Vision Transformer for Unsupervised Domain Adaptation
Yang, J., Liu, J., Xu, N., & Huang, J. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00059 · Cited by 170
Interventional Few-Shot Learning
Yue, Z., Zhang, H., Sun, Q., & Hua, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13000 · Cited by 111
Domain Transfer Learning for MCI Conversion Prediction
Cheng, B., Liu, M., Zhang, D., Munsell, B. C., & Shen, D. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2404809 · Cited by 182
“Here, the instance-transfer approach [37], [38] is used to join the auxiliary domain data (i.”
BackgroundMethodTransfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
Zhang, A., Wang, H., Li, S., Cui, Y., Liu, Z., Yang, G., & Hu, J. (2018) · Applied Sciences · doi:10.3390/app8122416 · Cited by 181
“Based on the availability of sample labels, transfer learning can be divided into three categories: inductive transfer learning, transductive transfer learning, and unsupervised transfer learning [28].”
Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU)
Li, W., Wu, H., Zhu, N., Jiang, Y., Tan, J., & Guo, Y. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2020.02.002 · Cited by 182
Kim, B., Park, J., & Suh, J. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113302 · Cited by 182
Yoo, S., Lee, S., Kim, S., Hwang, K. H., Park, J. H., & Kang, N. (2021) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-021-02953-9 · Cited by 181
Bhattacharjee, A., Verma, A., Mishra, S., & Saha, T. K. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3064287 · Cited by 181
Information-Theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation
Shi, Y., & Sha, F. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6438 · Cited by 181
“In real-world applications, there are many factors causing a Techniques for addressing learning problems with mis-matched distributions are often referred as domain adaptation, or sometimes transfer learning (Daum´e III & Marcu, 2006; Pan & Yang, 2010; Qui˜nonero-Candela et al., 2009).”
BackgroundA survey of emotion recognition methods with emphasis on E-Learning environments
Imani, M., & Montazer, G. A. (2019) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102423 · Cited by 181
Cross-Domain Recommendation via Cluster-Level Latent Factor Model
Gao, S., Luo, H., Chen, D., Li, S., Gallinari, P., & Guo, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40991-2_11 · Cited by 174
“Transfer learning aims to leverage the knowledge in the source domain to facilitate the learning tasks in the target domain [17].”
BackgroundMineGAN: Effective Knowledge Transfer From GANs to Target Domains With Few Images
Wang, Y., Gonzalez-Garcia, A., Berga, D., Herranz, L., Khan, F. S., & van de Weijer, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00935 · Cited by 171
A hybrid deep transfer learning strategy for short term cross-building energy prediction
Fang, X., Gong, G., Li, G., Chun, L., Li, W., & Peng, P. (2021) · Energy · doi:10.1016/j.energy.2020.119208 · Cited by 178
CDeep3M—Plug-and-Play cloud-based deep learning for image segmentation
Haberl, M. G., Churas, C., Tindall, L., Boassa, D., Phan, S., Bushong, E. A., Madany, M., Akay, R., Deerinck, T. J., Peltier, S. T., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0106-z · Cited by 180
Development and Motion Control of Biomimetic Underwater Robots: A Survey
Wang, R., Wang, S., Wang, Y., Cheng, L., & Tan, M. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3004862 · Cited by 176
Adaptive Extreme Edge Computing for Wearable Devices
Covi, E., Donati, E., Liang, X., Kappel, D., Heidari, H., Payvand, M., & Wang, W. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.611300 · Cited by 177
Invariant Models for Causal Transfer Learning
Rojas-Carulla, M., Schölkopf, B., Turner, R. E., & Peters, J. (2015) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.1507.05333 · Cited by 147
Kieu, S. T. H., Bade, A., Hijazi, M. H. A., & Kolivand, H. (2020) · Journal of Imaging · doi:10.3390/jimaging6120131 · Cited by 179
State of the art: a review of sentiment analysis based on sequential transfer learning
Chan, J. Y.-L., Bea, K. T., Leow, S. M. H., Phoong, S. W., & Cheng, W. K. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10183-8 · Cited by 179
“However, supervised learning approaches might suffer from the problem of insufficient training data and high costs for data labelling (Pan and Yang 2009).”
BackgroundData Generation for Machine Learning Interatomic Potentials and Beyond
Kulichenko, M., Nebgen, B., Lubbers, N., Smith, J. S., Barros, K., Allen, A. E. A., Habib, A., Shinkle, E., Fedik, N., Li, Y. W., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00572 · Cited by 176
StarCraft Micromanagement With Reinforcement Learning and Curriculum Transfer Learning
Shao, K., Zhu, Y., & Zhao, D. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2018.2823329 · Cited by 178
Gu, Y., Ge, Z., Bonnington, C. P., & Zhou, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2942429 · Cited by 176
Temporal Attentive Alignment for Large-Scale Video Domain Adaptation
Chen, M.-H., Kira, Z., Alregib, G., Yoo, J., Chen, R., & Zheng, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00642 · Cited by 174
“Domain adaptation (DA) [31] has been studied extensively in recent years [5] to address the domain shift problem [36, 33], which means the models trained on source labeled dataset do not generalize well to target datasets and tasks.”
BackgroundEvolutionary Multitasking With Dynamic Resource Allocating Strategy
Gong, M., Tang, Z., Li, H., & Zhang, J. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2893614 · Cited by 177
Weighted Transfer Learning for Improving Motor Imagery-Based Brain–Computer Interface
Azab, A. M., Mihaylova, L., Ang, K. K., & Arvaneh, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2923315 · Cited by 176
“successfully applied in different machine learning applications such as: text, image, and human activity classification [12].”
BackgroundMethodZhou, Y. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.125164 · Cited by 177
Foundations of population-based SHM, Part III: Heterogeneous populations – Mapping and transfer
Gardner, P., Bull, L. A., Gosliga, J., Dervilis, N., & Worden, K. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.107142 · Cited by 175
“This demonstrates the power of graph and attribute matching between members of a population (see Part II [2]), as locating the common attributes/subsystems Sc between members of a population helps identify the level of information that can be exchanged through a mapping / (where this mapping may be through a latent sp…”
BackgroundInfluentialGuirado, E., Tabik, S., Alcaraz-Segura, D., Cabello, J., & Herrera, F. (2017) · Remote Sensing · doi:10.3390/rs9121220 · Cited by 176
EEG-based measurement system for monitoring student engagement in learning 4.0
Apicella, A., Arpaia, P., Frosolone, M., Improta, G., Moccaldi, N., & Pollastro, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-09578-y · Cited by 174
Deep learning methods for object detection in smart manufacturing: A survey
Ahmad, H. M., & Rahimi, A. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.06.011 · Cited by 177
Deep transfer learning strategy in intelligent fault diagnosis of rotating machinery
Tang, S., Ma, J., Yan, Z., Zhu, Y., & Khoo, B. C. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108678 · Cited by 175
Super-resolution analysis via machine learning: a survey for fluid flows
Fukami, K., Fukagata, K., & Taira, K. (2023) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-023-00663-0 · Cited by 176
“SURFNet includes a transfer learning-based augmentation [92].”
BackgroundDeepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176
CNN based common approach to handwritten character recognition of multiple scripts
Maitra, D. S., Bhattacharya, U., & Parui, S. K. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333916 · Cited by 173
Automatic model based dataset generation for fast and accurate crop and weeds detection
Di Cicco, M., Potena, C., Grisetti, G., & Pretto, A. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206408 · Cited by 174
“Another approach used to mitigate the labeling effort is based on transfer learning [14].”
BackgroundCunha, A., Pochet, A., Lopes, H., & Gattass, M. (2020) · Computers & Geosciences · doi:10.1016/j.cageo.2019.104344 · Cited by 176
Liao, Y., Huang, R., Li, J., Chen, Z., & Li, W. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2992829 · Cited by 176
Convolutional neural networks for global human settlements mapping from Sentinel-2 satellite imagery
Corbane, C., Syrris, V., Sabo, F., Politis, P., Melchiorri, M., Pesaresi, M., Soille, P., & Kemper, T. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05449-7 · Cited by 187
An Effective Approach to Detect and Identify Brain Tumors Using Transfer Learning
Ullah, N., Khan, J. A., Khan, M. S., Khan, W., Hassan, I., Obayya, M., Negm, N., & Salama, A. S. (2022) · Applied Sciences · doi:10.3390/app12115645 · Cited by 174
Machine Learning in Polymer Research
Ge, W., De Silva, R., Fan, Y., Sisson, S. A., & Stenzel, M. H. (2025) · Advanced Materials · doi:10.1002/adma.202413695 · Cited by 167
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language ProcessingPreprint
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05542 · Cited by 432
“Transfer learning [15] allows the reuse of knowledge learned in source”
BackgroundValue-cognitive boosting with a support vector machine for cross-project defect prediction
Ryu, D., Choi, O., & Baik, J. (2016) · Empirical Software Engineering · doi:10.1007/s10664-014-9346-4 · Cited by 176
“According to Pan and Yang (Pan and Yang 2010), there are different transfer learning settings.”
BackgroundCross-Domain Co-Extraction of Sentiment and Topic Lexicons
Li, F., Pan, S. J., Jin, O., Yang, Q., & Zhu, X. (2012) · Cited by 230
Self-citationDeep learning in omics: a survey and guideline
Zhang, Z., Zhao, Y., Liao, X., Shi, W., Li, K., Zou, Q., & Peng, S. (2019) · Briefings in Functional Genomics · doi:10.1093/bfgp/ely030 · Cited by 175
Han, T., Liu, C., Yang, W., & Jiang, D. (2019) · ISA Transactions · doi:10.1016/j.isatra.2019.03.017 · Cited by 174
Prevalence and Psychological Effects of Hateful Speech in Online College Communities
Saha, K., Chandrasekharan, E., & De Choudhury, M. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326032 · Cited by 170
Deep Learning for Monitoring of Human Gait: A Review
Alharthi, A. S., Yunas, S. U., & Ozanyan, K. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928777 · Cited by 175
“Compared to starting from scratch, Transfer learning allows a substantial jump in the starting point for the delivery of a related ANN model [60].”
BackgroundReinforcement Learning with Tree-LSTM for Join Order Selection
Yu, X., Li, G., Chai, C., & Tang, N. (2020) · 2020 IEEE 36th International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00116 · Cited by 168
Semantic Segmentation of Litchi Branches Using DeepLabV3+ Model
Peng, H., Xue, C., Shao, Y., Chen, K., Xiong, J., Xie, Z., & Zhang, L. (2020) · IEEE Access · doi:10.1109/access.2020.3021739 · Cited by 172
Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · ResearchOnline - JCU (James Cook University) · doi:10.3929/ethz-b-000465927 · Cited by 176
Transfer Learning in Breast Cancer Diagnoses via Ultrasound Imaging
Ayana, G., Dese, K., & Choe, S.-W. (2021) · Cancers · doi:10.3390/cancers13040738 · Cited by 174
Li, Y., Jiang, W., Zhang, G., & Shu, L. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.01.143 · Cited by 173
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.