A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 701–800 of 1,257
Evaluation of deep neural networks for traffic sign detection systems
Arcos-García, Á., Álvarez-García, J. A., & Soria-Morillo, L. M. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.08.009 · Cited by 234
Zhang, Z., Wang, C., Gan, C., Sun, S., & Wang, M. (2019) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2019.2900201 · Cited by 234
Scope of machine learning in materials research—A review
Mobarak, M. H., Mimona, M. A., Islam, M. A., Hossain, N., Zohura, F. T., Imtiaz, I., & Rimon, M. I. H. (2023) · Applied Surface Science Advances · doi:10.1016/j.apsadv.2023.100523 · Cited by 230
Recent advances of deep learning in bioinformatics and computational biology
Tang, B., Pan, Z., Yin, K., & Khateeb, A. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00214 · Cited by 233
Fernandez, A., Herrera, F., Cordon, O., Jose del Jesus, M., & Marcelloni, F. (2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2881645 · Cited by 232
“This is the premise of the area of research known as transfer learning [58].”
BackgroundPothole Detection Using Computer Vision and Learning
Dhiman, A., & Klette, R. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2931297 · Cited by 231
“learning [77] using Mask R-CNN [78].”
Nematzadeh, S., Kiani, F., Torkamanian-Afshar, M., & Aydin, N. (2022) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2021.107619 · Cited by 229
Transfer learning for medical images analyses: A survey
Yu, X., Wang, J., Hong, Q.-Q., Teku, R., Wang, S.-H., & Zhang, Y.-D. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.08.159 · Cited by 232
Chen, Y., Tong, Z., Zheng, Y., Samuelson, H., & Norford, L. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.119866 · Cited by 231
PPFL: privacy-preserving federated learning with trusted execution environments
Mo, F., Haddadi, H., Katevas, K., Marin, E., Perino, D., & Kourtellis, N. (2021) · Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3458864.3466628 · Cited by 226
Perspectives on the integration between first-principles and data-driven modeling
Bradley, W., Kim, J., Kilwein, Z., Blakely, L., Eydenberg, M., Jalvin, J., Laird, C., & Boukouvala, F. (2022) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2022.107898 · Cited by 231
Online Detection of Freezing of Gait with Smartphones and Machine Learning Techniques
Mazilu, S., Hardegger, M., Zhu, Z., Roggen, D., Troester, G., Plotnik, M., & Hausdorff, J. (2012) · Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2012.248680 · Cited by 231
“A common non-pharmacological therapy for FoG is rhyth mical auditory cueing [10].”
BackgroundSamala, R. K., Chan, H.-P., Hadjiiski, L. M., Helvie, M. A., Cha, K. H., & Richter, C. D. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa93d4 · Cited by 232
Cheng, H., Kong, X., Chen, G., Wang, Q., & Wang, R. (2021) · Measurement · doi:10.1016/j.measurement.2020.108286 · Cited by 230
Data quantity governance for machine learning in materials science
Liu, Y., Yang, Z., Zou, X., Ma, S., Liu, D., Avdeev, M., & Shi, S. (2023) · National Science Review · doi:10.1093/nsr/nwad125 · Cited by 228
A Systematic Review of Deep Learning Approaches to Educational Data Mining
Hernández-Blanco, A., Herrera-Flores, B., Tomás, D., & Navarro-Colorado, B. (2019) · Complexity · doi:10.1155/2019/1306039 · Cited by 230
“Transfer learning [95] was used in [36] to initialize CNNs with weights pretrained on ImageNet.”
MethodDeep Learning Inversion of Electrical Resistivity Data
Liu, B., Guo, Q., Li, S., Liu, B., Ren, Y., Pang, Y., Guo, X., Liu, L., & Jiang, P. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2969040 · Cited by 215
“In order to improve the antinoise ability of deep learning inversion, we will introduce the idea of transfer learning [51], [52] in future research, which will adapt the trained networks to noise data by fine-tuning the parameters.”
MethodChen, H., Jin, M., Li, Z., Fan, C., Li, J., & He, H. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.778488 · Cited by 226
“As a sub-field of machine learning, DA improves the learning in the unlabeled target domain through the transfer of knowledge from the source domains, which can significantly reduce the number of labeled samples [18].”
BackgroundMusallam, A. S., Sherif, A. S., & Hussein, M. K. (2022) · IEEE Access · doi:10.1109/access.2022.3140289 · Cited by 226
Transformer Neural Network for Weed and Crop Classification of High Resolution UAV Images
Reedha, R., Dericquebourg, E., Canals, R., & Hafiane, A. (2022) · Remote Sensing · doi:10.3390/rs14030592 · Cited by 229
“During the training phase, we employed data augmentation strategies to enrich the datasets as it plays an important role in deep learning [45].”
MethodApparel Classification with Style
Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., & Van Gool, L. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37447-0_25 · Cited by 220
“[22]) and its usefulness has also been demonstrated in various vision domains, e.”
BackgroundMethodTransfer Capsule Network for Aspect Level Sentiment Classification
Chen, Z., & Qian, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1052 · Cited by 218
“It can be categorized into three types based on different situations in the source and target domains/tasks (Pan and Yang, 2010).”
BackgroundMatasci, G., Volpi, M., Kanevski, M., Bruzzone, L., & Tuia, D. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2377785 · Cited by 228
“attention within the machine learning community [13], [19].”
BackgroundInfluentialTransfer learning with seasonal and trend adjustment for cross-building energy forecasting
Ribeiro, M., Grolinger, K., ElYamany, H. F., Higashino, W. A., & Capretz, M. A. M. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2018.01.034 · Cited by 225
A comprehensive overview of biometric fusion
Singh, M., Singh, R., & Ross, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.12.003 · Cited by 221
Hyperspectral Classification Based on Lightweight 3-D-CNN With Transfer Learning
Zhang, H., Li, Y., Jiang, Y., Wang, P., Shen, Q., & Shen, C. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2902568 · Cited by 225
Wen, Y., Fashiar Rahman, M., Xu, H., & Tseng, T.-L. B. (2022) · Measurement · doi:10.1016/j.measurement.2021.110276 · Cited by 223
Chen, H., Luo, H., Huang, B., Jiang, B., & Kaynak, O. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3290974 · Cited by 219
Hu, J., Lu, J., & Tan, Y.-P. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298629 · Cited by 211
Aspect Extraction with Automated Prior Knowledge Learning
Chen, Z., Mukherjee, A., & Liu, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1033 · Cited by 224
Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning
Ge, W., & Yu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.9 · Cited by 221
“Transfer learning techniques that apply knowledge learnt from one task to other related tasks have been proven helpful [30].”
BackgroundUnveiling the potential of Graph Neural Networks for network modeling and optimization in SDN
Rusek, K., Suárez-Varela, J., Mestres, A., Barlet-Ros, P., & Cabellos-Aparicio, A. (2019) · Proceedings of the 2019 ACM Symposium on SDN Research · doi:10.1145/3314148.3314357 · Cited by 221
“Nevertheless, this shows the feasibility to adapt pre-trained models optimized for a specific metric to predict different network performance metrics (i.e., transfer learning [24]).”
BackgroundMulti-Source Distilling Domain Adaptation
Zhao, S., Wang, G., Zhang, S., Gu, Y., Li, Y., Song, Z., Xu, P., Hu, R., Chai, H., & Keutzer, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6997 · Cited by 213
Residual joint adaptation adversarial network for intelligent transfer fault diagnosis
Jiao, J., Zhao, M., Lin, J., & Liang, K. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.106962 · Cited by 225
A deep learning based traffic crash severity prediction framework
Rahim, M. A., & Hassan, H. M. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106090 · Cited by 223
Wan, L., Li, Y., Chen, K., Gong, K., & Li, C. (2022) · Measurement · doi:10.1016/j.measurement.2022.110752 · Cited by 223
Tian, J., Han, D., Li, M., & Shi, P. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108466 · Cited by 220
A General Logical Approach to Learning from Time Series (Invited Talk)
Zhu, T., Ran, Y., Zhou, X. J., & Wen, Y. (2019) · arXiv (Cornell University) · doi:10.4230/lipics.time.2024.1 · Cited by 224
Privacy-Preserving Federated Learning Using Homomorphic Encryption
Park, J., & Lim, H. (2022) · Applied Sciences · doi:10.3390/app12020734 · Cited by 223
“In this case, federated transfer learning utilizes the transfer learning techniques in [18] for FL-based systems.”
MethodDeep learning and alternative learning strategies for retrospective real-world clinical data
Chen, D., Liu, S., Kingsbury, P., Sohn, S., Storlie, C. B., Habermann, E. B., Naessens, J. M., Larson, D. W., & Liu, H. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0122-0 · Cited by 223
Challenges and Opportunities in Machine-Augmented Plant Stress Phenotyping
Singh, A., Jones, S., Ganapathysubramanian, B., Sarkar, S., Mueller, D., Sandhu, K., & Nagasubramanian, K. (2021) · Trends in Plant Science · doi:10.1016/j.tplants.2020.07.010 · Cited by 222
Backdoor Attacks Against Deep Learning Systems in the Physical World
Wenger, E., Passananti, J., Bhagoji, A. N., Yao, Y., Zheng, H., & Zhao, B. Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00614 · Cited by 212
Recent advances on federated learning: A systematic survey
Liu, B., Lv, N., Guo, Y., & Li, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128019 · Cited by 200
Transferring topical knowledge from auxiliary long texts for short text clustering
Jin, O., Liu, N. N., Zhao, K., Yu, Y., & Yang, Q. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063689 · Cited by 218
Self-citationSkin Lesion Analyser: An Efficient Seven-Way Multi-class Skin Cancer Classification Using MobileNet
Chaturvedi, S. S., Gupta, K., & Prasad, P. S. (2021) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-3383-9_15 · Cited by 207
Guo, J., Kurup, U., & Shah, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2926042 · Cited by 221
Deep Facial Diagnosis: Deep Transfer Learning From Face Recognition to Facial Diagnosis
Jin, B., Cruz, L., & Gonçalves, N. (2020) · IEEE Access · doi:10.1109/access.2020.3005687 · Cited by 221
“Deep transfer learning (DTL) [38], [39] is to transfer knowledge by pretrained deep neural network which originally aims to perform facial verification and recognition in this paper.”
BackgroundMethodMobileNetV3 for Image Classification
Qian, S., Ning, C., & Hu, Y. (2021) · 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie52039.2021.9389905 · Cited by 198
“Pre-trained weights [17, 18] on ImageNet [19] were used.”
MethodTransfer Learning with Graph Co-Regularization
Long, M., Wang, J., Ding, G., Shen, D., & Yang, Q. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.97 · Cited by 210
Self-citationCastellini, C., Artemiadis, P., Wininger, M., Ajoudani, A., Alimusaj, M., Bicchi, A., Caputo, B., Craelius, W., Dosen, S., Englehart, K., et al. (2014) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2014.00022 · Cited by 221
Jiang, Y., Wu, D., Deng, Z., Qian, P., Wang, J., Wang, G., Chung, F.-L., Choi, K.-S., & Wang, S. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2748388 · Cited by 221
“To cope with this issue, transfer learning (TL) [13]–[18], [40], [42], particularly, large margin projection (LMPROJ) [18], has been used to reduce the data distribution mismatch between the training and testing data.”
BackgroundMethodHohman, F., Park, H., Robinson, C., & Polo Chau, D. H. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934659 · Cited by 213
Affine Transformation-Enhanced Multifactorial Optimization for Heterogeneous Problems
Xue, X., Zhang, K., Tan, K. C., Feng, L., Wang, J., Chen, G., Zhao, X., Zhang, L., & Yao, J. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3036393 · Cited by 217
A survey on few-shot class-incremental learning
Tian, S., Li, L., Li, W., Ran, H., Ning, X., & Tiwari, P. (2024) · Neural Networks · doi:10.1016/j.neunet.2023.10.039 · Cited by 220
Learning to Combine Multiple Ranking Metrics for Fault Localization
Xuan, J., & Monperrus, M. (2014) · 2014 IEEE International Conference on Software Maintenance and Evolution · doi:10.1109/icsme.2014.41 · Cited by 210
Real-Time Articulated Hand Pose Estimation Using Semi-supervised Transductive Regression Forests
Tang, D., Yu, T.-H., & Kim, T.-K. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.400 · Cited by 219
Safety in numbers: Learning categories from few examples with multi model knowledge transfer
Tommasi, T., Orabona, F., & Caputo, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540064 · Cited by 216
“We focus on three key issues for knowledge transfer: how to transfer, what to transfer and when to transfer [16].”
BackgroundLearning Domain-Invariant Subspace Using Domain Features and Independence Maximization
Yan, K., Kou, L., & Zhang, D. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2633306 · Cited by 220
Riemannian Procrustes Analysis: Transfer Learning for Brain–Computer Interfaces
Rodrigues, P. L. C., Jutten, C., & Congedo, M. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2889705 · Cited by 219
“Our distribution matching method considers the semisupervised Transfer Learning paradigm [4], where one has knowledge of all the labels from the source dataset and access to a small subset of labels from the target dataset.”
BackgroundMethodTransfer learning for speech and language processing
Wang, D., & Zheng, T. F. (2015) · 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2015.7415532 · Cited by 213
“nditions that they apply to. Following the 3http://clopinet.com/isabelle/Projects/ICML2011/ 4https://sites.google.com/site/learningacross/ 5https://sites.google.com/site/icdmwptl2015/home taxonomy in [4], we use data and task as two conditional factors of transfer learning. For the data condition, it involves the feat…”
BackgroundMethodInfluentialFault diagnosis in rotating machines based on transfer learning: Literature review
Misbah, I., LEE, C. K. M., & KEUNG, K. L. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111158 · Cited by 215
Yan, P., Abdulkadir, A., Luley, P.-P., Rosenthal, M., Schatte, G. A., Grewe, B. F., & Stadelmann, T. (2024) · IEEE Access · doi:10.1109/access.2023.3349132 · Cited by 212
Darla Improving zero-shot transfer in reinforcement learning
Higgins, I., Pal, A., Rusu, A. A., Matthey, L., Burgess, C. P., Pritzel, A., Botvinick, M., Blundell, C., & Lerchner, A. (2017) · arXiv · doi:10.48550/arxiv.1707.08475 · Cited by 219
Federated reinforcement learning: techniques, applications, and open challenges
Qi, J., Zhou, Q., Lei, L., & Zheng, K. (2021) · Intelligence & Robotics · doi:10.20517/ir.2021.02 · Cited by 218
“In comparisonwith traditional transfer learning [16], FTL focuses on privacy-preserving issues and addresses distributed challenges.”
BackgroundCurriculum learning of multiple tasks
Pentina, A., Sharmanska, V., & Lampert, C. H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299188 · Cited by 213
Weakly-Shared Deep Transfer Networks for Heterogeneous-Domain Knowledge Propagation
Shu, X., Qi, G.-J., Tang, J., & Wang, J. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806216 · Cited by 211
“To this end, we propose a novel deep network structure that hierarchically learns to transfer the semantic knowledge from web texts to images [23], namely weakly-shared Deep Transfer Networks (DTNs) in this paper.”
BackgroundFeng, L., Huang, Y., Zhou, L., Zhong, J., Gupta, A., Tang, K., & Tan, K. C. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2962865 · Cited by 217
Rossi, R. A., & Ahmed, N. K. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2349913 · Cited by 212
Domain Invariant Transfer Kernel Learning
Long, M., Wang, J., Sun, J., & Yu, P. S. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2373376 · Cited by 217
“As such, domain transfer learning is the fundamental machine learning technology for cross-domain knowledge discovery [2].”
BackgroundZhao, W. X., Li, S., He, Y., Chang, E. Y., Wen, J.-R., & Li, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2508816 · Cited by 217
Liang, Y., Samtani, S., Guo, B., & Yu, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3004077 · Cited by 214
“To handle the imbalanced classification problem and smoothly conduct the user authentication on heterogeneous IoT devices, transfer learning [119], [120] is promising to transfer the trained model based on behavioral records collected on one source device to the target device.”
BackgroundMeta-learning Approaches for Few-Shot Learning: A Survey of Recent Advances
Gharoun, H., Momenifar, F., Chen, F., & Gandomi, A. H. (2024) · ACM Computing Surveys · doi:10.1145/3659943 · Cited by 211
“Model parameters, feature representations, and instances are different forms of knowledge that can be transferred in transfer learning [83].”
Battery Safety: Machine Learning-Based Prognostics
Zhao, J., Feng, X., Pang, Q., Fowler, M., Lian, Y., Ouyang, M., & Burke, A. F. (2024) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2023.101142 · Cited by 216
Heterogeneous Domain Adaptation Through Progressive Alignment
Li, J., Lu, K., Huang, Z., Zhu, L., & Shen, H. T. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2868854 · Cited by 216
“In recent years, domain adaptation [1], [2], [7], [26], which is wellknown as a branch of transfer learning [1], [27], has been regarded as a promising technology to leverage label information from the source domain.”
BackgroundInfluentialDomain Adaptation with Conditional Transferable Components.
Gong, M., Zhang, K., Liu, T., Tao, D., Glymour, C., & Schölkopf, B. (2016) · PubMed · Cited by 367
Cross-Subject Emotion Recognition Using Deep Adaptation Networks
Li, H., Jin, Y.-M., Zheng, W.-L., & Lu, B.-L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-04221-9_36 · Cited by 179
“[15], a domain D = {X , P (X)} consists of a feature space X and the corresponding marginal probability distribution P (X), where X ∈ X .”
BackgroundChen, X., Li, Y., Hu, R., Zhang, X., & Chen, X. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3009383 · Cited by 212
“T [29].”
BackgroundRahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214
“[124] Representa tion, Colearning Text, Image Media Event Classificat ion Crossmodal retrieval Data from different sources combined with weak supervision [125] Representa tion, Alignment, Co-learning Text, Image Crossmodal retrieval Transfer Learning Dictionary-based alignment with crossdomain cross-modality transfer…”
BackgroundMethodInfluentialStalder, S., Grabner, H., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops · doi:10.1109/iccvw.2009.5457445 · Cited by 214
“, by transfer learning (see [17] for a survey).”
BackgroundEmotion recognition with convolutional neural network and EEG-based EFDMs
Wang, F., Wu, S., Zhang, W., Xu, Z., Zhang, Y., Wu, C., & Coleman, S. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107506 · Cited by 214
Boosting for Regression Transfer
Pardoe, D., & Stone, P. (2010) · Cited by 214
Lee, H., Park, M., & Kim, J. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533053 · Cited by 193
“Thus, to restore the population information with reducing the bias, we apply transfer learning [17, 18, 19] for our classifier trained with thresh data, by re-training the classifier with the original full data.”
MethodScott, G. J., Marcum, R. A., Davis, C. H., & Nivin, T. W. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2722988 · Cited by 214
Structural health monitoring using extremely compressed data through deep learning
Azimi, M., & Pekcan, G. (2020) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12517 · Cited by 214
“By definition, TL transfers some level of knowledge from a source domain to the target domain for similar data types (Pan & Yang, 2010).”
BackgroundHardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.3036081 · Cited by 212
Qian, C., Liu, X., Ripley, C., Qian, M., Liang, F., & Yu, W. (2022) · Future Internet · doi:10.3390/fi14020064 · Cited by 211
SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation
Xie, B., Li, S., Li, M., Liu, C. H., Huang, G., & Wang, G. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3237740 · Cited by 211
Benchmarking in Optimization: Best Practice and Open Issues
Bartz-Beielstein, T., Doerr, C., Berg, D. V. D., Bossek, J., Chandrasekaran, S., Eftimov, T., Fischbach, A., Kerschke, P., La Cava, W., Lopez-Ibanez, M., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.03488 · Cited by 214
“In the context of machine learning, performance extrapolation is also referred to as transfer learning [Pan and Yang, 2010].”
MethodChen, Z., Hu, W., Wang, J., Zhao, S., Amos, B., Wu, G., Ha, K., Elgazzar, K., Pillai, P., Klatzky, R., et al. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134458 · Cited by 213
Learning-Based Privacy-Aware Offloading for Healthcare IoT With Energy Harvesting
Min, M., Wan, X., Xiao, L., Chen, Y., Xia, M., Wu, D., & Dai, H. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2875926 · Cited by 213
Ameri, R., Hsu, C.-C., & Band, S. S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107717 · Cited by 213
A Machine Learning Approach for Air Quality Prediction: Model Regularization and Optimization
Zhu, D., Cai, C., Yang, T., & Zhou, X. (2018) · Big Data and Cognitive Computing · doi:10.3390/bdcc2010005 · Cited by 213
“…for transfer learning, such as inductive transfer learning, transductive transfer learning and unsupervised transfer learning, and the approaches for transfer learning mainly include instance transfer, feature-representation transfer, parameter transfer and relational-knowledge transfer [60].”
BackgroundSeeing permeability from images: fast prediction with convolutional neural networks
Wu, J., Yin, X., & Xiao, H. (2018) · Science Bulletin · doi:10.1016/j.scib.2018.08.006 · Cited by 212
“In order to predict on real rock samples, approaches that have been proven effective in other machine learning practices [38] can be adopted, such as adding some real rock images with known permeability into the training data, and maintaining a validation dataset of real rock images to further ensure the extrapolation…”
BackgroundUnsupervised image translation using adversarial networks for improved plant disease recognition
Nazki, H., Yoon, S., Fuentes, A., & Park, D. S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105117 · Cited by 211
SenseFi: A library and benchmark on deep-learning-empowered WiFi human sensing
Yang, J., Chen, X., Zou, H., Lu, C. X., Wang, D., Sun, S., & Xie, L. (2023) · Patterns · doi:10.1016/j.patter.2023.100703 · Cited by 209
Multi-source information fusion: Progress and future
LI, X., DUNKIN, F., & DEZERT, J. (2024) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2023.12.009 · Cited by 204
Unsupervised Adaptation Across Domain Shifts by Generating Intermediate Data Representations
Gopalan, R., Li, R., & Chellappa, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.249 · Cited by 212
Transfer Learning in a Transductive Setting
Rohrbach, M., Ebert, S., & Schiele, B. (2013) · MPG.PuRe (Max Planck Society) · Cited by 212
Lu, D., Popuri, K., Ding, G. W., Balachandar, R., & Beg, M. F. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.02.002 · Cited by 211
Li, D., Deng, L., Lee, M., & Wang, H. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.04.006 · Cited by 212
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.