A Survey on Transfer Learning
The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These are perturbed versions of test inputs which seem almost indistinguishable from the original test input to a human, but fool the trained model [70, 441].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [70]
In the citing paper
“The rationale is to make the data distributions from different subjects more similar, and hence a classifier trained on the auxiliary data would have a better chance to perform well on the new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [23]
In the citing paper
“Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
From Applications of machine learning to machine fault diagnosis: A review and roadmap (2020) · cites this paper as [27]
In the citing paper
“TL has many advantages in the development of ML algorithms, such as shorter training times and the enhanced robustness of using models that have already passed initial tests.”
From A Survey of Underwater Acoustic Data Classification Methods Using Deep Learning for Shoreline Surveillance (2022) · cites this paper as [127]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“Among these, a closely related learning technique to transfer learning is the multitask learning framework [21], which tries to learn multiple tasks simultaneously even when they are different.”
BackgroundTop 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“ATA mining and machine learning technologies have already achieved significant success in many knowledge engineering areas including classification, regression, and clustering (e.g., [1], [2]).”
BackgroundSelf-citationCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753 · cited 2×
“Finally, on the WiFi localization data set, we show the comparison results reported in [67], where the baseline is a regularized least square regression model (RLSR), which is a standard regression model, and KPCA, which represents to apply RLSR on the new representations of the data learned by…”
MethodSelf-citationSemi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“MLNs [56] is a powerful formalism, which combines the compact expressiveness of first-order logic with flexibility of probability, for statistical relational learning.”
BackgroundEfficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Research works printed but not linked: 3
- 1998, Learning to Learn
- 10.5555/2981562.2981582 · doi:10.5555/2981562.2981582
- Joachims, Transductive Inference for Text Classification Using Support Vector Machines, 200
Cited by
Items 301–400 of 1,257
Huang, Z., Pan, Z., & Lei, B. (2017) · Remote Sensing · doi:10.3390/rs9090907 · Cited by 437
Machine Learning for Chemical Reactions
Meuwly, M. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00033 · Cited by 437
Zhang, W., Deng, L., Zhang, L., & Wu, D. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.106004 · Cited by 427
Transfer learning in environmental remote sensing
Ma, Y., Chen, S., Ermon, S., & Lobell, D. B. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113924 · Cited by 425
Transfer learning in hybrid classical-quantum neural networks
Mari, A., Bromley, T. R., Izaac, J., Schuld, M., & Killoran, N. (2020) · Quantum · doi:10.22331/q-2020-10-09-340 · Cited by 435
Transfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks
Peters, M. E., Ruder, S., & Smith, N. A. (2019) · Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019) · doi:10.18653/v1/w19-4302 · Cited by 432
“Sequential inductive transfer learning (Pan and Yang, 2010) consists of two stages: pretraining , in which the model learns a general-purpose representation of inputs, and adaptation , in which the representation is transferred to a new task.”
BackgroundSmart Augmentation Learning an Optimal Data Augmentation Strategy
Lemley, J., Bazrafkan, S., & Corcoran, P. (2017) · IEEE Access · doi:10.1109/access.2017.2696121 · Cited by 428
“In transfer learning, we want to take knowledge learned from one network, and transfer it to another [13].”
BackgroundTransfer Learning-Based Dynamic Multiobjective Optimization Algorithms
Jiang, M., Huang, Z., Qiu, L., Huang, W., & Yen, G. G. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2771451 · Cited by 419
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424
A multimodal approach to estimating vigilance using EEG and forehead EOG
Zheng, W.-L., & Lu, B.-L. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa5a98 · Cited by 424
Heidari, M., Mirniaharikandehei, S., Khuzani, A. Z., Danala, G., Qiu, Y., & Zheng, B. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104284 · Cited by 423
“In this study, we adopt a transfer learning approach since the previous studies have shown in order to avoid either overfitting or underfitting consequences using a small training dataset, a better approach is to take advantage of a CNN initially trained using a large-scale dataset [19].”
MOLI: multi-omics late integration with deep neural networks for drug response prediction
Sharifi-Noghabi, H., Zolotareva, O., Collins, C. C., & Ester, M. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz318 · Cited by 421
Zhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., & Gu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122807 · Cited by 410
THE CANNON: A DATA-DRIVEN APPROACH TO STELLAR LABEL DETERMINATION
Ness, M., Hogg, D. W., Rix, H.-W., Ho, A. Y. Q., & Zasowski, G. (2015) · The Astrophysical Journal · doi:10.1088/0004-637x/808/1/16 · Cited by 390
Kernels for Vector-Valued Functions: A Review
Álvarez, M. A., Rosasco, L., & Lawrence, N. D. (2012) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000036 · Cited by 415
Morocho-Cayamcela, M. E., Lee, H., & Lim, W. (2019) · IEEE Access · doi:10.1109/access.2019.2942390 · Cited by 418
“Researchers that start from a solution that worked in another context, often find themselves making significant modifications and improvements before they start getting results [178].”
BackgroundDomain Adaptation under Target and Conditional Shift
Zhang, K., Schölkopf, B., Muandet, K., & Wang, Z. (2013) · Max Planck Digital Library · Cited by 753
idtracker.ai: tracking all individuals in small or large collectives of unmarked animals
Romero-Ferrero, F., Bergomi, M. G., Hinz, R. C., Heras, F. J. H., & de Polavieja, G. G. (2019) · Nature Methods · doi:10.1038/s41592-018-0295-5 · Cited by 406
CoNet: Collaborative Cross Networks for Cross-Domain Recommendation
Hu, G., Zhang, Y., & Yang, Q. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271684 · Cited by 374
“Transfer and multitask learning Transfer learning (TL) aims at improving the performance of the target domain by exploiting knowledge from source domains [32].”
BackgroundSelf-citationTransferability vs. Discriminability: Batch Spectral Penalization for Adversarial Domain Adaptation
Chen, X., Wang, S., Long, M., & Wang, J. (2019) · International Conference on Machine Learning · Cited by 691
DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detection
Qiao, L., Zhao, Y., Li, Z., Qiu, X., Wu, J., & Zhang, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00856 · Cited by 387
Unsupervised Domain Adaptation for Zero-Shot Learning
Kodirov, E., Xiang, T., Fu, Z., & Gong, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.282 · Cited by 403
“ZSL can thus be considered as a special case of transfer learning [28].”
BackgroundInfluentialAutomatic Modulation Classification: A Deep Learning Enabled Approach
Meng, F., Chen, P., Wu, L., & Wang, X. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2868698 · Cited by 413
Singh, J., Hanson, J., Paliwal, K., & Zhou, Y. (2019) · Nature Communications · doi:10.1038/s41467-019-13395-9 · Cited by 411
“Transfer learning 35 involves further training a large model that was trained on a large dataset for a speci fi c task to some other related task with limited data.”
MethodZhu, Y., Zhuang, F., & Wang, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015989 · Cited by 387
Transfer Learning: A Riemannian Geometry framework with applications to Brain-Computer Interfaces
Zanini, P., Congedo, M., Jutten, C., Said, S., & Berthoumieu, Y. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2742541 · Cited by 412
“The second improvement relates to the problem of transfer learning [30].”
BackgroundMulti-Adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection
Shao, R., Lan, X., Li, J., & Yuen, P. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01026 · Cited by 402
“The generalized feature space learned by the domain generalization approach should be shared by multiple source domains and discriminative [15, 22].”
BackgroundDeep Learning Techniques: An Overview
Mathew, A., Amudha, P., & Sivakumari, S. (2021) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-3383-9_54 · Cited by 379
She, C., Sun, C., Gu, Z., Li, Y., Yang, C., Poor, H. V., & Vucetic, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3053601 · Cited by 405
Charting the Right Manifold: Manifold Mixup for Few-shot Learning
Mangla, P., Singh, M., Sinha, A., Kumari, N., Balasubramanian, V. N., & Krishnamurthy, B. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093338 · Cited by 372
LiT: Zero-Shot Transfer with Locked-image text Tuning
Zhai, X., Wang, X., Mustafa, B., Steiner, A., Keysers, D., Kolesnikov, A., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01759 · Cited by 402
“Transfer learning [44] has been a successful paradigm in computer vision [32,33,42].”
BackgroundDeep learning in bioinformatics: Introduction, application, and perspective in the big data era
Li, Y., Huang, C., Ding, L., Li, Z., Pan, Y., & Gao, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.008 · Cited by 401
Deep Learning for EMG-based Human-Machine Interaction: A Review
Xiong, D., Zhang, D., Zhao, X., & Zhao, Y. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003865 · Cited by 395
“[42] decomposed EMG into multiple streams, and a CNN with multiple sub-streams is used for gesture classification.”
BackgroundMethodGu, X., Cao, Z., Jolfaei, A., Xu, P., Wu, D., Jung, T.-P., & Lin, C.-T. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3052811 · Cited by 395
Li, Y., Song, Y., Jia, L., Gao, S., Li, Q., & Qiu, M. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3008010 · Cited by 399
Adversarial Domain Adaptation with Domain Mixup
Xu, M., Zhang, J., Ni, B., Li, T., Wang, C., Tian, Q., & Zhang, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6123 · Cited by 381
Ha, C. S., Yao, D., Xu, Z., Liu, C., Liu, H., Elkins, D., Kile, M., Deshpande, V., Kong, Z., Bauchy, M., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-40854-1 · Cited by 387
Web data extraction, applications and techniques: A survey
Ferrara, E., De Meo, P., Fiumara, G., & Baumgartner, R. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.07.007 · Cited by 396
“Various strategies have been proposed to perform such a transfer of information and some of these strategies take advantages from models and algorithms developed in the field of transfer of learning [96].”
MethodYang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2019) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00960ed2v01y201910aim043 · Cited by 261
Self-citationFault Description Based Attribute Transfer for Zero-Sample Industrial Fault Diagnosis
Feng, L., & Zhao, C. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2988208 · Cited by 395
“However, for deep transfer learning [17], the same kinds of faults have already been prepared well in the training domain.”
BackgroundA survey of deep meta-learning
Huisman, M., van Rijn, J. N., & Plaat, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10004-4 · Cited by 376
Thapa, C., & Camtepe, S. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104130 · Cited by 393
“Transfer Learning: Transfer learning [161] leverages pre-trained ML models by reusing them for new related problems.”
BackgroundJointly Learning Heterogeneous Features for RGB-D Activity Recognition
Hu, J.-F., Zheng, W.-S., Lai, J., & Zhang, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2640292 · Cited by 383
“Here, we introduce a transfer learning model to enhance our feature learning on the target set by the assistance of learning on other non-target datasets [29], [56].”
MethodHeterogeneous Domain Adaptation Using Manifold Alignment
Wang, C., & Mahadevan, S. (2011) · Cited by 400
Research and application of machine learning for additive manufacturing
Qin, J., Hu, F., Liu, Y., Witherell, P., Wang, C. C. L., Rosen, D. W., Simpson, T. W., Lu, Y., & Tang, Q. (2022) · Additive Manufacturing · doi:10.1016/j.addma.2022.102691 · Cited by 391
“A major assumption in most ML models is that the training and future data must be in the same feature space with the same distribution [218].”
Beijbom, O., Edmunds, P. J., Roelfsema, C., Smith, J., Kline, D. I., Neal, B. P., Dunlap, M. J., Moriarty, V., Fan, T.-Y., Tan, C.-J., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130312 · Cited by 386
A Survey of Deep Convolutional Neural Networks Applied for Prediction of Plant Leaf Diseases
Dhaka, V. S., Meena, S. V., Rani, G., Sinwar, D., Kavita, K., Ijaz, M. F., & Woźniak, M. (2021) · Sensors · doi:10.3390/s21144749 · Cited by 386
“As claimed in [69], the drawbacks make Batch Gradient Descent non-preferable for a deep learning model to update the parameters.”
BackgroundMethodMachine learning in concrete science: applications, challenges, and best practices
Li, Z., Yoon, J., Zhang, R., Rajabipour, F., Srubar III, W. V., Dabo, I., & Radlińska, A. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00810-x · Cited by 388
Usuga Cadavid, J. P., Lamouri, S., Grabot, B., Pellerin, R., & Fortin, A. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-019-01531-7 · Cited by 387
Heterogeneous Transfer Learning for Image Classification
Zhu, Y., Chen, Y., Lu, Z., Pan, S., Xue, G.-R., Yu, Y., & Yang, Q. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8090 · Cited by 378
Self-citationBrain tumor classification in MRI image using convolutional neural network
Ali Khan, H., 1 School of Computer Science and Technology, S. U. O. S. A. T., Jue, W., Mushtaq, M., Umer Mushtaq, M., 2 Insitute for Neuro and Bioinformatics, U. O. L., 3 School of Information Engineering, S. U. O. S. A. T., & 4 Department of Software Engineering, M. (2020) · Mathematical Biosciences and Engineering · doi:10.3934/mbe.2020328 · Cited by 383
“Sinno Pan and Qiang Yang have introduced a framework for a better understanding of Transfer Learning [23].”
BackgroundA survey: Deep learning for hyperspectral image classification with few labeled samples
Jia, S., Jiang, S., Lin, Z., Li, N., Xu, M., & Yu, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.035 · Cited by 378
“Transfer learning [83] is an effective method to deal with the small-sample problem.”
MethodTransfer Learning in Collaborative Filtering for Sparsity Reduction
Pan, W., Xiang, E., Liu, N., & Yang, Q. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7578 · Cited by 375
Self-citationRAPID: Rating Pictorial Aesthetics using Deep Learning
Lu, X., Lin, Z., Jin, H., Yang, J., & Wang, J. Z. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654927 · Cited by 383
“Alternatively, we can use ideas from inductive transfer learning [29], where we target minimizing the classification error with one label, whereas we construct feature representations with both labels.”
BackgroundMethodRemaining useful lifetime prediction via deep domain adaptation
da Costa, P. R. D. O., Akçay, A., Zhang, Y., & Kaymak, U. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2019.106682 · Cited by 381
Reducing Domain Gap by Reducing Style Bias
Nam, H., Lee, H., Park, J., Yoon, W., & Yoo, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00858 · Cited by 353
Multi-Adversarial Faster-RCNN for Unrestricted Object Detection
He, Z., & Zhang, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00677 · Cited by 368
Cheng, L., & Yu, T. (2019) · International Journal of Energy Research · doi:10.1002/er.4333 · Cited by 380
Insights on Transfer Optimization: Because Experience is the Best Teacher
Gupta, A., Ong, Y.-S., & Feng, L. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2769104 · Cited by 378
Transfer learning with neural networks for bearing fault diagnosis in changing working conditions
Zhang, R., Tao, H., Wu, L., & Guan, Y. (2017) · IEEE Access · doi:10.1109/access.2017.2720965 · Cited by 378
“It has made great progresses in image, audio and text recognition [16]–[18].”
BackgroundGeometric deep learning on molecular representations
Atz, K., Grisoni, F., & Schneider, G. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00418-8 · Cited by 373
“Transfer of knowledge from an existing deep learning model to a related task for which fewer training samples are available [28].”
BackgroundTowards a General Rule for Identifying Deceptive Opinion Spam
Li, J., Ott, M., Cardie, C., & Hovy, E. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1147 · Cited by 362
Computer-aided detection in chest radiography based on artificial intelligence: a survey
Qin, C., Yao, D., Shi, Y., & Song, Z. (2018) · BioMedical Engineering OnLine · doi:10.1186/s12938-018-0544-y · Cited by 377
Tan, Y., & Zhao, G. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2946551 · Cited by 376
Zhang, R., Zheng, Y., Mak, T. W. C., Yu, R., Wong, S. H., Lau, J. Y. W., & Poon, C. C. Y. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2635662 · Cited by 374
“An alternative way is to adopt a transfer learning strategy by making use of knowledge learned from large datasets in other domains [19].”
MethodWu, Y., Sicard, B., & Gadsden, S. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124678 · Cited by 357
Deep learning for smart fish farming: applications, opportunities and challenges
Yang, X., Zhang, S., Liu, J., Gao, Q., Dong, S., & Zhou, C. (2021) · Reviews in Aquaculture · doi:10.1111/raq.12464 · Cited by 364
How Generative Adversarial Networks and Their Variants Work: An Overview
Hong, Y., Hwang, U., Yoo, J., & Yoon, S. (2020) · ACM Computing Surveys · doi:10.1145/3301282 · Cited by 373
Artificial intelligence in Internet of things
Ghosh, A., Chakraborty, D., & Law, A. (2018) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2018.1008 · Cited by 368
Transfer learning techniques for medical image analysis: A review
Kora, P., Ooi, C. P., Faust, O., Raghavendra, U., Gudigar, A., Chan, W. Y., Meenakshi, K., Swaraja, K., Plawiak, P., & Rajendra Acharya, U. (2022) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2021.11.004 · Cited by 367
Interpretable bilinear attention network with domain adaptation improves drug–target prediction
Bai, P., Miljković, F., John, B., & Lu, H. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00605-1 · Cited by 362
Image-Based Surface Defect Detection Using Deep Learning: A Review
Bhatt, P. M., Malhan, R. K., Rajendran, P., Shah, B. C., Thakar, S., Yoon, Y. J., & Gupta, S. K. (2021) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4049535 · Cited by 362
Applications of Explainable Artificial Intelligence in Diagnosis and Surgery
Zhang, Y., Weng, Y., & Lund, J. (2022) · Diagnostics · doi:10.3390/diagnostics12020237 · Cited by 368
Hoeser, T., & Kuenzer, C. (2020) · Remote Sensing · doi:10.3390/rs12101667 · Cited by 366
Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition
Deng, J., Zhang, Z., Marchi, E., & Schuller, B. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.90 · Cited by 366
“Transfer learning aims to help improve the learning of the target predictive function in T t using the knowledge in T s [4].”
BackgroundMethodTransfer Learning for Drug Discovery
Cai, C., Wang, S., Xu, Y., Zhang, W., Tang, K., Ouyang, Q., Lai, L., & Pei, J. (2020) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.9b02147 · Cited by 366
Adaptive Personalized Federated Learning
Deng, Y., Kamani, M. M., & Mahdavi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13461 · Cited by 310
Metalearning: A survey of trends and technologies
Lemke, C., Budka, M., & Gabrys, B. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-013-9406-y · Cited by 365
“Although in these cases the information about base-learning is drawn in the sense of point 2a of Definition 1, these algorithms are limited to a single problem domain with a bias that is fixed a priori, so that they, using the definition above, do not undoubtedly qualify as metalearning methods.”
BackgroundArgumentation Mining: State of the Art and Emerging Trends
Lippi, M., & Torroni, P. (2016) · ACM Transactions on Internet Technology · doi:10.1145/2850417 · Cited by 363
Wurm, M., Stark, T., Zhu, X. X., Weigand, M., & Taubenböck, H. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.02.006 · Cited by 332
“When given a source domain dataset DS and a learning task TS, a target domain dataset DT and learning task TT aims to improve the learning of the target predictive function f (·) T in DT using the knowledge in DS and TS where T T S T (Pan and Yang, 2010).”
A survey on heterogeneous transfer learning
Day, O., & Khoshgoftaar, T. M. (2017) · Journal of Big Data · doi:10.1186/s40537-017-0089-0 · Cited by 360
Yu, J., Wang, Z., Majumdar, A., & Rajagopal, R. (2018) · Joule · doi:10.1016/j.joule.2018.11.021 · Cited by 362
Snorkel: rapid training data creation with weak supervision
Ratner, A., Bach, S. H., Ehrenberg, H., Fries, J., Wu, S., & Ré, C. (2020) · The VLDB Journal · doi:10.1007/s00778-019-00552-1 · Cited by 510
Vanschoren, J. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_2 · Cited by 328
Harmonizing Transferability and Discriminability for Adapting Object Detectors
Chen, C., Zheng, Z., Ding, X., Huang, Y., & Dou, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00889 · Cited by 350
From distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 356
Lan, Z., Sourina, O., Wang, L., Scherer, R., & Muller-Putz, G. R. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2826840 · Cited by 357
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358
“…transfer learning can be applied to leverage knowledge (features, parameters, etc) acquired in one domain and/or task with sufficient training data to support learning in another, which has got significantly less training data, thereby reducing expensive data annotation efforts [144,145].”
BackgroundLowe, M., Qin, R., & Mao, X. (2022) · Water · doi:10.3390/w14091384 · Cited by 354
Advances in De Novo Drug Design: From Conventional to Machine Learning Methods
Mouchlis, V. D., Afantitis, A., Serra, A., Fratello, M., Papadiamantis, A. G., Aidinis, V., Lynch, I., Greco, D., & Melagraki, G. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22041676 · Cited by 353
Mental health monitoring with multimodal sensing and machine learning: A survey
Garcia-Ceja, E., Riegler, M., Nordgreen, T., Jakobsen, P., Oedegaard, K. J., & Tørresen, J. (2018) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2018.09.003 · Cited by 356
A Broader Study of Cross-Domain Few-Shot Learning
Guo, Y., Codella, N. C., Karlinsky, L., Codella, J. V., Smith, J. R., Saenko, K., Rosing, T., & Feris, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58583-9_8 · Cited by 320
Tian, J., Xiong, R., Shen, W., & Lu, J. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116812 · Cited by 352
Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks
Xu, G., Liu, M., Jiang, Z., Shen, W., & Huang, C. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2902003 · Cited by 353
“in [31] and [32].”
Multisource Transfer Learning for Cross-Subject EEG Emotion Recognition
Li, J., Qiu, S., Shen, Y.-Y., Liu, C.-L., & He, H. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2904052 · Cited by 353
Automatic Analysis of Facial Actions: A Survey
Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2731763 · Cited by 350
A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., Krishna, R., Gonzalez, J. E., Sangiovanni-Vincentelli, A. L., Seshia, S. A., et al. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3028503 · Cited by 352
Deep Learning for Medical Image-Based Cancer Diagnosis
Jiang, X., Hu, Z., Wang, S., & Zhang, Y. (2023) · Cancers · doi:10.3390/cancers15143608 · Cited by 345
The present and future of deep learning in radiology
Saba, L., Biswas, M., Kuppili, V., Cuadrado Godia, E., Suri, H. S., Edla, D. R., Omerzu, T., Laird, J. R., Khanna, N. N., Mavrogeni, S., et al. (2019) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.02.038 · Cited by 353
“This particular feature of DL is also called Transfer Learning (TL) [43] and is highly popular in ML and DL community [44–46].”
Background
Metadata
- Authors
- Pan, S. J., & Yang, Q.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-10
- Volume
- 22
- Issue
- 10
- Pages
- 1345-1359
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2165698076
- Semantic Scholar
- a25fbcbbae1e8f79c4360d26aa11a3abf1a11972
- Cited by
- 23,387
- References
- 90
- Citations by year
- 2026: 1673 · 2025: 2106 · 2024: 2284 · 2023: 2499 · 2022: 2654 · 2021: 3152 · 2020: 2705 · 2019: 2137 · 2018: 1346 · 2017: 776 · 2016: 516 · 2015: 429 · 2014: 369 · 2013: 293 · 2012: 211
- FWCI
- 160.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- transfer learning, domain adaptation, multi-task learning, sample selection bias, covariate shift, knowledge transfer, classification, regression analysis, clustering, distribution shift
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.