The DOI matches its Crossref record; 143 of the 143 references it cites were found in a registry or an index.
A Survey on Negative Transfer
Open accessAbstract
Transfer learning (TL) utilizes data or knowledge from one or more source domains to facilitate learning in a target domain. It is particularly useful when the target domain has very few or no labeled data, due to annotation expense, privacy concerns, etc. Unfortunately, the effectiveness of TL is not always guaranteed. Negative transfer (NT), i.e., leveraging source domain data/knowledge undesirably reduces learning performance in the target domain, and has been a long-standing and challenging problem in TL. Various approaches have been proposed in the literature to address this issue. However, there does not exist a systematic survey. This paper fills this gap, by first introducing the definition of NT and its causes, and reviewing over fifty representative approaches for overcoming NT, which fall into three categories: domain similarity estimation, safe transfer, and NT mitigation. Many areas, including computer vision, bioinformatics, natural language processing, recommender systems, and robotics, that use NT mitigation strategies to facilitate positive transfers, are also reviewed. Finally, we give guidelines on NT task construction and baseline algorithms, benchmark existing TL and NT mitigation approaches on three NT-specific datasets, and point out challenges and future research directions. To ensure reproducibility, our code is publicized at https://github.com/chamwen/NT-Benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678 · cited 1×
“And the readers who are interested in application of transfer learning may refer to [17], [18].”
BackgroundTowards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Unsupervised Cross-lingual Representation Learning at Scale
Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.747 · Cited by 5,637
On Assessing ML Model Robustness: A Methodological Framework (Academic Track)
Awadid, A., & Robert, B. (2025) · OASIcs : OpenAccess Series in Informatics · doi:10.4230/oasics.saia.2024.1 · Cited by 4,702
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“Another idea is based on fine-tuning strategies [48], [49], which are frequently used in deep TL.”
BackgroundCatastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
Self-citationContinual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
Geodesic flow kernel for unsupervised domain adaptation
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247911 · Cited by 2,093
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 2×
“Test Performance Target performance [34], [35] Domain classifier [36]–[38]”
BackgroundMoment Matching for Multi-Source Domain Adaptation
Peng, X., Bai, Q., Xia, X., Huang, Z., Saenko, K., & Wang, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00149 · Cited by 1,621
Correcting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564089_7 · Cited by 1,560
Deep Subdomain Adaptation Network for Image Classification
Zhu, Y., Zhuang, F., Wang, J., Ke, G., Chen, J., Bian, J., Xiong, H., & He, Q. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2988928 · Cited by 1,245
Covariate Shift Adaptation by Importance Weighted Cross Validation
Sugiyama, M., Krauledat, M., & Müller, K. (2007) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.5555/1314498.1390324 · Cited by 1,226
Domain-adversarial training of neural networks
GaninYaroslav, UstinovaEvgeniya, AjakanHana, GermainPascal, LarochelleHugo, LavioletteFrançois, MarchandMario, & LempitskyVictor (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946704 · Cited by 1,201
An overview of multi-task learning
Zhang, Y., & Yang, Q. (2018) · National Science Review · doi:10.1093/nsr/nwx105 · Cited by 1,117
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J.-Y., & Lu, B.-L. (2013) · 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2013.6695876 · Cited by 1,100
Multi-Adversarial Domain Adaptation
Pei, Z., Cao, Z., Long, M., & Wang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11767 · Cited by 879
Wasserstein Distance Guided Representation Learning for Domain Adaptation
Shen, J., Qu, Y., Zhang, W., & Yu, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11784 · Cited by 862
Self-citationBourtoule, L., Chandrasekaran, V., Choquette-Choo, C. A., Jia, H., Travers, A., Zhang, B., Lie, D., & Papernot, N. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00019 · Cited by 810 · cited 1×
“1) Machine Unlearning: Aims to preserve data privacy in trained models by unlearning sensitive samples [33], [34].”
BackgroundLearning and evaluating classifiers under sample selection bias
Zadrozny, B. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015425 · Cited by 800
Semi-Supervised Domain Adaptation via Minimax Entropy
Saito, K., Kim, D., Sclaroff, S., Darrell, T., & Saenko, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00814 · Cited by 680
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 5×
“For instance, a feature adaptation-based TL strategy with support vector machine (SVM) [32] as the classifier should be compared with the original SVM algorithm to judge whether NT occurs.”
MethodInfluentialAdaptive batch normalization for practical domain adaptation
Li, Y., Wang, N., Shi, J., Hou, X., & Liu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.005 · Cited by 601
Joint Geometrical and Statistical Alignment for Visual Domain Adaptation
Zhang, J., Li, W., & Ogunbona, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.547 · Cited by 598
Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913914 · Cited by 569
Self-citationBusto, P. P., & Gall, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.88 · Cited by 564
Zhao, Z., Zhang, Q., Yu, X., Sun, C., Wang, S., Yan, R., & Chen, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3116309 · Cited by 526
You, K., Long, M., Cao, Z., Wang, J., & Jordan, M. I. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00283 · Cited by 487
Partial Transfer Learning with Selective Adversarial Networks
Cao, Z., Long, M., Wang, J., & Jordan, M. I. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00288 · Cited by 480
Bregman Divergence-Based Regularization for Transfer Subspace Learning
Si, S., Tao, D., & Geng, B. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.126 · Cited by 477
Characterizing and Avoiding Negative Transfer
Wang, Z., Dai, Z., Póczos, B., & Carbonell, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01155 · Cited by 463
Partial Adversarial Domain Adaptation
Cao, Z., Ma, L., Long, M., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_9 · Cited by 461
Importance Weighted Adversarial Nets for Partial Domain Adaptation
Zhang, J., Ding, Z., Li, W., & Ogunbona, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00851 · Cited by 455
Transfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
Self-citationWhy do deep convolutional networks generalize so poorly to small image transformations?
Azulay, A., & Weiss, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.12177 · Cited by 428
Analyzing the Performance of Multilayer Neural Networks for Object Recognition
Agrawal, P., Girshick, R., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_22 · Cited by 427 · cited 1×
“Another idea is based on fine-tuning strategies [48], [49], which are frequently used in deep TL.”
BackgroundDeep Cocktail Network: Multi-source Unsupervised Domain Adaptation with Category Shift
Xu, R., Chen, Z., Zuo, W., Yan, J., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00417 · Cited by 415
Minimum Class Confusion for Versatile Domain Adaptation
Jin, Y., Wang, X., Long, M., & Wang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_28 · Cited by 393
Harmonizing Transferability and Discriminability for Adapting Object Detectors
Chen, C., Zheng, Z., Ding, X., Huang, Y., & Dou, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00889 · Cited by 350
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
Self-citationMassively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
Arivazhagan, N., Bapna, A., Firat, O., Lepikhin, D., Johnson, M., Krikun, M., Chen, M. X., Cao, Y., Foster, G., Cherry, C., et al. (2019) · arXiv · doi:10.48550/arxiv.1907.05019 · Cited by 279
Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation
Li, S., Song, S., Huang, G., Ding, Z., & Wu, C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839528 · Cited by 277
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Silva, F. L. D., & Costa, A. H. R. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11396 · Cited by 273
Learning to Transfer Examples for Partial Domain Adaptation
Cao, Z., You, K., Long, M., Wang, J., & Yang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00310 · Cited by 273
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
Transferability and Hardness of Supervised Classification Tasks
Tran, A. T., Nguyen, C. V., & Hassner, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00148 · Cited by 241
Universal Source-Free Domain Adaptation
Nath Kundu, J., Venkat, N., Rahul, M. V., & Venkatesh Babu, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00460 · Cited by 231
Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling
Wang, Q., & Breckon, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6091 · Cited by 229
FixBi: Bridging Domain Spaces for Unsupervised Domain Adaptation
Na, J., Jung, H., Chang, H. J., & Hwang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00115 · Cited by 229
An Information-Theoretic Approach to Transferability in Task Transfer Learning
Bao, Y., Li, Y., Huang, S., Zhang, L., Zheng, L., Zamir, A., & Guibas, L. J. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803726 · Cited by 222
Self-citationDistant Domain Transfer Learning
Tan, B., Zhang, Y., Pan, S. J., & Yang, Q. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10826 · Cited by 214
Unsupervised Multi-source Domain Adaptation Without Access to Source Data
Ahmed, S. M., Raychaudhuri, D. S., Paul, S., Oymak, S., & Roy–Chowdhury, A. K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00997 · Cited by 208
Towards Safe Weakly Supervised Learning
Li, Y.-F., Guo, L.-Z., & Zhou, Z.-H. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2922396 · Cited by 204
Machine learning for targeted display advertising: transfer learning in action
Perlich, C., Dalessandro, B., Raeder, T., Stitelman, O., & Provost, F. J. (2013) · Machine Learning · doi:10.1007/s10994-013-5375-2 · Cited by 202
IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID
Dai, Y., Liu, J., Sun, Y., Tong, Z., Zhang, C., & Duan, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01165 · Cited by 195
Tan, B., Song, Y., Zhong, E., & Yang, Q. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783295 · Cited by 184
Pool-Based Sequential Active Learning for Regression
Wu, D. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2868649 · Cited by 184
Self-citationSide-Tuning: A Baseline for Network Adaptation via Additive Side Networks
Zhang, J. O., Sax, A., Zamir, A., Guibas, L., & Malik, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_41 · Cited by 184
Active learning for regression using greedy sampling
Wu, D., Lin, C.-T., & Huang, J. (2019) · Information Sciences · doi:10.1016/j.ins.2018.09.060 · Cited by 183
Self-citationManifold Embedded Knowledge Transfer for Brain-Computer Interfaces
Zhang, W., & Wu, D. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.2985996 · Cited by 183
Self-citationDynamic Weighted Learning for Unsupervised Domain Adaptation
Xiao, N., & Zhang, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01499 · Cited by 181
Self-citationTransfer Learning on Heterogenous Feature Spaces via Spectral Transformation
Shi, X., Liu, Q., Fan, W., Yu, P. S., & Zhu, R. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.65 · Cited by 180
Weighted Transfer Learning for Improving Motor Imagery-Based Brain–Computer Interface
Azab, A. M., Mihaylova, L., Ang, K. K., & Arvaneh, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2923315 · Cited by 176
Cross-Domain Recommendation via Cluster-Level Latent Factor Model
Gao, S., Luo, H., Chen, D., Li, S., Gallinari, P., & Guo, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40991-2_11 · Cited by 174
SENTRY: Selective Entropy Optimization via Committee Consistency for Unsupervised Domain Adaptation
Prabhu, V., Khare, S., Kartik, D., & Hoffman, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00844 · Cited by 174
Domain Adaptation with Auxiliary Target Domain-Oriented Classifier
Liang, J., Hu, D., & Feng, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01636 · Cited by 172
Multi-Source Domain Adaptation with Mixture of Experts
Guo, J., Shah, D., & Barzilay, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1498 · Cited by 168
Improving EEG-Based Emotion Classification Using Conditional Transfer Learning
Lin, Y.-P., & Jung, T.-P. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00334 · Cited by 167
Li, X., We, Z., Ma, H., Luo, Z., & Li, X. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.06.014 · Cited by 157
Curriculum Manager for Source Selection in Multi-source Domain Adaptation
Yang, L., Balaji, Y., Lim, S.-N., & Shrivastava, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_36 · Cited by 146
Concept Drift Adaptation by Exploiting Historical Knowledge
Sun, Y., Tang, K., Zhu, Z., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2775225 · Cited by 141
Kim, T., & Kim, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_35 · Cited by 141
Graph Adaptive Knowledge Transfer for Unsupervised Domain Adaptation
Ding, Z., Li, S., Shao, M., & Fu, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_3 · Cited by 138
On automated source selection for transfer learning in convolutional neural networks
Afridi, M. J., Ross, A. A., & Shapiro, E. M. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.07.019 · Cited by 137
Discriminative Joint Probability Maximum Mean Discrepancy (DJP-MMD) for Domain Adaptation
Zhang, W., & Wu, D. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207365 · Cited by 127
Self-citationClass-Imbalanced Domain Adaptation: An Empirical Odyssey
Tan, S., Peng, X., & Saenko, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66415-2_38 · Cited by 124
Exploring uncertainty in pseudo-label guided unsupervised domain adaptation
Liang, J., He, R., Sun, Z., & Tan, T. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106996 · Cited by 120
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment
Wang, Z., Lipton, Z. C., & Tsvetkov, Y. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.359 · Cited by 116
Backdoor Attacks Against Transfer Learning With Pre-Trained Deep Learning Models
Wang, S., Nepal, S., Rudolph, C., Grobler, M. M., Chen, S., & Chen, T. (2020) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2020.3000900 · Cited by 115
Online and Offline Domain Adaptation for Reducing BCI Calibration Effort
Wu, D. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2016.2608931 · Cited by 114
Self-citationDistant Domain Transfer Learning for Medical Imaging
Niu, S., Liu, M., Liu, Y., Wang, J., & Song, H. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3051470 · Cited by 111
Domain Adaptation in Regression
Cortes, C., & Mohri, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24412-4_25 · Cited by 110
CrossNorm and SelfNorm for Generalization under Distribution Shifts
Tang, Z., Gao, Y., Zhu, Y., Zhang, Z., Li, M., & Metaxas, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00012 · Cited by 107
Open Set Domain Adaptation for Image and Action Recognition
Busto, P. P., Iqbal, A., & Gall, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2880750 · Cited by 101
Bidirectional Adversarial Training for Semi-Supervised Domain Adaptation
Pin, J., Wu, A., Han, Y., Shao, Y., Qi, M., & Li, B. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/130 · Cited by 99
Different Set Domain Adaptation for Brain-Computer Interfaces: A Label Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.2980299 · Cited by 98
Self-citationAttention-Based Multi-Source Domain Adaptation
Zuo, Y., Yao, H., & Xu, C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3065254 · Cited by 95
Moreno, O., Shapira, B., Rokach, L., et al. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2396817 · Cited by 90
Positive and negative transfer in analogical problem solving by 6-year-old children
Chen, Z., & Daehler, M. W. (1989) · Cognitive Development · doi:10.1016/s0885-2014(89)90031-2 · Cited by 87
Zhang, X., Wu, D., Ding, L., Luo, H., Lin, C.-T., Jung, T., & Chavarriaga, R. (2020) · National Science Review · doi:10.1093/nsr/nwaa233 · Cited by 84
Self-citationDomain Adaptation by Class Centroid Matching and Local Manifold Self-Learning
Tian, L., Tang, Y., Hu, L., Ren, Z., & Zhang, W. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3031220 · Cited by 82
Self-citationTune it the Right Way: Unsupervised Validation of Domain Adaptation via Soft Neighborhood Density
Saito, K., Kim, D., Teterwak, P., Sclaroff, S., Darrell, T., & Saenko, K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00905 · Cited by 80
Wu, D., Lawhern, V. J., Hairston, W. D., & Lance, B. J. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2544108 · Cited by 74
Self-citationLong, M., Wang, J., Ding, G., Cheng, W., Zhang, X., & Wang, W. (2012) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.47 · Cited by 71
Negative transfer detection in transductive transfer learning
Gui, L., Xu, R., Lu, Q., Du, J., & Zhou, Y. (2017) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-016-0634-8 · Cited by 67
Learning Transferable Parameters for Unsupervised Domain Adaptation
Han, Z., Sun, H., & Yin, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3184848 · Cited by 66
Peng, Z., Zhang, W., Han, N., Fang, X., Kang, P., & Teng, L. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2900467 · Cited by 64
Self-citationGradient Distribution Alignment Certificates Better Adversarial Domain Adaptation
Gao, Z., Zhang, S., Huang, K., Wang, Q., & Zhong, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00881 · Cited by 63
Adversarial Weighting for Domain Adaptation in Regression
de Mathelin, A., Richard, G., Deheeger, F., Mougeot, M., & Vayatis, N. (2021) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai52525.2021.00015 · Cited by 62
Selective Transfer Between Learning Tasks Using Task-Based Boosting
Eaton, E., & desJardins, M. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7932 · Cited by 60
Importance Weighted Inductive Transfer Learning for Regression
Garcke, J., & Vanck, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44848-9_30 · Cited by 59
Combating Negative Transfer From Predictive Distribution Differences
Seah, C.-W., Ong, Y.-S., & Tsang, I. W.-H. (2012) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2225102 · Cited by 59
A Novel Positive Transfer Learning Approach for Telemonitoring of Parkinson’s Disease
Yoon, H., & Li, J. (2018) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2018.2874233 · Cited by 58
Zhang, X. L., Wu, D., Ding, L., Luo, H., Lin, C.-T., Jung, T., & Chavarriaga, R. (2020) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-20507 · Cited by 57
Self-citationDynamic Classifier Alignment for Unsupervised Multi-Source Domain Adaptation
Li, K., Lü, J., Zuo, H., & Zhang, G. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3144423 · Cited by 55
Universal adversarial perturbations for CNN classifiers in EEG-based BCIs
Liu, Z., Meng, L., Zhang, X. L., Fang, W., & Wu, D. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac0f4c · Cited by 54
Self-citationWu, D., Lance, B. J., & Lawhern, V. J. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6974353 · Cited by 50
Self-citationVirtual to Real-World Transfer Learning: A Systematic Review
Ranaweera, M., & Mahmoud, Q. H. (2021) · Electronics · doi:10.3390/electronics10121491 · Cited by 49
EEG-Based Brain–Computer Interfaces are Vulnerable to Backdoor Attacks
Meng, L., Jiang, X., Huang, J., Zeng, Z., Yu, S. P., Jung, T., Lin, C., Chavarriaga, R., & Wu, D. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3273214 · Cited by 46
Self-citationIshii, M., & Sugiyama, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.10842 · Cited by 44
A Principled Approach for Learning Task Similarity in Multitask Learning
Shui, C., Abbasi, M., Robitaille, L.-É., Wang, B., & Gagné, C. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/478 · Cited by 44
Source Model Selection for Deep Learning in the Time Series Domain
Meiseles, A., & Rokach, L. (2020) · IEEE Access · doi:10.1109/access.2019.2963742 · Cited by 42
Imbalanced Source-free Domain Adaptation
Li, X., Li, J., Zhu, L., Wang, G., & Huang, Z. H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475487 · Cited by 37
da Silva, R. P., Suphavilai, C., & Nagarajan, N. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab299 · Cited by 34
A study of the effects of negative transfer on deep unsupervised domain adaptation methods
Jiménez-Guarneros, M., & Gómez‐Gil, P. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114088 · Cited by 28
Transfer learning based clinical concept extraction on data from multiple sources
Lv, X., Guan, Y., & Benyang, D. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.05.006 · Cited by 24
Unsupervised Multi-source Domain Adaptation for Regression
Richard, G., de Mathelin, A., Hébrail, G., Mougeot, M., & Vayatis, N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67658-2_23 · Cited by 24
Hypothesis Disparity Regularized Mutual Information Maximization
Lao, Q., Jiang, X., & Havaei, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.17003 · Cited by 24
Multi-component transfer metric learning for handling unrelated source domain samples
Yi, C., Xu, Y., Yu, H., Yan, Y., & Liu, Y. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106132 · Cited by 23
Towards Making Deep Transfer Learning Never Hurt
Wan, R., Xiong, H., Li, X., Zhu, Z., & Huan, J. (2019) · Proceedings · doi:10.1109/icdm.2019.00068 · Cited by 19
Ibrahim, S., Ponomareva, N., & Mazumder, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26387-3_42 · Cited by 15
Adapted Tree Boosting for Transfer Learning
Fang, W., Chen, C., Song, B., Wang, L., Zhou, J., & Zhu, K. Q. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006028 · Cited by 13
Deep Face Detector Adaptation Without Negative Transfer or Catastrophic Forgetting
Jamal, M. A., Li, H., & Gong, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00588 · Cited by 12
A Selective Transfer Learning Method for Concept Drift Adaptation
Xie, G., Sun, Y., Lin, M., & Tang, K. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59081-3_42 · Cited by 10
Sorocky, M. J., Zhou, S., & Schoellig, A. P. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.3005886 · Cited by 10
Non-Negative Transfer Learning With Consistent Inter-Domain Distribution
Peng, Z., Jia, Y., & Hou, J. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3025061 · Cited by 10
Headless Horseman: Adversarial Attacks on Transfer Learning Models
Abdelkader, A., Curry, M. J., Fowl, L., Goldstein, T., Schwarzschild, A., Shu, M., Studer, C., & Zhu, C. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053181 · Cited by 7
Continuous Transfer Learning with Label-informed Distribution AlignmentPreprint
Wu, J., & He, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03230 · Cited by 5
Graves, L., Nagisetty, V., & Ganesh, V. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17371 · Cited by 5
Cited by
Deep Transfer Learning for Bearing Fault Diagnosis: A Systematic Review Since 2016
Chen, X., Yang, R., Xue, Y., Huang, M., Ferrero, R., & Wang, Z. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3244237 · Cited by 516
Chen, J., Huang, R., Chen, Z., Mao, W., & Li, W. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110239 · Cited by 267
Transferability-Guided Cross-Domain Cross-Task Transfer Learning
Tan, Y., Zhang, E., Li, Y., Huang, S.-L., & Zhang, X.-P. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3358094 · Cited by 24
“Inthisarticle, we mainly investigate the transferability estimation problem with two representative transfer paradigms for neural networks [5], i.e., Retrain head and Finetune .”
Quantifying the Hardness of Bioactivity Prediction Tasks for Transfer Learning
Fooladi, H., Hirte, S., & Kirchmair, J. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00160 · Cited by 6
Luo, T.-J. (2026) · Cognitive Neurodynamics · doi:10.1007/s11571-026-10450-2
Metadata
- Authors
- Zhang, W., Deng, L., Zhang, L., & Wu, D.
- Venue
- IEEE/CAA Journal of Automatica Sinica
- Published
- 2023-02
- Volume
- 10
- Issue
- 2
- Pages
- 305-329
- ISSN
- 2329-9266 (ISSN-L)
- 2329-9274
- OpenAlex
- W4311404181
- Cited by
- 427
- References
- 143
- FWCI
- 23.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.