The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Transfer learning using computational intelligence: A survey
Open accessAbstract
Transfer learning aims to provide a framework to utilize previously-acquired knowledge to solve new but similar problems much more quickly and effectively. In contrast to classical machine learning methods, transfer learning methods exploit the knowledge accumulated from data in auxiliary domains to facilitate predictive modeling consisting of different data patterns in the current domain. To improve the performance of existing transfer learning methods and handle the knowledge transfer process in real-world systems, computational intelligence has recently been applied in transfer learning. This paper systematically examines computational intelligence-based transfer learning techniques and clusters related technique developments into four main categories: (a) neural network-based transfer learning; (b) Bayes-based transfer learning; (c) fuzzy transfer learning, and (d) applications of computational intelligence-based transfer learning. By providing state-of-the-art knowledge, this survey will directly support researchers and practice-based professionals to understand the developments in computational intelligence-based transfer learning research and applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Zadeh, L. A. (1965) · Information and Control · doi:10.1016/s0019-9958(65)90241-x · Cited by 67,855
Zadeh, L. A. (1996) · Cited by 46,852
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
Decision-Making in a Fuzzy Environment
Bellman, R. E., & Zadeh, L. A. (1970) · Management Science · doi:10.1287/mnsc.17.4.b141 · Cited by 6,813
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Decision Making in a Fuzzy Environment
(2007) · Advances in Fuzzy Systems — Applications and Theory · doi:10.1142/9789812770622_0004 · Cited by 5,320
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,506
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515 · cited 1×
“The feature representation approaches can be categorized into two classes [11]: (A) Distribution similarity approaches aim explicitly to make the source and target domain sample distributions similar, either by penalizing or removing features whose statistics vary between domains [24, 30-32] or by learning a feature s…”
BackgroundText classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
A Tutorial on Learning with Bayesian Networks
Heckerman, D. (2008) · Studies in Computational Intelligence · doi:10.1007/978-3-540-85066-3_3 · Cited by 1,693
Improving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
Correcting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Domain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543 · cited 1×
“…statistics vary between domains [24, 30-32] or by learning a feature space projection in which a distribution divergence statistic is minimized [33-35]; (B) Latent feature approaches aim to construct new features by analyzing large amounts of unlabeled source and target domain data [25, 36-42].”
BackgroundA Tutorial on Learning with Bayesian Networks
Heckerman, D. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_11 · Cited by 1,220
Caruana, R. (1998) · Cited by 1,110
Friedman, N., & Koller, D. (2003) · Machine Learning · doi:10.1023/a:1020249912095 · Cited by 811
Cross-domain sentiment classification via spectral feature alignment
Pan, S. J., Ni, X., Sun, J.-T., Yang, Q., & Chen, Z. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772767 · Cited by 780
Instance Weighting for Domain Adaptation in NLP
Jiang, J., & Zhai, C. (2007) · Cited by 765
My own book review : The Irrational Organization
Brunsson, N. (2014) · Management Science · Cited by 726
Multitask Learning: A Knowledge-Based Source of Inductive Bias
Caruana, R. A. (1993) · Machine Learning Proceedings 1993 · doi:10.1016/b978-1-55860-307-3.50012-5 · Cited by 679
Direct importance estimation with model selection and its application to covariate shift adaptation
Sugiyama, M., Nakajima, S., Kashima, H., von Bünau, P., & Kawanabe, M. (2009) · Cited by 679
Transfer learning via dimensionality reduction
Pan, S. J., Kwok, J. T.-Y., & Yang, Q. (2008) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 653
Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers
Huang, J.-T., Li, J., Yu, D., Deng, L., & Gong, Y. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639081 · Cited by 595
(1995) · Cited by 520
Transfer learning for cross-company software defect prediction
Ma, Y., Luo, G., Zeng, X., & Chen, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.007 · Cited by 475
A guide to the literature on learning probabilistic networks from data
Buntine, W. (1996) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.494161 · Cited by 468
Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., & Spyropoulos, C. D. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345569 · Cited by 465
Customizing Sentiment Classifiers to New Domains: a Case Study
Aue, A., & Gamon, M. (2005) · International conference Recent advances in natural language processing · Cited by 437
Detecting Concept Drift with Support Vector Machines
Klinkenberg, R., & Joachims, T. (2000) · Cited by 422
Learning Bounds for Domain Adaptation
Blitzer, J. C., Crammer, K., Kulesza, A., Pereira, F. M. B., & Wortman, J. R. (2007) · Cited by 393
Exact Bayesian Structure Discovery in Bayesian Networks
Koivisto, M., & Sood, K. (2004) · Cited by 373
Knowledge transfer via multiple model local structure mapping
Gao, J., Fan, W., Jiang, J., & Han, J. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401928 · Cited by 330
Transferring naive bayes classifiers for text classification
Dai, W., Xue, G.-R., Yang, Q., & Yu, Y. H. (2007) · Cited by 325
INDUCTIVE AND BAYESIAN LEARNING IN MEDICAL DIAGNOSIS
KONONENKO, I. (1993) · Applied Artificial Intelligence · doi:10.1080/08839519308949993 · Cited by 302
Multi-task reinforcement learning: a hierarchical Bayesian approach
Wilson, A., Fern, A., Ray, S., & Tadepalli, P. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273624 · Cited by 261
Reranking and self-training for parser adaptation
McClosky, D., Charniak, E., & Johnson, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220218 · Cited by 235
Dependency Parsing and Domain Adaptation with LR Models and Parser Ensembles
Sagae, K., & Tsujii, J. (2007) · Cited by 230
Text classification without negative examples revisit
Fung, G. P. C., Yu, J. X., Lu, H., & Yu, P. S. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.16 · Cited by 221
Transfer learning for Latin and Chinese characters with Deep Neural Networks
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252544 · Cited by 209
A Comparative Study of Methods for Transductive Transfer Learning
Arnold, A. O., Nallapati, R., & Cohen, W. W. (2007) · doi:10.1109/icdmw.2007.2 · Cited by 200
A Comparative Study of Methods for Transductive Transfer Learning
Arnold, A., Nallapati, R., & Cohen, W. W. (2007) · Seventh IEEE International Conference on Data Mining Workshops (ICDMW 2007) · doi:10.1109/icdmw.2007.109 · Cited by 198
Transfer Learning via Inter-Task Mappings for Temporal Difference Learning
Taylor, M. E., Stone, P., & Liu, Y. (2007) · doi:10.5555/1314498.1314569 · Cited by 195
Topic-bridged PLSA for cross-domain text classification
Xue, G.-R., Dai, W., Yang, Q., & Yu, Y. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390441 · Cited by 193
Adapting Naive Bayes to Domain Adaptation for Sentiment Analysis
Tan, S., Cheng, X., Wang, Y., & Xu, H. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-00958-7_31 · Cited by 188
One-Shot Learning with a Hierarchical Nonparametric Bayesian Model
Salakhutdinov, R., Tenenbaum, J. B., & Torralba, A. B. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 186
Ahmed, A. A., Yu, K., Xu, W. H., Gong, Y., & Xing, E. P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_6 · Cited by 179
Hierarchical Bayesian domain adaptation
Finkel, J. R., & Manning, C. D. (2009) · Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09 · doi:10.3115/1620754.1620842 · Cited by 164
Classifier Ensembles with a Random Linear Oracle
Kuncheva, L. I., & Rodriguez, J. J. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.1016 · Cited by 160
Direct Density Ratio Estimation for Large-scale Covariate Shift Adaptation
Tsuboi, Y., Kashima, H., Hido, S., Bickel, S., & Sugiyama, M. (2009) · Journal of Information Processing · doi:10.2197/ipsjjip.17.138 · Cited by 137
Deng, Z., Choi, K., Jiang, Y., & Wang, S. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2311014 · Cited by 136
Bayesian multiple instance learning: automatic feature selection and inductive transfer
Raykar, V. C., Krishnapuram, B., Bi, J., Dündar, M., & Rao, R. B. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390258 · Cited by 134
Deep Learning of Invariant Features via Simulated Fixations in Video
Zou, W. Y., Shenghuo Zhu, B., Yu, K., & Ng, A. Y. (2012) · neural information processing systems · Cited by 129
The Task Rehearsal Method of Life-Long Learning: Overcoming Impoverished Data
Silver, D. L., & Mercer, R. E. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47922-8_8 · Cited by 127
A Lazy Approach to Associative Classification
Baralis, E., Chiusano, S., & Garza, P. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190677 · Cited by 124
A lifelong learning perspective for mobile robot control
Thrun, S. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1994.407413 · Cited by 122
A two-stage approach to domain adaptation for statistical classifiers
Jiang, J., & Zhai, C. (2007) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1321440.1321498 · Cited by 121
Unsupervised cross-lingual knowledge transfer in DNN-based LVCSR
Świętojański, P., Ghoshal, A. K., & Renals, S. J. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424230 · Cited by 116
Domain Adaptation of Conditional Probability Models Via Feature Subsetting
Satpal, S., & Sarawagi, S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74976-9_23 · Cited by 112
Supervised and unsupervised PCFG adaptation to novel domains
Brian Roark, A., & Bacchiani, M. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073445.1073472 · Cited by 97
Efficient classification across multiple database relations: a CrossMine approach
Yin, X., Han, J., Yang, J., & Yu, P. S. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.94 · Cited by 94
An EM Based Training Algorithm for Cross-Language Text Categorization
Rigutini, L., Maggini, M., & Liu, B. (2005) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1109/wi.2005.29 · Cited by 92
Distributional representations for handling sparsity in supervised sequence-labeling
Huang, F., & Yates, A. (2009) · doi:10.3115/1687878.1687948 · Cited by 92
Inductive Transfer for Bayesian Network Structure Learning
Niculescu-Mizil, A., & Caruana, R. (2007) · Cited by 91
Learning with knowledge from multiple experts
Richardson, M., & Domingos, P. (2003) · Cited by 89
Semi-supervised speech act recognition in emails and forums
Jeong, M., Lin, C.-Y., & Lee, G. G. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699648.1699671 · Cited by 80
Inductive transfer for learning Bayesian networks
Luis, R., Sucar, L. E., & Morales, E. F. (2009) · Machine Learning · doi:10.1007/s10994-009-5160-4 · Cited by 74
Neural network multitask learning for traffic flow forecasting
Jin, F., & Sun, S. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634057 · Cited by 74
Koçer, B., & Arslan, A. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.03.019 · Cited by 69
Extracting discriminative concepts for domain adaptation in text mining
Bo, C., Lam, W. P., Tsang, I. W.-H., & Wong, T.-L. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557045 · Cited by 67
Fuzzy Transfer Learning: Methodology and application
Shell, J., & Coupland, S. (2014) · Information Sciences · doi:10.1016/j.ins.2014.09.004 · Cited by 67
Fuzzy Refinement Domain Adaptation for Long Term Prediction in Banking Ecosystem
Behbood, V., Lü, J., & Zhang, G. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2012.2232935 · Cited by 60
Self-citationInductive transfer with context-sensitive neural networks
Silver, D. L., Poirier, R., & Currie, D. (2008) · Machine Learning · doi:10.1007/s10994-008-5088-0 · Cited by 52
Improving Deep Neural Network Performance by Reusing Features Trained with Transductive Transference
Kandaswamy, C., Silva, L. M., Alexandre, L. A., Santos, J. M., & de Sá, J. M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11179-7_34 · Cited by 48
Direct Density Ratio Estimation for Large-scale Covariate Shift Adaptation
Tsuboi, Y., Kashima, H., Hido, S., Bickel, S., & Sugiyama, M. (2008) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972788.40 · Cited by 45
Efficient Bayesian task-level transfer learning
Roy, D. M., & Kaelbling, L. P. (2007) · Cited by 38
Exploring Representation-Learning Approaches to Domain Adaptation
Huang, F., & Yates, A. (2010) · Cited by 34
Using Cases as Heuristics in Reinforcement Learning: A Transfer Learning Application
Junior, L. A. C., Matsuura, J. P., de Mántaras, R. L., & Bianchi, R. A. C. (2011) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · Cited by 28
Advances in Artificial Intelligence
Bergler, S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-68825-9 · Cited by 28
Open-Domain Semantic Role Labeling by Modeling Word Spans
Huang, F., & Yates, A. (2010) · Cited by 24
Leveraging Domain Knowledge in Multitask Bayesian Network Structure Learning
Oyen, D., & Lane, T. D. R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8302 · Cited by 23
Towards Fuzzy Transfer Learning for Intelligent Environments
Shell, J., & Coupland, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34898-3_10 · Cited by 20
Text categorization by fuzzy domain adaptation
Behbood, V., Lü, J., & Zhang, G. (2013) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2013.6622530 · Cited by 20
Self-citationFUZZY BRIDGED REFINEMENT DOMAIN ADAPTATION: LONG-TERM BANK FAILURE PREDICTION
Behbood, V., Lü, J., & Zhang, G. (2013) · International Journal of Computational Intelligence and Applications · doi:10.1142/s146902681350003x · Cited by 20
Self-citationBayesian Task-Level Transfer Learning for Non-linear Regression
Yang, P., Tan, Q., & Ding, Y. (2008) · doi:10.1109/csse.2008.1612 · Cited by 20
Domain Adaptation to Summarize Human Conversations
Sandu, O. A., Carenini, G., Murray, G., & Ng, R. T. (2010) · Cited by 17
Context-Sensitive MTL Networks for Machine Lifelong Learning.
Silver, D., & Poirier, R. (2007) · Cited by 15
Long term bank failure prediction using Fuzzy Refinement-based Transductive Transfer learning
Behbood, V., Lü, J., & Zhang, G. (2011) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzzy.2011.6007633 · Cited by 15
Self-citationSequential Inductive Transfer for Coronary Artery Disease Diagnosis
Silver, D. L., & Mercer, R. E. (2007) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2007.4371374 · Cited by 7
Shell, J. (2013) · DMU Open Research Archive (De Montfort University) · Cited by 6
Image Transformation: Inductive Transfer between Multiple Tasks Having Multiple Outputs
Silver, D. L., & Tu, L. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-68825-9_28 · Cited by 4
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Narin, A., Kaya, C., & Pamuk, Z. (2021) · Pattern Analysis and Applications · doi:10.1007/s10044-021-00984-y · Cited by 2,054
A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis
Wen, L., Gao, L., & Li, X. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2754287 · Cited by 1,095
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
Deep Model Based Domain Adaptation for Fault Diagnosis
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J., & Zhang, T. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2627020 · Cited by 761
Metadata
- Authors
- Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., & Zhang, G.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2015-05
- Volume
- 80
- Pages
- 14-23
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W1986614398
- Cited by
- 968
- References
- 97
- FWCI
- 50.99
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.