The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Adaptation Regularization: A General Framework for Transfer Learning
Abstract
Domain transfer learning, which learns a target classifier using labeled data from a different distribution, has shown promising value in knowledge discovery yet still been a challenging problem. Most previous works designed adaptive classifiers by exploring two learning strategies independently: distribution adaptation and label propagation. In this paper, we propose a novel transfer learning framework, referred to as Adaptation Regularization based Transfer Learning (ARTL), to model them in a unified way based on the structural risk minimization principle and the regularization theory. Specifically, ARTL learns the adaptive classifier by simultaneously optimizing the structural risk functional, the joint distribution matching between domains, and the manifold consistency underlying marginal distribution. Based on the framework, we propose two novel methods using Regularized Least Squares (RLS) and Support Vector Machines (SVMs), respectively, and use the Representer theorem in reproducing kernel Hilbert space to derive corresponding solutions. Comprehensive experiments verify that ARTL can significantly outperform state-of-the-art learning methods on several public text and image datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Self-citationDomain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Self-citation(2006) · Cited by 3,624
Graph Regularized Nonnegative Matrix Factorization for Data Representation
Cai, D., He, X., Han, J., & Huang, T. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.231 · Cited by 2,451
A Kernel Method for the Two-Sample-Problem
Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., & Smola, A. J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0069 · Cited by 2,167
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019
Boosting for transfer learning
Dai, W., Yang, Q., Xue, G.-R., & Yu, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273521 · Cited by 1,724
A Generalized Representer Theorem
Schölkopf, B., Herbrich, R., & Smola, A. J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_27 · Cited by 1,589
Domain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543
Argyriou, A., Evgeniou, T., & Pontil, M. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0010 · Cited by 1,333
Cross-domain sentiment classification via spectral feature alignment
Pan, S. J., Ni, X., Sun, J.-T., Yang, Q., & Chen, Z. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772767 · Cited by 780
Self-citationInstance Weighting for Domain Adaptation in NLP
Jiang, J., & Zhai, C. (2007) · Cited by 765
Cross-domain video concept detection using adaptive svms
Yang, J., Yan, R., & Hauptmann, A. G. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291276 · Cited by 667
Transfer learning via dimensionality reduction
Pan, S. J., Kwok, J. T.-Y., & Yang, Q. (2008) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 653
Self-citationDomain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy
Bruzzone, L., & Marconcini, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.57 · Cited by 591 · cited 1×
“2) Distribution Adaptation + Classifier Induction: These methods directly integrate the minimization of distribution difference as a regularization term to the standard supervised classifier [15]–[17], [19].”
MethodDomain Transfer Multiple Kernel Learning
Duan, L., Tsang, I. W., & Xu, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.114 · Cited by 548
Bregman Divergence-Based Regularization for Transfer Subspace Learning
Si, S., Tao, D., & Geng, B. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.126 · Cited by 477
Heterogeneous Domain Adaptation Using Manifold Alignment
Wang, C., & Mahadevan, S. (2011) · Cited by 400
Heterogeneous Transfer Learning for Image Classification
Zhu, Y., Chen, Y., Lu, Z., Pan, S., Xue, G.-R., Yu, Y., & Yang, Q. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8090 · Cited by 378
Self-citationTransfer learning for collaborative filtering via a rating-matrix generative model
Li, B., Yang, Q., & Xue, X. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553454 · Cited by 340
Co-clustering based classification for out-of-domain documents
Dai, W., Xue, G.-R., Yang, Q., & Yu, Y. (2007) · Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1281192.1281218 · Cited by 331
Knowledge transfer via multiple model local structure mapping
Gao, J., Fan, W., Jiang, J., & Han, J. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401928 · Cited by 330
What helps where – and why? Semantic relatedness for knowledge transfer
Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540121 · Cited by 273
Spectral Regression: A Unified Approach for Sparse Subspace Learning
Cai, D., He, X., & Han, J. (2007) · Seventh IEEE International Conference on Data Mining (ICDM 2007) · doi:10.1109/icdm.2007.89 · Cited by 212
Co-regularization Based Semi-supervised Domain Adaptation
Kumar, A., Saha, A., & Daumé, H. (2010) · neural information processing systems · Cited by 146
Large margin transductive transfer learning
Quanz, B., & Huan, J. (2009) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1645953.1646121 · Cited by 136
Spectral domain-transfer learning
Xiao, L., Dai, W., Xue, G.-R., Yang, Q., & Yu, Y. H. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401951 · Cited by 132
Semisupervised Multitask Learning
Liu, Q., Liao, X., Li, H., Stack, J. R., & Carin, L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.296 · Cited by 125
Cross domain distribution adaptation via kernel mapping
Zhong, E., Fan, W., Peng, J., Zhang, K., Ren, J., Turaga, D. S., & Verscheure, O. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557130 · Cited by 116
Transfer across Completely Different Feature Spaces via Spectral Embedding
Shi, X., Liu, Q., Fan, W., & Yu, P. S. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.252 · Cited by 81
Self-citationGraph-Based Semi-Supervised Learning and Spectral Kernel Design
Johnson, R., & Zhang, T. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.911294 · Cited by 78
Long, M., Wang, J., Ding, G., Cheng, W., Zhang, X., & Wang, W. (2012) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.47 · Cited by 71
Self-citationExtracting discriminative concepts for domain adaptation in text mining
Bo, C., Lam, W. P., Tsang, I. W.-H., & Wong, T.-L. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557045 · Cited by 67
On minimum distribution discrepancy support vector machine for domain adaptation
Tao, J., Chung, F.-L., & Wang, S. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.04.014 · Cited by 67
Knowledge Transfer with Low-Quality Data: A Feature Extraction Issue
Quanz, B., Huan, J., & Mishra, M. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.75 · Cited by 66
Zhuang, F., Luo, P., Shen, Z., He, Q., Xiong, Y., Shi, Z., & Xiong, H. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.143 · Cited by 47
Zhuang, F., Luo, P., Shen, Z., He, Q., Xiong, Y., Shi, Z., & Xiong, H. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.209 · Cited by 39
Transfer Learning with Graph Co-Regularization
Long, M., Wang, J., Ding, G., Shen, D., & Yang, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8290 · Cited by 36
Self-citationVideo summarization via transferrable structured learning
Li, L., Zhou, K., Xue, G.-R., et al. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963448 · Cited by 36
Learning with Minimum Supervision: A General Framework for Transductive Transfer Learning
Bahadori, M. T., Liu, Y., & Zhang, D. (2011) · Proceedings · doi:10.1109/icdm.2011.92 · Cited by 28
Semi-Supervised Kernel Matching for Domain Adaptation
Xiao, M., & Guo, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8292 · Cited by 22
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Deep Model Based Domain Adaptation for Fault Diagnosis
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J., & Zhang, T. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2627020 · Cited by 761
Visual Domain Adaptation with Manifold Embedded Distribution Alignment
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., & Yu, P. S. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240512 · Cited by 638
Self-citationTransfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
Metadata
- Authors
- Long, M., Wang, J., Ding, G., Pan, S. J., & Yu, P. S.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2014-05
- Volume
- 26
- Issue
- 5
- Pages
- 1076-1089
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2100664256
- Cited by
- 606
- References
- 43
- FWCI
- 20.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.