The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Domain Adaptation From Multiple Sources: A Domain-Dependent Regularization Approach
Abstract
In this paper, we propose a new framework called domain adaptation machine (DAM) for the multiple source domain adaption problem. Under this framework, we learn a robust decision function (referred to as target classifier) for label prediction of instances from the target domain by leveraging a set of base classifiers which are prelearned by using labeled instances either from the source domains or from the source domains and the target domain. With the base classifiers, we propose a new domain-dependent regularizer based on smoothness assumption, which enforces that the target classifier shares similar decision values with the relevant base classifiers on the unlabeled instances from the target domain. This newly proposed regularizer can be readily incorporated into many kernel methods (e.g., support vector machines (SVM), support vector regression, and least-squares SVM (LS-SVM)). For domain adaptation, we also develop two new domain adaptation methods referred to as FastDAM and UniverDAM. In FastDAM, we introduce our proposed domain-dependent regularizer into LS-SVM as well as employ a sparsity regularizer to learn a sparse target classifier with the support vectors only from the target domain, which thus makes the label prediction on any test instance very fast. In UniverDAM, we additionally make use of the instances from the source domains as Universum to further enhance the generalization ability of the target classifier. We evaluate our two methods on the challenging TRECIVD 2005 dataset for the large-scale video concept detection task as well as on the 20 newsgroups and email spam datasets for document retrieval. Comprehensive experiments demonstrate that FastDAM and UniverDAM outperform the existing multiple source domain adaptation methods for the two applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,123
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,388
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Self-citation(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 3,844
(2006) · Cited by 3,624
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
An introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Advances in Large-Margin Classifiers
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,869
Integrating structured biological data by Kernel Maximum Mean Discrepancy
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl242 · Cited by 1,674
Correcting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Domain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543
Frustratingly Easy Domain Adaptation
Daumé, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0907.1815 · Cited by 1,383
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
Learning Multiple Tasks with Kernel Methods
Evgeniou, T., Micchelli, C. A., & Pontil, M. (2005) · doi:10.5555/1046920.1088693 · Cited by 799
Detecting Change in Data Streams
Kifer, D., Ben-David, S., & Gehrke, J. (2004) · Proceedings 2004 VLDB Conference · doi:10.1016/b978-012088469-8.50019-x · Cited by 789
Benchmarking Least Squares Support Vector Machine Classifiers
van Gestel, T., Suykens, J. A. K., Baesens, B., Viaene, S., Vanthienen, J., Dedene, G., de Moor, B., & Vandewalle, J. (2004) · Machine Learning · doi:10.1023/b:mach.0000008082.80494.e0 · Cited by 745
Direct importance estimation with model selection and its application to covariate shift adaptation
Sugiyama, M., Nakajima, S., Kashima, H., von Bünau, P., & Kawanabe, M. (2009) · Cited by 679
Cross-domain video concept detection using adaptive svms
Yang, J., Yan, R., & Hauptmann, A. G. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291276 · Cited by 667
Large-Scale Concept Ontology for Multimedia
Naphade, M., Smith, J. R., Tesic, J., Chang, S.-F., Hsu, W., Kennedy, L., Hauptmann, A., & Curtis, J. (2006) · IEEE Multimedia · doi:10.1109/mmul.2006.63 · Cited by 648
Frustratingly Easy Domain Adaptation
Daum, H. (2007) · Cited by 601
Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy
Bruzzone, L., & Marconcini, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.57 · Cited by 591
Domain Adaptation: Learning Bounds and Algorithms
Mansour, Y., Mohri, M., & Rostamizadeh, A. (2009) · arXiv · doi:10.48550/arxiv.0902.3430 · Cited by 504
Beyond the point cloud: from transductive to semi-supervised learning
Sindhwani, V., Niyogi, P., & Belkin, M. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102455 · Cited by 439
(2008) · Cited by 436
To transfer or not to transfer
Rosenstein, M. T. (2005) · neural information processing systems · Cited by 430
Visual Event Recognition in Videos by Learning from Web Data
Duan, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.265 · Cited by 409
Self-citationLearning Bounds for Domain Adaptation
Blitzer, J. C., Crammer, K., Kulesza, A., Pereira, F. M. B., & Wortman, J. R. (2007) · Cited by 393
Improving SVM accuracy by training on auxiliary data sources
Wu, P., & Dietterich, T. G. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015436 · Cited by 301
Domain adaptation from multiple sources via auxiliary classifiers
Duan, L., Tsang, I. W., Xu, D., & Chua, T.-S. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553411 · Cited by 289
Self-citationLearning from Multiple Sources
Crammer, K., Kearns, M., & Wortman, J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0045 · Cited by 266
Domain Transfer SVM for video concept detection
Duan, L., Tsang, I. W., Xu, D., & Maybank, S. J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206747 · Cited by 255
Self-citationWeston, J., Collobert, R., Sinz, F., Bottou, L., & Vapnik, V. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143971 · Cited by 209
Impossibility Theorems for Domain Adaptation
Ben-David, S., Lu, T., Luu, T. V., & Pál, D. (2010) · Cited by 200
An Empirical Analysis of Domain Adaptation Algorithms for Genomic Sequence Analysis
Schweikert, G., Rätsch, G., Widmer, C., & Schölkopf, B. (2008) · Cited by 144
Transfer learning from multiple source domains via consensus regularization
Luo, P., Zhuang, F., Xiong, H., Xiong, Y., & He, Q. (2008) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1458082.1458099 · Cited by 117
Visual event recognition in videos by learning from web data
Duan, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539870 · Cited by 107
Self-citationMixture Regression for Covariate Shift
Storkey, A., & Sugiyama, M. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0172 · Cited by 106
Multi-Task Learning via Conic Programming
Kato, T., Kashima, H., Sugiyama, M., & Asai, K. (2007) · Cited by 98
An Analysis of Inference with the Universum
Chapelle, O., Agarwal, A., Sinz, F. H., & Schölkopf, B. (2007) · Cited by 95
Domain Transfer SVM for video concept detection
Duan, L., Tsang, I. W.-H., Xu, D., & Maybank, S. J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206747 · Cited by 91
Self-citationLarge-Scale Sparsified Manifold Regularization
Tsang, I. W.-H., & Kwok, J. T.-Y. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0180 · Cited by 71
Self-citationChang, S., He, J., Jiang, Y., Khoury, E., Ngo, C., Yanagawa, A., & Zavesky, E. (2008) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 69
A Multitask Learning Model for Online Pattern Recognition
Ozawa, S., Roy, A., & Roussinov, D. G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2007961 · Cited by 59
Semi-Supervised Learning Using Semi-Definite Programming
Bie, T. D., & Cristianini, N. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/6173.003.0011 · Cited by 47
Sheldon, D. R. (2008) · eCommons (Cornell University) · Cited by 33
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 899
Collaborative and Adversarial Network for Unsupervised Domain Adaptation
Zhang, W., Ouyang, W., Li, W., & Xu, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00400 · Cited by 503
Self-citationScatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization
Ghifary, M., Balduzzi, D., Kleijn, W. B., & Zhang, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599532 · Cited by 471
Metadata
- Authors
- Duan, L., Xu, D., & Tsang, I. W.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2012-03
- Volume
- 23
- Issue
- 3
- Pages
- 504-518
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1981658663
- Cited by
- 332
- References
- 54
- FWCI
- 20.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.