The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Wasserstein Distance Guided Representation Learning for Domain Adaptation
Open accessAbstract
Domain adaptation aims at generalizing a high-performance learner on a target domain via utilizing the knowledge distilled from a source domain which has a different but related data distribution. One solution to domain adaptation is to learn domain invariant feature representations while the learned representations should also be discriminative in prediction. To learn such representations, domain adaptation frameworks usually include a domain invariant representation learning approach to measure and reduce the domain discrepancy, as well as a discriminator for classification. Inspired by Wasserstein GAN, in this paper we propose a novel approach to learn domain invariant feature representations, namely Wasserstein Distance Guided Representation Learning (WDGRL). WDGRL utilizes a neural network, denoted by the domain critic, to estimate empirical Wasserstein distance between the source and target samples and optimizes the feature extractor network to minimize the estimated Wasserstein distance in an adversarial manner. The theoretical advantages of Wasserstein distance for domain adaptation lie in its gradient property and promising generalization bound. Empirical studies on common sentiment and image classification adaptation datasets demonstrate that our proposed WDGRL outperforms the state-of-the-art domain invariant representation learning approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 2×
“Even though the source and target domains have different marginal distributions (BenDavid et al. 2007; Pan and Yang 2010), domain adaptation aims at utilizing the knowledge distilled from the source domain to help target domain learning.”
BackgroundLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 4×
“However (Gulrajani et al. 2017) pointed out that weight clipping will cause capacity underuse and gradient vanishing or exploding problems.”
BackgroundInfluentialWeiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 3×
“Feature Visualization We randomly choose the D→E domain adaptation task of Amazon review dataset and plot in Figure 2 the t-SNE visualization following (Donahue et al. 2014; Long et al. 2016) to visualize the learned feature representations.”
MethodDeep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Geodesic flow kernel for unsupervised domain adaptation
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247911 · Cited by 2,093
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · HAL · Cited by 2,020
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 2×
“Motivated by theory in (Ben-David et al. 2007; 2010) suggesting that a good cross-domain representation contains no discriminative information about the origin (i.e. domain) of the input, domain adversarial neural network (DANN) (Ajakan et al. 2014; Ganin et al. 2016) was proposed to learn domain…”
Method(2007) · Cited by 2,018
Return of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 1×
“On the other hand, correlation alignment (CORAL) method (Sun, Feng, and Saenko 2016) was proposed to align the secondorder statistics of the source and target distributions with a linear transformation and (Sun and Saenko 2016) extended CORAL and proposed Deep CORAL to learn a nonlinear…”
MethodCorrecting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Bousmalis, K., Trigeorgis, G., Silberman, N., Krishnan, D., & Erhan, D. (2016) · arXiv · doi:10.48550/arxiv.1608.06019 · Cited by 1,208
Optimal Transport for Domain Adaptation
Courty, N., Flamary, R., Tuia, D., & Rakotomamonjy, A. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2615921 · Cited by 989
Marginalized Denoising Autoencoders for Domain Adaptation
Chen, M., Xu, Z., Weinberger, K. Q., & Sha, F. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.4683 · Cited by 498
Beyond Sharing Weights for Deep Domain Adaptation
Rozantsev, A., Salzmann, M., & Fua, P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2814042 · Cited by 462
(2008) · Cited by 436
Supervised Representation Learning: Transfer Learning with Deep Autoencoders
Zhuang, F., Cheng, X., Luo, P., Pan, S. J., & He, Q. (2016) · Cited by 431
Co-Training for Domain Adaptation
Chen, M., Weinberger, K. Q., & Blitzer, J. C. (2011) · Cited by 374
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05464 · Cited by 363
Selective Transfer Machine for Personalized Facial Action Unit Detection
Chu, W.-S., De la Torre, F., & Cohn, J. F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.451 · Cited by 307
Quantitative Concentration Inequalities for Empirical Measures on Non-compact Spaces
Bolley, F., Guillin, A., & Villani, C. (2007) · Probability Theory and Related Fields · doi:10.1007/s00440-006-0004-7 · Cited by 248
Domain-Adversarial Neural Networks
Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., & Marchand, M. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.4446 · Cited by 221
Duan, L., Xu, D., & Chang, S.-F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247819 · Cited by 193
Deep learning of transferable representation for scalable domain adaptation
Long, M., Wang, J., Cao, Y., Sun, J., & Yu, P. S. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2554549 · Cited by 191
Domain Adaptation with Regularized Optimal Transport
Courty, N., Flamary, R., & Tuia, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-44848-9_18 · Cited by 175
Theoretical Analysis of Domain Adaptation with Optimal Transport
Redko, I., Habrard, A., & Sebban, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71246-8_45 · Cited by 174
Sample Complexity of Testing the Manifold Hypothesis
Narayanan, H., & Mitter, S. K. (2010) · Cited by 148
Asymmetric and Category Invariant Feature Transformations for Domain Adaptation
Hoffman, J., Rodner, E., Donahue, J., Kulis, B., & Saenko, K. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0719-3 · Cited by 113
Automatic Feature Decomposition for Single View Co-training
Chen, M., Chen, Y., & Weinberger, K. Q. (2011) · Cited by 85
Asymmetric Transfer Learning with Deep Gaussian Processes
Kandemir, M. (2015) · Cited by 49
Close Yet Distinctive Domain AdaptationPreprint
Luo, L.-K., Wang, X.-F., Hu, S.-Q., Wang, C., Tang, Y.-X., & Chen, L. (2017) · arXiv.org · doi:10.48550/arxiv.1704.04235 · Cited by 19
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Deep visual domain adaptation: A survey
Wang, M., & Deng, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.083 · Cited by 2,209
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
A Review of Domain Adaptation without Target Labels
Kouw, W. M., & Loog, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2945942 · Cited by 613
WILDS: A Benchmark of in-the-Wild Distribution Shifts
Koh, P. W., Sagawa, S., Marklund, H., Xie, S. M., Zhang, M., Balsubramani, A., Hu, W., Yasunaga, M., Phillips, R. L., Gao, I., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07421 · Cited by 518
Metadata
- Authors
- Shen, J., Qu, Y., Zhang, W., & Yu, Y.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-29
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2770645414
- Cited by
- 862
- References
- 41
- FWCI
- 34.95
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.