The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Transfer Learning with Dynamic Adversarial Adaptation Network
Open accessAbstract
The recent advances in deep transfer learning reveal that adversarial learning can be embedded into deep networks to learn more transferable features to reduce the distribution discrepancy between two domains. Existing adversarial domain adaptation methods either learn a single domain discriminator to align the global source and target distributions, or pay attention to align subdomains based on multiple discriminators. However, in real applications, the marginal (global) and conditional (local) distributions between domains are often contributing differently to the adaptation. There is currently no method to dynamically and quantitatively evaluate the relative importance of these two distributions for adversarial learning. In this paper, we propose a novel Dynamic Adversarial Adaptation Network (DAAN) to dynamically learn domain-invariant representations while quantitatively evaluate the relative importance of global and local domain distributions. To the best of our knowledge, DAAN is the first attempt to perform dynamic adversarial distribution adaptation for deep adversarial learning. DAAN is extremely easy to implement and train in real applications. We theoretically analyze the effectiveness of DAAN, and it can also be explained in an attention strategy. Extensive experiments demonstrate that DAAN achieves better classification accuracy compared to state-of-the-art deep and adversarial methods. Results also imply the necessity and effectiveness of the dynamic distribution adaptation in adversarial transfer learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 2×
“Unsupervised domain adaptation is a specific area of transfer learning [3], which is to learn a discriminative model in the presence of the domain shift between domains.”
BackgroundLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(2017) · Cited by 11,625
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 2×
“Recent studies have indicated that deep networks can learn more transferable features for domain adaptation [12], [13].”
BackgroundAdversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
Self-citationDeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 3×
“Recent studies have indicated that deep networks can learn more transferable features for domain adaptation [12], [13].”
BackgroundMethodDeep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
Unsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Deep Hashing Network for Unsupervised Domain Adaptation
Venkateswara, H., Eusebio, J., Chakraborty, S., & Panchanathan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.572 · Cited by 2,171
Geodesic flow kernel for unsupervised domain adaptation
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247911 · Cited by 2,093
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Self-citationZagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 6×
“(6) And we calculate the local A-distance as: dA,l(Dcs,Dct ) = 2(1− 2(Lcl )), (7) where Dcs and D c t denote samples from class c and L c l is the local subdomain discriminator loss over class c. Eventually, the dynamic adversarial factor ω can be estimated as: ω̂ = dA,g(Ds,Dt) dA,g(Ds,Dt) + 1C ∑C c=1 dA,l(Dcs,Dct ) .”
BackgroundMethodInfluentialReturn of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 3×
“We compare our proposed Dynamic Adversarial Adaptation Network (DAAN) with several state-of-the-art deep unsupervised domain adaptation methods: • Deep residual learning [1] • Deep Domain Confusion (DDC) [33] • Deep Adaptation Network (DAN) [32] • Residual Transfer Network (RTN) [41] • Domain Adversarial Neural Networ…”
Correcting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Unsupervised Visual Domain Adaptation Using Subspace Alignment
Fernando, B., Habrard, A., Sebban, M., & Tuytelaars, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.368 · Cited by 1,314
Unsupervised Domain Adaptation with Residual Transfer Networks
Long, M., Han, Z., Wang, J., & Jordan, M. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04433 · Cited by 1,075
Self-citationMulti-Adversarial Domain Adaptation
Pei, Z., Cao, Z., Long, M., & Wang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11767 · Cited by 879
Self-citationVisual Domain Adaptation with Manifold Embedded Distribution Alignment
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., & Yu, P. S. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240512 · Cited by 638
Self-citationMind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation
Yan, H., Ding, Y., Li, P., Wang, Q., Xu, Y., & Zuo, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.107 · Cited by 613
Balanced Distribution Adaptation for Transfer Learning
Wang, J., Chen, Y., Hao, S., Feng, W., & Shen, Z. (2017) · 2017 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2017.150 · Cited by 589
Self-citationCollaborative and Adversarial Network for Unsupervised Domain Adaptation
Zhang, W., Ouyang, W., Li, W., & Xu, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00400 · Cited by 503
Supervised Representation Learning: Transfer Learning with Deep Autoencoders
Zhuang, F., Cheng, X., Luo, P., Pan, S. J., & He, Q. (2016) · Cited by 431
Learning Semantic Representations for Unsupervised Domain Adaptation
Xie, S., Zheng, Z., Chen, L., & Chen, C. (2018) · International Conference on Machine Learning · Cited by 419
Multi-representation adaptation network for cross-domain image classification
Zhu, Y., Zhuang, F., Wang, J., Chen, J., Shi, Z., Wu, W., & He, Q. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.07.010 · Cited by 286
Self-citationStratified Transfer Learning for Cross-domain Activity Recognition
Wang, J., Chen, Y., Hu, L., Peng, X., & Yu, P. S. (2018) · 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2018.8444572 · Cited by 253
Self-citationFew-Shot Adversarial Domain Adaptation
Motiian, S., Jones, Q., Iranmanesh, S. M., & Doretto, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02536 · Cited by 196
Co-regularized Alignment for Unsupervised Domain AdaptationPreprint
Kumar, A., Sattigeri, P., Wadhawan, K., Karlinsky, L., Feris, R., Freeman, W. T., & Wornell, G. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05443 · Cited by 186
Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learning
Zellinger, W., Grubinger, T., Lughofer, E. D., Natschläger, T., & Saminger‐Platz, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08811 · Cited by 184
Deep Transfer Learning for Cross-domain Activity Recognition
Wang, J., Zheng, V. W., Chen, Y., & Huang, M. (2018) · International Conference on Crowd Science and Engineering (ICCSE) · doi:10.1145/3265689.3265705 · Cited by 183
Self-citationSubspace Distribution Alignment for Unsupervised Domain Adaptation
Sun, B., & Saenko, K. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.24 · Cited by 168
Easy Transfer Learning By Exploiting Intra-Domain Structures
Wang, J., Chen, Y., Yu, H., Huang, M., & Yang, Q. (2019) · 2019 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00211 · Cited by 168
Self-citationCross Validation Framework to Choose amongst Models and Datasets for Transfer Learning
Zhong, E., Fan, W., Yang, Q., Verscheure, O., & Ren, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_35 · Cited by 132 · cited 1×
“Other Hyperparameters are tuned via transfer cross validation [44].”
MethodCross-position activity recognition with stratified transfer learning
Chen, Y., Wang, J., Huang, M., & Yu, H. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.04.004 · Cited by 96
Self-citationAccelerating Deep Unsupervised Domain Adaptation with Transfer Channel Pruning
Yu, C., Wang, J., Chen, Y., & Wu, Z. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851810 · Cited by 32
Self-citationCross-position Activity Recognition with Stratified Transfer LearningPreprint
Chen, Y., Wang, J., Huang, M., & Yu, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09776 · Cited by 22
Self-citation
Cited by
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
“[161] proposed a dynamic adversarial adaptation network.”
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
Zhang, Y., Li, W., Zhang, M., Wang, S., Tao, R., & Du, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3185795 · Cited by 340
Single-Source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification
Zhang, Y., Li, W., Sun, W., Tao, R., & Du, Q. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3243853 · Cited by 334
Zhang, Y., Li, W., Zhang, M., Qu, Y., Tao, R., & Qi, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3109872 · Cited by 304
Metadata
- Authors
- Yu, C., Wang, J., Chen, Y., & Huang, M.
- Venue
- 2019 IEEE International Conference on Data Mining (ICDM)
- Publisher
- IEEE
- Published
- 2019-11
- Pages
- 778-786
- ISSN
- 1550-4786 (ISSN-L)
- OpenAlex
- W3004205097
- Cited by
- 400
- References
- 44
- FWCI
- 12.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.