The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Beyond Sharing Weights for Deep Domain Adaptation
Open accessAbstract
The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too expensive or impractical. Domain Adaptation has therefore emerged as a solution to this problem; It leverages annotated data from a source domain, in which it is abundant, to train a classifier to operate in a target domain, in which it is either sparse or even lacking altogether. In this context, the recent trend consists of learning deep architectures whose weights are shared for both domains, which essentially amounts to learning domain invariant features. Here, we show that it is more effective to explicitly model the shift from one domain to the other. To this end, we introduce a two-stream architecture, where one operates in the source domain and the other in the target domain. In contrast to other approaches, the weights in corresponding layers are related but not shared. We demonstrate that this both yields higher accuracy than state-of-the-art methods on several object recognition and detection tasks and consistently outperforms networks with shared weights in both supervised and unsupervised settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“The simplest approach involves fine-tuning a Convolutional Neural Network (CNN) pre-trained on the source data using labeled target samples [5], [6].”
MethodAdapting visual category models to new domains
Saenko, K., Kulis, B., Fritz, M., & Darrell, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_16 · Cited by 2,847
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
A database for handwritten text recognition research
Hull, J. J. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.291440 · Cited by 2,244
A Kernel Method for the Two-Sample-Problem
Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., & Smola, A. J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0069 · Cited by 2,167
Neural Networks: Tricks of the Trade: Second Edition
(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116
Geodesic flow kernel for unsupervised domain adaptation
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247911 · Cited by 2,093
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Return of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 1×
“A similar idea was followed in [44] to minimize the difference in second order feature statistics using the CORAL loss [45] and to relate higher order feature statistics in [46].”
MethodCorrecting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · HAL · Cited by 1,566
Cross-Stitch Networks for Multi-task Learning
Misra, I., Shrivastava, A., Gupta, A., & Hebert, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.433 · Cited by 1,397
Unsupervised Visual Domain Adaptation Using Subspace Alignment
Fernando, B., Habrard, A., Sebban, M., & Tuytelaars, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.368 · Cited by 1,314
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1606.04671 · Cited by 1,307
Bousmalis, K., Trigeorgis, G., Silberman, N., Krishnan, D., & Erhan, D. (2016) · arXiv · doi:10.48550/arxiv.1608.06019 · Cited by 1,208
Simultaneous Deep Transfer Across Domains and Tasks
Tzeng, E., Hoffman, J., Darrell, T., & Saenko, K. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.463 · Cited by 1,149
GradientBased Learning Applied to Document Recognition
(2009) · Intelligent Signal Processing · doi:10.1109/9780470544976.ch9 · Cited by 1,135
Unsupervised Domain Adaptation with Residual Transfer Networks
Long, M., Han, Z., Wang, J., & Jordan, M. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04433 · Cited by 1,075
Domain adaptation for object recognition: An unsupervised approach
Gopalan, R., Li, R., & Chellappa, R. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126344 · Cited by 1,053
Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation
Ghifary, M., Kleijn, W. B., Zhang, M., Balduzzi, D., & Li, W. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_36 · Cited by 877
Domain Adaptation for Statistical Classifiers
Daume III, H., & Marcu, D. (2006) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1872 · Cited by 816
Neural Networks: Tricks of the Trade
(1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8 · Cited by 810
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
What you saw is not what you get: Domain adaptation using asymmetric kernel transforms
Kulis, B., Saenko, K., & Darrell, T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995702 · Cited by 688
Domain Transfer Multiple Kernel Learning
Duan, L., Tsang, I. W., & Xu, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.114 · Cited by 548
Digital video and HDTV algorithms and interfaces
(2003) · Choice Reviews Online · doi:10.5860/choice.40-6437 · Cited by 545
Bregman Divergence-Based Regularization for Transfer Subspace Learning
Si, S., Tao, D., & Geng, B. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.126 · Cited by 477
Gong, B., Grauman, K. L., & Sha, F. (2013) · Cited by 459
Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation
Li, W., Duan, L., Xu, D., & Tsang, I. W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.167 · Cited by 449
Unsupervised Domain Adaptation by Domain Invariant Projection
Baktashmotlagh, M., Harandi, M. T., Lovell, B. C., & Salzmann, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.100 · Cited by 448
Self-citationDomain Adaptive Neural Networks for Object Recognition
Ghifary, M., Kleijn, W. B., & Zhang, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13560-1_76 · Cited by 437
Correlation Alignment for Unsupervised Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_8 · Cited by 417
Visual Event Recognition in Videos by Learning from Web Data
Duan, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.265 · Cited by 409
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390303 · Cited by 380
Covariate Shift by Kernel Mean Matching
Gretton, A., Smola, A., Huang, J., Schmittfull, M., Borgwardt, K., & Schölkopf, B. (2008) · Dataset Shift in Machine Learning · doi:10.7551/mitpress/9780262170055.003.0008 · Cited by 378
Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks
Jin, J., Fu, K., & Zhang, C. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2308281 · Cited by 310
Domain Transfer SVM for video concept detection
Duan, L., Tsang, I. W., Xu, D., & Maybank, S. J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206747 · Cited by 255
Learning Transferrable Representations for Unsupervised Domain Adaptation
Şener, O., Song, H. O., Saxena, A., & Savarese, S. (2016) · neural information processing systems · Cited by 244
Deep domain adaptation for describing people based on fine-grained clothing attributes
Chen, Q., Huang, J., Feris, R., Brown, L. M., Dong, J., & Yan, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299169 · Cited by 241
Exploiting weakly-labeled Web images to improve object classification: a domain adaptation approach
Bergamo, A., & Torresani, L. (2010) · Cited by 213
Feature Selection for Multimedia Analysis by Sharing Information Among Multiple Tasks
Yang, Y., Ma, Z., Hauptmann, A. G., & Sebe, N. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2237023 · Cited by 202
Learning Cross-Domain Landmarks for Heterogeneous Domain Adaptation
Tsai, Y.-H. H., Yeh, Y.-R., & Wang, Y.-C. F. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.549 · Cited by 189
Memory Bounded Deep Convolutional NetworksPreprint
Collins, M. D., & Kohli, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1442 · Cited by 184
On rendering synthetic images for training an object detector
Rozantsev, A., Lepetit, V., & Fua, P. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.12.006 · Cited by 142
Self-citationDLID: Deep learning for domain adaptation by interpolating between domains
Chopra, S., Balakrishnan, S., & Gopalan, R. (2013) · Cited by 127
Domain Generalization and Adaptation Using Low Rank Exemplar SVMs
Li, W., Xu, Z., Xu, D., Dai, D., & Gool, L. V. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2704624 · Cited by 121
Domain Adaptation by Mixture of Alignments of Second-or Higher-Order Scatter Tensors
Koniusz, P., Tas, Y., & Porikli, F. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.755 · Cited by 120
Domain Transfer SVM for video concept detection
Duan, L., Tsang, I. W.-H., Xu, D., & Maybank, S. J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206747 · Cited by 91
Frustratingly Easy NBNN Domain Adaptation
Tommasi, T., & Barbara Caputo, B. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.116 · Cited by 78
Knowledge Adaptation with PartiallyShared Features for Event DetectionUsing Few Exemplars
Ma, Z., Yang, Y., Sebe, N., & Hauptmann, A. G. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2306419 · Cited by 77
Bi-Shifting Auto-Encoder for Unsupervised Domain Adaptation
Kan, M., Shan, S., & Chen, X. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.438 · Cited by 64
Beyond the shortest path: Unsupervised domain adaptation by Sampling Subspaces along the Spline Flow
Caseiro, R., Henriques, J. F., Martins, P., & Batista, J. (2015) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2015.7299009 · Cited by 57
Joint cross-domain classification and subspace learning for unsupervised adaptation
Fernando, B., Tommasi, T., & Tuytelaars, T. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.07.009 · Cited by 50
Non-Linear Domain Adaptation with Boosting
Becker, C., Christoudias, C. M., & Fua, P. (2013) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 40
Self-citationVisual domain adaptation using weighted subspace alignment
Chen, S., Zhou, F., & Liao, Q. (2016) · Visual Communications and Image Processing · doi:10.1109/vcip.2016.7805516 · Cited by 20
Cross-Domain Object Recognition Using Object Alignment
Liu, P., Wang, C., Yang, P., et al. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.66 · Cited by 3
Cited by
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Deep visual domain adaptation: A survey
Wang, M., & Deng, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.083 · Cited by 2,209
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
Wasserstein Distance Guided Representation Learning for Domain Adaptation
Shen, J., Qu, Y., Zhang, W., & Yu, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11784 · Cited by 862
Unified Deep Supervised Domain Adaptation and Generalization
Motiian, S., Piccirilli, M., Adjeroh, D. A., & Doretto, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.609 · Cited by 803
Metadata
- Authors
- Rozantsev, A., Salzmann, M., & Fua, P.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-04-01
- Volume
- 41
- Issue
- 4
- Pages
- 801-814
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2312004824
- Cited by
- 462
- References
- 73
- FWCI
- 34.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.