Generalizing to Unseen Domains: A Survey on Domain Generalization
The DOI matches its Crossref record; 287 of the 287 references it cites were found in a registry or an index.
Abstract
Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e., out-of-distribution generalization, has attracted increasing interests in recent years. Domain generalization deals with a challenging setting where one or several different but related domain(s) are given, and the goal is to learn a model that can generalize to an unseen test domain. Great progress has been made in the area of domain generalization for years. This paper presents the first review of recent advances in this area. First, we provide a formal definition of domain generalization and discuss several related fields. We then thoroughly review the theories related to domain generalization and carefully analyze the theory behind generalization. We categorize recent algorithms into three classes: data manipulation, representation learning, and learning strategy, and present several popular algorithms in detail for each category. Third, we introduce the commonly used datasets, applications, and our open-sourced codebase for fair evaluation. Finally, we summarize existing literature and present some potential research topics for the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The use of transformer-based architectures can model the long-range dependencies in images and helps to mitigate problems such as the domain gap [21] problem.”
From A survey on deep learning-based monocular spacecraft pose estimation: Current state, limitations and prospects (2023) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While synthetic data generation and laboratory data acquisition have been identified as the most tractable way to train and test such algorithms, the performance drops significantly on the test image domain compared to the train image domain, such problem being known as the domain gap [21].”
From A survey on deep learning-based monocular spacecraft pose estimation: Current state, limitations and prospects (2023) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,374
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Deep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124 · cited 1×
“[32] first used this method to generate more training data from the simulated environment for generalization”
MethodFixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
Sohn, K., Berthelot, D., Li, C.-L., Zhang, Z., Carlini, N., Cubuk, E. D., Kurakin, A., Zhang, H., & Raffel, C. (2020) · arXiv · doi:10.48550/arxiv.2001.07685 · Cited by 2,892
Adapting visual category models to new domains
Saenko, K., Kulis, B., Fritz, M., & Darrell, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_16 · Cited by 2,847
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
Unsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020) · arXiv · doi:10.48550/arxiv.2006.11477 · Cited by 2,369
Ros, G., Sellart, L., Materzynska, J., Vazquez, D., & Lopez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.352 · Cited by 2,338
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Deep visual domain adaptation: A survey
Wang, M., & Deng, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.083 · Cited by 2,209
Deep Hashing Network for Unsupervised Domain Adaptation
Venkateswara, H., Eusebio, J., Chakraborty, S., & Panchanathan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.572 · Cited by 2,171
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 2×
“of [179] theoretically proved that if the feature representations remain invariant to different domains, the representations are general and transferable to different domains (also refer to”
BackgroundReturn of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 5×
“(3) CORAL has slight improvements on both datasets compared to ERM, which is consistent with results offered by DomainBed [87].”
BackgroundMethodInfluentialPlaying for Data: Ground Truth from Computer Games
Richter, S. R., Vineet, V., Roth, S., & Koltun, V. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_7 · Cited by 1,815
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676 · cited 1×
“On the other hand, decentralized training is another possible solution [227].”
BackgroundMoment Matching for Multi-Source Domain Adaptation
Peng, X., Bai, Q., Xia, X., Huang, Z., Saenko, K., & Wang, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00149 · Cited by 1,621
Dataset Shift in Machine Learning
(2008) · doi:10.7551/mitpress/9780262170055.001.0001 · Cited by 1,553
Domain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543 · cited 1×
“For example, Amazon Review dataset [253] is widely used in”
MethodMeta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
Domain Generalization: A Survey
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315
Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
Peng, X. B., Andrychowicz, M., Zaremba, W., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460528 · Cited by 1,309 · cited 3×
“Similar techniques were also used in [26, 27, 28, 24] to strengthen the generalization capability of the models.”
MethodLearning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
Deeper, Broader and Artier Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.591 · Cited by 1,237
Domain Generalization with Adversarial Feature Learning
Li, H., Pan, S. J., Wang, S., & Kot, A. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00566 · Cited by 1,213
Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects
Ni, J., Li, J., & McAuley, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1018 · Cited by 1,200
Suitability of dysphonia measurements for telemonitoring of Parkinson’s disease
Little, M., McSharry, P., Hunter, E., Spielman, J., & Ramig, L. (2008) · Nature Precedings · doi:10.1038/npre.2008.2298.1 · Cited by 1,188
A perspective view and survey of meta-learning
Vilalta, R., & Drissi, Y. (2002) · Artificial Intelligence Review · doi:10.1023/a:1019956318069 · Cited by 1,108
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Y., Qin, X., Wang, J., Yu, C., & Gao, W. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988604 · Cited by 1,005
Self-citationArjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927
Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net
Pan, X., Luo, P., Shi, J., & Tang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_29 · Cited by 903
Domain Generalization with MixStylePreprint
Zhou, K., Yang, Y., Qiao, Y., & Xiang, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.02008 · Cited by 900
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 899
Meta-Learning in Neural Networks: A Survey
Hospedales, T. M., Antoniou, A., Micaelli, P., & Storkey, A. J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079209 · Cited by 886
Meta-Learning in Neural Networks: A Survey
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05439 · Cited by 886
Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization
Tremblay, J., Prakash, A., Acuna, D., Brophy, M., Jampani, V., Anil, C., To, T., Cameracci, E., Boochoon, S., & Birchfield, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00143 · Cited by 884
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
Domain Generalization by Solving Jigsaw Puzzles
Carlucci, F. M., D'Innocente, A., Bucci, S., Caputo, B., & Tommasi, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00233 · Cited by 813
Unified Deep Supervised Domain Adaptation and Generalization
Motiian, S., Piccirilli, M., Adjeroh, D. A., & Doretto, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.609 · Cited by 803
Just Train Twice: Improving Group Robustness without Training Group InformationPreprint
Liu, E., Haghgoo, B., Chen, A. S., Raghunathan, A., Koh, P. W., Sagawa, S., Liang, P., & Finn, C. (2021) · International Conference on Machine Learning · doi:10.48550/arxiv.2107.09044 · Cited by 782
Mixup: Beyond empirical risk minimization
Zhang, H. (2024) · arXiv (Cornell University) · doi:10.57702/dcy1c3gw · Cited by 773
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
A Learned Representation For Artistic Style
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 763
Domain Adaptation under Target and Conditional Shift
Zhang, K., Schölkopf, B., Muandet, K., & Wang, Z. (2013) · Max Planck Digital Library · Cited by 759
Recognition in Terra Incognita
Beery, S., Van Horn, G., & Perona, P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_28 · Cited by 679
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
Visual Domain Adaptation with Manifold Embedded Distribution Alignment
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., & Yu, P. S. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240512 · Cited by 638
Self-citationTolstikhin, I., Bousquet, O., Gelly, S., & Schölkopf, B. (2018) · MPG.PuRe (Max Planck Society) · Cited by 602
Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016) · arXiv · doi:10.48550/arxiv.1606.01540 · Cited by 582
Deep Domain Generalization via Conditional Invariant Adversarial Networks
Li, Y., Tian, X., Gong, M., Liu, Y., Liu, T., Zhang, K., & Tao, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_38 · Cited by 576
Bandi, P., Geessink, O., Manson, Q., Van Dijk, M., Balkenhol, M., Hermsen, M., Ehteshami Bejnordi, B., Lee, B., Paeng, K., Zhong, A., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2867350 · Cited by 569
A Fourier-based Framework for Domain Generalization
Xu, Q., Zhang, R., Zhang, Y., Wang, Y., & Tian, Q. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01415 · Cited by 561
Liu, Q., Chen, C., Qin, J., Dou, Q., & Heng, P.-A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00107 · Cited by 541
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
Lu, S., Guo, D., Ren, S., Huang, J., Svyatkovskiy, A., Blanco, A., Clement, C., Drain, D., Jiang, D., Tang, D., et al. (2021) · arXiv · doi:10.48550/arxiv.2102.04664 · Cited by 536
Self-challenging Improves Cross-Domain Generalization
Huang, Z., Wang, H., Xing, E. P., & Huang, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_8 · Cited by 530
A Survey of Zero-Shot Learning: Settings, Methods, and Applications
Wang, W., Zheng, V. W., Yu, H., & Miao, C. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3293318 · Cited by 528
WILDS: A Benchmark of in-the-Wild Distribution Shifts
Koh, P. W., Sagawa, S., Marklund, H., Xie, S. M., Zhang, M., Balsubramani, A., Hu, W., Yasunaga, M., Phillips, R. L., Gao, I., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07421 · Cited by 518 · cited 5×
“The last ten datasets are from WILDS [152].”
BackgroundMethodInfluentialFrameworks and Results in Distributionally Robust Optimization
Rahimian, H., & Mehrotra, S. (2022) · Open Journal of Mathematical Optimization · doi:10.5802/ojmo.15 · Cited by 506
Undoing the Damage of Dataset Bias
Khosla, A., Zhou, T., Malisiewicz, T., Efros, A. A., & Torralba, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_12 · Cited by 480
MetaReg: towards domain generalization using meta-regularization
Balaji, Y., Sankaranarayanan, S., & Chellappa, R. (2018) · neural information processing systems · Cited by 476
Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization
Ghifary, M., Balduzzi, D., Kleijn, W. B., & Zhang, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599532 · Cited by 471
Open Graph Benchmark: Datasets for Machine Learning on Graphs
Hu, W., Fey, M., Žitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., & Leskovec, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00687 · Cited by 470
FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling
Zhang, B., Wang, Y., Hou, W., Wu, H., Wang, J., Okumura, M., & Shinozaki, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08263 · Cited by 466
Self-citationLearning to Learn Single Domain Generalization
Qiao, F., Zhao, L., & Peng, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01257 · Cited by 455
In Search of Lost Domain Generalization
Gulrajani, I., & Lopez-Paz, D. (2020) · arXiv · doi:10.48550/arxiv.2007.01434 · Cited by 440
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Self-citationStyle Normalization and Restitution for Generalizable Person Re-Identification
Jin, X., Lan, C., Zeng, W., Chen, Z., & Zhang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00321 · Cited by 426
Self-citationYeh, C., Perez, A., Driscoll, A., Azzari, G., Tang, Z., Lobell, D., Ermon, S., & Burke, M. (2020) · Nature Communications · doi:10.1038/s41467-020-16185-w · Cited by 425
Out-of-Distribution Generalization via Risk Extrapolation (REx)
Krueger, D., Caballero, E., Jacobsen, J.-H., Zhang, A., Binas, J., Zhang, D., Priol, R. L., & Courville, A. (2020) · arXiv · doi:10.48550/arxiv.2003.00688 · Cited by 407
Multi-Adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection
Shao, R., Lan, X., Li, J., & Yuen, P. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01026 · Cited by 402
Measuring the VC-Dimension of a Learning Machine
Vapnik, V., Levin, E., & Cun, Y. L. (1994) · Neural Computation · doi:10.1162/neco.1994.6.5.851 · Cited by 388 · cited 1×
“Let d be the Vapnik–Chervonenkis (VC) dimension [26] of H, and Us and U t be unlabeled samples of size n from the two domains.”
BackgroundDeep Domain-Adversarial Image Generation for Domain Generalisation
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7003 · Cited by 388
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, Y., Mohamed, A., & Auli, M. (2020) · neural information processing systems · Cited by 386
Learning to Generate Novel Domains for Domain Generalization
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_33 · Cited by 382
Domain Generalization via Model-Agnostic Learning of Semantic Features
Dou, Q., Castro, D. C., Kamnitsas, K., & Glocker, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13580 · Cited by 381
Yue, X., Zhang, Y., Zhao, S., Sangiovanni-Vincentelli, A., Keutzer, K., & Gong, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00219 · Cited by 374
DLOW: Domain Flow for Adaptation and Generalization
Gong, R., Li, W., Chen, Y., & Van Gool, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00258 · Cited by 356
Self-citationReducing Domain Gap by Reducing Style Bias
Nam, H., Lee, H., Park, J., Yoon, W., & Yoo, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00858 · Cited by 353
Generalizing to Unseen Domains via Adversarial Data Augmentation
Volpi, R., Namkoong, H., Şener, O., Duchi, J. C., Murino, V., & Savarese, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12018 · Cited by 343
Sagawa, S., Koh, P. W., Hashimoto, T., & Liang, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08731 · Cited by 331
Choi, S., Jung, S., Yun, H., Kim, J. T., Kim, S., & Choo, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01141 · Cited by 329
Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias
Fang, C., Xu, Y., & Rockmore, D. N. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.208 · Cited by 324
Single-Side Domain Generalization for Face Anti-Spoofing
Jia, Y., Zhang, J., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00851 · Cited by 313
Christie, G., Fendley, N., Wilson, J., & Mukherjee, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00646 · Cited by 312
Generalized Out-of-Distribution Detection: A SurveyPreprint
Yang, J., Zhou, K., Li, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.11334 · Cited by 310
Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification
Borkan, D., Dixon, L., Sorensen, J., Thain, N., & Vasserman, L. (2019) · Companion Proceedings of The 2019 World Wide Web Conference · doi:10.1145/3308560.3317593 · Cited by 309
Generalizing Across Domains via Cross-Gradient Training
Shankar, S., Piratla, V., Chakrabarti, S., Chaudhuri, S., Jyothi, P., & Sarawagi, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10745 · Cited by 306
Domain Generalization Using a Mixture of Multiple Latent Domains
Matsuura, T., & Harada, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6846 · Cited by 289
FSDR: Frequency Space Domain Randomization for Domain Generalization
Huang, J., Guan, D., Xiao, A., & Lu, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00682 · Cited by 288
Deep Stable Learning for Out-Of-Distribution Generalization
Zhang, X., Cui, P., Xu, R., Zhou, L., He, Y., & Shen, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00533 · Cited by 284
Learning to Diversify for Single Domain Generalization
Wang, Z., Luo, Y., Qiu, R., Huang, Z., & Baktashmotlagh, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00087 · Cited by 284
Representation Learning via Invariant Causal MechanismsPreprint
Mitrovic, J., McWilliams, B., Walker, J., Buesing, L., & Blundell, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07922 · Cited by 282
Domain Adaptive Ensemble Learning
Zhou, K., Yang, Y., Qiao, Y., & Xiang, T. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3112012 · Cited by 278
(2011) · Cited by 277
David, E., Madec, S., Sadeghi-Tehran, P., Aasen, H., Zheng, B., Liu, S., Kirchgessner, N., Ishikawa, G., Nagasawa, K., Badhon, M. A., et al. (2020) · Plant Phenomics · doi:10.34133/2020/3521852 · Cited by 277
Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data
Prakash, A., Boochoon, S., Brophy, M., Acuna, D., Cameracci, E., State, G., Shapira, O., & Birchfield, S. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794443 · Cited by 266
On causal and anticausal learning
Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., Mooij, J. M., & Schölkopf, B. (2012) · MPG.PuRe (Max Planck Society) · Cited by 263
SelfReg: Self-supervised Contrastive Regularization for Domain Generalization
Kim, D., Yoo, Y., Park, S., Kim, J., & Lee, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00948 · Cited by 262
Causality-Inspired Single-Source Domain Generalization for Medical Image Segmentation
Ouyang, C., Chen, C., Li, S., Li, Z., Qin, C., Bai, W., & Rueckert, D. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3224067 · Cited by 260
Towards Out-Of-Distribution Generalization: A Survey
Liu, J., Shen, Z., He, Y., Zhang, X., Xu, R., Yu, H., & Cui, P. (2021) · arXiv · doi:10.48550/arxiv.2108.13624 · Cited by 253
AdaRNN: Adaptive Learning and Forecasting of Time Series
Du, Y., Wang, J., Feng, W., Pan, S., Qin, T., Xu, R., & Wang, C. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482315 · Cited by 251
Self-citationGradient Matching for Domain GeneralizationPreprint
Shi, Y., Seely, J., Torr, P. H. S., Siddharth, N., Hannun, A., Usunier, N., & Synnaeve, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.09937 · Cited by 248
Continual Lifelong Learning in Natural Language Processing: A Survey
Biesialska, M., Biesialska, K., & Costa‐jussà, M. R. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.574 · Cited by 245
Zhao, Y., Zhong, Z., Yang, F., Luo, Z., Lin, Y., Li, S., & Sebe, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00621 · Cited by 244
SWAD: Domain Generalization by Seeking Flat MinimaPreprint
Cha, J., Chun, S., Lee, K., Cho, H.-C., Park, S., Lee, Y., & Park, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08604 · Cited by 235
Generalizable Person Re-Identification by Domain-Invariant Mapping Network
Song, J., Yang, Y., Song, Y.-Z., Xiang, T., & Hospedales, T. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00081 · Cited by 232
Domain Agnostic Learning with Disentangled RepresentationsPreprint
Peng, X., Huang, Z., Sun, X., & Saenko, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12347 · Cited by 225
The Risks of Invariant Risk MinimizationPreprint
Rosenfeld, E., Ravikumar, P., & Risteski, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05761 · Cited by 225
Towards Non-I.I.D. image classification: A dataset and baselines
He, Y. H., Shen, Z., & Cui, P. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107383 · Cited by 220
Batch Normalization Embeddings for Deep Domain GeneralizationPreprint
Segu, M., Tonioni, A., & Tombari, F. (2020) · Pattern Recognition · doi:10.48550/arxiv.2011.12672 · Cited by 218
Learning to Optimize Domain Specific Normalization for Domain Generalization
Seo, S., Suh, Y., Kim, D., Kim, G., Han, J., & Han, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_5 · Cited by 214
ComboGAN: Unrestrained Scalability for Image Domain Translation
Anoosheh, A., Agustsson, E., Timofte, R., & Van Gool, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00122 · Cited by 209
Generalizing to unseen domains via distribution matchingPreprint
Albuquerque, I., Monteiro, J., Darvishi-Bayazi, M.-J., Falk, T. H., & Mitliagkas, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00804 · Cited by 201
Progressive Domain Expansion Network for Single Domain Generalization
Li, L., Gao, K., Cao, J., Huang, Z., Weng, Y., Mi, X., Yu, Z., Li, X., & Xia, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00029 · Cited by 197
Domain generalization in rotating machinery fault diagnostics using deep neural networks
Li, X., Zhang, W., Ma, H., Luo, Z., & Li, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.014 · Cited by 192
Exploiting Low-Rank Structure from Latent Domains for Domain Generalization
Xu, Z., Li, W., Niu, L., & Xu, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_41 · Cited by 190
Learning Attributes Equals Multi-Source Domain Generalization
Gan, C., Yang, T., & Gong, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.17 · Cited by 189
Domain Generalization by Marginal Transfer LearningPreprint
Blanchard, G., Deshmukh, A. A., Doǧan, Ü., Lee, G., & Scott, C. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07910 · Cited by 187
Feature-Critic Networks for Heterogeneous Domain GeneralizationPreprint
Li, Y., Yang, Y., Zhou, W., & Hospedales, T. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.11448 · Cited by 186
Towards Principled Disentanglement for Domain Generalization
Zhang, H., Zhang, Y., Liu, W., Weller, A., Schölkopf, B., & Xing, E. P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00786 · Cited by 182
Batch-Instance Normalization for Adaptively Style-Invariant Neural NetworksPreprint
Nam, H., & Kim, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07925 · Cited by 181
A Unified Feature Disentangler for Multi-Domain Image Translation and ManipulationPreprint
Liu, A. H., Liu, Y., Yeh, Y.-Y., & Wang, Y.-C. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.01361 · Cited by 179
Transfer Learning with Dynamic Distribution Adaptation
Wang, J., Chen, Y., Feng, W., Yu, H., Huang, M., & Yang, Q. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3360309 · Cited by 177
Self-citationOpen Domain Generalization with Domain-Augmented Meta-Learning
Yang, S., Cao, Z., Wang, C., Wang, J., & Long, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00950 · Cited by 177
Self-citationTolstikhin, I., Bousquet, O., Gelly, S., & Schölkopf, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01558 · Cited by 176
Conditional variance penalties and domain shift robustness
Heinze‐Deml, C., & Meinshausen, N. (2020) · Machine Learning · doi:10.1007/s10994-020-05924-1 · Cited by 176
Liao, Y., Huang, R., Li, J., Chen, Z., & Li, W. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2992829 · Cited by 176
Domain Generalization using Causal MatchingPreprint
Mahajan, D., Tople, S., & Sharma, A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07500 · Cited by 176
Li, D., Yang, J., Kreis, K., Torralba, A., & Fidler, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00820 · Cited by 174
Domain Generalization via Entropy Regularization
Zhao, S., Gong, M., Liu, T., Fu, H., & Tao, D. (2020) · neural information processing systems · Cited by 172
Batch normalization embeddings for deep domain generalization
Segù, M., Tonioni, A., & Tombari, F. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109115 · Cited by 172
Vanschoren, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03548 · Cited by 169
Domain Generalization via Conditional Invariant Representations
Li, Y., Gong, M., Tian, X., Liu, T., & Tao, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11682 · Cited by 168
Correlation-aware adversarial domain adaptation and generalization
Rahman, M. M., Fookes, C., Baktashmotlagh, M., & Sridharan, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107124 · Cited by 158
Learning to Learn with Variational Information Bottleneck for Domain Generalization
Du, Y., Xu, J., Xiong, H., Qiu, Q., Zhen, X., Snoek, C. G. M., & Shao, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_12 · Cited by 157
Domain adversarial neural networks for domain generalization: when it works and how to improve
Sicilia, A., Zhao, X., & Hwang, S. J. (2023) · Machine Learning · doi:10.1007/s10994-023-06324-x · Cited by 156
Towards Domain Generalization In Underwater Object Detection
Liu, H., Song, P., & Ding, R. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9191364 · Cited by 155
Federated Learning for IoT Devices With Domain Generalization
Zhang, L., Lei, X., Shi, Y., Huang, H., & Chen, C. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3234977 · Cited by 153
Best Sources Forward: Domain Generalization through Source-Specific Nets
Mancini, M., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451318 · Cited by 149
DIVA: Domain Invariant Variational AutoencodersPreprint
Ilse, M., Tomczak, J. M., Louizos, C., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10427 · Cited by 149
Learning explanations that are hard to varyPreprint
Parascandolo, G., Neitz, A., Orvieto, A., Gresele, L., & Schölkopf, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00329 · Cited by 147
Multi-Source Domain Adaptation: A Causal View
Zhang, K., Gong, M., & Schölkopf, B. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9542 · Cited by 146
Adversarially Adaptive Normalization for Single Domain Generalization
Fan, X., Wang, Q., Ke, J., Yang, F., Gong, B., & Zhou, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00811 · Cited by 143
Hu, S., Liao, Z., Zhang, J., & Xia, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3210133 · Cited by 142
Adaptive Methods for Real-World Domain Generalization
Dubey, A., Ramanathan, V., Pentland, A., & Mahajan, D. K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01411 · Cited by 140
Style Normalization and Restitution for Domain Generalization and Adaptation
Jin, X., Lan, C., Zeng, W., & Chen, Z. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3104379 · Cited by 136
Self-citationInvariance Principle Meets Information Bottleneck for Out-of-Distribution GeneralizationPreprint
Ahuja, K., Caballero, E., Zhang, D., Gagnon-Audet, J.-C., Bengio, Y., Mitliagkas, I., & Rish, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06607 · Cited by 136
Efficient Domain Generalization via Common-Specific Low-Rank DecompositionPreprint
Piratla, V., Netrapalli, P., & Sarawagi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12815 · Cited by 132
The iWildCam 2020 Competition DatasetPreprint
Beery, S., Cole, E., & Gjoka, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10340 · Cited by 130
Frustratingly Easy Person Re-Identification: Generalizing Person Re-ID in PracticePreprint
Jia, J., Ruan, Q., & Hospedales, T. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03422 · Cited by 130
Domain Generalization with Domain-Specific Aggregation Modules
D’Innocente, A., & Barbara Caputo, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_14 · Cited by 128
Heterogeneous Domain Generalization Via Domain Mixup
Wang, Y., Li, H., & Kot, A. C. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053273 · Cited by 127
Deep Domain Generalization With Structured Low-Rank Constraint
Ding, Z., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2758199 · Cited by 125
Domain Generalization and Adaptation Using Low Rank Exemplar SVMs
Li, W., Xu, Z., Xu, D., Dai, D., & Gool, L. V. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2704624 · Cited by 121
Collaborative Optimization and Aggregation for Decentralized Domain Generalization and Adaptation
Wu, G., & Gong, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00642 · Cited by 118
Zheng, H., Yang, Y., Yin, J., Li, Y., Wang, R., & Xu, M. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3016068 · Cited by 117
Synthetic to Real Adaptation with Generative Correlation Alignment Networks
Peng, X., & Saenko, K. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00219 · Cited by 116
Test-Time Classifier Adjustment Module for Model-Agnostic Domain Generalization
Iwasawa, Y., & Matsuo, Y. (2021) · neural information processing systems · Cited by 116
Fishr: Invariant Gradient Variances for Out-of-Distribution GeneralizationPreprint
Ramé, A., Dancette, C., & Cord, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02934 · Cited by 112
Invariant Risk Minimization GamesPreprint
Ahuja, K., Shanmugam, K., Varshney, K. R., & Dhurandhar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04692 · Cited by 109
Feature Stylization and Domain-aware Contrastive Learning for Domain Generalization
Jeon, S., Hong, K., Lee, P., Lee, J., & Byun, H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475271 · Cited by 106
On Calibration and Out-of-domain GeneralizationPreprint
Wald, Y., Feder, A., Greenfeld, D., & Shalit, U. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10395 · Cited by 99
Exploiting Domain-Specific Features to Enhance Domain GeneralizationPreprint
Bui, M.-H., Tran, T. B., Tran, A. T., & Phung, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09410 · Cited by 96
Semi-Supervised Domain Generalization with Stochastic StyleMatch
Zhou, K., Loy, C. C., & Liu, Z. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01821-x · Cited by 96
Probabilistic model for code with decision trees
Raychev, V., Bielik, P., & Vechev, M. (2016) · ACM SIGPLAN Notices · doi:10.1145/3022671.2984041 · Cited by 94
Wang, Y., Liao, S., & Shao, L. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413815 · Cited by 94
Multi-Component Image Translation for Deep Domain Generalization
Rahman, M. M., Fookes, C., Baktashmotlagh, M., & Sridharan, S. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00067 · Cited by 90
Learning Causal Semantic Representation for Out-of-Distribution PredictionPreprint
Liu, C., Sun, X., Wang, J., Hx, T., Qin, T., Qin, T., Chen, W., & Liu, T.-Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01681 · Cited by 86
Self-citationModel-Based Domain GeneralizationPreprint
Robey, A., Pappas, G. J., & Hassani, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11436 · Cited by 86
Latent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85 · cited 3×
“…disease e.g. DICA[27] Chest X-ray recognition e.g. MatchDG[76]/[90] EEG-based seizure detection e.g. [88] Human activity recognition e.g. GILE[128]/LAG[84] Fault diagnosis e.g. DSDGN[74]/DDGFD[73]/[90] Time series forecasting e.g. AdaRNN[80] Speech utterance recognition e.g.…”
BackgroundMethodInfluentialBrinkman, R. R., Gasparetto, M., Lee, S.-J. J., Ribickas, A. J., Perkins, J. B., Janssen, W. E., Smiley, R., & Smith, C. A. (2007) · Transplantation and Cellular Therapy · doi:10.1016/j.bbmt.2007.02.002 · Cited by 79
Meta-Learning for Domain Generalization in Semantic ParsingPreprint
Wang, B., Lapata, M., & Titov, I. (2020) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2010.11988 · Cited by 79
Meta-Learning for Domain Generalization in Semantic Parsing
Wang, B., Lapata, M., & Titov, I. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.33 · Cited by 79
Research works printed but not linked: 10
- 10.1109/ICCV48922.2021.00876 · DOI
- rahimian, 2019, Distributionally robust optimization: A review
- 10.1109/CVPR46437.2021.00621 · DOI · Paper page
- blanchard, 2021, Domain generalization by marginal transfer learning, J Mach Learn Res, 22
- zhang, 2022, ReMoS: Reducing defect inheritance in transfer learning via relevant model slicing, Proc 4th Int Conf Software Engineering, 1856
- zhu, 2021, CrossMatch: Cross-classifier consistency regularization for open-set single domain generalization, Proc Int Conf Learn Representations, 1
- yang, 2019, Federated Learning, 13, 1
- taylor, 2019, RxRx1: An image set for cellular morphological variation across many experimental batches, Proc Int Conf Learn Representations, 1
- 10.1109/ICCV.2019.00149 · DOI · Paper page
- sagawa, 2020, Distributionally robust neural networks for group shifts: On the importance of regularization for worst-case generalization, Proc Int Conf Learn Representations, 1
Cited by
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
“Li et al. [104] provided an overview of OOD evaluation for language models: adversarial robustness, domain generalization, and dataset biases.”
BackgroundInfluentialSelf-citationFederated learning for medical image analysis: A survey
Guan, H., Yap, P.-T., Bozoki, A., & Liu, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110424 · Cited by 518
A Comprehensive Survey on Test-Time Adaptation Under Distribution Shifts
Liang, J., He, R., & Tan, T. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02181-w · Cited by 271
Causal Machine Learning: A Survey and Open Problems
Kaddour, J., Lynch, A., Liu, Q., Kusner, M. J., & Silva, R. (2025) · Foundations and Trends® in Optimization · doi:10.1561/2400000052 · Cited by 347
AdaRNN: Adaptive Learning and Forecasting of Time Series
Du, Y., Wang, J., Feng, W., Pan, S., Qin, T., Xu, R., & Wang, C. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482315 · Cited by 251
Self-citation
Metadata
- Authors
- Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P.
- Affiliations
- Microsoft Research Asia (China) (CN)
- Chinese University of Hong Kong, Shenzhen (CN)
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- Chinese Academy of Sciences (CN)
- University of Illinois Chicago (US)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2022
- Pages
- 1-1
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3133542152
- Cited by
- 1,046
- References
- 282
- Citations by year
- 2026: 118 · 2025: 317 · 2024: 363 · 2023: 192 · 2022: 42
- FWCI
- 75.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- domain generalization, out-of-distribution generalization, generalization theory, data manipulation, representation learning, learning strategies, fair assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.