The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Generalizing to Unseen Domains: A Survey on Domain Generalization
Open accessAbstract
Domain generalization (DG), i.e., out-of-distribution generalization, has attracted increased interests in recent years. Domain generalization deals with a challenging setting where one or several different but related domain(s) are given, and the goal is to learn a model that can generalize to an unseen test domain. For years, great progress has been achieved. This paper presents the first review for recent advances in domain generalization. First, we provide a formal definition of domain generalization and discuss several related fields. Then, we categorize recent algorithms into three classes and present them in detail: data manipulation, representation learning, and learning strategy, each of which contains several popular algorithms. Third, we introduce the commonly used datasets and applications. Finally, we summarize existing literature and present some potential research topics for the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Deep Hashing Network for Unsupervised Domain Adaptation
Venkateswara, H., Eusebio, J., Chakraborty, S., & Panchanathan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.572 · Cited by 2,171
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019
Learning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
Deep Subdomain Adaptation Network for Image Classification
Zhu, Y., Zhuang, F., Wang, J., Ke, G., Chen, J., Bian, J., Xiong, H., & He, Q. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2988928 · Cited by 1,245
Self-citationDeeper, Broader and Artier Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.591 · Cited by 1,237
Domain Generalization with Adversarial Feature Learning
Li, H., Pan, S. J., Wang, S., & Kot, A. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00566 · Cited by 1,213
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 899
Domain Generalization by Solving Jigsaw Puzzles
Carlucci, F. M., D'Innocente, A., Bucci, S., Caputo, B., & Tommasi, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00233 · Cited by 813
Unified Deep Supervised Domain Adaptation and Generalization
Motiian, S., Piccirilli, M., Adjeroh, D. A., & Doretto, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.609 · Cited by 803
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
Visual Domain Adaptation with Manifold Embedded Distribution Alignment
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., & Yu, P. S. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240512 · Cited by 638
Self-citationTolstikhin, I., Bousquet, O., Gelly, S., & Schölkopf, B. (2018) · MPG.PuRe (Max Planck Society) · Cited by 602
Deep Domain Generalization via Conditional Invariant Adversarial Networks
Li, Y., Tian, X., Gong, M., Liu, Y., Liu, T., Zhang, K., & Tao, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_38 · Cited by 576
Self-challenging Improves Cross-Domain Generalization
Huang, Z., Wang, H., Xing, E. P., & Huang, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_8 · Cited by 530
Undoing the Damage of Dataset Bias
Khosla, A., Zhou, T., Malisiewicz, T., Efros, A. A., & Torralba, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_12 · Cited by 480
MetaReg: towards domain generalization using meta-regularization
Balaji, Y., Sankaranarayanan, S., & Chellappa, R. (2018) · neural information processing systems · Cited by 476
Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization
Ghifary, M., Balduzzi, D., Kleijn, W. B., & Zhang, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599532 · Cited by 471
Learning to Learn Single Domain Generalization
Qiao, F., Zhao, L., & Peng, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01257 · Cited by 455
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Self-citationStyle Normalization and Restitution for Generalizable Person Re-Identification
Jin, X., Lan, C., Zeng, W., Chen, Z., & Zhang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00321 · Cited by 426
Self-citationMulti-Adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection
Shao, R., Lan, X., Li, J., & Yuen, P. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01026 · Cited by 402
Deep Domain-Adversarial Image Generation for Domain Generalisation
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7003 · Cited by 388
Learning to Generate Novel Domains for Domain Generalization
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_33 · Cited by 382
Domain Generalization via Model-Agnostic Learning of Semantic Features
Dou, Q., Castro, D. C., Kamnitsas, K., & Glocker, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13580 · Cited by 381
DLOW: Domain Flow for Adaptation and Generalization
Gong, R., Li, W., Chen, Y., & Van Gool, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00258 · Cited by 356
Generalizing to Unseen Domains via Adversarial Data Augmentation
Volpi, R., Namkoong, H., Şener, O., Duchi, J. C., Murino, V., & Savarese, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12018 · Cited by 343
Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias
Fang, C., Xu, Y., & Rockmore, D. N. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.208 · Cited by 324
Single-Side Domain Generalization for Face Anti-Spoofing
Jia, Y., Zhang, J., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00851 · Cited by 313
Generalizing Across Domains via Cross-Gradient Training
Shankar, S., Piratla, V., Chakrabarti, S., Chaudhuri, S., Jyothi, P., & Sarawagi, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10745 · Cited by 306
(2011) · Cited by 277
Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data
Prakash, A., Boochoon, S., Brophy, M., Acuna, D., Cameracci, E., State, G., Shapira, O., & Birchfield, S. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794443 · Cited by 266
Zhao, Y., Zhong, Z., Yang, F., Luo, Z., Lin, Y., Li, S., & Sebe, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00621 · Cited by 244
Domain Agnostic Learning with Disentangled RepresentationsPreprint
Peng, X., Huang, Z., Sun, X., & Saenko, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12347 · Cited by 225
ComboGAN: Unrestrained Scalability for Image Domain Translation
Anoosheh, A., Agustsson, E., Timofte, R., & Van Gool, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00122 · Cited by 209
Domain generalization in rotating machinery fault diagnostics using deep neural networks
Li, X., Zhang, W., Ma, H., Luo, Z., & Li, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.014 · Cited by 192
Learning Attributes Equals Multi-Source Domain Generalization
Gan, C., Yang, T., & Gong, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.17 · Cited by 189
Domain Generalization using Causal MatchingPreprint
Mahajan, D., Tople, S., & Sharma, A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07500 · Cited by 176
Domain Generalization via Entropy Regularization
Zhao, S., Gong, M., Liu, T., Fu, H., & Tao, D. (2020) · neural information processing systems · Cited by 172
Batch normalization embeddings for deep domain generalization
Segù, M., Tonioni, A., & Tombari, F. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109115 · Cited by 172
Domain Generalization via Conditional Invariant Representations
Li, Y., Gong, M., Tian, X., Liu, T., & Tao, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11682 · Cited by 168
Easy Transfer Learning By Exploiting Intra-Domain Structures
Wang, J., Chen, Y., Yu, H., Huang, M., & Yang, Q. (2019) · 2019 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00211 · Cited by 168
Self-citationCorrelation-aware adversarial domain adaptation and generalization
Rahman, M. M., Fookes, C., Baktashmotlagh, M., & Sridharan, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107124 · Cited by 158
Best Sources Forward: Domain Generalization through Source-Specific Nets
Mancini, M., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451318 · Cited by 149
DIVA: Domain Invariant Variational AutoencodersPreprint
Ilse, M., Tomczak, J. M., Louizos, C., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10427 · Cited by 149
Efficient Domain Generalization via Common-Specific Low-Rank DecompositionPreprint
Piratla, V., Netrapalli, P., & Sarawagi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12815 · Cited by 132
Domain Generalization with Domain-Specific Aggregation Modules
D’Innocente, A., & Barbara Caputo, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_14 · Cited by 128
Heterogeneous Domain Generalization Via Domain Mixup
Wang, Y., Li, H., & Kot, A. C. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053273 · Cited by 127
Deep Domain Generalization With Structured Low-Rank Constraint
Ding, Z., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2758199 · Cited by 125
Domain Generalization and Adaptation Using Low Rank Exemplar SVMs
Li, W., Xu, Z., Xu, D., Dai, D., & Gool, L. V. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2704624 · Cited by 121
Meta-Learning for Domain Generalization in Semantic Parsing
Wang, B., Lapata, M., & Titov, I. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.33 · Cited by 79
Frustratingly Simple Domain Generalization via Image StylizationPreprint
Somavarapu, N., Ma, C., & Kira, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11207 · Cited by 72
Learning Causal Semantic Representation for Out-of-Distribution PredictionPreprint
Liu, C., Sun, X., Wang, J., Hx, T., Qin, T., Qin, T., Chen, W., & Liu, T.-Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01681 · Cited by 71
Self-citationDomain Generalization via Multidomain Discriminant Analysis
Hu, S., Zhang, K., Chen, Z., & Chan, L. (2019) · PubMed · doi:10.48550/arxiv.1907.11216 · Cited by 70
Multi-Component Image Translation for Deep Domain Generalization
Rahman, M. M., Fookes, C., Baktashmotlagh, M., & Sridharan, S. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00067 · Cited by 69
Discriminative adversarial domain generalization with meta-learning based cross-domain validation
Chen, K., Zhuang, D., & Chang, J. M. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.046 · Cited by 66
Multi-view Domain Generalization for Visual Recognition
Niu, L., Li, W., & Xu, D. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.477 · Cited by 65
Feature Alignment and Restoration for Domain Generalization and AdaptationPreprint
Jin, X., Lan, C., Zeng, W., & Chen, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12009 · Cited by 63
Self-citationDomain Randomization for Scene-Specific Car Detection and Pose Estimation
Khirodkar, R., Yoo, D., & Kitani, K. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00210 · Cited by 47
DomainMix: Learning Generalizable Person Re-Identification Without Human Annotations
Wang, W. H., Liao, S., Zhao, F., Kang, C., & Shao, L. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.89 · Cited by 41
A Generalization Error Bound for Multi-class Domain GeneralizationPreprint
Deshmukh, A. A., Lei, Y., Sharma, S., Doǧan, Ü., Cutler, J., & Scott, C. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10392 · Cited by 40
Robust domain generalisation by enforcing distribution invariance
Erfani, S., Baktashmotlagh, M., Moshtaghi, M., Vinh, N. X., Leckie, C. A., Bailey, J., & Ramamohanarao, K. (2016) · QUT ePrints (Queensland University of Technology) · Cited by 38
Domain Generalization Based on Transfer Component Analysis
Grubinger, T., Birlutiu, A., Schöner, H., Natschläger, T., & Heskes, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19258-1_28 · Cited by 34
Unseen Target Stance Detection with Adversarial Domain Generalization
Wang, Z., Wang, Q., Lv, C., Cao, X., & Fu, G. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206635 · Cited by 31
Domain Generalization with Optimal Transport and Metric Learning.Preprint
Zhou, F., Jiang, Z., Shui, C., Wang, B., & Chaib-draa, B. (2020) · arXiv (Cornell University) · Cited by 17
Generalized Convolutional Forest Networks for Domain Generalization and Visual Recognition
Ryu, J., Kwon, G., Yang, M., & Lim, J. (2020) · International Conference on Learning Representations · Cited by 15
Learn to Expect the Unexpected: Probably Approximately Correct Domain GeneralizationPreprint
Garg, V., Kalai, A. T., Ligett, K., & Wu, Z. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05660 · Cited by 9
Cited by
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Self-citationTrustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
Lowe, M., Qin, R., & Mao, X. (2022) · Water · doi:10.3390/w14091384 · Cited by 354
Single-Source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification
Zhang, Y., Li, W., Sun, W., Tao, R., & Du, Q. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3243853 · Cited by 334
Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging
Azizi, S., Culp, L., Freyberg, J., Mustafa, B., Baur, S., Kornblith, S., Chen, T., Tomasev, N., Mitrović, J., Strachan, P., et al. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01049-7 · Cited by 250
Metadata
- Authors
- Wang, J., Lan, C., Liu, C., Ouyang, Y., & Qin, T.
- Venue
- Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence
- Published
- 2021-08
- Pages
- 4627-4635
- OpenAlex
- W3189951784
- Cited by
- 308
- References
- 79
- FWCI
- 26.28
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.