The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Deep Stable Learning for Out-Of-Distribution Generalization
Abstract
Approaches based on deep neural networks have achieved striking performance when testing data and training data share similar distribution, but can significantly fail otherwise. Therefore, eliminating the impact of distribution shifts between training and testing data is crucial for building performance-promising deep models. Conventional methods assume either the known heterogeneity of training data (e.g. domain labels) or the approximately equal capacities of different domains. In this paper, we consider a more challenging case where neither of the above assumptions holds. We propose to address this problem by removing the dependencies between features via learning weights for training samples, which helps deep models get rid of spurious correlations and, in turn, concentrate more on the true connection between discriminative features and labels. Extensive experiments clearly demonstrate the effectiveness of our method on multiple distribution generalization benchmarks compared with state-of-the-art counterparts. Through extensive experiments on distribution generalization benchmarks including PACS, VLCS, MNIST-M, and NICO, we show the effectiveness of our method compared with state-of-the-art counterparts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Unsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
One Pixel Attack for Fooling Deep Neural Networks
Su, J., Vargas, D. V., & Sakurai, K. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2890858 · Cited by 2,406
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations
Hendrycks, D., & Dietterich, T. (2019) · arXiv · doi:10.48550/arxiv.1903.12261 · Cited by 1,335
Sanity Checks for Saliency Maps
Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., & Kim, B. (2018) · arXiv · doi:10.48550/arxiv.1810.03292 · Cited by 1,294
Learning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
Deeper, Broader and Artier Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.591 · Cited by 1,237
Domain Generalization with Adversarial Feature Learning
Li, H., Pan, S. J., Wang, S., & Kot, A. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00566 · Cited by 1,213
Arjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927
Deep Learning: A Critical Appraisal
Marcus, G. (2018) · arXiv · doi:10.48550/arxiv.1801.00631 · Cited by 853
Domain Generalization by Solving Jigsaw Puzzles
Carlucci, F. M., D'Innocente, A., Bucci, S., Caputo, B., & Tommasi, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00233 · Cited by 813
Unified Deep Supervised Domain Adaptation and Generalization
Motiian, S., Piccirilli, M., Adjeroh, D. A., & Doretto, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.609 · Cited by 803
Do ImageNet Classifiers Generalize to ImageNet?
Recht, B., Roelofs, R., Schmidt, L., & Shankar, V. (2019) · arXiv · doi:10.48550/arxiv.1902.10811 · Cited by 790
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
Dimensionality Reduction for Supervised Learning With Reproducing Kernel Hilbert Spaces
Fukumizu, K., Bach, F. R., & Jordan, M. I. (2003) · doi:10.21236/ada446572 · Cited by 723
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
A Kernel Statistical Test of Independence
Gretton, A., Fukumizu, K., Teo, C. H., Song, L., Schölkopf, B., & Smola, A. J. (2007) · ANU Open Research (Australian National University) · Cited by 656
Self-challenging Improves Cross-Domain Generalization
Huang, Z., Wang, H., Xing, E. P., & Huang, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_8 · Cited by 530
Undoing the Damage of Dataset Bias
Khosla, A., Zhou, T., Malisiewicz, T., Efros, A. A., & Torralba, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_12 · Cited by 480
MetaReg: towards domain generalization using meta-regularization
Balaji, Y., Sankaranarayanan, S., & Chellappa, R. (2018) · neural information processing systems · Cited by 476
Learning to Learn Single Domain Generalization
Qiao, F., Zhao, L., & Peng, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01257 · Cited by 455
Kernel Measures of Conditional Dependence
Fukumizu, K., Gretton, A., Sun, X., & Schölkopf, B. (2007) · Cited by 435
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Out-of-Distribution Generalization via Risk Extrapolation (REx)
Krueger, D., Caballero, E., Jacobsen, J.-H., Zhang, A., Binas, J., Zhang, D., Priol, R. L., & Courville, A. (2020) · arXiv · doi:10.48550/arxiv.2003.00688 · Cited by 407
Deep Domain-Adversarial Image Generation for Domain Generalisation
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7003 · Cited by 388
Learning to Generate Novel Domains for Domain Generalization
Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_33 · Cited by 382
Domain Generalization via Model-Agnostic Learning of Semantic Features
Dou, Q., Castro, D. C., Kamnitsas, K., & Glocker, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13580 · Cited by 381
Generalizing to Unseen Domains via Adversarial Data Augmentation
Volpi, R., Namkoong, H., Şener, O., Duchi, J. C., Murino, V., & Savarese, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12018 · Cited by 343
Generalizing Across Domains via Cross-Gradient Training
Shankar, S., Piratla, V., Chakrabarti, S., Chaudhuri, S., Jyothi, P., & Sarawagi, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10745 · Cited by 306
(2017) · doi:10.48550/arxiv.1712.02779 · Cited by 300
Domain Generalization Using a Mixture of Multiple Latent Domains
Matsuura, T., & Harada, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6846 · Cited by 289
Towards Non-I.I.D. image classification: A dataset and baselines
He, Y. H., Shen, Z., & Cui, P. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107383 · Cited by 220
Self-citationLearning to Optimize Domain Specific Normalization for Domain Generalization
Seo, S., Suh, Y., Kim, D., Kim, G., Han, J., & Han, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_5 · Cited by 214
Discovering Causal Signals in Images
Lopez-Paz, D., Nishihara, R., Chintala, S., Scholkopf, B., & Bottou, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.14 · Cited by 209
Select-additive learning: Improving generalization in multimodal sentiment analysis
Wang, H., Meghawat, A., Morency, L.-P., & Xing, E. P. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019301 · Cited by 203
Stable Learning via Sample Reweighting
Shen, Z., Cui, P., Zhang, T., & Kunag, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6024 · Cited by 190
Self-citationLearning from Extrinsic and Intrinsic Supervisions for Domain Generalization
Wang, S., Yu, L., Li, C., Fu, C.-W., & Heng, P.-A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_10 · Cited by 187
A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms
Bengio, Y., Deleu, T., Rahaman, N., Ke, R., Lachapelle, S., Bilaniuk, O., Goyal, A., & Pal, C. (2019) · arXiv · doi:10.48550/arxiv.1901.10912 · Cited by 182 · cited 1×
“In real cases, however, such a hypothesis can hardly be satisfied due to the complex generation mechanism of real data such as data selection biases, confounding factors, or other peculiarities [5, 54, 12, 47, 21].”
BackgroundLearning to Compose Domain-Specific Transformations for Data Augmentation
Ratner, A., Ehrenberg, H. R., Hussain, Z., Dunnmon, J., & Ré, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01643 · Cited by 180
Learning Robust Representations by Projecting Superficial Statistics OutPreprint
Wang, H., He, Z., Lipton, Z. C., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06256 · Cited by 168
Stable Prediction across Unknown Environments
Kuang, K., Cui, P., Athey, S., Xiong, R., & Li, B. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220082 · Cited by 159
Self-citationApproximate Kernel-Based Conditional Independence Tests for Fast Non-Parametric Causal Discovery
Strobl, E. V., Zhang, K., & Visweswaran, S. (2019) · Journal of Causal Inference · doi:10.1515/jci-2018-0017 · Cited by 158
Best Sources Forward: Domain Generalization through Source-Specific Nets
Mancini, M., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451318 · Cited by 149
Efficient Domain Generalization via Common-Specific Low-Rank DecompositionPreprint
Piratla, V., Netrapalli, P., & Sarawagi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12815 · Cited by 132
Stable Prediction with Model Misspecification and Agnostic Distribution Shift
Kuang, K., Xiong, R., Cui, P., Athey, S. C., & Li, B. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5876 · Cited by 129
Self-citationDomain Generalization with Domain-Specific Aggregation Modules
D’Innocente, A., & Barbara Caputo, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_14 · Cited by 128
Deep Domain Generalization With Structured Low-Rank Constraint
Ding, Z., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2758199 · Cited by 125
Domain Generalization via Multidomain Discriminant Analysis
Hu, S., Zhang, K., Chen, Z., & Chan, L. (2019) · PubMed · doi:10.48550/arxiv.1907.11216 · Cited by 70
Multi-view Domain Generalization for Visual Recognition
Niu, L., Li, W., & Xu, D. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.477 · Cited by 65
Robust Place Categorization With Deep Domain Generalization
Mancini, M., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2809700 · Cited by 64
Feature Alignment and Restoration for Domain Generalization and AdaptationPreprint
Jin, X., Lan, C., Zeng, W., & Chen, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12009 · Cited by 63
Test-Time Training for Out-of-Distribution Generalization
Sun, Y., Wang, X., Liu, Z., Miller, J. J., Efros, A. A., & Hardt, M. (2019) · Cited by 54
Cited by
Domain Generalization: A Survey
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046
Towards Out-Of-Distribution Generalization: A Survey
Liu, J., Shen, Z., He, Y., Zhang, X., Xu, R., Yu, H., & Cui, P. (2021) · arXiv · doi:10.48550/arxiv.2108.13624 · Cited by 253
Self-citation
Metadata
- Authors
- Zhang, X., Cui, P., Xu, R., Zhou, L., He, Y., & Shen, Z.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 5368-5378
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3180303049
- Cited by
- 284
- References
- 59
- FWCI
- 22.95
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.