The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Domain Generalization by Solving Jigsaw Puzzles
Open accessAbstract
Human adaptability relies crucially on the ability to learn and merge knowledge both from supervised and unsupervised learning: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly effective, because supervised learning can never be exhaustive and thus learning autonomously allows to discover invariances and regularities that help to generalize. In this paper we propose to apply a similar approach to the task of object recognition across domains: our model learns the semantic labels in a supervised fashion, and broadens its understanding of the data by learning from self-supervised signals how to solve a jigsaw puzzle on the same images. This secondary task helps the network to learn the concepts of spatial correlation while acting as a regularizer for the classification task. Multiple experiments on the PACS, VLCS, Office-Home and digits datasets confirm our intuition and show that this simple method outperforms previous domain generalization and adaptation solutions. An ablation study further illustrates the inner workings of our approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,149
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124 · cited 1×
“This solution was at first presented with the name of domain randomization [43] for samples from simulated environments whose variety was extended with random renderings.”
MethodUnsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Deep Hashing Network for Unsupervised Domain Adaptation
Venkateswara, H., Eusebio, J., Chakraborty, S., & Panchanathan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.572 · Cited by 2,171
Learning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
Deeper, Broader and Artier Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.591 · Cited by 1,237
Domain Generalization with Adversarial Feature Learning
Li, H., Pan, S. J., Wang, S., & Kot, A. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00566 · Cited by 1,213
Bousmalis, K., Trigeorgis, G., Silberman, N., Krishnan, D., & Erhan, D. (2016) · arXiv · doi:10.48550/arxiv.1608.06019 · Cited by 1,208
Unsupervised Learning of Visual Representations Using Videos
Wang, X., & Gupta, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.320 · Cited by 1,005
Unified Deep Supervised Domain Adaptation and Generalization
Motiian, S., Piccirilli, M., Adjeroh, D. A., & Doretto, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.609 · Cited by 803
Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_32 · Cited by 779
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
Deep Domain Generalization via Conditional Invariant Adversarial Networks
Li, Y., Tian, X., Gong, M., Liu, Y., Liu, T., Zhang, K., & Tao, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_38 · Cited by 576
Undoing the Damage of Dataset Bias
Khosla, A., Zhou, T., Malisiewicz, T., Efros, A. A., & Torralba, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_12 · Cited by 480
Partial Adversarial Domain Adaptation
Cao, Z., Ma, L., Long, M., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_9 · Cited by 461
A Comprehensive Survey on Domain Adaptation for Visual Applications
Csurka, G. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_1 · Cited by 440
Domain Adaptation in Computer Vision Applications
(2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1 · Cited by 426
Deep Cocktail Network: Multi-source Unsupervised Domain Adaptation with Category Shift
Xu, R., Chen, Z., Zuo, W., Yan, J., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00417 · Cited by 415
Generalizing to Unseen Domains via Adversarial Data Augmentation
Volpi, R., Namkoong, H., Şener, O., Duchi, J. C., Murino, V., & Savarese, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12018 · Cited by 343
Representation Learning by Learning to Count
Noroozi, M., Pirsiavash, H., & Favaro, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.628 · Cited by 324
Generalizing Across Domains via Cross-Gradient Training
Shankar, S., Piratla, V., Chakrabarti, S., Chaudhuri, S., Jyothi, P., & Sarawagi, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10745 · Cited by 306
Boosting Self-Supervised Learning via Knowledge Transfer
Noroozi, M., Vinjimoor, A., Favaro, P., & Pirsiavash, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00975 · Cited by 296
Apictorial Jigsaw Puzzles: The Computer Solution of a Problem in Pattern Recognition
Freeman, H., & Garder, L. (1964) · IEEE Transactions on Electronic Computers · doi:10.1109/pgec.1964.263781 · Cited by 244
A probabilistic image jigsaw puzzle solver
Cho, T. S., Avidan, S., & Freeman, W. T. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540212 · Cited by 174
Boosting Domain Adaptation by Discovering Latent Domains
Mancini, M., Porzi, L., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00397 · Cited by 160
A system for high-volume acquisition and matching of fresco fragments
Brown, B. J., Toler‐Franklin, C., Nehab, D., et al. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360683 · Cited by 156
Mitochondrial DNA as a Genomic Jigsaw Puzzle
Marande, W., & Burger, G. (2007) · Science · doi:10.1126/science.1148033 · Cited by 146
Jigsaw puzzles with pieces of unknown orientation
Gallagher, A. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247699 · Cited by 141
Domain Generalization with Domain-Specific Aggregation Modules
D’Innocente, A., & Barbara Caputo, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_14 · Cited by 128
Self-citationDeep Domain Generalization With Structured Low-Rank Constraint
Ding, Z., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2758199 · Cited by 125
A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles
Sholomon, D., David, O. E., & Netanyahu, N. S. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.231 · Cited by 71
Robust Place Categorization With Deep Domain Generalization
Mancini, M., Bulò, S. R., Barbara Caputo, B., & Ricci, E. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2809700 · Cited by 64
Solving Square Jigsaw Puzzles with Loop Constraints
Son, K., Hays, J. H., & Cooper, D. B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_3 · Cited by 58
Just DIAL: DomaIn Alignment Layers for Unsupervised Domain Adaptation
Carlucci, F. M., Porzi, L., Barbara Caputo, B., Ricci, E., & Bulò, S. R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68560-1_32 · Cited by 53
Self-citationCruz, R. S., Fernando, B., Cherian, A., & Gould, S. J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873701 · Cited by 53
Learning in children : progress in cognitive development research
Bisanz, J., & Kail, R. V. (1983) · Springer eBooks · Cited by 52
Solving Small-Piece Jigsaw Puzzles by Growing Consensus
Son, K., Moreno, D., Hays, J. H., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.134 · Cited by 45
Image Reassembly Combining Deep Learning and Shortest Path Problem
Paumard, M.-M., Picard, D., & Tabia, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_10 · Cited by 35
Very young infants learn abstract rules in the visual modality
Ferguson, B., Franconeri, S., & Waxman, S. R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190185 · Cited by 31
A system for high-volume acquisition and matching of fresco fragments
Brown, B. J., Toler‐Franklin, C., Nehab, D., et al. (2008) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1399504.1360683 · Cited by 25
Adaptive Deep Learning Through Visual Domain Localization
Angeletti, G., Barbara Caputo, B., & Tommasi, T. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460650 · Cited by 22
Self-citation
Cited by
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435
Domain Generalization: A Survey
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046
Graph Contrastive Learning with Augmentations
You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13902 · Cited by 824
A Fourier-based Framework for Domain Generalization
Xu, Q., Zhang, R., Zhang, Y., Wang, Y., & Tian, Q. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01415 · Cited by 561
Metadata
- Authors
- Carlucci, F. M., D'Innocente, A., Bucci, S., Caputo, B., & Tommasi, T.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 2224-2233
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2922499403
- Cited by
- 813
- References
- 50
- FWCI
- 39.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.