Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 50 of the 54 references it cites were found in a registry or an index.
Abstract
Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning paradigm, where sufficiently many input-output pairs are required for training. Acquisition of large training sets is one of the key challenges, when approaching a new task. In this paper, we aim for generic feature learning and present an approach for training a convolutional network using only unlabeled data. To this end, we train the network to discriminate between a set of surrogate classes. Each surrogate class is formed by applying a variety of transformations to a randomly sampled 'seed' image patch. In contrast to supervised network training, the resulting feature representation is not class specific. It rather provides robustness to the transformations that have been applied during training. This generic feature representation allows for classification results that outperform the state of the art for unsupervised learning on several popular datasets (STL-10, CIFAR-10, Caltech-101, Caltech-256). While features learned with our approach cannot compete with class specific features from supervised training on a classification task, we show that they are advantageous on geometric matching problems, where they also outperform the SIFT descriptor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since each data instance is regarded as one class, the exemplar learning method is difficult to apply to large datasets.”
From Self-supervised learning for medical image analysis using image context restoration (2019) · cites this paper as Dosovitskiy et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Research works printed but not linked: 3
- [36] K. Swersky, J. Snoek, and R. P. Adams, 'Multi-task bayesian optimization,' in NIPS , 2013. -
- [37] C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu, 'Deeply supervised nets,' in Deep Learning and Representation Learning Workshop, NIPS , 2014. -
- [24] S. Rifai, Y. N. Dauphin, P. Vincent, Y. Bengio, and X. Muller, 'The manifold tangent classifier,' in NIPS , 2011. -
Cited by
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Lu, J., Batra, D., Parikh, D., & Lee, S. (2019) · arXiv · doi:10.48550/arxiv.1908.02265 · Cited by 2,109
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,442
SimMIM: a Simple Framework for Masked Image Modeling
Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., & Hu, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00943 · Cited by 1,255
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435
A Survey on Deep Semi-Supervised Learning
Yang, X., Song, Z., King, I., & Xu, Z. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3220219 · Cited by 923
DINOv2: Learning Robust Visual Features without Supervision
Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., El-Nouby, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.07193 · Cited by 1,078
Evaluation of output embeddings for fine-grained image classification
Akata, Z., Reed, S., Walter, D., Lee, H., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298911 · Cited by 752
Convolutional networks for fast, energy-efficient neuromorphic computing
Esser, S. K., Merolla, P. A., Arthur, J. V., Cassidy, A. S., Appuswamy, R., Andreopoulos, A., Berg, D. J., McKinstry, J. L., Melano, T., Barch, D. R., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604850113 · Cited by 781
Invariant Information Clustering for Unsupervised Image Classification and Segmentation
Ji, X., Vedaldi, A., & Henriques, J. F. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00996 · Cited by 1,125
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 552
DeMoN: Depth and Motion Network for Learning Monocular Stereo
Ummenhofer, B., Zhou, H., Uhrig, J., Mayer, N., Ilg, E., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.596 · Cited by 692
Self-citationUsing Self-Supervised Learning Can Improve Model Robustness and Uncertainty
Hendrycks, D., Mazeika, M., Kadavath, S., & Song, D. (2019) · arXiv · doi:10.48550/arxiv.1906.12340 · Cited by 634
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature
Ye, M., Zhang, X., Yuen, P. C., & Chang, S.-F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00637 · Cited by 601
L2-Net: Deep Learning of Discriminative Patch Descriptor in Euclidean Space
Tian, Y., Fan, B., & Wu, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.649 · Cited by 601
Masked Feature Prediction for Self-Supervised Visual Pre-Training
Wei, C., Fan, H., Xie, S., Wu, C.-Y., Yuille, A., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01426 · Cited by 587
Self-supervised learning for medical image analysis using image context restoration
Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101539 · Cited by 575
SELF-LABELLING VIA SIMULTANEOUS CLUSTERING AND REPRESENTATION LEARNING
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.05371 · Cited by 94
Data Augmentation Using Learned Transformations for One-Shot Medical Image Segmentation
Zhao, A., Balakrishnan, G., Durand, F., Guttag, J. V., & Dalca, A. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00874 · Cited by 430
An Overview of Deep Semi-Supervised Learning
Ouali, Y., Hudelot, C., & Tami, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05278 · Cited by 230
Context Autoencoder for Self-supervised Representation Learning
Chen, X., Ding, M., Wang, X., Xin, Y., Mo, S., Wang, Y., Han, S., Luo, P., Zeng, G., & Wang, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01852-4 · Cited by 319
Self-Supervised Representation Learning: Introduction, advances, and challenges
Ericsson, L., Gouk, H., Loy, C. C., & Hospedales, T. M. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3134634 · Cited by 433
Large Scale Adversarial Representation Learning
Donahue, J., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02544 · Cited by 351
Zhou, Z., Sodha, V., Pang, J., Gotway, M. B., & Liang, J. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101840 · Cited by 328
Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities
Qi, G.-J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01265-2 · Cited by 341
Scaling and Benchmarking Self-Supervised Visual Representation Learning
Goyal, P., Mahajan, D., Gupta, A., & Misra, I. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00649 · Cited by 330
(2019) · neural information processing systems · Cited by 350
Augmentor: An Image Augmentation Library for Machine Learning
D Bloice, M., Stocker, C., & Holzinger, A. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00432 · Cited by 290
Driver Distraction Identification with an Ensemble of Convolutional Neural Networks
Eraqi, H. M., Abouelnaga, Y., Saad, M. H., & Moustafa, M. N. (2019) · Journal of Advanced Transportation · doi:10.1155/2019/4125865 · Cited by 305
A Survey on the New Generation of Deep Learning in Image Processing
Jiao, L., & Zhao, J. (2019) · IEEE Access · doi:10.1109/access.2019.2956508 · Cited by 293
Deep learning for time series forecasting: a survey
Kong, X., Chen, Z., Liu, W., Ning, K., Zhang, L., Muhammad Marier, S., Liu, Y., Chen, Y., & Xia, F. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02560-w · Cited by 211
Knowledge Distillation Meets Self-supervision
Xu, G., Liu, Z., Li, X., & Loy, C. C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_34 · Cited by 264
Self-Supervised Pretraining of 3D Features on any Point-Cloud
Zhang, Z., Girdhar, R., Joulin, A., & Misra, I. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01009 · Cited by 278
Vision-Language Pre-Training with Triple Contrastive Learning
Yang, J., Duan, J., Tran, S., Xu, Y., Chanda, S., Chen, L., Zeng, B., Chilimbi, T., & Huang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01522 · Cited by 309
Self-supervised learning methods and applications in medical imaging analysis: a survey
Shurrab, S., & Duwairi, R. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1045 · Cited by 254
Boosting Self-Supervised Learning via Knowledge Transfer
Noroozi, M., Vinjimoor, A., Favaro, P., & Pirsiavash, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00975 · Cited by 296
tempoGAN: a temporally coherent, volumetric GAN for super-resolution fluid flow
Xie, Y., Franz, A., Chu, M., & Thuerey, N. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201304 · Cited by 275
Mou, L., Ghamisi, P., & Zhu, X. X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2748160 · Cited by 294
Kerkech, M., Hafiane, A., & Canals, R. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.10.006 · Cited by 271
Detection of rice plant diseases based on deep transfer learning
Chen, J., Zhang, D., Nanehkaran, Y. A., & Li, D. (2020) · Journal of the Science of Food and Agriculture · doi:10.1002/jsfa.10365 · Cited by 262
Learning to Compose Domain-Specific Transformations for Data Augmentation
Ratner, A., Ehrenberg, H. R., Hussain, Z., Dunnmon, J., & Ré, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01643 · Cited by 180
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Kostrikov, I., Yarats, D., & Fergus, R. (2020) · arXiv · doi:10.48550/arxiv.2004.13649 · Cited by 267
Zeineldin, R. A., Karar, M. E., Coburger, J., Wirtz, C. R., & Burgert, O. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02186-z · Cited by 226
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey
Chen, Y., Mancini, M., Zhu, X., & Akata, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3201576 · Cited by 220
Unsupervised Pre-Training of Image Features on Non-Curated Data
Caron, M., Bojanowski, P., Mairal, J., & Joulin, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00305 · Cited by 258
Repeatability Is Not Enough: Learning Affine Regions via Discriminability
Mishkin, D., Radenović, F., & Matas, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_18 · Cited by 233
A Survey on Semi-, Self- and Unsupervised Learning for Image Classification
Schmarje, L., Santarossa, M., Schroder, S.-M., & Koch, R. (2021) · IEEE Access · doi:10.1109/access.2021.3084358 · Cited by 246
Decoupled Contrastive Learning
Yeh, C.-H., Hong, C.-Y., Hsu, Y.-C., Liu, T.-L., Chen, Y., & LeCun, Y. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19809-0_38 · Cited by 160
Audio-Visual Instance Discrimination with Cross-Modal Agreement
Morgado, P., Vasconcelos, N., & Misra, I. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01229 · Cited by 211
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222
Deep Comprehensive Correlation Mining for Image Clustering
Wu, J., Long, K., Wang, F., Qian, C., Li, C., Lin, Z., & Zha, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00824 · Cited by 198
Online Deep Clustering for Unsupervised Representation Learning
Zhan, X., Xie, J., Liu, Z., Ong, Y.-S., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00672 · Cited by 203
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
Chen, T., Liu, S., Chang, S., Cheng, Y., Amini, L., & Wang, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00078 · Cited by 205
Super-resolution analysis via machine learning: a survey for fluid flows
Fukami, K., Fukagata, K., & Taira, K. (2023) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-023-00663-0 · Cited by 176
CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP
Chen, R., Liu, Y., Kong, L., Zhu, X., Ma, Y., Li, Y., Hou, Y., Qiao, Y., & Wang, W. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00678 · Cited by 158
How Well Do Self-Supervised Models Transfer?
Ericsson, L., Gouk, H., & Hospedales, T. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00537 · Cited by 341
Wang, Z., Xiao, Y., Li, Y., Zhang, J., Lu, F., Hou, M., & Liu, X. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107613 · Cited by 186
A Cookbook of Self-Supervised Learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.12210 · Cited by 182
Review on self-supervised image recognition using deep neural networks
Ohri, K., & Kumar, M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107090 · Cited by 179
Handling imbalanced medical image data: A deep-learning-based one-class classification approach
Gao, L., Zhang, L., Liu, C., & Wu, S. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101935 · Cited by 162
Space-Time Correspondence as a Contrastive Random Walk
Jabri, A., Owens, A., & Efros, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14613 · Cited by 109
Self-Supervised Learning for Domain Adaptation on Point Clouds
Achituve, I., Maron, H., & Chechik, G. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00017 · Cited by 175
Towards Robust Pattern Recognition: A Review
Zhang, X.-Y., Liu, C., & Suen, C. Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2989782 · Cited by 200
Efficient Self-supervised Vision Transformers for Representation Learning
Li, C., Yang, J., Zhang, P., Gao, M., Xiao, B., Dai, X., Yuan, L., & Gao, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09785 · Cited by 82
GANSER: A Self-Supervised Data Augmentation Framework for EEG-Based Emotion Recognition
Zhang, Z., Liu, Y., & Zhong, S.-H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3170369 · Cited by 177
Data-driven synthesis of smoke flows with CNN-based feature descriptors
Chu, M., & Thuerey, N. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073643 · Cited by 178
Facial Expression Recognition Using a Hybrid CNN–SIFT Aggregator
Connie, T., Al-Shabi, M., Cheah, W. P., & Goh, M. K. O. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69456-6_12 · Cited by 176
Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis
Li, X., Jia, M., Islam, M. T., Yu, L., & Xing, L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3008871 · Cited by 150
Sun, M., Xing, J., Wang, H., Chen, B., & Zhou, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467186 · Cited by 116
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Yarats, D., Kostrikov, I., & Fergus, R. (2021) · International Conference on Learning Representations · Cited by 509
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154
Registration of Multimodal Remote Sensing Image Based on Deep Fully Convolutional Neural Network
Zhang, H., Ni, W., Yan, W., Xiang, D., Wu, J., Yang, X., & Hui, B. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2916560 · Cited by 154
Adversarial Self-Supervised Contrastive LearningPreprint
Kim, M., Tack, J., & Hwang, S. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07589 · Cited by 173
Self-supervised Pretraining of Visual Features in the Wild
Goyal, P., Caron, M., Lefaudeux, B., Xu, M., Wang, P., Pai, V., Singh, M., Liptchinsky, V., Misra, I., Joulin, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.01988 · Cited by 141
Mou, L., & Zhu, X. X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10249 · Cited by 184
A Kernel Theory of Modern Data Augmentation
Dao, T., Gu, A., Ratner, A., Smith, V., De, C., & Ré, C. (2018) · PubMed · doi:10.48550/arxiv.1803.06084 · Cited by 94
Augmentation Invariant and Instance Spreading Feature for Softmax Embedding
Ye, M., Shen, J., Zhang, X., Yuen, P. C., & Chang, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3013379 · Cited by 141
Morimoto, M., Fukami, K., Zhang, K., Nair, A., & Fukagata, K. (2021) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-021-00580-0 · Cited by 137
Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Images
Yu, A., & Grauman, K. L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.594 · Cited by 157
Contrastive Learning of Musical Representations
Spijkervet, J., & Burgoyne, J. (2021) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2103.09410 · Cited by 202
A critical analysis of self-supervision, or what we can learn from a single image
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.13132 · Cited by 95
Data augmentation for motor imagery signal classification based on a hybrid neural network.
Zhang, K., Xu, G., Han, Z., Ma, K., Zheng, X., Chen, L., Duan, N., & Zhang, S. (2020) · Sensors · doi:10.3390/s20164485 · Cited by 130
Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
Stojnic, V., & Risojevic, V. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00129 · Cited by 118
Impact of leakage delay on bifurcation in high-order fractional BAM neural networks
Huang, C., & Cao, J. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.11.020 · Cited by 128
Instance Localization for Self-supervised Detection Pretraining
Yang, C., Wu, Z., Zhou, B., & Lin, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00398 · Cited by 112
Self-supervised Video Transformer
Ranasinghe, K., Naseer, M., Khan, S. H., Khan, F. S., & Ryoo, M. S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00289 · Cited by 165
Recent trends and advances in fundus image analysis: A review
Iqbal, S., Khan, T. M., Naveed, K., Naqvi, S. S., & Nawaz, S. J. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106277 · Cited by 147
Artificial intelligence in drug combination therapy
Tsigelny, I. F. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bby004 · Cited by 119
Cluster-Guided Asymmetric Contrastive Learning for Unsupervised Person Re-Identification
Li, M., Li, C.-G., & Guo, J. H. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3173163 · Cited by 132
Improvements to Context Based Self-Supervised Learning
Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00973 · Cited by 124
Selfie: Self-supervised Pretraining for Image Embedding
Trinh, T. H., Luong, M.-T., & Le, Q. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02940 · Cited by 65
Wang, S., Wang, T., Yang, L., Yang, D. M., Fujimoto, J., Yi, F., Luo, X., Yang, Y., Yao, B., Lin, S., et al. (2019) · EBioMedicine · doi:10.1016/j.ebiom.2019.10.033 · Cited by 112
Self-Supervised Pretraining Improves Self-Supervised Pretraining
Reed, C. J., Yue, X., Nrusimha, A., Ebrahimi, S., Vijaykumar, V., Mao, R., Li, B., Zhang, S., Guillory, D., Metzger, S., et al. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00112 · Cited by 98
Multi-modal Self-Supervision from Generalized Data TransformationsPreprint
Patrick, M., Asano, Y. M., Кузнецова, П., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · arXiv (Cornell University) · Cited by 149
Unsupervised Feature Learning for Writer Identification and Writer Retrieval
Christlein, V., Gropp, M., Fiel, S., & Maier, A. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.165 · Cited by 136
Self-Supervised Learning of Point Clouds via Orientation Estimation
Poursaeed, O., Jiang, T., Qiao, H., Xu, N., & Kim, V. G. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00112 · Cited by 147
What makes instance discrimination good for transfer learning?
Zhao, N., Wu, Z., Lau, R. W. H., & Lin, S. (2020) · arXiv · doi:10.48550/arxiv.2006.06606 · Cited by 115
Metadata
- Authors
- Dosovitskiy, A., Fischer, P., Springenberg, J. T., Riedmiller, M., & Brox, T.
- Affiliations
- University of Freiburg (DE)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-09-01
- Volume
- 38
- Issue
- 9
- Pages
- 1734-1747
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2144796873
- Cited by
- 762
- References
- 54
- Citations by year
- 2026: 30 · 2025: 73 · 2024: 52 · 2023: 81 · 2022: 125 · 2021: 158 · 2020: 110 · 2019: 55 · 2018: 43 · 2017: 27 · 2016: 5
- FWCI
- 25.50
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ERC (279401)
- BrainLinks-BrainTools Cluster of Excellence
- German Research Foundation (EXC 1086)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- unsupervised feature learning, discriminative feature learning, image transformation, geometric matching, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.