Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 50 of the 54 references it cites were found in a registry or an index.
Abstract
Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning paradigm, where sufficiently many input-output pairs are required for training. Acquisition of large training sets is one of the key challenges, when approaching a new task. In this paper, we aim for generic feature learning and present an approach for training a convolutional network using only unlabeled data. To this end, we train the network to discriminate between a set of surrogate classes. Each surrogate class is formed by applying a variety of transformations to a randomly sampled 'seed' image patch. In contrast to supervised network training, the resulting feature representation is not class specific. It rather provides robustness to the transformations that have been applied during training. This generic feature representation allows for classification results that outperform the state of the art for unsupervised learning on several popular datasets (STL-10, CIFAR-10, Caltech-101, Caltech-256). While features learned with our approach cannot compete with class specific features from supervised training on a classification task, we show that they are advantageous on geometric matching problems, where they also outperform the SIFT descriptor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since each data instance is regarded as one class, the exemplar learning method is difficult to apply to large datasets.”
From Self-supervised learning for medical image analysis using image context restoration (2019) · cites this paper as Dosovitskiy et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Research works printed but not linked: 3
- [36] K. Swersky, J. Snoek, and R. P. Adams, 'Multi-task bayesian optimization,' in NIPS , 2013. -
- [37] C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu, 'Deeply supervised nets,' in Deep Learning and Representation Learning Workshop, NIPS , 2014. -
- [24] S. Rifai, Y. N. Dauphin, P. Vincent, Y. Bengio, and X. Muller, 'The manifold tangent classifier,' in NIPS , 2011. -
Cited by
Items 201–300 of 801
The Challenges of Continuous Self-Supervised Learning
Purushwalkam, S., Morgado, P. M., & Gupta, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_40 · Cited by 67
Clustering based Point Cloud Representation Learning for 3D Analysis
Feng, T., Wang, W., Wang, X., Yang, Y., & Zheng, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00761 · Cited by 61
Feature-Guided Multitask Change Detection Network
Deng, Y., Chen, J., Yi, S., Yue, A., Meng, Y., Chen, J., & Zhang, Y. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3215773 · Cited by 47
Cross-domain Self-supervised Learning for Domain Adaptation with Few Source LabelsPreprint
Kim, D., Saito, K., Oh, T.-H., Plummer, B. A., Sclaroff, S., & Saenko, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08264 · Cited by 53
Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics
Jenni, S., Jin, H., & Favaro, P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00644 · Cited by 53
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
Hoffmann, D. T., Behrmann, N., Gall, J., Brox, T., & Noroozi, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19972 · Cited by 73
Self-citationPoint-Level Region Contrast for Object Detection Pre-Training
Bai, Y., Chen, X., Kirillov, A., Yuille, A., & Berg, A. C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01559 · Cited by 57
Self-supervised audio representation learning for mobile devicesPreprint
Tagliasacchi, M., Gfeller, B., Quitry, F. D. C., & Roblek, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11796 · Cited by 44
Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning
Wu, X., Wen, X., Liu, X., & Zhao, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00908 · Cited by 87
Learning Spatial-Semantic Relationship for Facial Attribute Recognition with Limited Labeled Data
Shu, Y., Yan, Y., Chen, S., Xue, J., Shen, C., & Wang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01174 · Cited by 51
Face Recognition Using the SR-CNN Model
Yang, Y., Wen, C. B., Xie, K., Wen, F., Sheng, G., & Tang, X. (2018) · Sensors · doi:10.3390/s18124237 · Cited by 50
Automatic Data Augmentation Via Deep Reinforcement Learning for Effective Kidney Tumor Segmentation
Qin, T., Wang, Z., He, K., Shi, Y., Gao, Y., & Shen, D. G. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053403 · Cited by 45
Chen, S., Han, Y., Lin, J., Zhao, X., & Kong, P. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101881 · Cited by 42
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning
Denize, J., Rabarisoa, J., Orcesi, A., Hérault, R., & Canu, S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00273 · Cited by 53
Lee, J., & Sohn, S. Y. (2020) · Scientometrics · doi:10.1007/s11192-020-03731-y · Cited by 42
Deeply Unsupervised Patch Re-Identification for Pre-Training Object Detectors
Ding, J., Xie, E., Xu, H., Jiang, C., Li, Z., Luo, P., & Xia, G.-S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3164911 · Cited by 45
Fidelity-Weighted LearningPreprint
Dehghani, M., Mehrjou, A., Gouws, S., Kamps, J., & Schölkopf, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02799 · Cited by 75
Zhu, Y. M., Liang, X., Wang, T., Xie, J., & Yang, J. N. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3225008 · Cited by 51
Solving Graph Coloring Problem via Graph Neural Network (GNN)
Ijaz, A. Z., Ali, R. H., Ali, N., Laique, T., & Khan, T. A. (2022) · International Conference on Emerging Technologies · doi:10.1109/icet56601.2022.10004654 · Cited by 46
Scene Parsing Using Fully Convolutional Network for Semantic Segmentation
Ali, N., Ijaz, A. Z., Ali, R. H., Abideen, Z. U., & Bais, A. (2023) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece58730.2023.10288934 · Cited by 40
A Unified View of Masked Image Modeling
Peng, Z., Li, D., Bao, H., Ye, Q., & Wei, F. (2022) · Transactions on machine learning research · doi:10.48550/arxiv.2210.10615 · Cited by 45
Domain Knowledge-Guided Self-Supervised Change Detection for Remote Sensing Images
Yan, L., Yang, J., & Wang, J. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3270498 · Cited by 31
Res2-UNeXt: a novel deep learning framework for few-shot cell image segmentation
Chan, S., Huang, C., Bai, C., Ding, W., & Chen, S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10536-5 · Cited by 41
Unsupervised Learning using Pretrained CNN and Associative Memory Bank
Liu, Q., & Mukhopadhyay, S. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489408 · Cited by 48
From Big to Small: Adaptive Learning to Partial-Set Domains
Cao, Z., You, K., Zhang, Z., Wang, J., & Long, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3159831 · Cited by 46
Self-supervised Contrastive Learning of Multi-view Facial Expressions
Roy, S., & Etemad, A. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479955 · Cited by 46
Camera-Based In-Process Quality Measurement of Hairpin Welding
Hartung, J., Jahn, A., Bocksrocker, O., & Heizmann, M. (2021) · Applied Sciences · doi:10.3390/app112110375 · Cited by 37
Reducing and Stretching Deep Convolutional Activation Features for Accurate Image Classification
Zhong, G., Yan, S., Huang, K., Cai, Y., & Dong, J. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9515-z · Cited by 37
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning
Knights, J., Harwood, B., Ward, D., Vanderkop, A., Mackenzie-Ross, O., & Moghadam, P. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412071 · Cited by 46
Nguyen, N., & Chang, J. M. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3121663 · Cited by 38
A survey on intelligent human action recognition techniques
Kumar, R., & Kumar, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17529-6 · Cited by 46
A Comprehensive Survey on Self-Supervised Learning for Specific Emitter Identification
Liu, C., Gui, G., Wang, Y., Ohtsuki, T. O., Niyato, D. T., & Shen, X. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3588171 · Cited by 41
A Shape Transformation-based Dataset Augmentation Framework for Pedestrian Detection
Chen, Z., Ouyang, W., Liu, T., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01412-0 · Cited by 35
Improving the slice interaction of 2.5D CNN for automatic pancreas segmentation
Zheng, H., Qian, L., Qin, Y., Gu, Y., & Yang, J. (2020) · Medical Physics · doi:10.1002/mp.14303 · Cited by 36
Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation
Yang, J., Li, C., An, W., Ma, H., Guo, Y., Rong, Y., Zhao, P., & Huang, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00906 · Cited by 47
MiCE: Mixture of Contrastive Experts for Unsupervised Image ClusteringPreprint
Tsai, T. W., Li, C., & Zhu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.01899 · Cited by 58
Mix-and-Match Tuning for Self-Supervised Semantic Segmentation
Zhan, X., Liu, Z., Luo, P., Tang, X., & Loy, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12331 · Cited by 34
Rethinking 360° Image Visual Attention Modelling with Unsupervised Learning
Djilali, Y. A. D., Krishna, T., McGuinness, K., & O'Connor, N. E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01513 · Cited by 39
PhilEO Bench: Evaluating Geo-Spatial Foundation Models
Fibæk, C. S., Camilleri, L., Luyts, A., Dionelis, N., & Saux, B. L. (2024) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss53475.2024.10642780 · Cited by 51
Ember: energy management of batteryless event detection sensors with deep reinforcement learning
Fraternali, F., Balaji, B., Sengupta, D., Hong, D., & Gupta, R. K. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430734 · Cited by 41
MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
Fu, Y., & Feng, X. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892218 · Cited by 43
Fully Convolutional Network-Based Self-Supervised Learning for Semantic Segmentation
Yang, Z., Yu, H., He, Y., Sun, W., Mao, Z., & Mian, A. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3172423 · Cited by 38
Decomposition Methods for Machine Learning with Small, Incomplete or Noisy Datasets
Caiafa, C. F., Solé-Casals, J., Marti-Puig, P., Zhe, S., & Tanaka, T. (2020) · Applied Sciences · doi:10.3390/app10238481 · Cited by 33
Demertzis, K., & Iliadis, L. (2020) · Algorithms · doi:10.3390/a13030061 · Cited by 33
Wang, G., Xie, X., Lai, J., & Zhuo, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.306 · Cited by 33
Pruning Convolutional Neural Networks with Self-SupervisionPreprint
Caron, M., Morcos, A. S., Bojanowski, P., Mairal, J., & Joulin, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03554 · Cited by 35
Information maximization clustering via multi-view self-labelling
Ntelemis, F., Jin, Y., & Thomas, S. A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109042 · Cited by 36
Unsupervised Object Detection with LiDAR Clues
Tian, H., Chen, Y., Dai, J., Zhang, Z., & Zhu, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00590 · Cited by 41
Song, C., Yang, B., Zhang, L., & Wu, D. (2021) · Plant Methods · doi:10.1186/s13007-021-00748-z · Cited by 33
How Transferable Are Self-supervised Features in Medical Image Classification Tasks?Preprint
Truong, T., Mohammadi, S., & Lenga, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10048 · Cited by 66
Deng, X., Zhu, Y., & Newsam, S. D. (2018) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/3274895.3274969 · Cited by 39
Long Short View Feature Decomposition via Contrastive Video Representation Learning
Behrmann, N., Fayyaz, M., Gall, J., & Noroozi, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00911 · Cited by 40
Contrastive Bayesian Analysis for Deep Metric Learning
Kan, S., He, Z., Cen, Y., Li, Y., Mladenovic, V. M., & He, Z. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3221486 · Cited by 40
Multi-task self-supervised time-series representation learning
Choi, H., & Kang, P. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120654 · Cited by 34
DeiT-LT: Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
Rangwani, H., Mondal, P., Mishra, M., Asokan, A. R., & Babu, R. V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02208 · Cited by 50
Berenguer, A. D., Oveneke, M. C., Khalid, H.-U.-R., Alioscha‐Perez, M., Bourdoux, A., & Sahli, H. (2019) · IEEE Access · doi:10.1109/access.2019.2942305 · Cited by 30
Transformation GAN for Unsupervised Image Synthesis and Representation Learning
Wang, J., Zhou, W., Qi, G.-J., Fu, Z., Tian, Q. C., & Li, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00055 · Cited by 34
A Centrifugal Pump Fault Diagnosis Framework Based on Supervised Contrastive Learning
Ahmad, S., Ahmad, Z., & Kim, J.-M. (2022) · Sensors · doi:10.3390/s22176448 · Cited by 34
A Multi-Level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference
Li, S., Hu, X., Li, L., Liu, A., Wen, L., & Yu, P. S. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3270771 · Cited by 33
Gao, Z. Y., Sun, W., Lu, Y., Zhang, Y., Song, W., Zhang, Y., & Zhai, R. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3290232 · Cited by 43
Self-Supervised Point Set Local Descriptors for Point Cloud Registration
Yuan, Y., Borrmann, D., Hou, J., Ma, Y., Nüchter, A., & Schwertfeger, S. (2021) · Sensors · doi:10.3390/s21020486 · Cited by 33
Kilinc, O., & Uysal, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.03063 · Cited by 31
Rapid Synthesis of Cryo-ET Data for Training Deep Learning ModelsPreprint
Purnell, C. J., Heebner, J. E., Swulius, M. T., Hylton, R. K., Kabonick, S. G., Grillo, M. A., Grigoryev, S. A., Heberle, F. A., Waxham, M. N., & Swulius, M. T. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.04.28.538636 · Cited by 34
Mahmood, M. A., Jamel, L., Alturki, N. M., & Tawfeek, M. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-96014-6 · Cited by 31
RetractedUltrasound Image Representation Learning by Modeling Sonographer Visual Attention
Droste, R., Cai, Y., Sharma, H., Chatelain, P., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-20351-1_46 · Cited by 30
Weakly Supervised Discriminative Feature Learning With State Information for Person Identification
Yu, H.-X., & Zheng, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00557 · Cited by 36
Improving Semantic Analysis on Point Clouds via Auxiliary Supervision of Local Geometric Priors
Tang, L., Chen, K., Wu, C., Hong, Y., Jia, K., & Yang, Z.-X. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3025798 · Cited by 33
Supervised Momentum Contrastive Learning for Few-Shot ClassificationPreprint
Majumder, O., Ravichandran, A., Maji, S., Achille, A., Polito, M., & Soatto, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11058 · Cited by 31
A study of the generalizability of self-supervised representations
Tendle, A., & Hasan, M. R. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100124 · Cited by 43
Schreyer, M., Sattarov, T., & Borth, D. (2021) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3490354.3494373 · Cited by 33
Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks
Jezequel, L., Vu, N., Beaudet, J., & Histace, A. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3231532 · Cited by 32
Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning
Patrick, M., Huang, P.-Y., Misra, I., Metze, F., Vedaldi, A., Asano, Y. M., & Henriques, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01039 · Cited by 43
Unsupervised Visual Representation Learning by Online Constrained K-Means
Qian, Q., Xu, Y., Hu, J., Li, H., & Jin, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01614 · Cited by 47
MinEnt: Minimum entropy for self-supervised representation learning
Li, S., Liu, F., Hao, Z., Jiao, L., Liu, X., & Guo, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109364 · Cited by 36
Personalized Speech Enhancement Through Self-Supervised Data Augmentation and Purification
Sivaraman, A., Kim, S., & Kim, M. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1868 · Cited by 32
Text-to-image synthesis with self-supervised learning
Tan, Y. X., Lee, C. P., Neo, M., & Lim, K. M. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.04.010 · Cited by 27
Robust image hashing for content identification through contrastive self-supervised learning
Fonseca-Bustos, J., Ramírez-Gutiérrez, K. A., & Feregrino-Uribe, C. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.028 · Cited by 29
Learning Salient Feature for Salient Object Detection Without Labels
Li, S., Liu, F., Jiao, L., Liu, X., & Chen, P. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3209978 · Cited by 29
When Multitask Learning Meets Partial Supervision: A Computer Vision Review
Fontana, M., Spratling, M., & Shi, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3435012 · Cited by 33
Unsupervised Visual Representation Learning via Dual-Level Progressive Similar Instance Selection
Fan, H., Liu, P., Xu, M., & Yang, Y. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3054978 · Cited by 29
The Emergence of Objectness: Learning Zero-Shot Segmentation from VideosPreprint
Liu, R., Wu, Z., Yu, S. X., & Lin, S. C.-F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.06394 · Cited by 43
A data augmentation approach to train fully convolutional networks for left ventricle segmentation
Lin, A., Wu, J., & Yang, X. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.08.004 · Cited by 27
An end-to-end exemplar association for unsupervised person Re-identification
Wu, J., Yang, Y., Lei, Z., Wang, J., Li, S. Z., Tiwari, P., & Pandey, H. M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.015 · Cited by 26
Wang, J., & Zhang, W. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-189039 · Cited by 26
Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency
Wu, H., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00999 · Cited by 35
Self-Taught Metric Learning without Labels
Kim, S., Kim, D.-W., Cho, M., & Kwak, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00728 · Cited by 39
CDbin: Compact Discriminative Binary Descriptor Learned With Efficient Neural Network
Ye, J., Zhang, S. S., Huang, T., & Rui, Y. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2896095 · Cited by 32
SETTI: A S elf-supervised Adv E rsarial Malware De T ection Archi T ecture in an I oT Environment
Golmaryami, M., Taheri, R., Pooranian, Z., Shojafar, M., & Xiao, P. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3536425 · Cited by 28
MimCo: Masked Image Modeling Pre-training with Contrastive Teacher
Zhou, Q., Yu, C., Luo, H., Wang, Z., & Li, H. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548173 · Cited by 37
Unsupervised Deep Metric Learning via Orthogonality Based Probabilistic Loss
Dutta, U. K., Harandi, M. T., & Sekhar, C. C. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2020.3026982 · Cited by 33
Parts2Whole: Self-supervised Contrastive Learning via Reconstruction
Feng, R., Zhou, Z., Gotway, M. B., & Liang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60548-3_9 · Cited by 33
Li, Y., Kan, S., & He, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58621-8_9 · Cited by 34
Unsupervised phenotypic analysis of cellular images with multi-scale convolutional neural networksPreprint
Godinez, W. J., Hossain, I., & Zhang, X. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/361410 · Cited by 25
Learning a deep predictive coding network for a semi-supervised 3D-hand pose estimation
Banzi, J. F., Bulugu, I., & Ye, Z. (2020) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003090 · Cited by 24
Zhang, X., & Han, L. (2023) · Remote Sensing · doi:10.3390/rs15215238 · Cited by 26
Location-Aware Self-Supervised Transformers for Semantic Segmentation
Caron, M., Houlsby, N., & Schmid, C. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00019 · Cited by 38
Self-supervised deep metric learning for ancient papyrus fragments retrieval
Pirrone, A., Beurton‐Aimar, M., & Journet, N. (2021) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-021-00369-1 · Cited by 29
SSL++: Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem
Song, C., Xue, J., Chang, J., Zhang, J., Yang, J., & Tian, Q. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3135470 · Cited by 25
Directional Self-supervised Learning for Heavy Image Augmentations
Bai, Y., Yang, Y., Zhang, W., & Mei, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01619 · Cited by 30
SSCLNet: A Self-Supervised Contrastive Loss-Based Pre-Trained Network for Brain MRI Classification
Mishra, A., Jha, R., & Bhattacharjee, V. (2023) · IEEE Access · doi:10.1109/access.2023.3237542 · Cited by 23
Metadata
- Authors
- Dosovitskiy, A., Fischer, P., Springenberg, J. T., Riedmiller, M., & Brox, T.
- Affiliations
- University of Freiburg (DE)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-09-01
- Volume
- 38
- Issue
- 9
- Pages
- 1734-1747
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2144796873
- Cited by
- 762
- References
- 54
- Citations by year
- 2026: 30 · 2025: 73 · 2024: 52 · 2023: 81 · 2022: 125 · 2021: 158 · 2020: 110 · 2019: 55 · 2018: 43 · 2017: 27 · 2016: 5
- FWCI
- 25.50
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ERC (279401)
- BrainLinks-BrainTools Cluster of Excellence
- German Research Foundation (EXC 1086)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- unsupervised feature learning, discriminative feature learning, image transformation, geometric matching, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.