Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 50 of the 54 references it cites were found in a registry or an index.
Abstract
Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning paradigm, where sufficiently many input-output pairs are required for training. Acquisition of large training sets is one of the key challenges, when approaching a new task. In this paper, we aim for generic feature learning and present an approach for training a convolutional network using only unlabeled data. To this end, we train the network to discriminate between a set of surrogate classes. Each surrogate class is formed by applying a variety of transformations to a randomly sampled 'seed' image patch. In contrast to supervised network training, the resulting feature representation is not class specific. It rather provides robustness to the transformations that have been applied during training. This generic feature representation allows for classification results that outperform the state of the art for unsupervised learning on several popular datasets (STL-10, CIFAR-10, Caltech-101, Caltech-256). While features learned with our approach cannot compete with class specific features from supervised training on a classification task, we show that they are advantageous on geometric matching problems, where they also outperform the SIFT descriptor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since each data instance is regarded as one class, the exemplar learning method is difficult to apply to large datasets.”
From Self-supervised learning for medical image analysis using image context restoration (2019) · cites this paper as Dosovitskiy et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Research works printed but not linked: 3
- [36] K. Swersky, J. Snoek, and R. P. Adams, 'Multi-task bayesian optimization,' in NIPS , 2013. -
- [37] C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu, 'Deeply supervised nets,' in Deep Learning and Representation Learning Workshop, NIPS , 2014. -
- [24] S. Rifai, Y. N. Dauphin, P. Vincent, Y. Bengio, and X. Muller, 'The manifold tangent classifier,' in NIPS , 2011. -
Cited by
Items 101–200 of 801
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition
Ahsan, U., Madhok, R., & Essa, I. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00025 · Cited by 106
Associative Deep Clustering: Training a Classification Network with No Labels
Haeusser, P., Plapp, J., Golkov, V., Aljalbout, E., & Cremers, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_2 · Cited by 135
Salient Subsequence Learning for Time Series Clustering
Zhang, Q., Wu, J. X., Zhang, P., Long, G., & Chengqi Zhang, B. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2847699 · Cited by 113
Self-Supervised Learning of Object Parts for Semantic Segmentation
Ziegler, A., & Asano, Y. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01410 · Cited by 165
Physics-driven deep-learning inversion with application to transient electromagnetics
Colombo, D., Türkoğlu, E., Li, W., Sandoval‐Curiel, E., & Rovetta, D. (2021) · Geophysics · doi:10.1190/geo2020-0760.1 · Cited by 112
Deep Fuzzy Clustering - A Representation Learning Approach
Feng, Q., Chen, L., Chen, C. L. P., & Guo, L. (2020) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2020.2966173 · Cited by 121
ClusterFit: Improving Generalization of Visual Representations
Yan, X., Misra, I., Gupta, A., Ghadiyaram, D., & Mahajan, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00654 · Cited by 98
Liu, L., Chen, S., Zhang, F., Wu, F., Pan, Y. F., & Wang, J. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04096-x · Cited by 112
SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning
Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122173 · Cited by 117
A Deep Learning-Based Algorithm Identifies Glaucomatous Discs Using Monoscopic Fundus Photographs
Liu, S., Graham, S. L., Schulz, A., Kalloniatis, M., Zangerl, B., Cai, W., Gao, Y., Chua, B., Arvind, H., Grigg, J., et al. (2018) · Ophthalmology Glaucoma · doi:10.1016/j.ogla.2018.04.002 · Cited by 107
Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis
Li, X., Hu, X., Qi, X., Yu, L., Zhao, W., Heng, P.-A., & Xing, L. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3075244 · Cited by 105
Automatic Data Augmentation for Generalization in Deep Reinforcement Learning
Răileanu, R., Goldstein, M., Yarats, D., Kostrikov, I., & Fergus, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12862 · Cited by 46
Multi-task contrastive learning for automatic CT and X-ray diagnosis of COVID-19
Li, J., Zhao, G., Tao, Y., Zhai, P., Chen, H., He, H., & Cai, T. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107848 · Cited by 116
Self-EMD: Self-Supervised Object Detection without ImageNetPreprint
Liu, S., Li, Z., & Sun, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13677 · Cited by 111
Predicting What You Already Know Helps: Provable Self-Supervised Learning
Lee, J. D., Lei, Q., Saunshi, N., & Zhuo, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01064 · Cited by 45
Unsupervised Learning of Discriminative Attributes and Visual Representations
Huang, C., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.559 · Cited by 98
Learning Representations by Predicting Bags of Visual Words
Gidaris, S., Bursuc, A., Komodakis, N., Perez, P., & Cord, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00696 · Cited by 94
Yang, Z., Sinnott, R., Bailey, J., & Ke, Q. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01853-2 · Cited by 121
Wang, J., Gao, Y., Li, K., Lin, Y., Ma, A. J., Cheng, H., Peng, P., Huang, F., Ji, R., & Sun, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01163 · Cited by 128
On Robustness and Transferability of Convolutional Neural Networks
Djolonga, J., Yung, J., Tschannen, M., Romijnders, R., Beyer, L., Kolesnikov, A., Puigcerver, J., Minderer, M., D'Amour, A., Moldovan, D., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01619 · Cited by 98
tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid FlowPreprint
Xie, Y. X., Franz, E., Chu, M., & Thuerey, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09710 · Cited by 100
On Robustness and Transferability of Convolutional Neural Networks
Djolonga, J., Yung, J., Tschannen, M., Romijnders, R., Beyer, L., Kolesnikov, A., Puigcerver, J., Minderer, M., D'Amour, A., Moldovan, D., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.08558 · Cited by 98
The Surprising Effectiveness of Representation Learning for Visual Imitation
Pari, J., Shafiullah, N. M. (., Arunachalam, S. P., & Pinto, L. (2022) · Robotics: Science and Systems XVIII · doi:10.15607/rss.2022.xviii.010 · Cited by 95
A DEEP CONVOLUTIONAL AUTO-ENCODER WITH POOLING – UNPOOLING LAYERS IN CAFFE
Turchenko, V., Chalmers, E., & Luczak, A. (2019) · International Journal of Computing · doi:10.47839/ijc.18.1.1270 · Cited by 96
Valizadegan, H., Martinho, M. J. S., Wilkens, L. S., Jenkins, J. M., Smith, J. C., Caldwell, D. A., Twicken, J. D., Gerum, P. C. L., Walia, N., Hausknecht, K., et al. (2022) · The Astrophysical Journal · doi:10.3847/1538-4357/ac4399 · Cited by 94
The Surprising Effectiveness of Representation Learning for Visual Imitation
Pari, J., Shafiullah, N. M., Arunachalam, S. P., & Pinto, L. (2021) · arXiv · doi:10.48550/arxiv.2112.01511 · Cited by 94
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning
Gidaris, S., Bursuc, A., Puy, G., Komodakis, N., Cord, M., & Pérez, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00676 · Cited by 120
Seismic stratigraphy interpretation by deep convolutional neural networks: A semisupervised workflow
Di, H., Li, Z., Maniar, H., & Abubakar, A. (2020) · Geophysics · doi:10.1190/geo2019-0433.1 · Cited by 94
Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective
You, C., Dai, W., Min, Y., Liu, F., Clifton, D. A., Zhou, S. K., Staib, L. H., & Duncan, J. S. (2023) · PubMed · doi:10.48550/arxiv.2302.01735 · Cited by 143
Patch2Self: Denoising Diffusion MRI with Self-Supervised LearningPreprint
Fadnavis, S., Batson, J., & Garyfallidis, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01355 · Cited by 169
Automated Brain Metastases Detection Framework for T1-Weighted Contrast-Enhanced 3D MRI
Dikici, E., Ryu, J., Demirer, M., Bigelow, M. T., White, R. D., Slone, W. H., Erdal, B. S., & Prevedello, L. M. S. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2982103 · Cited by 92
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination
Wang, X., Liu, Z., & Yu, S. X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01240 · Cited by 112
Promises and challenges of human computational ethology
Mobbs, D., Wise, T., Suthana, N., Guzmán, N., Kriegeskorte, N., & Leibo, J. Z. (2021) · Neuron · doi:10.1016/j.neuron.2021.05.021 · Cited by 82
Neural Style Transfer: A Critical Review
Singh, A., Jaiswal, V., Joshi, G., Sanjeeve, A., Gite, S., & Kotecha, K. V. (2021) · IEEE Access · doi:10.1109/access.2021.3112996 · Cited by 101
Spatially Consistent Representation Learning
Roh, B., Shin, W., Kim, I., & Kim, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00120 · Cited by 85
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation LearningPreprint
Lee, K., Zhu, Y., Sohn, K., Li, C., Shin, J., & Lee, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08887 · Cited by 102
Aerial orthoimage generation for UAV remote sensing: Review
Zhang, J., Xu, S., Zhao, Y., Sun, J., Xu, S., & Zhang, X. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.08.007 · Cited by 88
DIOD: Fast and Efficient Weakly Semi-Supervised Deep Complex ISAR Object Detection
Xue, B., & Tong, N. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2856821 · Cited by 82
Jigsaw Clustering for Unsupervised Visual Representation Learning
Chen, P., Liu, S., & Jia, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01136 · Cited by 104
Unsupervised Salient Object Detection with Spectral Cluster Voting
Shin, G., Albanie, S., & Xie, W. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00442 · Cited by 100
Deep-learning-based quality filtering of mechanically exfoliated 2D crystals
Saito, Y., Kento, S., Terayama, K., Desai, S. A., Onga, M., Nakagawa, Y., Itahashi, Y. M., Iwasa, Y., Yamada, M., & Tsuda, K. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0262-4 · Cited by 88
Neural Transformation Learning for Deep Anomaly Detection Beyond ImagesPreprint
Chen, Q., Pfrommer, T., Kloft, M., Mandt, S., & Rudolph, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.16440 · Cited by 140
Diffusion Models as Masked Autoencoders
Wei, C., Mangalam, K., Huang, P.-Y., Li, Y., Fan, H., Hu, X., Wang, H., Xie, C., Yuille, A., & Feichtenhofer, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01492 · Cited by 134
EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learning
Liu, H., Jia, J., Qu, W., & Gong, N. Z. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484749 · Cited by 138
A Broad Study of Pre-training for Domain Generalization and Adaptation
Kim, D., Wang, K., Sclaroff, S., & Saenko, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19827-4_36 · Cited by 108
Unsupervised Deep Learning of Compact Binary Descriptors
Lin, K., Lu, J., Chen, C., Zhou, J., & Sun, M. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2833865 · Cited by 79
Self-Supervised Representation Learning for Wafer Bin Map Defect Pattern Classification
Kahng, H., & Kim, S. B. (2020) · IEEE Transactions on Semiconductor Manufacturing · doi:10.1109/tsm.2020.3038165 · Cited by 79
Survey on deep learning methods in human action recognition
Koohzadi, M., & Charkari, N. M. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0355 · Cited by 80
Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognition
Yang, M., Liao, M., Lu, P., Wang, J., Zhu, S., Luo, H., Tian, Q. C., & Bai, X. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547784 · Cited by 95
Mahapatra, D., Poellinger, A., Shao, L., & Reyes, M. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3061724 · Cited by 82
Peng, J., Kim, D. D., Patel, J., Zeng, X., Huang, J., Chang, K., Xun, X., Zhang, C., Sollee, J., Wu, J., et al. (2021) · Neuro-Oncology · doi:10.1093/neuonc/noab151 · Cited by 79
Mehralian, M., & Karasfi, B. (2018) · doi:10.1109/aiar.2018.8769811 · Cited by 84
Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective
Xu, J., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00992 · Cited by 114
Lan, X., Xian, W., Zhou, M., Yan, J., Wei, X., Luo, J., Jia, W., & Kwong, S. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3586106 · Cited by 72
High-resolution photoacoustic microscopy with deep penetration through learning
Cheng, S., Zhou, Y., Chen, J., Li, H., Wang, L., & Lai, P. (2021) · Photoacoustics · doi:10.1016/j.pacs.2021.100314 · Cited by 68
Semi-Supervised Contrastive Learning With Similarity Co-Calibration
Zhang, Y., Zhang, X., Li, J., Qiu, R. C., Xu, H., & Tian, Q. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3158069 · Cited by 67
Dang, B., & Li, Y. (2021) · Remote Sensing · doi:10.3390/rs13163122 · Cited by 73
SCL: Self-supervised contrastive learning for few-shot image classification
Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.05.037 · Cited by 72
Liang, H., Jiang, C., Feng, D., Chen, X., Xu, H., Liang, X., Zhang, W., Li, Z., & Gool, L. V. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00328 · Cited by 93
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images
Wang, W.-C., Ahn, E., Feng, D. D., & Kim, J. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1406-4 · Cited by 72
Solving Inefficiency of Self-supervised Representation Learning
Wang, G., Wang, K., Wang, G., Torr, P. H. S., & Lin, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00937 · Cited by 65
Exemplar based Deep Discriminative and Shareable Feature Learning for scene image classification
Zuo, Z. C., Wang, G., Shuai, B., Zhao, L., & Yang, Q. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.003 · Cited by 65
Cross Pixel Optical-Flow Similarity for Self-supervised Learning
Mahendran, A., Thewlis, J., & Vedaldi, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20873-8_7 · Cited by 70
Fan, H., Chang, X., Zhang, W., Cheng, Y., Sun, Y., & Kankanhalli, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00627 · Cited by 79
Deep Age Estimation: From Classification to Ranking
Chen, S., Zhang, C., & Dong, M. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2786869 · Cited by 68
A review on remote sensing imagery augmentation using deep learning
Lalitha, V., & Latha, B. (2022) · Materials Today Proceedings · doi:10.1016/j.matpr.2022.03.341 · Cited by 62
Akhavan, J., Lyu, J., & Manoochehri, S. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02121-4 · Cited by 62
Yu, Y., Gong, Z., Wang, C., & Zhong, P. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2767626 · Cited by 65
Unsupervised and Semi-Supervised Image Classification With Weak Semantic Consistency
Zhang, C., Cheng, J., & Tian, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2903628 · Cited by 62
Gómez‐de‐Mariscal, E., Maška, M., Kotrbova, A. V., Pospíchalová, V., Matula, P., & Muñoz‐Barrutia, A. (2019) · Scientific Reports · doi:10.1038/s41598-019-49431-3 · Cited by 68
Fighting Class Imbalance with Contrastive Learning
Marrakchi, Y., Makansi, O., & Brox, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87199-4_44 · Cited by 76
Self-citationPseudo-Pair Based Self-Similarity Learning for Unsupervised Person Re-Identification
Wu, L. Y., Liu, D., Zhang, W., Chen, D., Ge, Z., Boussaïd, F., Bennamoun, M., & Shen, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3186746 · Cited by 63
Liu, Q., Zhang, X., & Liu, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3353718 · Cited by 66
Representation Learning via Global Temporal Alignment and Cycle-Consistency
Hadji, I., Derpanis, K. G., & Jepson, A. D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01092 · Cited by 88
Unsupervised Hyperbolic Metric Learning
Yan, J., Luo, L., Deng, C. D., & Huang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01228 · Cited by 83
Probabilistic Representations for Video Contrastive Learning
Park, J., Lee, J., Kim, I.-J., & Sohn, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01430 · Cited by 80
Incremental False Negative Detection for Contrastive LearningPreprint
Chen, T.-S., Hung, W.-C., Tseng, H.-Y., Chien, S., & Yang, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03719 · Cited by 89
Li, S., Liu, F., Jiao, L., Chen, P., & Li, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3185638 · Cited by 62
Robust Cross-Modal Representation Learning with Progressive Self-Distillation
Andonian, A., Chen, S., & Hamid, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01594 · Cited by 90
Nemavhola, A., Chibaya, C., & Viriri, S. (2025) · Information · doi:10.3390/info16020107 · Cited by 64
On Exposing the Challenging Long Tail in Future Prediction of Traffic Actors
Makansi, O., Çiçek, Ö., Marrakchi, Y., & Brox, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01290 · Cited by 91
Self-citationA Framework for Learning Ante-hoc Explainable Models via Concepts
Sarkar, A., Vijaykeerthy, D., Sarkar, A., & Balasubramanian, V. N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01004 · Cited by 93
Contrastive Self-Supervised Learning: A Survey on Different Architectures
Khan, A., Albarri, S., & Manzoor, M. A. (2022) · doi:10.1109/icai55435.2022.9773725 · Cited by 74
CDS: Cross-Domain Self-supervised Pre-training
Kim, D., Saito, K., Oh, T.-H., Plummer, B. A., Sclaroff, S., & Saenko, K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00899 · Cited by 70
DisCo: Remedying Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning
Gao, Y., Zhuang, J., Lin, S., Cheng, H., Sun, X., Li, K., & Shen, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_14 · Cited by 68
Unsupervised Palmprint Image Quality Assessment via Pseudo-Label Generation and Ranking Guidance
Zou, Y., Liu, C., Shao, H., & Zhong, D. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3288259 · Cited by 58
Yellapragada, B., Hornauer, S., Snyder, K. R., Yu, S. X., & Yiu, G. C. (2021) · Ophthalmology Retina · doi:10.1016/j.oret.2021.06.010 · Cited by 60
Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach
Vo, H. V., Khalidov, V., Darcet, T., Moutakanni, T., Smetanin, N., Szafraniec, M., Touvron, H., Couprie, C., Oquab, M., Joulin, A., et al. (2024) · Transactions on machine learning research · doi:10.48550/arxiv.2405.15613 · Cited by 88
Self-Supervised Learning of Local Features in 3D Point Clouds
Thabet, A., Alwassel, H., & Ghanem, B. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00477 · Cited by 55
Mahapatra, D., Ge, Z., & Reyes, M. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3163232 · Cited by 60
Time-Equivariant Contrastive Video Representation Learning
Jenni, S., & Jin, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00982 · Cited by 74
Vi2CLR: Video and Image for Visual Contrastive Learning of Representation
Diba, A., Sharma, V., Safdari, R., Lotfi, D., Sarfraz, M. S., Stiefelhagen, R., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00153 · Cited by 53
A survey of 2D shape representation: Methods, evaluations, and future research directions
Kurnianggoro, L., Wahyono, W., & Jo, K.-H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.093 · Cited by 53
Probabilistic Structural Latent Representation for Unsupervised Embedding
Ye, M., & Shen, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00550 · Cited by 55
Munawar, A., Vinayavekhin, P., & De Magistris, G. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.118 · Cited by 44
Pre-Training Audio Representations With Self-Supervision
Tagliasacchi, M., Gfeller, B., Quitry, F. D. C., & Roblek, D. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.2985586 · Cited by 61
Rao, Y., Liu, B., Wei, Y., Lu, J., Hsieh, C., & Zhou, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00327 · Cited by 63
Distilling Localization for Self-Supervised Representation Learning
Zhao, N., Wu, Z., Lau, R. W. H., & Lin, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17312 · Cited by 37
Machine learning–based analysis of in-cylinder flow fields to predict combustion engine performance
Hanuschkin, A., Schober, S., Bode, J., Schorr, J., Böhm, B., Krüger, C., & Peters, S. (2019) · International Journal of Engine Research · doi:10.1177/1468087419833269 · Cited by 48
Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation
Mahapatra, D., Bozorgtabar, B., & Shao, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00963 · Cited by 50
Metadata
- Authors
- Dosovitskiy, A., Fischer, P., Springenberg, J. T., Riedmiller, M., & Brox, T.
- Affiliations
- University of Freiburg (DE)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-09-01
- Volume
- 38
- Issue
- 9
- Pages
- 1734-1747
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2144796873
- Cited by
- 762
- References
- 54
- Citations by year
- 2026: 30 · 2025: 73 · 2024: 52 · 2023: 81 · 2022: 125 · 2021: 158 · 2020: 110 · 2019: 55 · 2018: 43 · 2017: 27 · 2016: 5
- FWCI
- 25.50
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ERC (279401)
- BrainLinks-BrainTools Cluster of Excellence
- German Research Foundation (EXC 1086)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- unsupervised feature learning, discriminative feature learning, image transformation, geometric matching, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.