Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning
Open accessThe DOI matches its OpenAlex record; 37 of the 37 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“It is shown that this loss function makes use of unlabeled data and pushes the decision boundary to a less dense area of decision space.”
BackgroundGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
(2010) · Cited by 14,134
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382 · cited 1×
“Stochastic gradient descent, dropout [8], randomized data transformation and augmentation [9] and many other training techniques that are essential for fast convergence and effective generalization of the learning functions introduce some non-deterministic behavior to the learning system.”
BackgroundCombining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,518
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Cited by
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
Sohn, K., Berthelot, D., Li, C.-L., Zhang, Z., Carlini, N., Cubuk, E. D., Kurakin, A., Zhang, H., & Raffel, C. (2020) · arXiv · doi:10.48550/arxiv.2001.07685 · Cited by 2,892
“This has led to a plethora of SSL methods that are designed for deep networks [28, 39, 21, 43, 3, 45, 2, 22, 38].”
BackgroundMethodInfluentialVirtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
Miyato, T., Maeda, S.-I., Koyama, M., & Ishii, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858821 · Cited by 2,843
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
A survey on semi-supervised learning
van Engelen, J. E., & Hoos, H. H. (2020) · Machine Learning · doi:10.1007/s10994-019-05855-6 · Cited by 2,666
“Such an approach was taken by Sajjadi et al. (2016), who additionally perturbed the input data with random transformations.”
MethodUnsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
Training Generative Adversarial Networks with Limited Data
Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., & Aila, T. (2020) · arXiv · doi:10.48550/arxiv.2006.06676 · Cited by 1,170
AutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014
Interpolation consistency training for semi-supervised learning
Verma, V., Kawaguchi, K., Lamb, A., Kannala, J., Solin, A., Bengio, Y., & Lopez-Paz, D. (2022) · Neural Networks · doi:10.1016/j.neunet.2021.10.008 · Cited by 881
Realistic Evaluation of Deep Semi-Supervised Learning Algorithms
Oliver, A., Odena, A., Raffel, C., Cubuk, E. D., & Goodfellow, I. J. (2018) · arXiv · doi:10.48550/arxiv.1804.09170 · Cited by 772
Label Propagation for Deep Semi-Supervised Learning
Iscen, A., Tolias, G., Avrithis, Y., & Chum, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00521 · Cited by 686
Semi-supervised Medical Image Segmentation through Dual-task Consistency
Luo, X., Chen, J., Song, T., & Wang, G. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17066 · Cited by 684
Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation
Yang, L., Qi, L., Feng, L., Zhang, W., & Shi, Y. (2022) · arXiv · doi:10.48550/arxiv.2208.09910 · Cited by 619
Roy, S., Menapace, W., Oei, S., Luijten, B., Fini, E., Saltori, C., Huijben, I., Chennakeshava, N., Mento, F., Sentelli, A., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2994459 · Cited by 597
Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation
Yang, L., Qi, L., Feng, L., Zhang, W., & Shi, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00699 · Cited by 580
End-to-End Semi-Supervised Object Detection with Soft Teacher
Xu, M., Zhang, Z., Hu, H., Wang, J., Wang, L., Wei, F., Bai, X., & Liu, Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00305 · Cited by 565
MixMatch: A Holistic Approach to Semi-Supervised Learning
Berthelot, D., Carlini, N., Goodfellow, I., Papernot, N., Oliver, A., & Raffel, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02249 · Cited by 562
Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation
Li, X., Yu, L., Chen, H., Fu, C.-W., Xing, L., & Heng, P.-A. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2995319 · Cited by 543
ST++: Make Self-trainingWork Better for Semi-supervised Semantic Segmentation
Yang, L., Zhuo, W., Qi, L., Shi, Y., & Gao, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00423 · Cited by 518
Deep Co-Training for Semi-Supervised Image Recognition
Qiao, S., Shen, W., Zhang, Z., Wang, B., & Yuille, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_9 · Cited by 507
Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels
Wang, Y., Wang, H., Shen, Y., Fei, J., Li, W., Jin, G., Wu, L., Zhao, R., & Le, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00421 · Cited by 504
FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling
Zhang, B., Wang, Y., Hou, W., Wu, H., Wang, J., Okumura, M., & Shinozaki, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08263 · Cited by 466
Colorization as a Proxy Task for Visual Understanding
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.96 · Cited by 458
Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification
Zhuang, C., & Ma, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186116 · Cited by 423
Data Distillation: Towards Omni-Supervised Learning
Radosavovic, I., Dollar, P., Girshick, R., Gkioxari, G., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00433 · Cited by 421
Big Self-Supervised Models are Strong Semi-Supervised Learners
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10029 · Cited by 421
Semi-Supervised Sequence Modeling with Cross-View Training
Clark, K., Luong, M.-T., Manning, C. D., & Le, Q. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1217 · Cited by 366
MIC: Masked Image Consistency for Context-Enhanced Domain Adaptation
Hoyer, L., Dai, D., Wang, H., & Van Gool, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01128 · Cited by 357
Jiao, R., Zhang, Y., Ding, L., Xue, B., Zhang, J., Cai, R., & Jin, C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107840 · Cited by 345
Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities
Qi, G.-J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01265-2 · Cited by 341
Learning to Learn From Noisy Labeled Data
Li, J., Wong, Y., Zhao, Q., & Kankanhalli, M. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00519 · Cited by 324
Qi, G.-J., & Luo, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3031898 · Cited by 315
A Simple Semi-Supervised Learning Framework for Object Detection
Sohn, K., Zhang, Z., Li, C., Zhang, H., Lee, C., & Pfister, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04757 · Cited by 306
CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning
Wei, C., Sohn, K., Mellina, C., Yuille, A., & Yang, F. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01071 · Cited by 298
LSTM Learning With Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT
Wu, D., Jiang, Z., Xie, X., Wei, X., Yu, W., & Li, R. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2952917 · Cited by 290
CoMatch: Semi-supervised Learning with Contrastive Graph Regularization
Li, J., Xiong, C., & Hoi, S. C. H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00934 · Cited by 284
Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised Learning
Cascante-Bonilla, P., Tan, F., Qi, Y., & Ordonez, V. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16852 · Cited by 281
Xia, Y., Yang, D., Yu, Z., Liu, F., Cai, J., Yu, L., Zhu, Z., Xu, D., Yuille, A., & Roth, H. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101766 · Cited by 278
Learning Discrete Representations via Information Maximizing Self-Augmented Training
Hu, W., Miyato, T., Tokui, S., Matsumoto, E., & Sugiyama, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08720 · Cited by 271
Smooth Neighbors on Teacher Graphs for Semi-Supervised Learning
Luo, Y., Zhu, J., Li, M., Ren, Y., & Zhang, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00927 · Cited by 264
Alonso, I., Sabater, A., Ferstl, D., Montesano, L., & Murillo, A. C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00811 · Cited by 264
Transductive Semi-Supervised Deep Learning Using Min-Max Features
Shi, W., Gong, Y., Ding, C., Ma, Z., Tao, X., & Zheng, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_19 · Cited by 215
“Recent research works [24–28] have explored supervisory information from unlabeled image samples by adding different perturbations to each image, and enforcing the label consistency between different perturbed versions of the image.”
BackgroundSPICE: Semantic Pseudo-Labeling for Image Clustering
Niu, C., Shan, H., & Wang, G. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3221290 · Cited by 185
“In this category, remarkable results were obtained with consistency regularization [45], [46] that constrains the model to output the same prediction for different transformations of the same image, pseudolabeling [47] that uses confident predictions of the model as the labels to guide training processes, and entropy…”
BackgroundSemi-supervised Medical Image Segmentation via Learning Consistency Under Transformations
Bortsova, G., Dubost, F., Hogeweg, L., Katramados, I., & de Bruijne, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32226-7_90 · Cited by 183
“This idea was already explored before and applied to the prediction of image-level labels: image classification [13,10] and landmark coordinate regression [6].”
Method3D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Training
Xia, Y., Liu, F., Yang, D., Cai, J., Yu, L., Zhu, Z., Xu, D., Yuille, A., & Roth, H. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093608 · Cited by 170
Are Labels Required for Improving Adversarial Robustness?
Uesato, J., Alayrac, J.-B., Huang, P.-S., Stanforth, R., Fawzi, A., & Kohli, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13725 · Cited by 159
FocalMix: Semi-Supervised Learning for 3D Medical Image Detection
Wang, D., Zhang, Y., Zhang, K., & Wang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00401 · Cited by 157
Self-supervised driven consistency training for annotation efficient histopathology image analysis
Srinidhi, C. L., Kim, S. W., Chen, F.-D., & Martel, A. L. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102256 · Cited by 116
“tion (Laine and Aila, 2016; Sajjadi et al., 2016), and adversarial perturbation (Miyato et al.”
BackgroundMethodPseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning
Arazo, E., Ortego, D., Albert, P., O'Connor, N. E., & McGuinness, K. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207304 · Cited by 77
Semi-Supervised Contrastive Learning With Similarity Co-Calibration
Zhang, Y., Zhang, X., Li, J., Qiu, R. C., Xu, H., & Tian, Q. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3158069 · Cited by 67
Self-Supervised Wasserstein Pseudo-Labeling for Semi-Supervised Image Classification
Taherkhani, F., Dabouei, A., Soleymani, S., Dawson, J., & Nasrabadi, N. M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01209 · Cited by 45
Hailat, Z., Komarichev, A., & Chen, X.-W. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546327 · Cited by 13
“Sajjadi [14] on various labeled / unlabeled training ratios from the SVHN dataset.”
BackgroundMethodInfluential
Metadata
- Authors
- Sajjadi, M. S. M., Javanmardi, M., & Taşdizen, T.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2016-06-14
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.04586
- OpenAlex
- W2431080869
- Cited by
- 532
- References
- 37
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.