The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Multi-Modal Curriculum Learning for Semi-Supervised Image Classification
Abstract
Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 2×
“This learning approach was proposed by [10], which hypothesizes that curriculum learning is able to boost the convergence speed of the training process as well as find a better local minima than the existing solvers for non-convex problems.”
BackgroundConstrained Optimization and Lagrange Multiplier Methods
(1982) · Elsevier eBooks · doi:10.1016/c2013-0-10366-2 · Cited by 4,016
Learning with Local and Global Consistency
Zhou, D., Bousquet, O., Lal, T. N., Weston, J., & Schölkopf, B. (2003) · MPG.PuRe (Max Planck Society) · Cited by 3,864
(2006) · Cited by 3,624
Semi-supervised learning using Gaussian fields and harmonic functions
Zhu, X., Zoubin Ghahramani, A., & Lafferty, J. (2003) · Cited by 3,509
NUS-WIDE: a real-world web image database from National University of Singapore
Chua, T.-S., Tang, J., Hong, R., Li, H., Luo, Z., & Zheng, Y. (2009) · Proceedings of the ACM International Conference on Image and Video Retrieval · doi:10.1145/1646396.1646452 · Cited by 3,025
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Face Recognition with Local Binary Patterns
Ahonen, T., Hadid, A., & Pietikäinen, M. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_36 · Cited by 2,462
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01548-9 · Cited by 1,766
Learning from labeled and unlabeled data with label propagation
Zhu, X., & Ghahramani, Z. (2002) · Cited by 1,534
Representing shape with a spatial pyramid kernel
Bosch, A., Zisserman, A., & Munoz, X. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282340 · Cited by 1,399
Self-Paced Learning for Latent Variable Models
Kumar, M., Packer, B., & Koller, D. (2010) · neural information processing systems · Cited by 1,204
A Survey on Multi-view Learning
Xu, C., Tao, D., & Xu, C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.5634 · Cited by 942
Self-citationSemi-Supervised Self-Training of Object Detection Models
Rosenberg, C., Hebert, M., & Schneiderman, H. (2005) · 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1 · doi:10.1109/acvmot.2005.107 · Cited by 796
Classification with Noisy Labels by Importance Reweighting
Liu, T., & Tao, D. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2456899 · Cited by 782
Self-citationWhat, where and who? Classifying events by scene and object recognition
Li, L.-J., & Fei-Fei, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408872 · Cited by 781
Semi-Supervised Graph-Based Hyperspectral Image Classification
Camps-Valls, G., Bandos Marsheva, T. V., & Zhou, D. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.895416 · Cited by 622
Self-Paced Curriculum Learning
Jiang, L., Meng, D., Zhao, Q., Shan, S., & Hauptmann, A. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9608 · Cited by 480
Robust Face Recognition via Multimodal Deep Face Representation
Ding, C., & Tao, D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477042 · Cited by 449
Self-citationMultimodal semi-supervised learning for image classification
Guillaumin, M., Verbeek, J., & Schmid, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540120 · Cited by 418
Self-Paced Learning with Diversity
Jiang, L., Meng, D., Yu, S.-I., Lan, Z., Shan, S., & Hauptmann, A. G. (2014) · Cited by 326
Towards Making Unlabeled Data Never Hurt
Li, Y.-F., & Zhou, Z.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2299812 · Cited by 318
Projection-like Retractions on Matrix Manifolds
Absil, P.-A., & Malick, J. (2012) · SIAM Journal on Optimization · doi:10.1137/100802529 · Cited by 296
Self-Paced Learning for Long-Term Tracking
Supancic III, J. S., & Ramanan, D. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.308 · Cited by 290
Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search
Jiang, L., Meng, D., Mitamura, T., & Hauptmann, A. G. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654918 · Cited by 271
Clustering and Embedding Using Commute Times
Qiu, H., & Hancock, E. R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1103 · Cited by 232
Semi-Supervised Learning in Gigantic Image Collections
Fergus, R., Weiss, Y., & Torralba, A. B. (2009) · Cited by 222
Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification
Luo, Y., Tao, D., Geng, B., Xu, C., & Maybank, S. J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2218825 · Cited by 181
Self-citationLearning the easy things first: Self-paced visual category discovery
Lee, Y. J., & Grauman, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995523 · Cited by 168
Multiview Matrix Completion for Multilabel Image Classification
Luo, Y., Liu, T., Tao, D., & Xu, C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2421309 · Cited by 151
Self-citationDynamic Label Propagation for Semi-supervised Multi-class Multi-label Classification
Wang, B., Tu, Z., & Tsotsos, J. K. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.60 · Cited by 144
Convex Multi-view Subspace Learning
White, M., Zhang, X., Schuurmans, D., & Yu, Y. (2012) · Cited by 143
Heterogeneous Image Features Integration via Multi-modal Semi-supervised Learning Model
Cai, X., Nie, F., Cai, W., & Huang, H. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.218 · Cited by 136
Label Propagation via Teaching-to-Learn and Learning-to-Teach
Gong, C., Tao, D., Liu, W., Liu, L., & Yang, J. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2514360 · Cited by 128
Self-citationSemi-supervised learning : from Gaussian fields to Gaussian processes
Zhu, X., Lafferty, J., & Ghahramani, Z. (2018) · doi:10.1184/r1/6609434.v1 · Cited by 116
Ensemble Projection for Semi-supervised Image Classification
Dai, D., & Gool, L. V. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.259 · Cited by 98
Constrained Semi-Supervised Learning Using Attributes and Comparative Attributes
Shrivastava, A., Singh, S., & Gupta, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_27 · Cited by 82
Local Rademacher Complexity for Multi-Label Learning
Xu, C., Liu, T., Tao, D., & Xu, C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2524207 · Cited by 74
Self-citationFick’s Law Assisted Propagation for Semisupervised Learning
Gong, C., Tao, D., Fu, K., & Yang, J. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2376963 · Cited by 61
Self-citationManifold-based Similarity Adaptation for Label Propagation
Karasuyama, M., & Mamitsuka, H. (2013) · neural information processing systems · Cited by 57
Teaching-to-Learn and Learning-to-Teach for Multi-label Propagation
Gong, C., Tao, D., Yang, J., & Liu, W. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10191 · Cited by 45
Self-citationA Low-Rank Approximation-Based Transductive Support Tensor Machine for Semisupervised Classification
Liu, X., Guo, T., He, L., & Yang, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2403235 · Cited by 34
Multinomial Latent Logistic Regression for Image Understanding
Xu, Z., Hong, Z., Zhang, Y., Wu, J., Tsoi, A. C., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2509422 · Cited by 19
Self-citationGraph-based multimodal semi-supervised image classification
Xie, W., Lu, Z., Peng, Y., & Xiao, J. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.12.052 · Cited by 13
Sparse Label-Indicator Optimization Methods for Image Classification
Jing, L., & Ng, M. K. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2294546 · Cited by 6
Cited by
A Survey on Curriculum Learning
Wang, X., Chen, Y., & Zhu, W. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3069908 · Cited by 692
Soviany, P., Ionescu, R. T., Rota, P., & Sebe, N. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01611-x · Cited by 431
Teacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 320
Dynamic Curriculum Learning for Imbalanced Data Classification
Wang, Y., Gan, W., Yang, J., Wu, W., & Yan, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00512 · Cited by 261
Self-citation
Metadata
- Authors
- Gong, C., Tao, D., Maybank, S. J., Liu, W., Kang, G., & Yang, J.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-07
- Volume
- 25
- Issue
- 7
- Pages
- 3249-3260
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2345837149
- Cited by
- 285
- References
- 51
- FWCI
- 28.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.