The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Beyond the point cloud: from transductive to semi-supervised learning
Abstract
Due to its occurrence in engineering domains and implications for natural learning, the problem of utilizing unlabeled data is attracting increasing attention in machine learning. A large body of recent literature has focussed on the transductive setting where labels of unlabeled examples are estimated by learning a function defined only over the point cloud data. In a truly semi-supervised setting however, a learning machine has access to labeled and unlabeled examples and must make predictions on data points never encountered before. In this paper, we show how to turn transductive and standard supervised learning algorithms into semi-supervised learners. We construct a family of data-dependent norms on Reproducing Kernel Hilbert Spaces (RKHS). These norms allow us to warp the structure of the RKHS to reflect the underlying geometry of the data. We derive explicit formulas for the corresponding new kernels. Our approach demonstrates state of the art performance on a variety of classification tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Learning with Local and Global Consistency
Zhou, D., Bousquet, O., Lal, T. N., Weston, J., & Schölkopf, B. (2003) · MPG.PuRe (Max Planck Society) · Cited by 3,864
Semi-supervised learning using Gaussian fields and harmonic functions
Zhu, X., Zoubin Ghahramani, A., & Lafferty, J. (2003) · Cited by 3,509
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Semi-Supervised Classification by Low Density Separation
Chapelle, O., Zien, A., & Ghahramani, R. C. Z. (2005) · Cited by 765
Transductive learning via spectral graph partitioning
Joachims, T. (2003) · Cited by 633
Cluster Kernels for Semi-Supervised Learning
Chapelle, O., Weston, J., & Schölkopf, B. (2002) · Cited by 461
On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion
Smola, A. J., & Schölkopf, B. (1998) · Algorithmica · doi:10.1007/pl00013831 · Cited by 298
Efficient Non-Parametric Function Induction in Semi-Supervised LearningPreprint
Bengio, Y., Delalleau, O., & Roux, N. L. (2004) · RePEc: Research Papers in Economics · Cited by 170
Problems of learning on manifolds
Niyogi, P., & Belkin, M. A. (2003) · Cited by 138
Self-citation
Cited by
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
(2006) · Cited by 3,624
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01548-9 · Cited by 1,766
Semi-Supervised and Unsupervised Extreme Learning Machines
Huang, G., Song, S., Gupta, J. N. D., & Wu, C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307349 · Cited by 797
Semi-supervised Discriminant Analysis
Cai, D., He, X., & Han, J. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408856 · Cited by 758
Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition
Xia, R., Pan, Y., Du, L., & Yin, J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8950 · Cited by 713
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction
Nie, F., Xu, D., Tsang, I. W.-H., & Zhang, C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2044958 · Cited by 509
Kontschieder, P., Fiterau, M., Criminisi, A., & Bulo, S. R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.172 · Cited by 490
Semi-supervised learning by disagreement
Zhou, Z.-H., & Li, M. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0209-z · Cited by 410
Optimization Techniques for Semi-Supervised Support Vector Machines
Chapelle, O., Sindhwani, V., & Keerthi, S. S. (2008) · MPG.PuRe (Max Planck Society) · doi:10.5555/1390681.1390688 · Cited by 401
Self-citationDiscriminative Semi-Supervised Feature Selection Via Manifold Regularization
Xu, Z., King, I., Lyu, M. R.-T., & Jin, R. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2047114 · Cited by 384
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390303 · Cited by 380
Toward Supervised Anomaly Detection
Goernitz, N., Kloft, M., Rieck, K., & Brefeld, U. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3623 · Cited by 371
A Survey of Signed Network Mining in Social Media
Tang, J., Chang, Y., Aggarwal, C., & Liu, H. (2017) · ACM Computing Surveys · doi:10.1145/2956185 · Cited by 342
Graph-Based Semi-Supervised Learning: A Comprehensive Review
Song, Z., Yang, X., Xu, Z., & King, I. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3155478 · Cited by 334
Domain Adaptation From Multiple Sources: A Domain-Dependent Regularization Approach
Duan, L., Xu, D., & Tsang, I. W. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2178556 · Cited by 332
Goldberg, A. B., & Zhu, X. (2006) · Proceedings of TextGraphs: the First Workshop on Graph Based Methods for Natural Language Processing on the First Workshop on Graph Based Methods for Natural Language Processing - TextGraphs '06 · doi:10.3115/1654758.1654769 · Cited by 316
Semisupervised Neural Networks for Efficient Hyperspectral Image Classification
Ratle, F., Camps-Valls, G., & Weston, J. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2037898 · Cited by 316
Laplacian Support Vector Machines Trained in the Primal
Melacci, S., & Belkin, M. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0909.5422 · Cited by 311
Self-citationSupport vector machines in engineering: an overview
Salcedo‐Sanz, S., Rojo‐Álvarez, J. L., Martínez‐Ramón, M., & Camps‐Valls, G. (2014) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1125 · Cited by 301
Domain adaptation from multiple sources via auxiliary classifiers
Duan, L., Tsang, I. W., Xu, D., & Chua, T.-S. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553411 · Cited by 289
Machine learning for streaming data: state of the art, challenges, and opportunities
Gomes, H. M., Read, J., Bifet, A., Barddal, J. P., & Gama, J. (2019) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3373464.3373470 · Cited by 267
Generalized extreme learning machine autoencoder and a new deep neural network
Sun, K., Zhang, J., Zhang, C., & Hu, J. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.027 · Cited by 154
Compact Time-Domain Representation for Logical Access Spoofed Audio
Karo, M., Yeredor, A., & Lapidot, I. (2024) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2023.3341000 · Cited by 6
Metadata
- Authors
- Sindhwani, V., Niyogi, P., & Belkin, M.
- Venue
- Proceedings of the 22nd international conference on Machine learning - ICML '05
- Publisher
- ACM Press
- Published
- 2005
- Pages
- 824-831
- OpenAlex
- W2148029428
- Cited by
- 439
- References
- 14
- FWCI
- 16.93
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.