The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Reduced Support Vector Machines: A Statistical Theory
Abstract
In dealing with large data sets, the reduced support vector machine (RSVM) was proposed for the practical objective to overcome some computational difficulties as well as to reduce the model complexity. In this paper, we study the RSVM from the viewpoint of sampling design, its robustness, and the spectral analysis of the reduced kernel. We consider the nonlinear separating surface as a mixture of kernels. Instead of a full model, the RSVM uses a reduced mixture with kernels sampled from certain candidate set. Our main results center on two major themes. One is the robustness of the random subset mixture model. The other is the spectral analysis of the reduced kernel. The robustness is judged by a few criteria as follows: 1) model variation measure; 2) model bias (deviation) between the reduced model and the full model; and 3) test power in distinguishing the reduced model from the full one. For the spectral analysis, we compare the eigenstructures of the full kernel matrix and the approximation kernel matrix. The approximation kernels are generated by uniform random subsets. The small discrepancies between them indicate that the approximation kernels can retain most of the relevant information for learning tasks in the full kernel. We focus on some statistical theory of the reduced set method mainly in the context of the RSVM. The use of a uniform random subset is not limited to the RSVM. This approach can act as a supplemental algorithm on top of a basic optimization algorithm, wherein the actual optimization takes place on the subset-approximated data. The statistical properties discussed in this paper are still valid.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,123
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Witten, I. H. (2008) · Cited by 9,143
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,658
Data mining and knowledge discovery: making sense out of data
Feyyad, U. M. (1996) · IEEE Expert · doi:10.1109/64.539013 · Cited by 4,612
Remarks on Some Nonparametric Estimates of a Density Function
Rosenblatt, M. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728190 · Cited by 4,547
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Monte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
(2007) · Springer eBooks · doi:10.1007/978-0-387-71107-2 · Cited by 2,687
(1998) · Cited by 2,679
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
UCI Repository of Machine Learning Databases
Merz, C. J. (1996) · Medical Entomology and Zoology · Cited by 2,363
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Using the Nyström Method to Speed Up Kernel Machines
Williams, C. K. I., & Seeger, M. (2000) · Cited by 1,646
Learning from Data: Concepts, Theory, and Methods
Cherkassky, V., & Mulier, F. M. (1998) · Cited by 1,637
Sparse Gaussian Processes using Pseudo-inputs
Snelson, E., & Ghahramani, Z. (2005) · Cited by 1,415
Monte Carlo Strategies in Scientific Computing
Hesterberg, T. (2002) · Technometrics · doi:10.1198/tech.2002.s85 · Cited by 1,409
Feature Selection via Concave Minimization and Support Vector Machines
Bradley, P. S., & Mangasarian, O. L. (1998) · Cited by 984
Uniform Design: Theory and Application
Fang, K.-T., Lin, D. K. J., Winker, P., & Zhang, Y. (2000) · Technometrics · doi:10.1080/00401706.2000.10486045 · Cited by 952
Proximal support vector machine classifiers
Fung, G., & Mangasarian, O. L. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502527 · Cited by 842
On the Nyström Method for Approximating a Gram Matrix for Improved Kernel-Based Learning
Petros Drineas, B., & Mahoney, M. W. (2005) · doi:10.5555/1046920.1194916 · Cited by 795
RSVM: Reduced Support Vector Machines
Lee, Y.-J., & Mangasarian, O. L. (2001) · Proceedings of the 2001 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972719.13 · Cited by 647
Self-citationSparse Greedy Matrix Approximation for Machine Learning
Smola, A. J., & Schökopf, B. (2000) · doi:10.5555/645529.657980 · Cited by 574
SSVM: A Smooth Support Vector Machine for Classification
Lee, Y.-J., & Mangasarian, O. L. (2001) · Computational Optimization and Applications · doi:10.1023/a:1011215321374 · Cited by 518
Self-citationA class of smoothing functions for nonlinear and mixed complementarity problems
Chen, C., & Mangasarian, O. L. (1996) · Computational Optimization and Applications · doi:10.1007/bf00249052 · Cited by 505
Kernels for Nonparametric Curve Estimation
Gasser, T., MÜller, H.-G., & Mammitzsch, V. (1985) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1985.tb01350.x · Cited by 470
Successive overrelaxation for support vector machines
Mangasarian, O. L., & Musicant, D. R. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788643 · Cited by 438
Generalized Support Vector Machines
Mangasarian, O. L. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0012 · Cited by 298
Eigenvalues of Matrices: Revised Edition
Chatelin, F. (2012) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611972467 · Cited by 285
Smoothing methods for convex inequalities and linear complementarity problems
Chen, C., & Mangasarian, O. L. (1995) · Mathematical Programming · doi:10.1007/bf01592244 · Cited by 277
A study on reduced support vector machines
Lin, K.-M., & Lin, C.-J. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820828 · Cited by 249
Robust linear and support vector regression
Mangasarian, O. L., & Musicant, D. R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.877518 · Cited by 186
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/15324430152748218 · Cited by 182
Rasmussen, C. E., & Ghahramani, Z. (2000) · neural information processing systems · Cited by 172
Multiclass least squares support vector machines
Suykens, J. A. K., & Vandewalle, J. (2003) · IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339) · doi:10.1109/ijcnn.1999.831072 · Cited by 158
/spl epsi/-SSVR: a smooth support vector machine for /spl epsi/-insensitive regression
Lee, Y., Hsieh, W.-F., & Huang, C. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.77 · Cited by 145
Self-citationMika, S. (2003) · doi:10.14279/depositonce-575 · Cited by 123
Training Data Selection for Support Vector Machines
Wang, J., Neskovic, P., & Cooper, L. N. (2005) · Lecture notes in computer science · doi:10.1007/11539087_71 · Cited by 105
Mathematical Programming in Neural Networks
Mangasarian, O. L. (1993) · INFORMS journal on computing · doi:10.1287/ijoc.5.4.349 · Cited by 105
A Direct Method for Building Sparse Kernel Learning Algorithms
Wu, M., Schölkopf, B., & Bakır, G. (2006) · doi:10.5555/1248547.1248568 · Cited by 103
Active Set Support Vector Regression
Musicant, D. R., & Feinberg, A. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.824259 · Cited by 88
Large Scale Kernel Regression via Linear Programming
Mangasarian, O. L., & Musicant, D. R. (2002) · Machine Learning · doi:10.1023/a:1012422931930 · Cited by 79
Biedermann, S., & Holger Dette, A. (2001) · Statistics & Probability Letters · doi:10.1016/s0167-7152(00)00244-3 · Cited by 28
Generating the Reduced Set by Systematic Sampling
Chang, C.-C., & Lee, Y. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28651-6_107 · Cited by 11
Self-citationClustering Model Selection for Reduced Support Vector Machines
Jen, L.-R., & Lee, Y. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28651-6_106 · Cited by 7
Self-citationData Visualization via Kernel Machines
Chang, Y. I., Lee, Y., Pao, H.-K., Lee, M., & Huang, S. (2007) · Springer eBooks · doi:10.1007/978-3-540-33037-0_21 · Cited by 5
Self-citation
Cited by
A comprehensive survey on support vector machine classification: Applications, challenges and trends
Cervantes, J., Garcia-Lamont, F., Rodríguez-Mazahua, L., & Lopez, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.118 · Cited by 2,381
TSVR: An efficient Twin Support Vector Machine for regression
Peng, X. (2010) · Neural Networks · doi:10.1016/j.neunet.2009.07.002 · Cited by 460
Land cover mapping of large areas using chain classification of neighboring Landsat satellite images
Knorn, J., Rabe, A., Radeloff, V. C., Kuemmerle, T., Kozak, J., & Hostert, P. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2009.01.010 · Cited by 255
An Equivalence between the Lasso and Support Vector Machines
Jaggi, M. (2013) · arXiv · doi:10.48550/arxiv.1303.1152 · Cited by 35
Dynamically Adaptive Genetic Algorithm to Select Training Data for SVMs
Kawulok, M., & Nalepa, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-12027-0_20 · Cited by 11
Metadata
- Authors
- Lee, Y.-J., & Huang, S.-Y.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2007-01
- Volume
- 18
- Issue
- 1
- Pages
- 1-13
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2136824894
- Cited by
- 268
- References
- 59
- FWCI
- 29.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.