The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Benchmarking Least Squares Support Vector Machine Classifiers
Open accessAbstract
In Support Vector Machines (SVMs), the solution of the classification problem is characterized by a (convex) quadratic programming (QP) problem. In a modified version of SVMs, called Least Squares SVM classifiers (LS-SVMs), a least squares cost function is proposed so as to obtain a linear set of equations in the dual space. While the SVM classifier has a large margin interpretation, the LS-SVM formulation is related in this paper to a ridge regression approach for classification with binary targets and to Fisher's linear discriminant analysis in the feature space. Multiclass categorization problems are represented by a set of binary classifiers using different output coding schemes. While regularization is used to control the effective number of parameters of the LS-SVM classifier, the sparseness property of SVMs is lost due to the choice of the 2-norm. Sparseness can be imposed in a second stage by gradually pruning the support value spectrum and optimizing the hyperparameters during the sparse approximation procedure. In this paper, twenty public domain benchmark datasets are used to evaluate the test set performance of LS-SVM classifiers with linear, polynomial and radial basis function (RBF) kernels. Both the SVM and LS-SVM classifier with RBF kernel in combination with standard cross-validation procedures for hyperparameter selection achieve comparable test set performances. These SVM and LS-SVM performances are consistently very good when compared to a variety of methods described in the literature including decision tree based algorithms, statistical algorithms and instance based learning methods. We show on ten UCI datasets that the LS-SVM sparse approximation procedure can be successfully applied.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
(1992) · Cited by 23,431
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Self-citationPattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
The Nature of Statistical Learning Theory
Sain, S. R. (1996) · Technometrics · doi:10.1080/00401706.1996.10484565 · Cited by 5,434
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840
Pattern classification and scene analysis
Chien, Y. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100577 · Cited by 3,398
(1989) · Cited by 3,214
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Solving Multiclass Learning Problems via Error-Correcting Output Codes
Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
Regularized Discriminant Analysis
Friedman, J. H. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478752 · Cited by 2,421
Instance-based learning algorithms
Aha, D. W., Kibler, D., & Albert, M. K. (1991) · Machine Learning · doi:10.1007/bf00153759 · Cited by 2,163
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,791
Generalized Discriminant Analysis Using a Kernel Approach
Baudat, G., & Anouar, F. (2000) · Neural Computation · doi:10.1162/089976600300014980 · Cited by 1,673
Parallel Networks that Learn to Pronounce English Text
B, T. J. S. A. (1987) · Cited by 1,514
(1993) · CaltechAUTHORS (California Institute of Technology) · Cited by 1,498
Comparing support vector machines with Gaussian kernels to radial basis function classifiers
Scholkopf, B., Sung, K.-K., Burges, C. J. C., Girosi, F., Niyogi, P., Poggio, T., & Vapnik, V. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650102 · Cited by 1,400
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,299
Weighted least squares support vector machines: robustness and sparse approximation
Suykens, J. A. K., De Brabanter, J., Lukas, L., & Vandewalle, J. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00644-0 · Cited by 1,265
Self-citationRegularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,197
Lim, T.-S., Loh, W.-Y., & Shih, Y.-S. (2000) · Machine Learning · doi:10.1023/a:1007608224229 · Cited by 1,133
Feature Selection via Concave Minimization and Support Vector Machines
Bradley, P. S., & Mangasarian, O. L. (1998) · Cited by 984
Mackay, D. J. C. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/011 · Cited by 915
Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers
Allwein, E. L., Schapire, R. E., & Singer, Y. (2000) · Cited by 914
Ridge Regression Learning Algorithm in Dual Variables
Saunders, C. J., Gammerman, A., & Vovk, V. (1998) · ePrints Soton (University of Southampton) · Cited by 811
Nonparametric Functional Estimation
(1983) · Elsevier eBooks · doi:10.1016/c2013-0-11326-8 · Cited by 783
Prediction with Gaussian Processes: From Linear Regression to Linear Prediction and Beyond
Williams, C. K. I. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_23 · Cited by 659
The Support Vector Method of Function Estimation
Vapnik, V. (1998) · Nonlinear Modeling · doi:10.1007/978-1-4615-5703-6_3 · Cited by 630
The connection between regularization operators and support vector kernels
Smola, A. J., Schölkopf, B., & Müller, K.-R. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00032-x · Cited by 625
(1985) · Statistical Mechanics · doi:10.1142/9789812385482_0010 · Cited by 557
Optimal control by least squares support vector machines
Suykens, J. A. K., Vandewalle, J., & De Moor, B. (2001) · Neural Networks · doi:10.1016/s0893-6080(00)00077-0 · Cited by 540
Self-citationAn Equivalence Between Sparse Approximation and Support Vector Machines
Girosi, F. (1998) · Neural Computation · doi:10.1162/089976698300017269 · Cited by 506
Van Gestel, T., Suykens, J. A. K., Baestaens, D.-E., Lambrechts, A., Lanckriet, G., Vandaele, B., De Moor, B., & Vandewalle, J. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.935093 · Cited by 499
Self-citationData Mining - Practical Machine Learning Tools and Techniques with JAVA Implementations
Witten, I. H., & Frank, E. (2000) · Cumulative Index of Computer Aided Architectural Design · Cited by 394
Recurrent least squares support vector machines
Suykens, J. A. K., & Vandewalle, J. (2000) · IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications · doi:10.1109/81.855471 · Cited by 338
Self-citationGestel, T. V., Suykens, J. A. K., Lanckriet, G., Lambrechts, A., Moor, B. D., & Vandewalle, J. (2002) · Neural Computation · doi:10.1162/089976602753633411 · Cited by 291
Self-citationUnifying instance-based and rule-based induction
Domingos, P. (1996) · Machine Learning · doi:10.1007/bf00058656 · Cited by 242
Nearest neighbor classification from multiple feature subsets
Bay, S. (1999) · Intelligent Data Analysis · doi:10.1016/s1088-467x(99)00018-9 · Cited by 189
Moderating the outputs of support vector machine classifiers
Kwok, J. T.-Y. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788642 · Cited by 159
Multiclass least squares support vector machines
Suykens, J. A. K., & Vandewalle, J. (2003) · IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339) · doi:10.1109/ijcnn.1999.831072 · Cited by 158
Self-citationThe evidence framework applied to support vector machines
Kwok, J. T.-Y. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870047 · Cited by 152
Nonlinear modeling : advanced black-box techniques
Suykens, J. A. K., & Vandewalle, J. P. L. (1998) · Medical Entomology and Zoology · Cited by 137
Self-citationRegularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.003.0014 · Cited by 123
Nonlinear modeling: Advanced black-box techniques
(1999) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(99)90317-6 · Cited by 120
Smola, A. J. (1998) · doi:10.24406/publica-fhg-273328 · Cited by 101
Navia-Vázquez, A., Pérez‐Cruz, F., Artés-Rodríguez, A., & Figueiras-Vidal, A. R. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.950134 · Cited by 79
(1998)
Cited by
Weighted least squares support vector machines: robustness and sparse approximation
Suykens, J. A. K., De Brabanter, J., Lukas, L., & Vandewalle, J. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00644-0 · Cited by 1,265
Self-citationLessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
Self-citationBenchmarking state-of-the-art classification algorithms for credit scoring
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601545 · Cited by 904
Self-citationThe support vector machine under test
Meyer, D., Leisch, F., & Hornik, K. (2003) · Neurocomputing · doi:10.1016/s0925-2312(03)00431-4 · Cited by 777
Group Search Optimizer: An Optimization Algorithm Inspired by Animal Searching Behavior
He, S., Wu, Q. H., & Saunders, J. R. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2011992 · Cited by 724
Metadata
- Authors
- van Gestel, T., Suykens, J. A. K., Baesens, B., Viaene, S., Vanthienen, J., Dedene, G., de Moor, B., & Vandewalle, J.
- Venue
- Machine Learning
- Published
- 2004-01
- Volume
- 54
- Issue
- 1
- Pages
- 5-32
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W2151388232
- Cited by
- 745
- References
- 64
- FWCI
- 20.85
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.