The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
An overview of statistical learning theory
Abstract
Statistical learning theory was introduced in the late 1960's. Until the 1990's it was a purely theoretical analysis of the problem of function estimation from a given collection of data. In the middle of the 1990's new types of learning algorithms (called support vector machines) based on the developed theory were proposed. This made statistical learning theory not only a tool for the theoretical analysis but also a tool for creating practical algorithms for estimating multidimensional functions. This article presents a very general overview of statistical learning theory including both theoretical and algorithmic aspects of the theory. The goal of this overview is to demonstrate how the abstract learning theory established conditions for generalization which are more general than those discussed in classical statistical paradigms and how the understanding of these conditions inspired new algorithmic approaches to function estimation problems. A more detailed overview of the theory (without proofs) can be found in Vapnik (1995). In Vapnik (1998) one can find detailed description of the theory (including proofs).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Self-citationThe Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Self-citationWu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Self-citationNonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
A Probabilistic Theory of Pattern Recognition
Devroye, L., Györfi, L., & Lugosi, G. (1996) · Stochastic Modelling and Applied Probability · doi:10.1007/978-1-4612-0711-5 · Cited by 3,274
Research works printed but not linked: 6
- minsky, 1969, Perceptrons, 248
- opper, 1999, on the annealed vc entropy for margin classifiers: a statistical mechanics study, Advances in Kernel Methods— Support Vector Learning
- vapnik, 1991, the necessary and sufficient conditions for consistency of the method of empirical risk minimization, Yearbook of the Academy of Sciences of the USSR on Recognition Classification and Forecasting, 2, 217
- 10.1006/jcss.1996.0033 · doi:10.1006/jcss.1996.0033
- vapnik, 1979, Estimation of Dependencies Based on Empirical Data, 448
- vapnik, 1979, <emph>theory of pattern recognition</emph>. moscow, russia: nauka, 1974 (in russian). german translation: w. n. wapnik and a. ja. chervonenkis, Theorie der Zeichenerkennung, 353
Cited by
Items 101–142 of 142
Behnood, A., Verian, K. P., & Modiri Gharehveran, M. (2015) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2015.08.124 · Cited by 183
Gray matter atrophy pattern in elderly with subjective memory impairment
Peter, J., Scheef, L., Abdulkadir, A., Boecker, H., Heneka, M., Wagner, M., Koppara, A., Klöppel, S., Jessen, F., & Initiative, A. D. N. (2014) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2013.05.1764 · Cited by 165
Harmless interpolation of noisy data in regression
Muthukumar, V., Vodrahalli, K., & Sahai, A. (2019) · 2019 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849614 · Cited by 162
Voice Disorder Identification by Using Machine Learning Techniques
Verde, L., De Pietro, G., & Sannino, G. (2018) · IEEE Access · doi:10.1109/access.2018.2816338 · Cited by 156
Jiang, Y., Xie, J., Han, Z., Liu, W., Xi, S., Huang, L., Huang, W., Lin, T., Zhao, L., Hu, Y., et al. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-0848 · Cited by 143
Artificial Intelligence and/or Machine Learning Algorithms in Microalgae Bioprocesses
Imamoglu, E. (2024) · Bioengineering · doi:10.3390/bioengineering11111143 · Cited by 143
Alsarhan, A., Alauthman, M., Alshdaifat, E., Al-Ghuwairi, A.-R., & Al-Dubai, A. (2023) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-02963-x · Cited by 123
Emotion Recognition through Physiological Signals for Human-Machine Communication
Maaoui, C., & Pruski, A. (2010) · Cutting Edge Robotics 2010 · doi:10.5772/10312 · Cited by 109
“An example of five physiological signals (BVP, EMG, SC, SKT and Resp) acquired during the induction of the six emotions (left: Subjectl, right: Subject 2) www.intechopen.com theory, pioneered by Vapnik [21], instead of heuristics or analogies with natural learning systems.”
BackgroundInfluentialHashemzadeh, M., & Zademehdi, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.019 · Cited by 100
GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling
Xu, X., Liu, X., Zhang, H., Wang, W., Nepal, S., Sefidgar, Y., Seo, W., Kuehn, K. S., Huckins, J. F., Morris, M. E., et al. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3569485 · Cited by 96
Explainable AI and Multi-Modal Causability in Medicine
Holzinger, A. (2021) · i-com · doi:10.1515/icom-2020-0024 · Cited by 87
Machine learning for microalgae detection and utilization
Ning, H., Li, R., & Zhou, T. (2022) · Frontiers in Marine Science · doi:10.3389/fmars.2022.947394 · Cited by 83
In vivo evidence of neurophysiological maturation of the human adolescent striatum
Larsen, B., & Luna, B. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.12.003 · Cited by 78
Road vehicle classification using Support Vector Machines
Chen, Z., Pears, N., Freeman, M., & Austin, J. (2009) · 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems · doi:10.1109/icicisys.2009.5357707 · Cited by 74
A multi-modal, multi-atlas-based approach for Alzheimer detection via machine learning
Asim, Y., Raza, B., Malik, A. K., Rathore, S., Hussain, L., & Iftikhar, M. A. (2018) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.22263 · Cited by 74
Yilmaz, A., Ugur, Z., Bisgin, H., Akyol, S., Bahado-Singh, R., Wilson, G., Imam, K., Maddens, M. E., & Graham, S. F. (2020) · Metabolites · doi:10.3390/metabo10090357 · Cited by 65
Validation of a Portable Device for Mapping Motor and Gait Disturbances in Parkinson’s Disease
Rodríguez-Molinero, A., Samà, A., Pérez-Martínez, D. A., Pérez López, C., Romagosa, J., Bayés, À., Sanz, P., Calopa, M., Gálvez-Barrón, C., de Mingo, E., et al. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3321 · Cited by 64
Facial decomposition for expression recognition using texture/shape descriptors and SVM classifier
Lekdioui, K., Messoussi, R., Ruichek, Y., Chaabi, Y., & Touahni, R. (2017) · Signal Processing: Image Communication · doi:10.1016/j.image.2017.08.001 · Cited by 62
Deep learning in ovarian cancer diagnosis: a comprehensive review of various imaging modalities
Sadeghi, M. H., Sina, S., Omidi, H., Farshchitabrizi, A. H., & Alavi, M. (2024) · Polish Journal of Radiology · doi:10.5114/pjr.2024.134817 · Cited by 54
Cao, W., Liu, X., & Ni, J. (2020) · IEEE Access · doi:10.1109/access.2020.2993267 · Cited by 49
“The (cid:15) -SVR prediction approach is a type of SVR that was developed by Vapnik [1].”
MethodQuit Playing Games with My Heart: Understanding Online Dating Scams
Huang, J., Stringhini, G., & Yong, P. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-20550-2_12 · Cited by 48
Epistemic Uncertainty Sampling
Nguyen, V.-L., Destercke, S., & Hüllermeier, E. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-33778-0_7 · Cited by 48
Resting-state amplitude of low-frequency fluctuation is associated with suicidal ideation
Lan, M. J., Rizk, M. M., Pantazatos, S. P., Rubin‐Falcone, H., Miller, J. M., Sublette, M. E., Oquendo, M. A., Keilp, J. G., & Mann, J. J. (2019) · Depression and Anxiety · doi:10.1002/da.22888 · Cited by 48
Human biases limit cumulative innovation
Thompson, B., & Griffiths, T. L. (2021) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2020.2752 · Cited by 40
“This introduces a problem of induction—the need to generalize beyond what is observable—that can only be solved by inductive bias [26].”
BackgroundA Deep Learning Method Combined Sparse Autoencoder with SVM
Ju, Y., Guo, J., & Liu, S. (2015) · 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery · doi:10.1109/cyberc.2015.39 · Cited by 37
A unified probabilistic framework for measuring the intensity of spontaneous facial action units
Li, Y., Mavadati, S. M., Mahoor, M. H., & Ji, Q. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553757 · Cited by 36
Han, D., Zhao, N., & Shi, P. (2017) · Advances in Mechanical Engineering · doi:10.1177/1687814017743113 · Cited by 35
Larburu, N., Artetxe, A., Escolar, V., Lozano, A., & Kerexeta, J. (2018) · Mobile Information Systems · doi:10.1155/2018/1546210 · Cited by 35
In silico prediction of chronic toxicity with chemical category approaches
Li, X., Zhang, Y., Chen, H., Li, H., & Zhao, Y. (2017) · RSC Advances · doi:10.1039/c7ra08415c · Cited by 33
Park, B.-Y., Kim, M., Seo, J., Lee, J.-M., & Park, H. (2016) · Brain Topography · doi:10.1007/s10548-015-0463-1 · Cited by 31
Chagué, P., Marro, B., Fadili, S., Houot, M., Morin, A., Samper-González, J., Beunon, P., Arrivé, L., Dormont, D., Dubois, B., et al. (2021) · Journal of Neuroradiology · doi:10.1016/j.neurad.2020.04.004 · Cited by 31
Cancer survival classification using integrated data sets and intermediate information
Kim, S., Park, T., & Kon, M. (2014) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2014.06.003 · Cited by 25
Gangsar, P., & Tiwari, R. (2014) · Journal of Failure Analysis and Prevention · doi:10.1007/s11668-014-9893-4 · Cited by 25
KSwSVR: A New Load Forecasting Method for Efficient Resources Provisioning in Cloud
Hu, R., Jiang, J., Liu, G., & Wang, L. (2013) · 2013 IEEE International Conference on Services Computing · doi:10.1109/scc.2013.67 · Cited by 22
Real time evolution with neural-network quantum states
Gutiérrez, I. L., & Mendl, C. B. (2022) · Quantum · doi:10.22331/q-2022-01-20-627 · Cited by 20
Generalization Guarantees for Imitation Learning
Ren, A. Z., Veer, S., & Majumdar, A. (2020) · arXiv · doi:10.48550/arxiv.2008.01913 · Cited by 17
Bus Arrival Time Prediction: A Comprehensive Review
Kumar, B. A., Singh, R., Shaji, H. E., & Vanajakshi, L. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3545695 · Cited by 13
Oropharyngeal dysphagia identification using wavelets and optimum path forest
Spadotto, A. A., Pereira, J. C., Guido, R. C., Papa, J. P., Falcao, A. X., Gatto, A. R., Cola, P. C., & Schelp, A. O. (2008) · 2008 3rd International Symposium on Communications, Control and Signal Processing · doi:10.1109/isccsp.2008.4537320 · Cited by 12
Han, C., Xiong, W., Xiong, M., & Liu, Z. (2023) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2023.000020 · Cited by 7
A novel technique for raindrop detection on a car windshield using geometric-photometric model
Sugimoto, M., Kakiuchi, N., Ozaki, N., & Sugawara, R. (2012) · 2012 15th International IEEE Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2012.6338613 · Cited by 6
(2025) · doi:10.1038/s41598-025-27163-x · Cited by 1
Bus Arrival Time Prediction Using Machine Learning Approaches
Pov, P. (2025) · Techno-Science Research Journal · doi:10.64702/technosrj.2025.v13.i1.06
Metadata
- Authors
- Vapnik, V. N.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1999
- Volume
- 10
- Issue
- 5
- Pages
- 988-999
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2149298154
- Cited by
- 6,266
- References
- 28
- FWCI
- 15.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.