The DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index.
Kernel methods in machine learning
Open accessAbstract
We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a kernel. Working in linear spaces of function has the benefit of facilitating the construction and analysis of learning algorithms while at the same time allowing large classes of functions. The latter include nonlinear functions as well as functions defined on nonvectorial data. We cover a wide range of methods, ranging from binary classifiers to sophisticated methods for estimation with structured data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Self-citationAtomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
Self-citationFast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
RELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Algebraic connectivity of graphs
Fiedler, M. (1973) · Czechoslovak Mathematical Journal · doi:10.21136/cmj.1973.101168 · Cited by 3,977
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,252
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799
Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing
Vapnik, V. N., Golowich, S. E., & Smola, A. J. (1997) · Cited by 2,757
Self-citationOn the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448
Solution of incorrectly formulated problems and the regularization method
Tikhonov, A. N. (1963) · Medical Entomology and Zoology · Cited by 2,359
Kuhn, H. W., & Tucker, A. W. (1951) · Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability · doi:10.1525/9780520411586-036 · Cited by 1,985
On the algorithmic implementation of multiclass kernel-based vector machines
Crammer, K., & Singer, Y. (2002) · Cited by 1,887
Blind signal separation: statistical principles
Cardoso, J.-F. (1998) · Proceedings of the IEEE · doi:10.1109/5.720250 · Cited by 1,885
Large Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · MPG.PuRe (Max Planck Society) · Cited by 1,879
Self-citationAdvances in Large-Margin Classifiers
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,869
Integrating structured biological data by Kernel Maximum Mean Discrepancy
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl242 · Cited by 1,674
Self-citationA Projection Pursuit Algorithm for Exploratory Data Analysis
Friedman, J. H., & Tukey, J. W. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.224051 · Cited by 1,652
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564089_7 · Cited by 1,560
Self-citationTheoretical Foundations of the Potential Function Method in Pattern Recognition Learning
Айзерман, М. А. (1964) · Automation and Remote Control · Cited by 1,485
Bamber, D. (1975) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(75)90001-2 · Cited by 1,439
Baum, L. E. (1972) · Medical Entomology and Zoology · Cited by 1,405
Methods for Solving Incorrectly Posed Problems
Morozov, V. A. (1984) · Springer eBooks · doi:10.1007/978-1-4612-5280-1 · Cited by 1,357
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Some results on Tchebycheffian spline functions
Kimeldorf, G., & Wahba, G. (1971) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(71)90184-3 · Cited by 1,254
Shallow parsing with conditional random fields
Sha, F., & Pereira, F. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073473 · Cited by 1,246
Generalized Iterative Scaling for Log-Linear Models
Darroch, J. N., & Ratcliff, D. (1972) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177692379 · Cited by 1,206
Pattern recognition using generalized portrait method
Vapnik, V. N. (1963) · Automation and Remote Control · Cited by 1,151
Harmonic Analysis on Semigroups
Berg, C., Christensen, J. P. R., & Ressel, P. (1984) · Graduate Texts in Mathematics · doi:10.1007/978-1-4612-1128-0 · Cited by 1,134
Large Margin Rank Boundaries for Ordinal Regression
Herbrich, R., Graepel, T., & Obermayer, K. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0010 · Cited by 1,074
Convexity, Classification, and Risk Bounds
Bartlett, P. L., Jordan, M. I., & McAuliffe, J. D. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000000907 · Cited by 1,037
Kernel Methods in Computational Biology
(2004) · The MIT Press eBooks · doi:10.7551/mitpress/4057.001.0001 · Cited by 1,032
THE SPECTRUM KERNEL: A STRING KERNEL FOR SVM PROTEIN CLASSIFICATION
LESLIE, C., ESKIN, E., & NOBLE, W. S. (2001) · Biocomputing 2002 · doi:10.1142/9789812799623_0053 · Cited by 927
Canonical analysis of several sets of variables
KETTENRING, J. R. (1971) · Biometrika · doi:10.1093/biomet/58.3.433 · Cited by 896
Kernels and Regularization on Graphs
Smola, A. J., & Kondor, R. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45167-9_12 · Cited by 841
Self-citationConvolution Kernels for Natural Language
Collins, M., & Duffy, N. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0085 · Cited by 808
A support vector method for multivariate performance measures
Joachims, T. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102399 · Cited by 786
Robust linear programming discrimination of two linearly inseparable sets
Bennett, K. P., & Mangasarian, O. L. (1992) · Optimization Methods and Software · doi:10.1080/10556789208805504 · Cited by 780
Zettlemoyer, L., & Collins, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.1420 · Cited by 728
Marginalized kernels between labeled graphs
Kashima, H., Tsuda, K., & Inokuchi, A. (2003) · Cited by 710
Discriminative Reranking for Natural Language Parsing
Collins, M., & Koo, T. (2005) · Computational Linguistics · doi:10.1162/0891201053630273 · Cited by 710
Rényi, A. (1959) · Acta Mathematica Academiae Scientiarum Hungaricae · doi:10.1007/bf02024507 · Cited by 708
The connection between regularization operators and support vector kernels
Smola, A. J., Schölkopf, B., & Müller, K.-R. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00032-x · Cited by 625
Self-citationTraining Invariant Support Vector Machines
Decoste, D., & Schölkopf, B. (2002) · Machine Learning · doi:10.1023/a:1012454411458 · Cited by 588
Self-citation(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303768966085 · Cited by 583
Markov fields on finite graphs and lattices
Hammersley, J. M., & Clifford, P. (1971) · Cited by 579
A kernel view of the dimensionality reduction of manifolds
Ham, J., Lee, D. D., Mika, S., & Schölkopf, B. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015417 · Cited by 532
Self-citationJones, M. C., & Sibson, R. (1987) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981662 · Cited by 522
Aronszajn, N. (1950) · Transactions of the American Mathematical Society · doi:10.2307/1990404 · Cited by 495
(2000) · Applied Physics Letters · doi:10.1162/15324430152733133 · Cited by 494
Functions of positive and negative type, and their connection with the theory of integral equations
Mercer, J. (1909) · Proceedings of the Royal Society of London. Series A, Containing Papers of a Mathematical and Physical Character · doi:10.1098/rspa.1909.0075 · Cited by 482
Cristianini, N., Shawe-Taylor, J., Elisseeff, A., & Kandola, J. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0052 · Cited by 474
Hidden Markov support vector machines
Altün, Y., Tsochantaridis, I., & Hofmann, T. (2003) · Cited by 458
Self-citationA survey of kernels for structured data
Gärtner, T. (2003) · ACM SIGKDD Explorations Newsletter · doi:10.1145/959242.959248 · Cited by 452
Grundzüge einer allgemeinen Theorie der linearen Integralgleichungen
Hilbert, D. (1989) · Teubner-Archiv zur Mathematik · doi:10.1007/978-3-322-84410-1_1 · Cited by 450
Diffusion kernels on graphs and other discrete structures
Kondor, R. (2002) · Cited by 449
Theory of Classification: a Survey of Some Recent Advances
Boucheron, S., Bousquet, O., & Lugosi, G. (2005) · ESAIM: Probability and Statistics · doi:10.1051/ps:2005018 · Cited by 436
Engineering support vector machine kernels that recognize translation initiation sites
Zien, A., Rätsch, G., Mika, S., Schölkopf, B., Lengauer, T., & Müller, K.-R. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.9.799 · Cited by 420
Self-citationRademacher penalties and structural risk minimization
Koltchinskii, V. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.930926 · Cited by 373
Unifying collaborative and content-based filtering
Basilico, J., & Hofmann, T. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015394 · Cited by 352
Self-citationLinear and Nonlinear Separation of Patterns by Linear Programming
Mangasarian, O. L. (1965) · Operations Research · doi:10.1287/opre.13.3.444 · Cited by 328
Monotone Funktionen, Stieltjessche Integrale und harmonische Analyse
Bochner, S. (1933) · Mathematische Annalen · doi:10.1007/bf01452844 · Cited by 318
Yang, H. H., & Amari, S.-I. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1457 · Cited by 314
Iterative kernel principal component analysis for image modeling
Kwa, Franz, M. O., & Scholkopf, B. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.181 · Cited by 306
On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion
Smola, A. J., & Schölkopf, B. (1998) · Algorithmica · doi:10.1007/pl00013831 · Cited by 298
Self-citationFast Kernels for String and Tree Matching
Vishwanathan, S. V. N., & Smola, A. J. (2004) · Kernel Methods in Computational Biology · doi:10.7551/mitpress/4057.003.0008 · Cited by 294
Self-citationAutomatic Smoothing of Regression Functions in Generalized Linear Models
O'sullivan, F., Yandell, B. S., & Raynor, W. J. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478243 · Cited by 277
Watkins, C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0006 · Cited by 244
Applications of a general propagation algorithm for probabilistic expert systems
Dawid, A. P. (1992) · Statistics and Computing · doi:10.1007/bf01890546 · Cited by 239
Wahba, G., Wang, Y., Gu, C., Klein, R., & Klein, B. (1995) · The Annals of Statistics · doi:10.1214/aos/1034713638 · Cited by 235
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244302760185252 · Cited by 212
Probabilistic Kernel Regression Models
Jaakkola, T., & Haussler, D. H. (1999) · Cited by 208
Exploratory Projection Pursuit
Friedman, J. H. (1987) · Journal of the American Statistical Association · doi:10.2307/2289161 · Cited by 186
Differential Geometry and Statistics
Murray, M. K., & Rice, J. W. (1993) · Springer eBooks · doi:10.1007/978-1-4899-3306-5 · Cited by 172
Positive definite functions and generalizations, an historical survey
Stewart, J. (1976) · Rocky Mountain Journal of Mathematics · doi:10.1216/rmj-1976-6-3-409 · Cited by 167
Support Vector Machines are Universally Consistent
Steinwart, I. (2002) · Journal of Complexity · doi:10.1006/jcom.2002.0642 · Cited by 164
A Few Notes on Statistical Learning Theory
Mendelson, S. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-36434-x_1 · Cited by 161
On optimal nonlinear associative recall
Poggio, T. (1975) · Biological Cybernetics · doi:10.1007/bf02281970 · Cited by 139
On the difficulty of approximately maximizing agreements
Ben-David, S., Eiron, N., & Long, P. M. (2003) · Journal of Computer and System Sciences · doi:10.1016/s0022-0000(03)00038-2 · Cited by 134
Bhattacharyya and Expected Likelihood Kernels
Jebara, T., & Kondor, R. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45167-9_6 · Cited by 131
Semi-parametric Generalized Linear Models
Green, P. J., & Yandell, B. S. (1985) · Lecture notes in statistics · doi:10.1007/978-1-4615-7070-7_6 · Cited by 129
Support Vector Regression with ANOVA Decomposition Kernels
Stitson, M. O., Gammerman, A., Vapnik, V. N., et al. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/1130.003.0023 · Cited by 128
A Conditional Random Field for Discriminatively-Trained Finite-State String Edit Distance
McCallum, A., Bellare, K., & Pereira, F. M. B. (2005) · Defense Technical Information Center (DTIC) · doi:10.21236/ada440386 · Cited by 126
Kernel conditional random fields
Lafferty, J., Zhu, X., & Liu, Y. (2004) · doi:10.1145/1015330.1015337 · Cited by 125
Generalized Quantile Processes
Einmahl, J. H. J., & Mason, D. M. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348670 · Cited by 104
A general regression technique for learning transductions
Cortes, C., Mohri, M., & Weston, J. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102371 · Cited by 88
Consistent independent component analysis and prewhitening
Chen, A., & Bickel, P. J. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.855098 · Cited by 66
Scale-sensitive dimensions, uniform convergence, and learnability
Alon, N., Ben-David, S., Cesa‐Bianchi, N., & Haussler, D. H. (2002) · Annual Symposium on Foundations of Computer Science · doi:10.1109/sfcs.1993.366858 · Cited by 53
A Machine Learning Approach to Conjoint Analysis
Chapelle, O., & Harchaoui, Z. (2004) · Cited by 46
Exponential families for conditional random fields
Altün, Y., Smola, A. J., & Hofmann, T. (2004) · Uncertainty in Artificial Intelligence · doi:10.5555/1036843.1036844 · Cited by 33
Self-citation(1996)
Cited by
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
Recent advances in physical reservoir computing: A review
Tanaka, G., Yamane, T., Héroux, J. B., Nakane, R., Kanazawa, N., Takeda, S., Numata, H., Nakano, D., & Hirose, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.03.005 · Cited by 2,146
Quantum Support Vector Machine for Big Data Classification
Rebentrost, P., Mohseni, M., & Lloyd, S. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.130503 · Cited by 1,951
Quantum Machine Learning in Feature Hilbert Spaces
Schuld, M., & Killoran, N. (2019) · Physical Review Letters · doi:10.1103/physrevlett.122.040504 · Cited by 1,840
Metadata
- Authors
- Hofmann, T., Schölkopf, B., & Smola, A. J.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2008-06-01
- Volume
- 36
- Issue
- 3
- Pages
- 1171-1220
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2168029744
- Cited by
- 1,651
- References
- 99
- FWCI
- 23.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.