The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
The Kernel Recursive Least-Squares Algorithm
Abstract
We present a nonlinear version of the recursive least squares (RLS) algorithm. Our algorithm performs linear regression in a high-dimensional feature space induced by a Mercer kernel and can therefore be used to recursively construct minimum mean-squared-error solutions to nonlinear least-squares problems that are frequently encountered in signal processing applications. In order to regularize solutions and keep the complexity of the algorithm bounded, we use a sequential sparsification process that admits into the kernel representation a new input sample only if its feature space image cannot be sufficiently well approximated by combining the images of previously admitted samples. This sparsification procedure allows the algorithm to operate online, often in real time. We analyze the behavior of the algorithm, compare its scaling properties to those of support vector machines, and demonstrate its utility in solving two signal processing problems-time-series prediction and channel equalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
System Identification: Theory for the User
Lennart Ljung, A. (1987) · Cited by 17,690
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Haykin, S. (1986) · Cited by 12,603
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Rogers, S. (1996) · Control Engineering Practice · doi:10.1016/0967-0661(96)82838-3 · Cited by 9,278
System identification—Theory for the user
Sinha, N. K. (1989) · Automatica · doi:10.1016/0005-1098(89)90019-8 · Cited by 9,184
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
Weak Convergence and Empirical Processes
van der Vaart, A. W., & Wellner, J. A. (1996) · Springer Series in Statistics · doi:10.1007/978-1-4757-2545-2 · Cited by 5,014
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Oscillation and Chaos in Physiological Control Systems
Mackey, M. C., & Glass, L. (1977) · Science · doi:10.1126/science.267326 · Cited by 4,135
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Ljung, L. (1999) · Wiley Encyclopedia of Electrical and Electronics Engineering · doi:10.1002/047134608x.w1046 · Cited by 3,778
Sparse Approximate Solutions to Linear Systems
Natarajan, B. K. (1995) · SIAM Journal on Computing · doi:10.1137/s0097539792240406 · Cited by 2,783
Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing
Vapnik, V. N., Golowich, S. E., & Smola, A. J. (1997) · Cited by 2,757
Using the Nyström Method to Speed Up Kernel Machines
Williams, C. K. I., & Seeger, M. (2000) · Cited by 1,646
Neural network learning theoretical foundations
Anthony, M., & Bartlett, P. L. (2009) · Cited by 1,310
Some results on Tchebycheffian spline functions
Kimeldorf, G., & Wahba, G. (1971) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(71)90184-3 · Cited by 1,254
Regularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,197
Input space versus feature space in kernel-based methods
Scholkopf, B., Mika, S., Burges, C. J. C., Knirsch, P., Muller, K.-R., Ratsch, G., & Smola, A. J. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788641 · Cited by 1,164
Time series prediction: Forecasting the future and understanding the past
Makridakis, S. (1994) · International Journal of Forecasting · doi:10.1016/0169-2070(94)90077-9 · Cited by 841
Sparse On-Line Gaussian Processes
Csató, L., & Opper, M. (2002) · Neural Computation · doi:10.1162/089976602317250933 · Cited by 749
Prediction with Gaussian Processes: From Linear Regression to Linear Prediction and Beyond
Williams, C. K. I. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_23 · Cited by 659
Efficient svm training using low-rank kernel representations
Fine, S., & Scheinberg, K. (2002) · doi:10.5555/944790.944812 · Cited by 579
Sparse Greedy Matrix Approximation for Machine Learning
Smola, A. J., & Schökopf, B. (2000) · doi:10.5555/645529.657980 · Cited by 574
Learning Kernel Classifiers: Theory and Algorithms
Herbrich, R. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4170.001.0001 · Cited by 547
Incremental learning with support vector machines
Ruping, S. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989589 · Cited by 524
A state-space approach to adaptive RLS filtering
Sayed, A. H., & Kailath, T. (1994) · IEEE Signal Processing Magazine · doi:10.1109/79.295229 · Cited by 449 · cited 1×
“Other directions include the utilization of specialized kernels tailored to specic problems, such as time series prediction; optimization of the kernel function by tuning its hyper-parameters; noise estimation (in the spirit of adaptive RLS); an exponentially weighted version of KRLS; and adaptive model order identica…”
MethodSimplified support vector decision rules
Burges, C. J. C. (1996) · Cited by 427
Support vector machine techniques for nonlinear equalization
Sebald, D. J., & Bucklew, J. A. (2000) · IEEE Transactions on Signal Processing · doi:10.1109/78.875477 · Cited by 320
Vincent, P., & Bengio, Y. (2002) · Machine Learning · doi:10.1023/a:1013955821559 · Cited by 317
Sparse Greedy Gaussian Process Regression
Smola, A. J., & Bartlett, P. L. (2000) · Cited by 316
(1996) · Cited by 315
Time series prediction: Forecasting the future and understanding the past
Chatfield, C., & Weigend, A. S. (1994) · International Journal of Forecasting · doi:10.1016/0169-2070(94)90058-2 · Cited by 225
Exact simplification of support vector solutions
Downs, T., Gates, K. E., & Masters, A. L. (2002) · doi:10.5555/944790.944814 · Cited by 195
Bayesian Methods for Support Vector Machines: Evidence and Predictive Class Probabilities
Sollich, P. (2002) · Machine Learning · doi:10.1023/a:1012489924661 · Cited by 187
Weigend, A. S. (2018) · Routledge eBooks · doi:10.4324/9780429492648 · Cited by 162
Efficient implementation of gaussian processes
Gibbs, M. (1997) · Cited by 151
Using support vector machines for time series prediction
Müller, K., Smola, A. J., Rätsch, G., et al. (1999) · doi:10.5555/299094.299107 · Cited by 146
Sequential greedy approximation for certain convex optimization problems
Zhang, T. (2003) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.808136 · Cited by 136
Sparse Online Greedy Support Vector Regression
Engel, Y., Mannor, S., & Meir, R. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36755-1_8 · Cited by 52
Self-citation(1998)
Cited by
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Quantized Kernel Least Mean Square Algorithm
Chen, B., Zhao, S., Zhu, P., & Principe, J. C. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2178446 · Cited by 407
A Tutorial on Environment-Aware Communications via Channel Knowledge Map for 6G
Zeng, Y., Chen, J., Xu, J., Wu, D., Xu, X., Jin, S., Gao, X., Gesbert, D., Cui, S., & Zhang, R. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3364508 · Cited by 303
Machine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 288
Kernel Methods and Machine Learning
Kung, S. Y. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139176224 · Cited by 287
Metadata
- Authors
- Engel, Y., Mannor, S., & Meir, R.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2004-08
- Volume
- 52
- Issue
- 8
- Pages
- 2275-2285
- ISSN
- 1053-587X (ISSN-L)
- OpenAlex
- W2153290280
- Cited by
- 1,104
- References
- 45
- FWCI
- 21.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.